• It's recommended to check out the latest log via: the Stats page >> View log >> Tail

PROJECT (sourcing_v2), SPIDER (auto1.it)

2026-01-28 20:00:22 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-01-28 20:00:22 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-01-28 20:00:22 [auto1.it] INFO: Starting spider auto1.it
2026-01-28 20:00:22 [scrapy.addons] INFO: Enabled addons:
[]
2026-01-28 20:00:23 [asyncio] DEBUG: Using selector: EpollSelector
2026-01-28 20:00:23 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-01-28 20:00:23 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-01-28 20:00:23 [scrapy.extensions.telnet] INFO: Telnet Password: 1519db3ddfc5efba
2026-01-28 20:00:23 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2026-01-28 20:00:23 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 7200,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto1.it/task_75_2026-01-28T20_00_01.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2026-01-28 20:00:23 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-01-28 20:00:23 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-01-28 20:00:23 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-01-28 20:00:23 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-01-28 20:00:23 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
 'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-01-28 20:00:23 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_CLIENT_ID, AZURE_TENANT_ID
2026-01-28 20:00:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:00:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:00:23 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-01-28 20:00:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-01-28 20:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:23 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2026-01-28 20:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2026-01-28 20:00:24 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-01-28 20:00:24 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: low_mileage_for_country.json
2026-01-28 20:00:24 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_mileage.json
2026-01-28 20:00:24 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-01-28 20:00:24 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-01-28 20:00:24 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-01-28 20:00:24 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-01-28 20:00:24 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-01-28 20:00:24 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-01-28 20:00:24 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-01-28 20:00:24 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-01-28 20:00:24 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: cars_too_new_for_country.json
2026-01-28 20:00:24 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_price_for_currency.json
2026-01-28 20:00:24 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-01-28 20:00:24 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-01-28 20:00:24 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-01-28 20:00:24 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-01-28 20:00:24 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_mileage_for_country.json
2026-01-28 20:00:24 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-01-28 20:00:24 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-01-28 20:00:24 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-01-28 20:00:24 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-01-28 20:00:24 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-01-28 20:00:24 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: registration_date_old.json
2026-01-28 20:00:24 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_mileage_for_make.json
2026-01-28 20:00:24 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-01-28 20:00:24 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-01-28 20:00:24 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
 'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
 'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-01-28 20:00:24 [scrapy.core.engine] INFO: Spider opened
2026-01-28 20:00:24 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-01-28 20:00:24 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6026
2026-01-28 20:00:24 [scrapy-playwright] INFO: Starting download handler
2026-01-28 20:00:24 [scrapy-playwright] INFO: Starting download handler
2026-01-28 20:00:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:00:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/home> (referer: None) ['zyte-api']
2026-01-28 20:00:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:00:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/en/merchant/signin/ajax> (referer: https://www.auto1.com/en/home) ['zyte-api']
2026-01-28 20:00:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:00:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/user-token/obtain-token> (referer: https://www.auto1.com/en/merchant/signin/ajax) ['zyte-api']
2026-01-28 20:00:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:00:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/en/app/user-token/obtain-token) ['zyte-api']
2026-01-28 20:00:33 [auto1.it] INFO: Parsing search results for channel: 24h
2026-01-28 20:00:33 [auto1.it] INFO: Found listing with ID: VF92545
2026-01-28 20:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VF92545%27 HTTP/1.1" 200 None
2026-01-28 20:00:33 [auto1.it] INFO: Scrape type for VF92545: 2
2026-01-28 20:00:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:00:33 [auto1.it] INFO: Found listing with ID: GZ99689
2026-01-28 20:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GZ99689%27 HTTP/1.1" 200 None
2026-01-28 20:00:33 [auto1.it] INFO: Scrape type for GZ99689: 2
2026-01-28 20:00:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:00:33 [auto1.it] INFO: Found listing with ID: EW36675
2026-01-28 20:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EW36675%27 HTTP/1.1" 200 None
2026-01-28 20:00:33 [auto1.it] INFO: Scrape type for EW36675: 2
2026-01-28 20:00:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:00:33 [auto1.it] INFO: Found listing with ID: WM74528
2026-01-28 20:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WM74528%27 HTTP/1.1" 200 None
2026-01-28 20:00:33 [auto1.it] INFO: Scrape type for WM74528: 1
2026-01-28 20:00:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:00:33 [auto1.it] INFO: Found listing with ID: RY76570
2026-01-28 20:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RY76570%27 HTTP/1.1" 200 None
2026-01-28 20:00:33 [auto1.it] INFO: Scrape type for RY76570: 2
2026-01-28 20:00:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:00:33 [auto1.it] INFO: Found listing with ID: PR91188
2026-01-28 20:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PR91188%27 HTTP/1.1" 200 None
2026-01-28 20:00:33 [auto1.it] INFO: Scrape type for PR91188: 2
2026-01-28 20:00:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:00:33 [auto1.it] INFO: Found listing with ID: YB92663
2026-01-28 20:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YB92663%27 HTTP/1.1" 200 None
2026-01-28 20:00:34 [auto1.it] INFO: Scrape type for YB92663: 2
2026-01-28 20:00:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:00:34 [auto1.it] INFO: Found listing with ID: BJ59156
2026-01-28 20:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BJ59156%27 HTTP/1.1" 200 None
2026-01-28 20:00:34 [auto1.it] INFO: Scrape type for BJ59156: 1
2026-01-28 20:00:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:00:34 [auto1.it] INFO: Found listing with ID: RX31393
2026-01-28 20:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RX31393%27 HTTP/1.1" 200 None
2026-01-28 20:00:34 [auto1.it] INFO: Scrape type for RX31393: 2
2026-01-28 20:00:34 [auto1.it] INFO: Found listing with ID: WR27841
2026-01-28 20:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WR27841%27 HTTP/1.1" 200 None
2026-01-28 20:00:34 [auto1.it] INFO: Scrape type for WR27841: 1
2026-01-28 20:00:34 [auto1.it] INFO: Found listing with ID: NR29634
2026-01-28 20:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NR29634%27 HTTP/1.1" 200 None
2026-01-28 20:00:34 [auto1.it] INFO: Scrape type for NR29634: 2
2026-01-28 20:00:34 [auto1.it] INFO: Found listing with ID: LU91869
2026-01-28 20:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LU91869%27 HTTP/1.1" 200 None
2026-01-28 20:00:34 [auto1.it] INFO: Scrape type for LU91869: 1
2026-01-28 20:00:34 [auto1.it] INFO: Found listing with ID: LR57167
2026-01-28 20:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LR57167%27 HTTP/1.1" 200 None
2026-01-28 20:00:34 [auto1.it] INFO: Scrape type for LR57167: 1
2026-01-28 20:00:34 [auto1.it] INFO: Found listing with ID: NF99707
2026-01-28 20:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NF99707%27 HTTP/1.1" 200 None
2026-01-28 20:00:34 [auto1.it] INFO: Scrape type for NF99707: 0
2026-01-28 20:00:34 [auto1.it] INFO: Found listing with ID: WA05631
2026-01-28 20:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WA05631%27 HTTP/1.1" 200 None
2026-01-28 20:00:34 [auto1.it] INFO: Scrape type for WA05631: 1
2026-01-28 20:00:34 [auto1.it] INFO: Found listing with ID: TR68531
2026-01-28 20:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TR68531%27 HTTP/1.1" 200 None
2026-01-28 20:00:34 [auto1.it] INFO: Scrape type for TR68531: 1
2026-01-28 20:00:34 [auto1.it] INFO: Found listing with ID: LM12647
2026-01-28 20:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LM12647%27 HTTP/1.1" 200 None
2026-01-28 20:00:34 [auto1.it] INFO: Scrape type for LM12647: 2
2026-01-28 20:00:34 [auto1.it] INFO: Found listing with ID: HN05440
2026-01-28 20:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HN05440%27 HTTP/1.1" 200 None
2026-01-28 20:00:34 [auto1.it] INFO: Scrape type for HN05440: 1
2026-01-28 20:00:34 [auto1.it] INFO: Found listing with ID: RR68985
2026-01-28 20:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RR68985%27 HTTP/1.1" 200 None
2026-01-28 20:00:34 [auto1.it] INFO: Scrape type for RR68985: 0
2026-01-28 20:00:34 [auto1.it] INFO: Found listing with ID: JM33256
2026-01-28 20:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JM33256%27 HTTP/1.1" 200 None
2026-01-28 20:00:34 [auto1.it] INFO: Scrape type for JM33256: 0
2026-01-28 20:00:34 [auto1.it] INFO: Found listing with ID: FM26794
2026-01-28 20:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FM26794%27 HTTP/1.1" 200 None
2026-01-28 20:00:34 [auto1.it] INFO: Scrape type for FM26794: 1
2026-01-28 20:00:34 [auto1.it] INFO: Found listing with ID: MW66167
2026-01-28 20:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MW66167%27 HTTP/1.1" 200 None
2026-01-28 20:00:34 [auto1.it] INFO: Scrape type for MW66167: 1
2026-01-28 20:00:34 [auto1.it] INFO: Found listing with ID: EA99584
2026-01-28 20:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EA99584%27 HTTP/1.1" 200 None
2026-01-28 20:00:34 [auto1.it] INFO: Scrape type for EA99584: 1
2026-01-28 20:00:34 [auto1.it] INFO: Found listing with ID: GN63531
2026-01-28 20:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GN63531%27 HTTP/1.1" 200 None
2026-01-28 20:00:34 [auto1.it] INFO: Scrape type for GN63531: 1
2026-01-28 20:00:34 [auto1.it] INFO: Found listing with ID: AW68260
2026-01-28 20:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AW68260%27 HTTP/1.1" 200 None
2026-01-28 20:00:34 [auto1.it] INFO: Scrape type for AW68260: 1
2026-01-28 20:00:34 [auto1.it] INFO: Found listing with ID: HE46295
2026-01-28 20:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HE46295%27 HTTP/1.1" 200 None
2026-01-28 20:00:34 [auto1.it] INFO: Scrape type for HE46295: 2
2026-01-28 20:00:34 [auto1.it] INFO: Found listing with ID: VT26842
2026-01-28 20:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VT26842%27 HTTP/1.1" 200 None
2026-01-28 20:00:34 [auto1.it] INFO: Scrape type for VT26842: 0
2026-01-28 20:00:34 [auto1.it] INFO: Found listing with ID: DT01319
2026-01-28 20:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DT01319%27 HTTP/1.1" 200 None
2026-01-28 20:00:34 [auto1.it] INFO: Scrape type for DT01319: 1
2026-01-28 20:00:34 [auto1.it] INFO: Found listing with ID: RD52267
2026-01-28 20:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RD52267%27 HTTP/1.1" 200 None
2026-01-28 20:00:34 [auto1.it] INFO: Scrape type for RD52267: 2
2026-01-28 20:00:34 [auto1.it] INFO: Found listing with ID: ZG67214
2026-01-28 20:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZG67214%27 HTTP/1.1" 200 None
2026-01-28 20:00:34 [auto1.it] INFO: Scrape type for ZG67214: 2
2026-01-28 20:00:34 [auto1.it] INFO: Found listing with ID: GD75064
2026-01-28 20:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GD75064%27 HTTP/1.1" 200 None
2026-01-28 20:00:34 [auto1.it] INFO: Scrape type for GD75064: 2
2026-01-28 20:00:34 [auto1.it] INFO: Found listing with ID: TE33165
2026-01-28 20:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TE33165%27 HTTP/1.1" 200 None
2026-01-28 20:00:34 [auto1.it] INFO: Scrape type for TE33165: 1
2026-01-28 20:00:34 [auto1.it] INFO: Found listing with ID: LM18187
2026-01-28 20:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LM18187%27 HTTP/1.1" 200 None
2026-01-28 20:00:34 [auto1.it] INFO: Scrape type for LM18187: 1
2026-01-28 20:00:34 [auto1.it] INFO: Found listing with ID: JX24929
2026-01-28 20:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JX24929%27 HTTP/1.1" 200 None
2026-01-28 20:00:34 [auto1.it] INFO: Scrape type for JX24929: 1
2026-01-28 20:00:34 [auto1.it] INFO: Found listing with ID: VP25370
2026-01-28 20:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VP25370%27 HTTP/1.1" 200 None
2026-01-28 20:00:34 [auto1.it] INFO: Scrape type for VP25370: 1
2026-01-28 20:00:34 [auto1.it] INFO: Found listing with ID: DJ22210
2026-01-28 20:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DJ22210%27 HTTP/1.1" 200 None
2026-01-28 20:00:34 [auto1.it] INFO: Scrape type for DJ22210: 1
2026-01-28 20:00:34 [auto1.it] INFO: Found listing with ID: LN41021
2026-01-28 20:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LN41021%27 HTTP/1.1" 200 None
2026-01-28 20:00:34 [auto1.it] INFO: Scrape type for LN41021: 0
2026-01-28 20:00:34 [auto1.it] INFO: Found listing with ID: AZ28034
2026-01-28 20:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AZ28034%27 HTTP/1.1" 200 None
2026-01-28 20:00:34 [auto1.it] INFO: Scrape type for AZ28034: 0
2026-01-28 20:00:34 [auto1.it] INFO: Found listing with ID: TS13156
2026-01-28 20:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TS13156%27 HTTP/1.1" 200 None
2026-01-28 20:00:35 [auto1.it] INFO: Scrape type for TS13156: 0
2026-01-28 20:00:35 [auto1.it] INFO: Found listing with ID: CD79561
2026-01-28 20:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CD79561%27 HTTP/1.1" 200 None
2026-01-28 20:00:35 [auto1.it] INFO: Scrape type for CD79561: 0
2026-01-28 20:00:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RY76570/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:00:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:00:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GZ99689/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:00:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:00:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EW36675/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:00:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:00:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:00:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:00:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VF92545/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:00:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:00:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WM74528/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:00:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:00:35 [auto1.it] INFO: Parsing search results for channel: 24h
2026-01-28 20:00:35 [auto1.it] INFO: Found listing with ID: VF92545
2026-01-28 20:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VF92545%27 HTTP/1.1" 200 None
2026-01-28 20:00:35 [auto1.it] INFO: Scrape type for VF92545: 2
2026-01-28 20:00:35 [scrapy.dupefilters] DEBUG: Filtered duplicate request: <GET https://www.auto1.com/v1/car-details-view/VF92545/cdb8adcc-312b-4040-b112-4a289f3f9b07> - no more duplicates will be shown (see DUPEFILTER_DEBUG to show all duplicates)
2026-01-28 20:00:35 [auto1.it] INFO: Found listing with ID: GZ99689
2026-01-28 20:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GZ99689%27 HTTP/1.1" 200 None
2026-01-28 20:00:35 [auto1.it] INFO: Scrape type for GZ99689: 2
2026-01-28 20:00:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PR91188/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:00:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:00:35 [auto1.it] INFO: Found listing with ID: EW36675
2026-01-28 20:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EW36675%27 HTTP/1.1" 200 None
2026-01-28 20:00:35 [auto1.it] INFO: Scrape type for EW36675: 2
2026-01-28 20:00:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YB92663/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:00:35 [auto1.it] INFO: Found listing with ID: WM74528
2026-01-28 20:00:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:00:35 [auto1.it] INFO: Found listing with ID: RY76570
2026-01-28 20:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RY76570%27 HTTP/1.1" 200 None
2026-01-28 20:00:35 [auto1.it] INFO: Scrape type for RY76570: 2
2026-01-28 20:00:35 [auto1.it] INFO: Found listing with ID: PR91188
2026-01-28 20:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PR91188%27 HTTP/1.1" 200 None
2026-01-28 20:00:35 [auto1.it] INFO: Scrape type for PR91188: 2
2026-01-28 20:00:35 [auto1.it] INFO: Found listing with ID: YB92663
2026-01-28 20:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YB92663%27 HTTP/1.1" 200 None
2026-01-28 20:00:35 [auto1.it] INFO: Scrape type for YB92663: 2
2026-01-28 20:00:35 [auto1.it] INFO: Found listing with ID: BJ59156
2026-01-28 20:00:35 [auto1.it] INFO: Found listing with ID: RX31393
2026-01-28 20:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RX31393%27 HTTP/1.1" 200 None
2026-01-28 20:00:35 [auto1.it] INFO: Scrape type for RX31393: 2
2026-01-28 20:00:35 [auto1.it] INFO: Found listing with ID: WR27841
2026-01-28 20:00:35 [auto1.it] INFO: Found listing with ID: NR29634
2026-01-28 20:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NR29634%27 HTTP/1.1" 200 None
2026-01-28 20:00:35 [auto1.it] INFO: Scrape type for NR29634: 2
2026-01-28 20:00:35 [auto1.it] INFO: Found listing with ID: LU91869
2026-01-28 20:00:35 [auto1.it] INFO: Found listing with ID: LR57167
2026-01-28 20:00:35 [auto1.it] INFO: Found listing with ID: NF99707
2026-01-28 20:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NF99707%27 HTTP/1.1" 200 None
2026-01-28 20:00:35 [auto1.it] INFO: Scrape type for NF99707: 0
2026-01-28 20:00:35 [auto1.it] INFO: Found listing with ID: WA05631
2026-01-28 20:00:35 [auto1.it] INFO: Found listing with ID: TR68531
2026-01-28 20:00:35 [auto1.it] INFO: Found listing with ID: LM12647
2026-01-28 20:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LM12647%27 HTTP/1.1" 200 None
2026-01-28 20:00:35 [auto1.it] INFO: Scrape type for LM12647: 2
2026-01-28 20:00:35 [auto1.it] INFO: Found listing with ID: HN05440
2026-01-28 20:00:35 [auto1.it] INFO: Found listing with ID: RR68985
2026-01-28 20:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RR68985%27 HTTP/1.1" 200 None
2026-01-28 20:00:35 [auto1.it] INFO: Scrape type for RR68985: 0
2026-01-28 20:00:35 [auto1.it] INFO: Found listing with ID: JM33256
2026-01-28 20:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JM33256%27 HTTP/1.1" 200 None
2026-01-28 20:00:35 [auto1.it] INFO: Scrape type for JM33256: 0
2026-01-28 20:00:35 [auto1.it] INFO: Found listing with ID: FM26794
2026-01-28 20:00:35 [auto1.it] INFO: Found listing with ID: MW66167
2026-01-28 20:00:35 [auto1.it] INFO: Found listing with ID: EA99584
2026-01-28 20:00:35 [auto1.it] INFO: Found listing with ID: GN63531
2026-01-28 20:00:35 [auto1.it] INFO: Found listing with ID: AW68260
2026-01-28 20:00:35 [auto1.it] INFO: Found listing with ID: HE46295
2026-01-28 20:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HE46295%27 HTTP/1.1" 200 None
2026-01-28 20:00:35 [auto1.it] INFO: Scrape type for HE46295: 2
2026-01-28 20:00:35 [auto1.it] INFO: Found listing with ID: VT26842
2026-01-28 20:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VT26842%27 HTTP/1.1" 200 None
2026-01-28 20:00:35 [auto1.it] INFO: Scrape type for VT26842: 0
2026-01-28 20:00:35 [auto1.it] INFO: Found listing with ID: DT01319
2026-01-28 20:00:35 [auto1.it] INFO: Found listing with ID: RD52267
2026-01-28 20:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RD52267%27 HTTP/1.1" 200 None
2026-01-28 20:00:35 [auto1.it] INFO: Scrape type for RD52267: 2
2026-01-28 20:00:35 [auto1.it] INFO: Found listing with ID: ZG67214
2026-01-28 20:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZG67214%27 HTTP/1.1" 200 None
2026-01-28 20:00:35 [auto1.it] INFO: Scrape type for ZG67214: 2
2026-01-28 20:00:35 [auto1.it] INFO: Found listing with ID: GD75064
2026-01-28 20:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GD75064%27 HTTP/1.1" 200 None
2026-01-28 20:00:35 [auto1.it] INFO: Scrape type for GD75064: 2
2026-01-28 20:00:35 [auto1.it] INFO: Found listing with ID: TE33165
2026-01-28 20:00:35 [auto1.it] INFO: Found listing with ID: LM18187
2026-01-28 20:00:35 [auto1.it] INFO: Found listing with ID: JX24929
2026-01-28 20:00:35 [auto1.it] INFO: Found listing with ID: VP25370
2026-01-28 20:00:35 [auto1.it] INFO: Found listing with ID: DJ22210
2026-01-28 20:00:35 [auto1.it] INFO: Found listing with ID: LN41021
2026-01-28 20:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LN41021%27 HTTP/1.1" 200 None
2026-01-28 20:00:35 [auto1.it] INFO: Scrape type for LN41021: 0
2026-01-28 20:00:35 [auto1.it] INFO: Found listing with ID: AZ28034
2026-01-28 20:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AZ28034%27 HTTP/1.1" 200 None
2026-01-28 20:00:35 [auto1.it] INFO: Scrape type for AZ28034: 0
2026-01-28 20:00:35 [auto1.it] INFO: Found listing with ID: TS13156
2026-01-28 20:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TS13156%27 HTTP/1.1" 200 None
2026-01-28 20:00:35 [auto1.it] INFO: Scrape type for TS13156: 0
2026-01-28 20:00:35 [auto1.it] INFO: Found listing with ID: CD79561
2026-01-28 20:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CD79561%27 HTTP/1.1" 200 None
2026-01-28 20:00:35 [auto1.it] INFO: Scrape type for CD79561: 0
2026-01-28 20:00:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RX31393/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:00:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:00:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WR27841/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:00:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:00:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BJ59156/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:00:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NR29634/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:00:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LR57167/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:00:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TR68531/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:00:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WA05631/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:00:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LU91869/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:00:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DJ22210/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:00:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VP25370/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:00:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JX24929/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:00:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RY76570> (referer: https://www.auto1.com/v1/car-details-view/RY76570/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:00:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GZ99689> (referer: https://www.auto1.com/v1/car-details-view/GZ99689/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:00:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:00:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a733d5a3-38a4-56db-94a2-4ecbad2a96e2 with identifier: RY76570
2026-01-28 20:00:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a733d5a3-38a4-56db-94a2-4ecbad2a96e2 with scrape type 2
2026-01-28 20:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a733d5a3-38a4-56db-94a2-4ecbad2a96e2 with scrape type 2
2026-01-28 20:00:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a733d5a3-38a4-56db-94a2-4ecbad2a96e2, identifier: RY76570
2026-01-28 20:00:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a733d5a3-38a4-56db-94a2-4ecbad2a96e2 with identifier: RY76570
2026-01-28 20:00:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-28 20:00:37 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=white HTTP/1.1" 200 None
2026-01-28 20:00:37 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-28 20:00:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-28 20:00:38 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=hybrid HTTP/1.1" 200 None
2026-01-28 20:00:38 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-28 20:00:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a733d5a3-38a4-56db-94a2-4ecbad2a96e2 with identifier: RY76570
2026-01-28 20:00:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a733d5a3-38a4-56db-94a2-4ecbad2a96e2 with identifier: RY76570 to the API
2026-01-28 20:00:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:00:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:00:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RY76570>
{'auction_title': '',
 'c_o_2_emission_value': 32,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.3L',
 'engine_horse_power': 280,
 'expiration_date': '2026-01-29T16:45:46Z',
 'fuel_type': 'hybrid',
 'id': 'a733d5a3-38a4-56db-94a2-4ecbad2a96e2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RY76570',
 'listing': 'auction',
 'location': 'IT, Roma',
 'make': 'Alfa Romeo',
 'model': 'Tonale',
 'odometer': 90050,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-02-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Alfa Romeo Tonale 1.3 Plug-in Hybrid Veloce AWD',
 'transmission': 'automatic',
 'trim': 'Veloce AWD',
 'year': 2023}
2026-01-28 20:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RY76570%27 HTTP/1.1" 200 None
2026-01-28 20:00:38 [auto1.it] INFO: Saving data for RY76570: {'auction_closing_time': 1769705146.0, 'created_time': 1767866497.303589, 'last_price_update_time': 1769630438.722451}
2026-01-28 20:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RY76570') HTTP/1.1" 204 0
2026-01-28 20:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EW36675> (referer: https://www.auto1.com/v1/car-details-view/EW36675/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:00:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:00:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YB92663> (referer: https://www.auto1.com/v1/car-details-view/YB92663/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WM74528> (referer: https://www.auto1.com/v1/car-details-view/WM74528/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PR91188> (referer: https://www.auto1.com/v1/car-details-view/PR91188/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VF92545> (referer: https://www.auto1.com/v1/car-details-view/VF92545/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:00:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:00:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:00:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:00:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:00:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f10f61d7-2cee-5386-9aec-c44fca6eaca7 with identifier: GZ99689
2026-01-28 20:00:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f10f61d7-2cee-5386-9aec-c44fca6eaca7 with scrape type 2
2026-01-28 20:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f10f61d7-2cee-5386-9aec-c44fca6eaca7 with scrape type 2
2026-01-28 20:00:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f10f61d7-2cee-5386-9aec-c44fca6eaca7, identifier: GZ99689
2026-01-28 20:00:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f10f61d7-2cee-5386-9aec-c44fca6eaca7 with identifier: GZ99689
2026-01-28 20:00:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-28 20:00:39 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=black HTTP/1.1" 200 None
2026-01-28 20:00:39 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-28 20:00:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-28 20:00:39 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=diesel HTTP/1.1" 200 None
2026-01-28 20:00:39 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-28 20:00:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f10f61d7-2cee-5386-9aec-c44fca6eaca7 with identifier: GZ99689
2026-01-28 20:00:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f10f61d7-2cee-5386-9aec-c44fca6eaca7 with identifier: GZ99689 to the API
2026-01-28 20:00:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:00:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:00:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GZ99689>
{'auction_title': '',
 'c_o_2_emission_value': 171,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '2.0L',
 'engine_horse_power': 240,
 'expiration_date': '2026-01-29T16:11:04Z',
 'fuel_type': 'diesel',
 'id': 'f10f61d7-2cee-5386-9aec-c44fca6eaca7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GZ99689',
 'listing': 'auction',
 'location': 'IT, Capannori (LU)',
 'make': 'Land Rover',
 'model': 'Range Rover Velar',
 'odometer': 122550,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-03-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Range Rover Velar 2.0 Diesel R-Dynamic S',
 'transmission': 'automatic',
 'trim': 'R-Dynamic S',
 'year': 2019}
2026-01-28 20:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GZ99689%27 HTTP/1.1" 200 None
2026-01-28 20:00:40 [auto1.it] INFO: Saving data for GZ99689: {'auction_closing_time': 1769703064.0, 'created_time': 1766520616.921772, 'last_price_update_time': 1769630440.004574}
2026-01-28 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GZ99689') HTTP/1.1" 204 0
2026-01-28 20:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LM18187/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:00:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:00:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a68a6fe0-d772-5ebe-8b4c-2b9a114987f1 with identifier: EW36675
2026-01-28 20:00:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a68a6fe0-d772-5ebe-8b4c-2b9a114987f1 with scrape type 2
2026-01-28 20:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a68a6fe0-d772-5ebe-8b4c-2b9a114987f1 with scrape type 2
2026-01-28 20:00:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a68a6fe0-d772-5ebe-8b4c-2b9a114987f1, identifier: EW36675
2026-01-28 20:00:40 [auto1.it] INFO: Parsing search results for channel: 24h
2026-01-28 20:00:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd67007f-1836-5a49-847c-8bf480dbd91d with identifier: YB92663
2026-01-28 20:00:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd67007f-1836-5a49-847c-8bf480dbd91d with scrape type 2
2026-01-28 20:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cd67007f-1836-5a49-847c-8bf480dbd91d with scrape type 2
2026-01-28 20:00:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: cd67007f-1836-5a49-847c-8bf480dbd91d, identifier: YB92663
2026-01-28 20:00:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4b89307b-38ce-5892-a385-97791261efe8 with identifier: WM74528
2026-01-28 20:00:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b89307b-38ce-5892-a385-97791261efe8 with scrape type 1
2026-01-28 20:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 4b89307b-38ce-5892-a385-97791261efe8
2026-01-28 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252Fef%252Fd3ef532722c53ca0d22c8249f1740c93%252Fpa%252FWM74528_857edafb29aeb56ee5a16f77255f5953.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/ef/d3ef532722c53ca0d22c8249f1740c93/pa/WM74528_857edafb29aeb56ee5a16f77255f5953.jpg already downloaded
2026-01-28 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252Fef%252Fd3ef532722c53ca0d22c8249f1740c93%252Fpa%252FWM74528_4170bbbb46b0960f932e6a9cbe81a7c2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/ef/d3ef532722c53ca0d22c8249f1740c93/pa/WM74528_4170bbbb46b0960f932e6a9cbe81a7c2.jpg already downloaded
2026-01-28 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252Fef%252Fd3ef532722c53ca0d22c8249f1740c93%252Fpa%252FWM74528_7d6f804dfd4017c6cb3815241304fec4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/ef/d3ef532722c53ca0d22c8249f1740c93/pa/WM74528_7d6f804dfd4017c6cb3815241304fec4.jpg already downloaded
2026-01-28 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252Fef%252Fd3ef532722c53ca0d22c8249f1740c93%252Fpa%252FWM74528_1889d94f1c9912427197d015d195c455.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/ef/d3ef532722c53ca0d22c8249f1740c93/pa/WM74528_1889d94f1c9912427197d015d195c455.jpg already downloaded
2026-01-28 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252Fef%252Fd3ef532722c53ca0d22c8249f1740c93%252Fpa%252FWM74528_0ef8e0dd9a75da260f26612a0f6416dc.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/ef/d3ef532722c53ca0d22c8249f1740c93/pa/WM74528_0ef8e0dd9a75da260f26612a0f6416dc.jpg already downloaded
2026-01-28 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252Fef%252Fd3ef532722c53ca0d22c8249f1740c93%252Fpa%252FWM74528_3b34c753bc10d6a27105127834fb580a.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/ef/d3ef532722c53ca0d22c8249f1740c93/pa/WM74528_3b34c753bc10d6a27105127834fb580a.jpg already downloaded
2026-01-28 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252Fef%252Fd3ef532722c53ca0d22c8249f1740c93%252Fpa%252FWM74528_af29a8608796c5eec70141825924b639.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/ef/d3ef532722c53ca0d22c8249f1740c93/pa/WM74528_af29a8608796c5eec70141825924b639.jpg already downloaded
2026-01-28 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252Fef%252Fd3ef532722c53ca0d22c8249f1740c93%252Fpa%252FWM74528_9e70aa499fcbce339e6ebefe0aedb852.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/ef/d3ef532722c53ca0d22c8249f1740c93/pa/WM74528_9e70aa499fcbce339e6ebefe0aedb852.jpg already downloaded
2026-01-28 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252Fef%252Fd3ef532722c53ca0d22c8249f1740c93%252Fpa%252FWM74528_9d1653300af82c6e250a6001b6f4019a.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/ef/d3ef532722c53ca0d22c8249f1740c93/pa/WM74528_9d1653300af82c6e250a6001b6f4019a.jpg already downloaded
2026-01-28 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252Fef%252Fd3ef532722c53ca0d22c8249f1740c93%252Fpa%252FWM74528_3e1b8d09063e729db06bf4f914fc681d.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/ef/d3ef532722c53ca0d22c8249f1740c93/pa/WM74528_3e1b8d09063e729db06bf4f914fc681d.jpg already downloaded
2026-01-28 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252Fef%252Fd3ef532722c53ca0d22c8249f1740c93%252Fpa%252FWM74528_161706a0f55b44994a6308966ebb731c.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/ef/d3ef532722c53ca0d22c8249f1740c93/pa/WM74528_161706a0f55b44994a6308966ebb731c.jpg already downloaded
2026-01-28 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252Fef%252Fd3ef532722c53ca0d22c8249f1740c93%252Fpa%252FWM74528_33526455e0afcbb60fa1912644434357.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/ef/d3ef532722c53ca0d22c8249f1740c93/pa/WM74528_33526455e0afcbb60fa1912644434357.jpg already downloaded
2026-01-28 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252Fef%252Fd3ef532722c53ca0d22c8249f1740c93%252Fpa%252FWM74528_f481e7e697b0f89045e6b49a9796dfb2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/ef/d3ef532722c53ca0d22c8249f1740c93/pa/WM74528_f481e7e697b0f89045e6b49a9796dfb2.jpg already downloaded
2026-01-28 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252Fef%252Fd3ef532722c53ca0d22c8249f1740c93%252Fpa%252FWM74528_c73697906c230e0f482a92c4cbbd13cc.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/ef/d3ef532722c53ca0d22c8249f1740c93/pa/WM74528_c73697906c230e0f482a92c4cbbd13cc.jpg already downloaded
2026-01-28 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252Fef%252Fd3ef532722c53ca0d22c8249f1740c93%252Fpa%252FWM74528_b64a5e90affaf4aa3e12eca3576fc3d2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/ef/d3ef532722c53ca0d22c8249f1740c93/pa/WM74528_b64a5e90affaf4aa3e12eca3576fc3d2.jpg already downloaded
2026-01-28 20:00:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4b89307b-38ce-5892-a385-97791261efe8, identifier: WM74528
2026-01-28 20:00:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb4d20cc-092c-5cfe-9f5a-4c5f6bab30a5 with identifier: PR91188
2026-01-28 20:00:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb4d20cc-092c-5cfe-9f5a-4c5f6bab30a5 with scrape type 2
2026-01-28 20:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fb4d20cc-092c-5cfe-9f5a-4c5f6bab30a5 with scrape type 2
2026-01-28 20:00:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: fb4d20cc-092c-5cfe-9f5a-4c5f6bab30a5, identifier: PR91188
2026-01-28 20:00:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 572dbbcd-81e9-524d-84f9-f02812f568db with identifier: VF92545
2026-01-28 20:00:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 572dbbcd-81e9-524d-84f9-f02812f568db with scrape type 2
2026-01-28 20:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 572dbbcd-81e9-524d-84f9-f02812f568db with scrape type 2
2026-01-28 20:00:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 572dbbcd-81e9-524d-84f9-f02812f568db, identifier: VF92545
2026-01-28 20:00:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a68a6fe0-d772-5ebe-8b4c-2b9a114987f1 with identifier: EW36675
2026-01-28 20:00:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-28 20:00:41 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=silver HTTP/1.1" 200 None
2026-01-28 20:00:41 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-28 20:00:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-28 20:00:41 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=petrol HTTP/1.1" 200 None
2026-01-28 20:00:41 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-28 20:00:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a68a6fe0-d772-5ebe-8b4c-2b9a114987f1 with identifier: EW36675
2026-01-28 20:00:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a68a6fe0-d772-5ebe-8b4c-2b9a114987f1 with identifier: EW36675 to the API
2026-01-28 20:00:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:00:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:00:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EW36675>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.0L',
 'engine_horse_power': 115,
 'expiration_date': '2026-01-29T16:51:35Z',
 'fuel_type': 'petrol',
 'id': 'a68a6fe0-d772-5ebe-8b4c-2b9a114987f1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EW36675',
 'listing': 'auction',
 'location': 'IT, Milano',
 'make': 'Audi',
 'model': 'Q2',
 'odometer': 132346,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-07-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q2 1.0 TFSI Sport ultra',
 'transmission': 'automatic',
 'trim': 'Sport ultra',
 'year': 2018}
2026-01-28 20:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EW36675%27 HTTP/1.1" 200 None
2026-01-28 20:00:42 [auto1.it] INFO: Saving data for EW36675: {'auction_closing_time': 1769705495.0, 'created_time': 1768471434.18388, 'last_price_update_time': 1769630442.491026}
2026-01-28 20:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EW36675') HTTP/1.1" 204 0
2026-01-28 20:00:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: cd67007f-1836-5a49-847c-8bf480dbd91d with identifier: YB92663
2026-01-28 20:00:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: cd67007f-1836-5a49-847c-8bf480dbd91d with identifier: YB92663
2026-01-28 20:00:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: cd67007f-1836-5a49-847c-8bf480dbd91d with identifier: YB92663 to the API
2026-01-28 20:00:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:00:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:00:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YB92663>
{'auction_title': '',
 'c_o_2_emission_value': 167,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '3.0L',
 'engine_horse_power': 325,
 'expiration_date': '2026-01-29T16:29:17Z',
 'fuel_type': 'diesel',
 'id': 'cd67007f-1836-5a49-847c-8bf480dbd91d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YB92663',
 'listing': 'auction',
 'location': 'IT, Roma',
 'make': 'Audi',
 'model': 'A7 Sportback',
 'odometer': 106480,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-03-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A7 Sportback 3.0 V6 TDI quattro Competition',
 'transmission': 'automatic',
 'trim': 'quattro Competition',
 'year': 2018}
2026-01-28 20:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YB92663%27 HTTP/1.1" 200 None
2026-01-28 20:00:42 [auto1.it] INFO: Saving data for YB92663: {'auction_closing_time': 1769704157.0, 'created_time': 1768816959.219016, 'last_price_update_time': 1769630442.978332}
2026-01-28 20:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YB92663') HTTP/1.1" 204 0
2026-01-28 20:00:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4b89307b-38ce-5892-a385-97791261efe8 with identifier: WM74528
2026-01-28 20:00:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-28 20:00:43 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gray HTTP/1.1" 200 None
2026-01-28 20:00:43 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-28 20:00:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4b89307b-38ce-5892-a385-97791261efe8 with identifier: WM74528
2026-01-28 20:00:43 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'fiat' containing 'fiat' and model 'panda' containing 'panda'
2026-01-28 20:00:43 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 4b89307b-38ce-5892-a385-97791261efe8 spider: auto1.it
2026-01-28 20:00:43 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 4b89307b-38ce-5892-a385-97791261efe8 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'fiat' containing 'fiat' and model 'panda' containing 'panda'
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2026-01-29T16:24:40Z',
 'fuel_type': 'petrol',
 'id': '4b89307b-38ce-5892-a385-97791261efe8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WM74528',
 'listing': 'auction',
 'location': 'IT, Milano',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 36942,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgd3/ef/d3ef532722c53ca0d22c8249f1740c93/pa/WM74528_857edafb29aeb56ee5a16f77255f5953.jpg',
                'https://img-pa.auto1.com/imgd3/ef/d3ef532722c53ca0d22c8249f1740c93/pa/WM74528_4170bbbb46b0960f932e6a9cbe81a7c2.jpg',
                'https://img-pa.auto1.com/imgd3/ef/d3ef532722c53ca0d22c8249f1740c93/pa/WM74528_7d6f804dfd4017c6cb3815241304fec4.jpg',
                'https://img-pa.auto1.com/imgd3/ef/d3ef532722c53ca0d22c8249f1740c93/pa/WM74528_1889d94f1c9912427197d015d195c455.jpg',
                'https://img-pa.auto1.com/imgd3/ef/d3ef532722c53ca0d22c8249f1740c93/pa/WM74528_0ef8e0dd9a75da260f26612a0f6416dc.jpg',
                'https://img-pa.auto1.com/imgd3/ef/d3ef532722c53ca0d22c8249f1740c93/pa/WM74528_3b34c753bc10d6a27105127834fb580a.jpg',
                'https://img-pa.auto1.com/imgd3/ef/d3ef532722c53ca0d22c8249f1740c93/pa/WM74528_af29a8608796c5eec70141825924b639.jpg',
                'https://img-pa.auto1.com/imgd3/ef/d3ef532722c53ca0d22c8249f1740c93/pa/WM74528_9e70aa499fcbce339e6ebefe0aedb852.jpg',
                'https://img-pa.auto1.com/imgd3/ef/d3ef532722c53ca0d22c8249f1740c93/pa/WM74528_9d1653300af82c6e250a6001b6f4019a.jpg',
                'https://img-pa.auto1.com/imgd3/ef/d3ef532722c53ca0d22c8249f1740c93/pa/WM74528_3e1b8d09063e729db06bf4f914fc681d.jpg',
                'https://img-pa.auto1.com/imgd3/ef/d3ef532722c53ca0d22c8249f1740c93/pa/WM74528_161706a0f55b44994a6308966ebb731c.jpg',
                'https://img-pa.auto1.com/imgd3/ef/d3ef532722c53ca0d22c8249f1740c93/pa/WM74528_33526455e0afcbb60fa1912644434357.jpg',
                'https://img-pa.auto1.com/imgd3/ef/d3ef532722c53ca0d22c8249f1740c93/pa/WM74528_f481e7e697b0f89045e6b49a9796dfb2.jpg',
                'https://img-pa.auto1.com/imgd3/ef/d3ef532722c53ca0d22c8249f1740c93/pa/WM74528_c73697906c230e0f482a92c4cbbd13cc.jpg',
                'https://img-pa.auto1.com/imgd3/ef/d3ef532722c53ca0d22c8249f1740c93/pa/WM74528_b64a5e90affaf4aa3e12eca3576fc3d2.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b89307b-38ce-5892-a385-97791261efe8/4b89307b-38ce-5892-a385-97791261efe8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3082205,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/ef/d3ef532722c53ca0d22c8249f1740c93/pa/WM74528_857edafb29aeb56ee5a16f77255f5953.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b89307b-38ce-5892-a385-97791261efe8/4b89307b-38ce-5892-a385-97791261efe8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76826,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/ef/d3ef532722c53ca0d22c8249f1740c93/pa/WM74528_4170bbbb46b0960f932e6a9cbe81a7c2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b89307b-38ce-5892-a385-97791261efe8/4b89307b-38ce-5892-a385-97791261efe8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2983814,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/ef/d3ef532722c53ca0d22c8249f1740c93/pa/WM74528_7d6f804dfd4017c6cb3815241304fec4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b89307b-38ce-5892-a385-97791261efe8/4b89307b-38ce-5892-a385-97791261efe8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67673,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/ef/d3ef532722c53ca0d22c8249f1740c93/pa/WM74528_1889d94f1c9912427197d015d195c455.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b89307b-38ce-5892-a385-97791261efe8/4b89307b-38ce-5892-a385-97791261efe8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63308,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/ef/d3ef532722c53ca0d22c8249f1740c93/pa/WM74528_0ef8e0dd9a75da260f26612a0f6416dc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b89307b-38ce-5892-a385-97791261efe8/4b89307b-38ce-5892-a385-97791261efe8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66248,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/ef/d3ef532722c53ca0d22c8249f1740c93/pa/WM74528_3b34c753bc10d6a27105127834fb580a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b89307b-38ce-5892-a385-97791261efe8/4b89307b-38ce-5892-a385-97791261efe8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54334,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/ef/d3ef532722c53ca0d22c8249f1740c93/pa/WM74528_af29a8608796c5eec70141825924b639.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b89307b-38ce-5892-a385-97791261efe8/4b89307b-38ce-5892-a385-97791261efe8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74984,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/ef/d3ef532722c53ca0d22c8249f1740c93/pa/WM74528_9e70aa499fcbce339e6ebefe0aedb852.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b89307b-38ce-5892-a385-97791261efe8/4b89307b-38ce-5892-a385-97791261efe8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70883,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/ef/d3ef532722c53ca0d22c8249f1740c93/pa/WM74528_9d1653300af82c6e250a6001b6f4019a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b89307b-38ce-5892-a385-97791261efe8/4b89307b-38ce-5892-a385-97791261efe8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57432,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/ef/d3ef532722c53ca0d22c8249f1740c93/pa/WM74528_3e1b8d09063e729db06bf4f914fc681d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b89307b-38ce-5892-a385-97791261efe8/4b89307b-38ce-5892-a385-97791261efe8_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76291,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/ef/d3ef532722c53ca0d22c8249f1740c93/pa/WM74528_161706a0f55b44994a6308966ebb731c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b89307b-38ce-5892-a385-97791261efe8/4b89307b-38ce-5892-a385-97791261efe8_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56302,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/ef/d3ef532722c53ca0d22c8249f1740c93/pa/WM74528_33526455e0afcbb60fa1912644434357.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b89307b-38ce-5892-a385-97791261efe8/4b89307b-38ce-5892-a385-97791261efe8_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68960,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/ef/d3ef532722c53ca0d22c8249f1740c93/pa/WM74528_f481e7e697b0f89045e6b49a9796dfb2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b89307b-38ce-5892-a385-97791261efe8/4b89307b-38ce-5892-a385-97791261efe8_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48978,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/ef/d3ef532722c53ca0d22c8249f1740c93/pa/WM74528_c73697906c230e0f482a92c4cbbd13cc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b89307b-38ce-5892-a385-97791261efe8/4b89307b-38ce-5892-a385-97791261efe8_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44646,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/ef/d3ef532722c53ca0d22c8249f1740c93/pa/WM74528_b64a5e90affaf4aa3e12eca3576fc3d2.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-01-30',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat Panda 1.2 Easy',
 'transmission': 'manual',
 'trim': 'Easy',
 'year': 2020}
2026-01-28 20:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WM74528%27 HTTP/1.1" 200 None
2026-01-28 20:00:43 [auto1.it] INFO: Saving data for WM74528: {'created_time': 1769630443.473127, 'last_price_update_time': 1769630443.473394, 'auction_closing_time': 1769703880.0}
2026-01-28 20:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WM74528') HTTP/1.1" 204 0
2026-01-28 20:00:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: fb4d20cc-092c-5cfe-9f5a-4c5f6bab30a5 with identifier: PR91188
2026-01-28 20:00:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: fb4d20cc-092c-5cfe-9f5a-4c5f6bab30a5 with identifier: PR91188
2026-01-28 20:00:43 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 168306 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    168306
2026-01-28 20:00:43 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: fb4d20cc-092c-5cfe-9f5a-4c5f6bab30a5 spider: auto1.it
2026-01-28 20:00:43 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: fb4d20cc-092c-5cfe-9f5a-4c5f6bab30a5 due to rule: high_mileage_for_country.json, error: 168306 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    168306
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.4L',
 'engine_horse_power': 140,
 'expiration_date': '2026-01-29T16:23:43Z',
 'fuel_type': 'petrol',
 'id': 'fb4d20cc-092c-5cfe-9f5a-4c5f6bab30a5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PR91188',
 'listing': 'auction',
 'location': 'IT, Varedo (MB)',
 'make': 'Opel',
 'model': 'Mokka X',
 'odometer': 168306,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-07-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Mokka X 1.4 Turbo Innovation Start/Stop',
 'transmission': 'manual',
 'trim': 'Innovation Start/Stop',
 'year': 2018}
2026-01-28 20:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PR91188%27 HTTP/1.1" 200 None
2026-01-28 20:00:43 [auto1.it] INFO: Saving data for PR91188: {'auction_closing_time': 1769703823.0, 'created_time': 1769199426.756908, 'last_price_update_time': 1769630443.83325}
2026-01-28 20:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PR91188') HTTP/1.1" 204 0
2026-01-28 20:00:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 572dbbcd-81e9-524d-84f9-f02812f568db with identifier: VF92545
2026-01-28 20:00:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 572dbbcd-81e9-524d-84f9-f02812f568db with identifier: VF92545
2026-01-28 20:00:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 572dbbcd-81e9-524d-84f9-f02812f568db with identifier: VF92545 to the API
2026-01-28 20:00:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:00:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:00:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VF92545>
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:32:14Z',
 'fuel_type': 'diesel',
 'id': '572dbbcd-81e9-524d-84f9-f02812f568db',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VF92545',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 31538,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-03-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.5 Blue-HDi GT Pack',
 'transmission': 'automatic',
 'trim': 'GT Pack',
 'year': 2022}
2026-01-28 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VF92545%27 HTTP/1.1" 200 None
2026-01-28 20:00:45 [auto1.it] INFO: Saving data for VF92545: {'auction_closing_time': 1769704334.0, 'created_time': 1769199529.132108, 'last_price_update_time': 1769630445.249698}
2026-01-28 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VF92545') HTTP/1.1" 204 0
2026-01-28 20:00:45 [auto1.it] INFO: Found listing with ID: FT64477
2026-01-28 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FT64477%27 HTTP/1.1" 200 None
2026-01-28 20:00:45 [auto1.it] INFO: Scrape type for FT64477: 0
2026-01-28 20:00:45 [auto1.it] INFO: Found listing with ID: CA86340
2026-01-28 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CA86340%27 HTTP/1.1" 200 None
2026-01-28 20:00:45 [auto1.it] INFO: Scrape type for CA86340: 0
2026-01-28 20:00:45 [auto1.it] INFO: Found listing with ID: UL25385
2026-01-28 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UL25385%27 HTTP/1.1" 200 None
2026-01-28 20:00:45 [auto1.it] INFO: Scrape type for UL25385: 0
2026-01-28 20:00:45 [auto1.it] INFO: Found listing with ID: UP48367
2026-01-28 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UP48367%27 HTTP/1.1" 200 None
2026-01-28 20:00:45 [auto1.it] INFO: Scrape type for UP48367: 0
2026-01-28 20:00:45 [auto1.it] INFO: Found listing with ID: CE44712
2026-01-28 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CE44712%27 HTTP/1.1" 200 None
2026-01-28 20:00:45 [auto1.it] INFO: Scrape type for CE44712: 0
2026-01-28 20:00:45 [auto1.it] INFO: Found listing with ID: AT20318
2026-01-28 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AT20318%27 HTTP/1.1" 200 None
2026-01-28 20:00:45 [auto1.it] INFO: Scrape type for AT20318: 0
2026-01-28 20:00:45 [auto1.it] INFO: Found listing with ID: HT61249
2026-01-28 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HT61249%27 HTTP/1.1" 200 None
2026-01-28 20:00:45 [auto1.it] INFO: Scrape type for HT61249: 0
2026-01-28 20:00:45 [auto1.it] INFO: Found listing with ID: JE58021
2026-01-28 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JE58021%27 HTTP/1.1" 200 None
2026-01-28 20:00:45 [auto1.it] INFO: Scrape type for JE58021: 0
2026-01-28 20:00:45 [auto1.it] INFO: Found listing with ID: XL30417
2026-01-28 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XL30417%27 HTTP/1.1" 200 None
2026-01-28 20:00:45 [auto1.it] INFO: Scrape type for XL30417: 0
2026-01-28 20:00:45 [auto1.it] INFO: Found listing with ID: PP03591
2026-01-28 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PP03591%27 HTTP/1.1" 200 None
2026-01-28 20:00:45 [auto1.it] INFO: Scrape type for PP03591: 0
2026-01-28 20:00:45 [auto1.it] INFO: Found listing with ID: LC41614
2026-01-28 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LC41614%27 HTTP/1.1" 200 None
2026-01-28 20:00:45 [auto1.it] INFO: Scrape type for LC41614: 0
2026-01-28 20:00:45 [auto1.it] INFO: Found listing with ID: ZN59549
2026-01-28 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZN59549%27 HTTP/1.1" 200 None
2026-01-28 20:00:45 [auto1.it] INFO: Scrape type for ZN59549: 0
2026-01-28 20:00:45 [auto1.it] INFO: Found listing with ID: GL50499
2026-01-28 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GL50499%27 HTTP/1.1" 200 None
2026-01-28 20:00:45 [auto1.it] INFO: Scrape type for GL50499: 0
2026-01-28 20:00:45 [auto1.it] INFO: Found listing with ID: VT99729
2026-01-28 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VT99729%27 HTTP/1.1" 200 None
2026-01-28 20:00:45 [auto1.it] INFO: Scrape type for VT99729: 0
2026-01-28 20:00:45 [auto1.it] INFO: Found listing with ID: RR79285
2026-01-28 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RR79285%27 HTTP/1.1" 200 None
2026-01-28 20:00:45 [auto1.it] INFO: Scrape type for RR79285: 0
2026-01-28 20:00:45 [auto1.it] INFO: Found listing with ID: HE18961
2026-01-28 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HE18961%27 HTTP/1.1" 200 None
2026-01-28 20:00:45 [auto1.it] INFO: Scrape type for HE18961: 0
2026-01-28 20:00:45 [auto1.it] INFO: Found listing with ID: KE68041
2026-01-28 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KE68041%27 HTTP/1.1" 200 None
2026-01-28 20:00:45 [auto1.it] INFO: Scrape type for KE68041: 0
2026-01-28 20:00:45 [auto1.it] INFO: Found listing with ID: SM84715
2026-01-28 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SM84715%27 HTTP/1.1" 200 None
2026-01-28 20:00:45 [auto1.it] INFO: Scrape type for SM84715: 0
2026-01-28 20:00:45 [auto1.it] INFO: Found listing with ID: AP06921
2026-01-28 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AP06921%27 HTTP/1.1" 200 None
2026-01-28 20:00:45 [auto1.it] INFO: Scrape type for AP06921: 0
2026-01-28 20:00:45 [auto1.it] INFO: Found listing with ID: FU00657
2026-01-28 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FU00657%27 HTTP/1.1" 200 None
2026-01-28 20:00:45 [auto1.it] INFO: Scrape type for FU00657: 0
2026-01-28 20:00:45 [auto1.it] INFO: Found listing with ID: RU40979
2026-01-28 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RU40979%27 HTTP/1.1" 200 None
2026-01-28 20:00:45 [auto1.it] INFO: Scrape type for RU40979: 0
2026-01-28 20:00:45 [auto1.it] INFO: Found listing with ID: FS37784
2026-01-28 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FS37784%27 HTTP/1.1" 200 None
2026-01-28 20:00:45 [auto1.it] INFO: Scrape type for FS37784: 0
2026-01-28 20:00:45 [auto1.it] INFO: Found listing with ID: CV26562
2026-01-28 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CV26562%27 HTTP/1.1" 200 None
2026-01-28 20:00:45 [auto1.it] INFO: Scrape type for CV26562: 0
2026-01-28 20:00:45 [auto1.it] INFO: Found listing with ID: UU21154
2026-01-28 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UU21154%27 HTTP/1.1" 200 None
2026-01-28 20:00:45 [auto1.it] INFO: Scrape type for UU21154: 0
2026-01-28 20:00:45 [auto1.it] INFO: Found listing with ID: FT86640
2026-01-28 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FT86640%27 HTTP/1.1" 200 None
2026-01-28 20:00:45 [auto1.it] INFO: Scrape type for FT86640: 0
2026-01-28 20:00:45 [auto1.it] INFO: Found listing with ID: NV14879
2026-01-28 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NV14879%27 HTTP/1.1" 200 None
2026-01-28 20:00:45 [auto1.it] INFO: Scrape type for NV14879: 0
2026-01-28 20:00:45 [auto1.it] INFO: Found listing with ID: YC09499
2026-01-28 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YC09499%27 HTTP/1.1" 200 None
2026-01-28 20:00:45 [auto1.it] INFO: Scrape type for YC09499: 0
2026-01-28 20:00:45 [auto1.it] INFO: Found listing with ID: EA57164
2026-01-28 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EA57164%27 HTTP/1.1" 200 None
2026-01-28 20:00:45 [auto1.it] INFO: Scrape type for EA57164: 0
2026-01-28 20:00:45 [auto1.it] INFO: Found listing with ID: UY53299
2026-01-28 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UY53299%27 HTTP/1.1" 200 None
2026-01-28 20:00:45 [auto1.it] INFO: Scrape type for UY53299: 0
2026-01-28 20:00:45 [auto1.it] INFO: Found listing with ID: SY04833
2026-01-28 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SY04833%27 HTTP/1.1" 200 None
2026-01-28 20:00:45 [auto1.it] INFO: Scrape type for SY04833: 0
2026-01-28 20:00:45 [auto1.it] INFO: Found listing with ID: XF61996
2026-01-28 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XF61996%27 HTTP/1.1" 200 None
2026-01-28 20:00:45 [auto1.it] INFO: Scrape type for XF61996: 0
2026-01-28 20:00:45 [auto1.it] INFO: Found listing with ID: LS33015
2026-01-28 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LS33015%27 HTTP/1.1" 200 None
2026-01-28 20:00:45 [auto1.it] INFO: Scrape type for LS33015: 0
2026-01-28 20:00:45 [auto1.it] INFO: Found listing with ID: NX59013
2026-01-28 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NX59013%27 HTTP/1.1" 200 None
2026-01-28 20:00:45 [auto1.it] INFO: Scrape type for NX59013: 0
2026-01-28 20:00:45 [auto1.it] INFO: Found listing with ID: DA21697
2026-01-28 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DA21697%27 HTTP/1.1" 200 None
2026-01-28 20:00:45 [auto1.it] INFO: Scrape type for DA21697: 0
2026-01-28 20:00:45 [auto1.it] INFO: Found listing with ID: FG14287
2026-01-28 20:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FG14287%27 HTTP/1.1" 200 None
2026-01-28 20:00:46 [auto1.it] INFO: Scrape type for FG14287: 0
2026-01-28 20:00:46 [auto1.it] INFO: Found listing with ID: TT43912
2026-01-28 20:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TT43912%27 HTTP/1.1" 200 None
2026-01-28 20:00:46 [auto1.it] INFO: Scrape type for TT43912: 0
2026-01-28 20:00:46 [auto1.it] INFO: Found listing with ID: KW99798
2026-01-28 20:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KW99798%27 HTTP/1.1" 200 None
2026-01-28 20:00:46 [auto1.it] INFO: Scrape type for KW99798: 2
2026-01-28 20:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BJ59156> (referer: https://www.auto1.com/v1/car-details-view/BJ59156/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:00:46 [auto1.it] INFO: Found listing with ID: VH97733
2026-01-28 20:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VH97733%27 HTTP/1.1" 200 None
2026-01-28 20:00:46 [auto1.it] INFO: Scrape type for VH97733: 0
2026-01-28 20:00:46 [auto1.it] INFO: Found listing with ID: EN85352
2026-01-28 20:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EN85352%27 HTTP/1.1" 200 None
2026-01-28 20:00:46 [auto1.it] INFO: Scrape type for EN85352: 0
2026-01-28 20:00:46 [auto1.it] INFO: Found listing with ID: HF12865
2026-01-28 20:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HF12865%27 HTTP/1.1" 200 None
2026-01-28 20:00:46 [auto1.it] INFO: Scrape type for HF12865: 2
2026-01-28 20:00:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:00:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f481803-e42c-5e05-831b-8e592226bcca with identifier: BJ59156
2026-01-28 20:00:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f481803-e42c-5e05-831b-8e592226bcca with scrape type 1
2026-01-28 20:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 4f481803-e42c-5e05-831b-8e592226bcca
2026-01-28 20:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F00%252F8700d9e33999e04d33f9a45d69a91b10%252Fpa%252FBJ59156_0e62c4798d560fba49858f9f1fb8d5eb.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/00/8700d9e33999e04d33f9a45d69a91b10/pa/BJ59156_0e62c4798d560fba49858f9f1fb8d5eb.jpg already downloaded
2026-01-28 20:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F00%252F8700d9e33999e04d33f9a45d69a91b10%252Fpa%252FBJ59156_9f8afeab91b8312910ac69fb9f3d9503.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/00/8700d9e33999e04d33f9a45d69a91b10/pa/BJ59156_9f8afeab91b8312910ac69fb9f3d9503.jpg already downloaded
2026-01-28 20:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F00%252F8700d9e33999e04d33f9a45d69a91b10%252Fpa%252FBJ59156_c8cf616b8b85af26548b32483e274f78.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/00/8700d9e33999e04d33f9a45d69a91b10/pa/BJ59156_c8cf616b8b85af26548b32483e274f78.jpg already downloaded
2026-01-28 20:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F00%252F8700d9e33999e04d33f9a45d69a91b10%252Fpa%252FBJ59156_5380c5df8b60c4171b37201753d4f17d.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/00/8700d9e33999e04d33f9a45d69a91b10/pa/BJ59156_5380c5df8b60c4171b37201753d4f17d.jpg already downloaded
2026-01-28 20:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F00%252F8700d9e33999e04d33f9a45d69a91b10%252Fpa%252FBJ59156_802778362f495ebdfd6631d5732a9f65.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/00/8700d9e33999e04d33f9a45d69a91b10/pa/BJ59156_802778362f495ebdfd6631d5732a9f65.jpg already downloaded
2026-01-28 20:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F00%252F8700d9e33999e04d33f9a45d69a91b10%252Fpa%252FBJ59156_bb464119d67ce98bac6d31d22269b89f.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/00/8700d9e33999e04d33f9a45d69a91b10/pa/BJ59156_bb464119d67ce98bac6d31d22269b89f.jpg already downloaded
2026-01-28 20:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F00%252F8700d9e33999e04d33f9a45d69a91b10%252Fpa%252FBJ59156_8c308390eb41018e595567494cd7a3ee.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/00/8700d9e33999e04d33f9a45d69a91b10/pa/BJ59156_8c308390eb41018e595567494cd7a3ee.jpg already downloaded
2026-01-28 20:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F00%252F8700d9e33999e04d33f9a45d69a91b10%252Fpa%252FBJ59156_2bca86f4852f2bf968ba1b5af709b6ca.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/00/8700d9e33999e04d33f9a45d69a91b10/pa/BJ59156_2bca86f4852f2bf968ba1b5af709b6ca.jpg already downloaded
2026-01-28 20:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F00%252F8700d9e33999e04d33f9a45d69a91b10%252Fpa%252FBJ59156_7420d169a54251b8923eb982108c71f0.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/00/8700d9e33999e04d33f9a45d69a91b10/pa/BJ59156_7420d169a54251b8923eb982108c71f0.jpg already downloaded
2026-01-28 20:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F00%252F8700d9e33999e04d33f9a45d69a91b10%252Fpa%252FBJ59156_eb7528e68b182f35737a46b445dc8191.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/00/8700d9e33999e04d33f9a45d69a91b10/pa/BJ59156_eb7528e68b182f35737a46b445dc8191.jpg already downloaded
2026-01-28 20:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F00%252F8700d9e33999e04d33f9a45d69a91b10%252Fpa%252FBJ59156_36732624e4a4a097bb90683b2a6b8fa5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/00/8700d9e33999e04d33f9a45d69a91b10/pa/BJ59156_36732624e4a4a097bb90683b2a6b8fa5.jpg already downloaded
2026-01-28 20:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F00%252F8700d9e33999e04d33f9a45d69a91b10%252Fpa%252FBJ59156_9bfb425138c9c9cbaefa2b647c8004e0.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/00/8700d9e33999e04d33f9a45d69a91b10/pa/BJ59156_9bfb425138c9c9cbaefa2b647c8004e0.jpg already downloaded
2026-01-28 20:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F00%252F8700d9e33999e04d33f9a45d69a91b10%252Fpa%252FBJ59156_78e4d01bb58f21ddba4a6620cc467458.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/00/8700d9e33999e04d33f9a45d69a91b10/pa/BJ59156_78e4d01bb58f21ddba4a6620cc467458.jpg already downloaded
2026-01-28 20:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F00%252F8700d9e33999e04d33f9a45d69a91b10%252Fpa%252FBJ59156_b09f695304b6c2502db961986f3e1b1d.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/00/8700d9e33999e04d33f9a45d69a91b10/pa/BJ59156_b09f695304b6c2502db961986f3e1b1d.jpg already downloaded
2026-01-28 20:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F00%252F8700d9e33999e04d33f9a45d69a91b10%252Fpa%252FBJ59156_57859a077ddfcc8b44f66168ef889701.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/00/8700d9e33999e04d33f9a45d69a91b10/pa/BJ59156_57859a077ddfcc8b44f66168ef889701.jpg already downloaded
2026-01-28 20:00:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4f481803-e42c-5e05-831b-8e592226bcca, identifier: BJ59156
2026-01-28 20:00:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4f481803-e42c-5e05-831b-8e592226bcca with identifier: BJ59156
2026-01-28 20:00:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4f481803-e42c-5e05-831b-8e592226bcca with identifier: BJ59156
2026-01-28 20:00:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4f481803-e42c-5e05-831b-8e592226bcca with identifier: BJ59156 to the API
2026-01-28 20:00:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:00:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:00:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BJ59156>
{'auction_title': '',
 'c_o_2_emission_value': 41,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 367,
 'expiration_date': '2026-01-29T16:35:35Z',
 'fuel_type': 'hybrid',
 'id': '4f481803-e42c-5e05-831b-8e592226bcca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BJ59156',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'Audi',
 'model': 'Q5 Sportback',
 'odometer': 135736,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img87/00/8700d9e33999e04d33f9a45d69a91b10/pa/BJ59156_0e62c4798d560fba49858f9f1fb8d5eb.jpg',
                'https://img-pa.auto1.com/img87/00/8700d9e33999e04d33f9a45d69a91b10/pa/BJ59156_9f8afeab91b8312910ac69fb9f3d9503.jpg',
                'https://img-pa.auto1.com/img87/00/8700d9e33999e04d33f9a45d69a91b10/pa/BJ59156_c8cf616b8b85af26548b32483e274f78.jpg',
                'https://img-pa.auto1.com/img87/00/8700d9e33999e04d33f9a45d69a91b10/pa/BJ59156_5380c5df8b60c4171b37201753d4f17d.jpg',
                'https://img-pa.auto1.com/img87/00/8700d9e33999e04d33f9a45d69a91b10/pa/BJ59156_802778362f495ebdfd6631d5732a9f65.jpg',
                'https://img-pa.auto1.com/img87/00/8700d9e33999e04d33f9a45d69a91b10/pa/BJ59156_bb464119d67ce98bac6d31d22269b89f.jpg',
                'https://img-pa.auto1.com/img87/00/8700d9e33999e04d33f9a45d69a91b10/pa/BJ59156_8c308390eb41018e595567494cd7a3ee.jpg',
                'https://img-pa.auto1.com/img87/00/8700d9e33999e04d33f9a45d69a91b10/pa/BJ59156_2bca86f4852f2bf968ba1b5af709b6ca.jpg',
                'https://img-pa.auto1.com/img87/00/8700d9e33999e04d33f9a45d69a91b10/pa/BJ59156_7420d169a54251b8923eb982108c71f0.jpg',
                'https://img-pa.auto1.com/img87/00/8700d9e33999e04d33f9a45d69a91b10/pa/BJ59156_eb7528e68b182f35737a46b445dc8191.jpg',
                'https://img-pa.auto1.com/img87/00/8700d9e33999e04d33f9a45d69a91b10/pa/BJ59156_36732624e4a4a097bb90683b2a6b8fa5.jpg',
                'https://img-pa.auto1.com/img87/00/8700d9e33999e04d33f9a45d69a91b10/pa/BJ59156_9bfb425138c9c9cbaefa2b647c8004e0.jpg',
                'https://img-pa.auto1.com/img87/00/8700d9e33999e04d33f9a45d69a91b10/pa/BJ59156_78e4d01bb58f21ddba4a6620cc467458.jpg',
                'https://img-pa.auto1.com/img87/00/8700d9e33999e04d33f9a45d69a91b10/pa/BJ59156_b09f695304b6c2502db961986f3e1b1d.jpg',
                'https://img-pa.auto1.com/img87/00/8700d9e33999e04d33f9a45d69a91b10/pa/BJ59156_57859a077ddfcc8b44f66168ef889701.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f481803-e42c-5e05-831b-8e592226bcca/4f481803-e42c-5e05-831b-8e592226bcca_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77078,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/00/8700d9e33999e04d33f9a45d69a91b10/pa/BJ59156_0e62c4798d560fba49858f9f1fb8d5eb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f481803-e42c-5e05-831b-8e592226bcca/4f481803-e42c-5e05-831b-8e592226bcca_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71904,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/00/8700d9e33999e04d33f9a45d69a91b10/pa/BJ59156_9f8afeab91b8312910ac69fb9f3d9503.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f481803-e42c-5e05-831b-8e592226bcca/4f481803-e42c-5e05-831b-8e592226bcca_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2096248,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img87/00/8700d9e33999e04d33f9a45d69a91b10/pa/BJ59156_c8cf616b8b85af26548b32483e274f78.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f481803-e42c-5e05-831b-8e592226bcca/4f481803-e42c-5e05-831b-8e592226bcca_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55618,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/00/8700d9e33999e04d33f9a45d69a91b10/pa/BJ59156_5380c5df8b60c4171b37201753d4f17d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f481803-e42c-5e05-831b-8e592226bcca/4f481803-e42c-5e05-831b-8e592226bcca_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71303,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/00/8700d9e33999e04d33f9a45d69a91b10/pa/BJ59156_802778362f495ebdfd6631d5732a9f65.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f481803-e42c-5e05-831b-8e592226bcca/4f481803-e42c-5e05-831b-8e592226bcca_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71935,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/00/8700d9e33999e04d33f9a45d69a91b10/pa/BJ59156_bb464119d67ce98bac6d31d22269b89f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f481803-e42c-5e05-831b-8e592226bcca/4f481803-e42c-5e05-831b-8e592226bcca_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55402,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/00/8700d9e33999e04d33f9a45d69a91b10/pa/BJ59156_8c308390eb41018e595567494cd7a3ee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f481803-e42c-5e05-831b-8e592226bcca/4f481803-e42c-5e05-831b-8e592226bcca_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68076,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/00/8700d9e33999e04d33f9a45d69a91b10/pa/BJ59156_2bca86f4852f2bf968ba1b5af709b6ca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f481803-e42c-5e05-831b-8e592226bcca/4f481803-e42c-5e05-831b-8e592226bcca_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71696,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/00/8700d9e33999e04d33f9a45d69a91b10/pa/BJ59156_7420d169a54251b8923eb982108c71f0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f481803-e42c-5e05-831b-8e592226bcca/4f481803-e42c-5e05-831b-8e592226bcca_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85874,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/00/8700d9e33999e04d33f9a45d69a91b10/pa/BJ59156_eb7528e68b182f35737a46b445dc8191.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f481803-e42c-5e05-831b-8e592226bcca/4f481803-e42c-5e05-831b-8e592226bcca_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62803,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/00/8700d9e33999e04d33f9a45d69a91b10/pa/BJ59156_36732624e4a4a097bb90683b2a6b8fa5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f481803-e42c-5e05-831b-8e592226bcca/4f481803-e42c-5e05-831b-8e592226bcca_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57586,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/00/8700d9e33999e04d33f9a45d69a91b10/pa/BJ59156_9bfb425138c9c9cbaefa2b647c8004e0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f481803-e42c-5e05-831b-8e592226bcca/4f481803-e42c-5e05-831b-8e592226bcca_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49489,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/00/8700d9e33999e04d33f9a45d69a91b10/pa/BJ59156_78e4d01bb58f21ddba4a6620cc467458.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f481803-e42c-5e05-831b-8e592226bcca/4f481803-e42c-5e05-831b-8e592226bcca_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51942,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/00/8700d9e33999e04d33f9a45d69a91b10/pa/BJ59156_b09f695304b6c2502db961986f3e1b1d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f481803-e42c-5e05-831b-8e592226bcca/4f481803-e42c-5e05-831b-8e592226bcca_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83829,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/00/8700d9e33999e04d33f9a45d69a91b10/pa/BJ59156_57859a077ddfcc8b44f66168ef889701.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-05-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q5 Sportback 55 TFSIe quattro S line',
 'transmission': 'automatic',
 'trim': 'quattro S line',
 'year': 2021}
2026-01-28 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BJ59156%27 HTTP/1.1" 200 None
2026-01-28 20:00:47 [auto1.it] INFO: Saving data for BJ59156: {'created_time': 1769630447.282388, 'last_price_update_time': 1769630447.282401, 'auction_closing_time': 1769704535.0}
2026-01-28 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BJ59156') HTTP/1.1" 204 0
2026-01-28 20:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VP25370> (referer: https://www.auto1.com/v1/car-details-view/VP25370/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LR57167> (referer: https://www.auto1.com/v1/car-details-view/LR57167/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WA05631> (referer: https://www.auto1.com/v1/car-details-view/WA05631/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TR68531> (referer: https://www.auto1.com/v1/car-details-view/TR68531/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NR29634> (referer: https://www.auto1.com/v1/car-details-view/NR29634/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DJ22210> (referer: https://www.auto1.com/v1/car-details-view/DJ22210/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:00:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:00:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:00:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:00:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:00:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:00:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:00:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 191bba90-0f82-54b1-88fa-cbe17ff9a5a0 with identifier: VP25370
2026-01-28 20:00:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 191bba90-0f82-54b1-88fa-cbe17ff9a5a0 with scrape type 1
2026-01-28 20:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 191bba90-0f82-54b1-88fa-cbe17ff9a5a0
2026-01-28 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F52%252F265278f2bef552d5057c2293e62259ec%252Fpa%252FVP25370_8a3efa5fe1f112814f62107c36c25449.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/52/265278f2bef552d5057c2293e62259ec/pa/VP25370_8a3efa5fe1f112814f62107c36c25449.jpg not downloaded yet
2026-01-28 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F52%252F265278f2bef552d5057c2293e62259ec%252Fpa%252FVP25370_36080cd7e735b14c341bcf02ffe429af.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/52/265278f2bef552d5057c2293e62259ec/pa/VP25370_36080cd7e735b14c341bcf02ffe429af.jpg not downloaded yet
2026-01-28 20:00:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc5c4f45-8b25-54ea-b926-7633afefd3ad with identifier: LR57167
2026-01-28 20:00:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc5c4f45-8b25-54ea-b926-7633afefd3ad with scrape type 1
2026-01-28 20:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item dc5c4f45-8b25-54ea-b926-7633afefd3ad
2026-01-28 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Fad%252F86ade3eab8a7620be7ebf908e9dbc88b%252Fpa%252FLR57167_37ebd8ecaa41f9b65d4f850a43625b59.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/ad/86ade3eab8a7620be7ebf908e9dbc88b/pa/LR57167_37ebd8ecaa41f9b65d4f850a43625b59.jpg already downloaded
2026-01-28 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Fad%252F86ade3eab8a7620be7ebf908e9dbc88b%252Fpa%252FLR57167_63008438f7fb6e5ea6e34d794e8d6437.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/ad/86ade3eab8a7620be7ebf908e9dbc88b/pa/LR57167_63008438f7fb6e5ea6e34d794e8d6437.jpg already downloaded
2026-01-28 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Fad%252F86ade3eab8a7620be7ebf908e9dbc88b%252Fpa%252FLR57167_b39966f0976fed4f6f531a6d29dba516.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/ad/86ade3eab8a7620be7ebf908e9dbc88b/pa/LR57167_b39966f0976fed4f6f531a6d29dba516.jpg already downloaded
2026-01-28 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Fad%252F86ade3eab8a7620be7ebf908e9dbc88b%252Fpa%252FLR57167_65ac70af2e9e4095d20879cb5f7cbe60.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/ad/86ade3eab8a7620be7ebf908e9dbc88b/pa/LR57167_65ac70af2e9e4095d20879cb5f7cbe60.jpg already downloaded
2026-01-28 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Fad%252F86ade3eab8a7620be7ebf908e9dbc88b%252Fpa%252FLR57167_b0b658db990ee290cc8198c937f80ff1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/ad/86ade3eab8a7620be7ebf908e9dbc88b/pa/LR57167_b0b658db990ee290cc8198c937f80ff1.jpg already downloaded
2026-01-28 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Fad%252F86ade3eab8a7620be7ebf908e9dbc88b%252Fpa%252FLR57167_61f8decc04e69dd3bb2720da707f6f51.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/ad/86ade3eab8a7620be7ebf908e9dbc88b/pa/LR57167_61f8decc04e69dd3bb2720da707f6f51.jpg already downloaded
2026-01-28 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Fad%252F86ade3eab8a7620be7ebf908e9dbc88b%252Fpa%252FLR57167_1c3da52e74d28ebd93723190fc6c0f39.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/ad/86ade3eab8a7620be7ebf908e9dbc88b/pa/LR57167_1c3da52e74d28ebd93723190fc6c0f39.jpg already downloaded
2026-01-28 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Fad%252F86ade3eab8a7620be7ebf908e9dbc88b%252Fpa%252FLR57167_5baf0319164246bf7577db15a05cca1b.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/ad/86ade3eab8a7620be7ebf908e9dbc88b/pa/LR57167_5baf0319164246bf7577db15a05cca1b.jpg already downloaded
2026-01-28 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Fad%252F86ade3eab8a7620be7ebf908e9dbc88b%252Fpa%252FLR57167_3c8f734c434beb55b3ff5b2897a84326.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/ad/86ade3eab8a7620be7ebf908e9dbc88b/pa/LR57167_3c8f734c434beb55b3ff5b2897a84326.jpg already downloaded
2026-01-28 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Fad%252F86ade3eab8a7620be7ebf908e9dbc88b%252Fpa%252FLR57167_f1703fbdd9880046eb0ae3a4b5956dab.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/ad/86ade3eab8a7620be7ebf908e9dbc88b/pa/LR57167_f1703fbdd9880046eb0ae3a4b5956dab.jpg already downloaded
2026-01-28 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Fad%252F86ade3eab8a7620be7ebf908e9dbc88b%252Fpa%252FLR57167_8e6f441947e03848403c7f2b25140807.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/ad/86ade3eab8a7620be7ebf908e9dbc88b/pa/LR57167_8e6f441947e03848403c7f2b25140807.jpg already downloaded
2026-01-28 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Fad%252F86ade3eab8a7620be7ebf908e9dbc88b%252Fpa%252FLR57167_df0d6762df8daacb48d59663daeb088e.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/ad/86ade3eab8a7620be7ebf908e9dbc88b/pa/LR57167_df0d6762df8daacb48d59663daeb088e.jpg already downloaded
2026-01-28 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Fad%252F86ade3eab8a7620be7ebf908e9dbc88b%252Fpa%252FLR57167_7f66f0a89d74ceb4ed524a72585b318a.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/ad/86ade3eab8a7620be7ebf908e9dbc88b/pa/LR57167_7f66f0a89d74ceb4ed524a72585b318a.jpg already downloaded
2026-01-28 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Fad%252F86ade3eab8a7620be7ebf908e9dbc88b%252Fpa%252FLR57167_ffb7060864e94328b138a76ed58b7dac.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/ad/86ade3eab8a7620be7ebf908e9dbc88b/pa/LR57167_ffb7060864e94328b138a76ed58b7dac.jpg already downloaded
2026-01-28 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Fad%252F86ade3eab8a7620be7ebf908e9dbc88b%252Fpa%252FLR57167_bd03e1961338c6abe7f2fbc91a3f1dbe.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/ad/86ade3eab8a7620be7ebf908e9dbc88b/pa/LR57167_bd03e1961338c6abe7f2fbc91a3f1dbe.jpg already downloaded
2026-01-28 20:00:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: dc5c4f45-8b25-54ea-b926-7633afefd3ad, identifier: LR57167
2026-01-28 20:00:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: dc5c4f45-8b25-54ea-b926-7633afefd3ad with identifier: LR57167
2026-01-28 20:00:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: dc5c4f45-8b25-54ea-b926-7633afefd3ad with identifier: LR57167
2026-01-28 20:00:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: dc5c4f45-8b25-54ea-b926-7633afefd3ad with identifier: LR57167 to the API
2026-01-28 20:00:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:00:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:00:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LR57167>
{'auction_title': '',
 'c_o_2_emission_value': 174,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-01-29T16:50:32Z',
 'fuel_type': 'petrol',
 'id': 'dc5c4f45-8b25-54ea-b926-7633afefd3ad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LR57167',
 'listing': 'auction',
 'location': 'IT, Bentivoglio (BO)',
 'make': 'Audi',
 'model': 'Q3 Sportback',
 'odometer': 35999,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img86/ad/86ade3eab8a7620be7ebf908e9dbc88b/pa/LR57167_37ebd8ecaa41f9b65d4f850a43625b59.jpg',
                'https://img-pa.auto1.com/img86/ad/86ade3eab8a7620be7ebf908e9dbc88b/pa/LR57167_63008438f7fb6e5ea6e34d794e8d6437.jpg',
                'https://img-pa.auto1.com/img86/ad/86ade3eab8a7620be7ebf908e9dbc88b/pa/LR57167_b39966f0976fed4f6f531a6d29dba516.jpg',
                'https://img-pa.auto1.com/img86/ad/86ade3eab8a7620be7ebf908e9dbc88b/pa/LR57167_65ac70af2e9e4095d20879cb5f7cbe60.jpg',
                'https://img-pa.auto1.com/img86/ad/86ade3eab8a7620be7ebf908e9dbc88b/pa/LR57167_b0b658db990ee290cc8198c937f80ff1.jpg',
                'https://img-pa.auto1.com/img86/ad/86ade3eab8a7620be7ebf908e9dbc88b/pa/LR57167_61f8decc04e69dd3bb2720da707f6f51.jpg',
                'https://img-pa.auto1.com/img86/ad/86ade3eab8a7620be7ebf908e9dbc88b/pa/LR57167_1c3da52e74d28ebd93723190fc6c0f39.jpg',
                'https://img-pa.auto1.com/img86/ad/86ade3eab8a7620be7ebf908e9dbc88b/pa/LR57167_5baf0319164246bf7577db15a05cca1b.jpg',
                'https://img-pa.auto1.com/img86/ad/86ade3eab8a7620be7ebf908e9dbc88b/pa/LR57167_3c8f734c434beb55b3ff5b2897a84326.jpg',
                'https://img-pa.auto1.com/img86/ad/86ade3eab8a7620be7ebf908e9dbc88b/pa/LR57167_f1703fbdd9880046eb0ae3a4b5956dab.jpg',
                'https://img-pa.auto1.com/img86/ad/86ade3eab8a7620be7ebf908e9dbc88b/pa/LR57167_8e6f441947e03848403c7f2b25140807.jpg',
                'https://img-pa.auto1.com/img86/ad/86ade3eab8a7620be7ebf908e9dbc88b/pa/LR57167_df0d6762df8daacb48d59663daeb088e.jpg',
                'https://img-pa.auto1.com/img86/ad/86ade3eab8a7620be7ebf908e9dbc88b/pa/LR57167_7f66f0a89d74ceb4ed524a72585b318a.jpg',
                'https://img-pa.auto1.com/img86/ad/86ade3eab8a7620be7ebf908e9dbc88b/pa/LR57167_ffb7060864e94328b138a76ed58b7dac.jpg',
                'https://img-pa.auto1.com/img86/ad/86ade3eab8a7620be7ebf908e9dbc88b/pa/LR57167_bd03e1961338c6abe7f2fbc91a3f1dbe.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc5c4f45-8b25-54ea-b926-7633afefd3ad/dc5c4f45-8b25-54ea-b926-7633afefd3ad_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77726,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img86/ad/86ade3eab8a7620be7ebf908e9dbc88b/pa/LR57167_37ebd8ecaa41f9b65d4f850a43625b59.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc5c4f45-8b25-54ea-b926-7633afefd3ad/dc5c4f45-8b25-54ea-b926-7633afefd3ad_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75093,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img86/ad/86ade3eab8a7620be7ebf908e9dbc88b/pa/LR57167_63008438f7fb6e5ea6e34d794e8d6437.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc5c4f45-8b25-54ea-b926-7633afefd3ad/dc5c4f45-8b25-54ea-b926-7633afefd3ad_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70618,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img86/ad/86ade3eab8a7620be7ebf908e9dbc88b/pa/LR57167_b39966f0976fed4f6f531a6d29dba516.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc5c4f45-8b25-54ea-b926-7633afefd3ad/dc5c4f45-8b25-54ea-b926-7633afefd3ad_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60777,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img86/ad/86ade3eab8a7620be7ebf908e9dbc88b/pa/LR57167_65ac70af2e9e4095d20879cb5f7cbe60.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc5c4f45-8b25-54ea-b926-7633afefd3ad/dc5c4f45-8b25-54ea-b926-7633afefd3ad_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60933,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img86/ad/86ade3eab8a7620be7ebf908e9dbc88b/pa/LR57167_b0b658db990ee290cc8198c937f80ff1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc5c4f45-8b25-54ea-b926-7633afefd3ad/dc5c4f45-8b25-54ea-b926-7633afefd3ad_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72549,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img86/ad/86ade3eab8a7620be7ebf908e9dbc88b/pa/LR57167_61f8decc04e69dd3bb2720da707f6f51.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc5c4f45-8b25-54ea-b926-7633afefd3ad/dc5c4f45-8b25-54ea-b926-7633afefd3ad_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2853945,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img86/ad/86ade3eab8a7620be7ebf908e9dbc88b/pa/LR57167_1c3da52e74d28ebd93723190fc6c0f39.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc5c4f45-8b25-54ea-b926-7633afefd3ad/dc5c4f45-8b25-54ea-b926-7633afefd3ad_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2995984,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img86/ad/86ade3eab8a7620be7ebf908e9dbc88b/pa/LR57167_5baf0319164246bf7577db15a05cca1b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc5c4f45-8b25-54ea-b926-7633afefd3ad/dc5c4f45-8b25-54ea-b926-7633afefd3ad_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2857846,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img86/ad/86ade3eab8a7620be7ebf908e9dbc88b/pa/LR57167_3c8f734c434beb55b3ff5b2897a84326.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc5c4f45-8b25-54ea-b926-7633afefd3ad/dc5c4f45-8b25-54ea-b926-7633afefd3ad_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52412,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img86/ad/86ade3eab8a7620be7ebf908e9dbc88b/pa/LR57167_f1703fbdd9880046eb0ae3a4b5956dab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc5c4f45-8b25-54ea-b926-7633afefd3ad/dc5c4f45-8b25-54ea-b926-7633afefd3ad_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63522,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img86/ad/86ade3eab8a7620be7ebf908e9dbc88b/pa/LR57167_8e6f441947e03848403c7f2b25140807.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc5c4f45-8b25-54ea-b926-7633afefd3ad/dc5c4f45-8b25-54ea-b926-7633afefd3ad_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61426,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img86/ad/86ade3eab8a7620be7ebf908e9dbc88b/pa/LR57167_df0d6762df8daacb48d59663daeb088e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc5c4f45-8b25-54ea-b926-7633afefd3ad/dc5c4f45-8b25-54ea-b926-7633afefd3ad_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72927,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img86/ad/86ade3eab8a7620be7ebf908e9dbc88b/pa/LR57167_7f66f0a89d74ceb4ed524a72585b318a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc5c4f45-8b25-54ea-b926-7633afefd3ad/dc5c4f45-8b25-54ea-b926-7633afefd3ad_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63226,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img86/ad/86ade3eab8a7620be7ebf908e9dbc88b/pa/LR57167_ffb7060864e94328b138a76ed58b7dac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc5c4f45-8b25-54ea-b926-7633afefd3ad/dc5c4f45-8b25-54ea-b926-7633afefd3ad_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80255,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img86/ad/86ade3eab8a7620be7ebf908e9dbc88b/pa/LR57167_bd03e1961338c6abe7f2fbc91a3f1dbe.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-03-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q3 Sportback 40 TFSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2023}
2026-01-28 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LR57167%27 HTTP/1.1" 200 None
2026-01-28 20:00:48 [auto1.it] INFO: Saving data for LR57167: {'created_time': 1769630448.469772, 'last_price_update_time': 1769630448.469781, 'auction_closing_time': 1769705432.0}
2026-01-28 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LR57167') HTTP/1.1" 204 0
2026-01-28 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F52%252F265278f2bef552d5057c2293e62259ec%252Fpa%252FVP25370_6334ec9fd14f4db6d94965152a8caae2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/52/265278f2bef552d5057c2293e62259ec/pa/VP25370_6334ec9fd14f4db6d94965152a8caae2.jpg not downloaded yet
2026-01-28 20:00:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JX24929> (referer: https://www.auto1.com/v1/car-details-view/JX24929/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:00:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 84994043-29e3-5bff-9fe1-4d4f8e69dcc8 with identifier: WA05631
2026-01-28 20:00:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84994043-29e3-5bff-9fe1-4d4f8e69dcc8 with scrape type 1
2026-01-28 20:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 84994043-29e3-5bff-9fe1-4d4f8e69dcc8
2026-01-28 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Fd0%252Ffad0b17e66ac2592dbe1afcbe0ad855f%252Fpa%252FWA05631_ec0aaf30374b90c125be723b7233b663.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/d0/fad0b17e66ac2592dbe1afcbe0ad855f/pa/WA05631_ec0aaf30374b90c125be723b7233b663.jpg already downloaded
2026-01-28 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Fd0%252Ffad0b17e66ac2592dbe1afcbe0ad855f%252Fpa%252FWA05631_7e476d9303b454508b51d8cb3fe4f2f2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/d0/fad0b17e66ac2592dbe1afcbe0ad855f/pa/WA05631_7e476d9303b454508b51d8cb3fe4f2f2.jpg already downloaded
2026-01-28 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Fd0%252Ffad0b17e66ac2592dbe1afcbe0ad855f%252Fpa%252FWA05631_22c3a6bae52f680ef304b34c38af9497.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/d0/fad0b17e66ac2592dbe1afcbe0ad855f/pa/WA05631_22c3a6bae52f680ef304b34c38af9497.jpg already downloaded
2026-01-28 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Fd0%252Ffad0b17e66ac2592dbe1afcbe0ad855f%252Fpa%252FWA05631_4b768e3c2c6e411a9109cdbd04af3932.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/d0/fad0b17e66ac2592dbe1afcbe0ad855f/pa/WA05631_4b768e3c2c6e411a9109cdbd04af3932.jpg already downloaded
2026-01-28 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Fd0%252Ffad0b17e66ac2592dbe1afcbe0ad855f%252Fpa%252FWA05631_008434af14dce13b71189723a5fb895b.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/d0/fad0b17e66ac2592dbe1afcbe0ad855f/pa/WA05631_008434af14dce13b71189723a5fb895b.jpg already downloaded
2026-01-28 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Fd0%252Ffad0b17e66ac2592dbe1afcbe0ad855f%252Fpa%252FWA05631_bdd93abae45806d5532949817ae5ef1c.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/d0/fad0b17e66ac2592dbe1afcbe0ad855f/pa/WA05631_bdd93abae45806d5532949817ae5ef1c.jpg already downloaded
2026-01-28 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Fd0%252Ffad0b17e66ac2592dbe1afcbe0ad855f%252Fpa%252FWA05631_c91d6c2985b43fe48aafbd44a4d56416.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/d0/fad0b17e66ac2592dbe1afcbe0ad855f/pa/WA05631_c91d6c2985b43fe48aafbd44a4d56416.jpg already downloaded
2026-01-28 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Fd0%252Ffad0b17e66ac2592dbe1afcbe0ad855f%252Fpa%252FWA05631_1bf2aea7a5edfdcaa3c914962ccedd9c.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/d0/fad0b17e66ac2592dbe1afcbe0ad855f/pa/WA05631_1bf2aea7a5edfdcaa3c914962ccedd9c.jpg already downloaded
2026-01-28 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Fd0%252Ffad0b17e66ac2592dbe1afcbe0ad855f%252Fpa%252FWA05631_02720b37284bf3642b721ac7acd9f367.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/d0/fad0b17e66ac2592dbe1afcbe0ad855f/pa/WA05631_02720b37284bf3642b721ac7acd9f367.jpg already downloaded
2026-01-28 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Fd0%252Ffad0b17e66ac2592dbe1afcbe0ad855f%252Fpa%252FWA05631_8cb1551e199a9dc64aee99268dce4651.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/d0/fad0b17e66ac2592dbe1afcbe0ad855f/pa/WA05631_8cb1551e199a9dc64aee99268dce4651.jpg already downloaded
2026-01-28 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Fd0%252Ffad0b17e66ac2592dbe1afcbe0ad855f%252Fpa%252FWA05631_1b90fdb6e347f2020b8645338732ac70.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/d0/fad0b17e66ac2592dbe1afcbe0ad855f/pa/WA05631_1b90fdb6e347f2020b8645338732ac70.jpg already downloaded
2026-01-28 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Fd0%252Ffad0b17e66ac2592dbe1afcbe0ad855f%252Fpa%252FWA05631_7095755c363bb449666aa89233b16938.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/d0/fad0b17e66ac2592dbe1afcbe0ad855f/pa/WA05631_7095755c363bb449666aa89233b16938.jpg already downloaded
2026-01-28 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Fd0%252Ffad0b17e66ac2592dbe1afcbe0ad855f%252Fpa%252FWA05631_63f5c2ee919dad7feca482e57c445c46.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/d0/fad0b17e66ac2592dbe1afcbe0ad855f/pa/WA05631_63f5c2ee919dad7feca482e57c445c46.jpg already downloaded
2026-01-28 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Fd0%252Ffad0b17e66ac2592dbe1afcbe0ad855f%252Fpa%252FWA05631_e95095cccf34d4be1668f5fa5b16e8a1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/d0/fad0b17e66ac2592dbe1afcbe0ad855f/pa/WA05631_e95095cccf34d4be1668f5fa5b16e8a1.jpg already downloaded
2026-01-28 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Fd0%252Ffad0b17e66ac2592dbe1afcbe0ad855f%252Fpa%252FWA05631_30f5daa351a3aac908412424f5a0e348.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/d0/fad0b17e66ac2592dbe1afcbe0ad855f/pa/WA05631_30f5daa351a3aac908412424f5a0e348.jpg already downloaded
2026-01-28 20:00:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 84994043-29e3-5bff-9fe1-4d4f8e69dcc8, identifier: WA05631
2026-01-28 20:00:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15f4eb87-fd88-5b8d-a1b2-57d01cde0e0e with identifier: TR68531
2026-01-28 20:00:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15f4eb87-fd88-5b8d-a1b2-57d01cde0e0e with scrape type 1
2026-01-28 20:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 15f4eb87-fd88-5b8d-a1b2-57d01cde0e0e
2026-01-28 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F42%252F9942f7bd2dd5e605d268467eb1689c1f%252Fpa%252FTR68531_99f84e9f848cf45a15b4c853c439bf2a.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/42/9942f7bd2dd5e605d268467eb1689c1f/pa/TR68531_99f84e9f848cf45a15b4c853c439bf2a.jpg already downloaded
2026-01-28 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F42%252F9942f7bd2dd5e605d268467eb1689c1f%252Fpa%252FTR68531_f2bd1eee68cb484bd041ef62db7ec001.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/42/9942f7bd2dd5e605d268467eb1689c1f/pa/TR68531_f2bd1eee68cb484bd041ef62db7ec001.jpg already downloaded
2026-01-28 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F42%252F9942f7bd2dd5e605d268467eb1689c1f%252Fpa%252FTR68531_a7896c1ea2fda7359a5c8dfbe3931628.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/42/9942f7bd2dd5e605d268467eb1689c1f/pa/TR68531_a7896c1ea2fda7359a5c8dfbe3931628.jpg already downloaded
2026-01-28 20:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F42%252F9942f7bd2dd5e605d268467eb1689c1f%252Fpa%252FTR68531_c2a35e65d05dcb30cd1cf23d09546c2f.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/42/9942f7bd2dd5e605d268467eb1689c1f/pa/TR68531_c2a35e65d05dcb30cd1cf23d09546c2f.jpg already downloaded
2026-01-28 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F42%252F9942f7bd2dd5e605d268467eb1689c1f%252Fpa%252FTR68531_ccfb416b3eaa1c22454142a81f8d5499.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/42/9942f7bd2dd5e605d268467eb1689c1f/pa/TR68531_ccfb416b3eaa1c22454142a81f8d5499.jpg already downloaded
2026-01-28 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F42%252F9942f7bd2dd5e605d268467eb1689c1f%252Fpa%252FTR68531_53765635931c30ce27724ea89569d206.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/42/9942f7bd2dd5e605d268467eb1689c1f/pa/TR68531_53765635931c30ce27724ea89569d206.jpg already downloaded
2026-01-28 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F42%252F9942f7bd2dd5e605d268467eb1689c1f%252Fpa%252FTR68531_8cbbe50cff8a1cfca0a0dd441bac4eb8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/42/9942f7bd2dd5e605d268467eb1689c1f/pa/TR68531_8cbbe50cff8a1cfca0a0dd441bac4eb8.jpg already downloaded
2026-01-28 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F42%252F9942f7bd2dd5e605d268467eb1689c1f%252Fpa%252FTR68531_8cbd730090f6a691ed11a82b2eebe264.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/42/9942f7bd2dd5e605d268467eb1689c1f/pa/TR68531_8cbd730090f6a691ed11a82b2eebe264.jpg already downloaded
2026-01-28 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F42%252F9942f7bd2dd5e605d268467eb1689c1f%252Fpa%252FTR68531_dfa1f1748b17d2ce1406f6d5618b28db.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/42/9942f7bd2dd5e605d268467eb1689c1f/pa/TR68531_dfa1f1748b17d2ce1406f6d5618b28db.jpg already downloaded
2026-01-28 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F42%252F9942f7bd2dd5e605d268467eb1689c1f%252Fpa%252FTR68531_bd7ebfded768d8525ab4012a751d587d.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/42/9942f7bd2dd5e605d268467eb1689c1f/pa/TR68531_bd7ebfded768d8525ab4012a751d587d.jpg already downloaded
2026-01-28 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F42%252F9942f7bd2dd5e605d268467eb1689c1f%252Fpa%252FTR68531_6b4da8bc67cb7d542509c928cff0129f.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/42/9942f7bd2dd5e605d268467eb1689c1f/pa/TR68531_6b4da8bc67cb7d542509c928cff0129f.jpg already downloaded
2026-01-28 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F42%252F9942f7bd2dd5e605d268467eb1689c1f%252Fpa%252FTR68531_274ab2f455fc61e8185099bb7966f650.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/42/9942f7bd2dd5e605d268467eb1689c1f/pa/TR68531_274ab2f455fc61e8185099bb7966f650.jpg already downloaded
2026-01-28 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F42%252F9942f7bd2dd5e605d268467eb1689c1f%252Fpa%252FTR68531_bfb379802ddbfc14297111167fd7be23.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/42/9942f7bd2dd5e605d268467eb1689c1f/pa/TR68531_bfb379802ddbfc14297111167fd7be23.jpg already downloaded
2026-01-28 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F42%252F9942f7bd2dd5e605d268467eb1689c1f%252Fpa%252FTR68531_a409a5216389c63fd7d0ffc2e3ee084b.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/42/9942f7bd2dd5e605d268467eb1689c1f/pa/TR68531_a409a5216389c63fd7d0ffc2e3ee084b.jpg already downloaded
2026-01-28 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F42%252F9942f7bd2dd5e605d268467eb1689c1f%252Fpa%252FTR68531_fd42a3717643451393596268e148c778.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/42/9942f7bd2dd5e605d268467eb1689c1f/pa/TR68531_fd42a3717643451393596268e148c778.jpg already downloaded
2026-01-28 20:00:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 15f4eb87-fd88-5b8d-a1b2-57d01cde0e0e, identifier: TR68531
2026-01-28 20:00:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 128a829e-94fe-5020-be5b-ed14f1ecc9b9 with identifier: NR29634
2026-01-28 20:00:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 128a829e-94fe-5020-be5b-ed14f1ecc9b9 with scrape type 2
2026-01-28 20:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 128a829e-94fe-5020-be5b-ed14f1ecc9b9 with scrape type 2
2026-01-28 20:00:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 128a829e-94fe-5020-be5b-ed14f1ecc9b9, identifier: NR29634
2026-01-28 20:00:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8aea567-3ec2-586f-8165-3ba50fde04ea with identifier: DJ22210
2026-01-28 20:00:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8aea567-3ec2-586f-8165-3ba50fde04ea with scrape type 1
2026-01-28 20:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item e8aea567-3ec2-586f-8165-3ba50fde04ea
2026-01-28 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252Fa6%252F27a657fee4c38facf349d22de315ad81%252Fpa%252FDJ22210_80874957cc4fe48b8c50bebc0a24e51a.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/a6/27a657fee4c38facf349d22de315ad81/pa/DJ22210_80874957cc4fe48b8c50bebc0a24e51a.jpg not downloaded yet
2026-01-28 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F52%252F265278f2bef552d5057c2293e62259ec%252Fpa%252FVP25370_cd9a55e4161699c14fe1880718aaed03.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/52/265278f2bef552d5057c2293e62259ec/pa/VP25370_cd9a55e4161699c14fe1880718aaed03.jpg not downloaded yet
2026-01-28 20:00:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LU91869> (referer: https://www.auto1.com/v1/car-details-view/LU91869/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:00:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 84994043-29e3-5bff-9fe1-4d4f8e69dcc8 with identifier: WA05631
2026-01-28 20:00:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 84994043-29e3-5bff-9fe1-4d4f8e69dcc8 with identifier: WA05631
2026-01-28 20:00:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 84994043-29e3-5bff-9fe1-4d4f8e69dcc8 with identifier: WA05631 to the API
2026-01-28 20:00:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:00:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:00:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WA05631>
{'auction_title': '',
 'c_o_2_emission_value': 171,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '2.0L',
 'engine_horse_power': 240,
 'expiration_date': '2026-01-29T16:56:52Z',
 'fuel_type': 'diesel',
 'id': '84994043-29e3-5bff-9fe1-4d4f8e69dcc8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WA05631',
 'listing': 'auction',
 'location': 'IT, Milano',
 'make': 'Land Rover',
 'model': 'Range Rover Velar',
 'odometer': 122552,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgfa/d0/fad0b17e66ac2592dbe1afcbe0ad855f/pa/WA05631_ec0aaf30374b90c125be723b7233b663.jpg',
                'https://img-pa.auto1.com/imgfa/d0/fad0b17e66ac2592dbe1afcbe0ad855f/pa/WA05631_7e476d9303b454508b51d8cb3fe4f2f2.jpg',
                'https://img-pa.auto1.com/imgfa/d0/fad0b17e66ac2592dbe1afcbe0ad855f/pa/WA05631_22c3a6bae52f680ef304b34c38af9497.jpg',
                'https://img-pa.auto1.com/imgfa/d0/fad0b17e66ac2592dbe1afcbe0ad855f/pa/WA05631_4b768e3c2c6e411a9109cdbd04af3932.jpg',
                'https://img-pa.auto1.com/imgfa/d0/fad0b17e66ac2592dbe1afcbe0ad855f/pa/WA05631_008434af14dce13b71189723a5fb895b.jpg',
                'https://img-pa.auto1.com/imgfa/d0/fad0b17e66ac2592dbe1afcbe0ad855f/pa/WA05631_bdd93abae45806d5532949817ae5ef1c.jpg',
                'https://img-pa.auto1.com/imgfa/d0/fad0b17e66ac2592dbe1afcbe0ad855f/pa/WA05631_c91d6c2985b43fe48aafbd44a4d56416.jpg',
                'https://img-pa.auto1.com/imgfa/d0/fad0b17e66ac2592dbe1afcbe0ad855f/pa/WA05631_1bf2aea7a5edfdcaa3c914962ccedd9c.jpg',
                'https://img-pa.auto1.com/imgfa/d0/fad0b17e66ac2592dbe1afcbe0ad855f/pa/WA05631_02720b37284bf3642b721ac7acd9f367.jpg',
                'https://img-pa.auto1.com/imgfa/d0/fad0b17e66ac2592dbe1afcbe0ad855f/pa/WA05631_8cb1551e199a9dc64aee99268dce4651.jpg',
                'https://img-pa.auto1.com/imgfa/d0/fad0b17e66ac2592dbe1afcbe0ad855f/pa/WA05631_1b90fdb6e347f2020b8645338732ac70.jpg',
                'https://img-pa.auto1.com/imgfa/d0/fad0b17e66ac2592dbe1afcbe0ad855f/pa/WA05631_7095755c363bb449666aa89233b16938.jpg',
                'https://img-pa.auto1.com/imgfa/d0/fad0b17e66ac2592dbe1afcbe0ad855f/pa/WA05631_63f5c2ee919dad7feca482e57c445c46.jpg',
                'https://img-pa.auto1.com/imgfa/d0/fad0b17e66ac2592dbe1afcbe0ad855f/pa/WA05631_e95095cccf34d4be1668f5fa5b16e8a1.jpg',
                'https://img-pa.auto1.com/imgfa/d0/fad0b17e66ac2592dbe1afcbe0ad855f/pa/WA05631_30f5daa351a3aac908412424f5a0e348.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84994043-29e3-5bff-9fe1-4d4f8e69dcc8/84994043-29e3-5bff-9fe1-4d4f8e69dcc8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61642,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/d0/fad0b17e66ac2592dbe1afcbe0ad855f/pa/WA05631_ec0aaf30374b90c125be723b7233b663.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84994043-29e3-5bff-9fe1-4d4f8e69dcc8/84994043-29e3-5bff-9fe1-4d4f8e69dcc8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62936,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/d0/fad0b17e66ac2592dbe1afcbe0ad855f/pa/WA05631_7e476d9303b454508b51d8cb3fe4f2f2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84994043-29e3-5bff-9fe1-4d4f8e69dcc8/84994043-29e3-5bff-9fe1-4d4f8e69dcc8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57973,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/d0/fad0b17e66ac2592dbe1afcbe0ad855f/pa/WA05631_22c3a6bae52f680ef304b34c38af9497.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84994043-29e3-5bff-9fe1-4d4f8e69dcc8/84994043-29e3-5bff-9fe1-4d4f8e69dcc8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47986,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/d0/fad0b17e66ac2592dbe1afcbe0ad855f/pa/WA05631_4b768e3c2c6e411a9109cdbd04af3932.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84994043-29e3-5bff-9fe1-4d4f8e69dcc8/84994043-29e3-5bff-9fe1-4d4f8e69dcc8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62699,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/d0/fad0b17e66ac2592dbe1afcbe0ad855f/pa/WA05631_008434af14dce13b71189723a5fb895b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84994043-29e3-5bff-9fe1-4d4f8e69dcc8/84994043-29e3-5bff-9fe1-4d4f8e69dcc8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64088,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/d0/fad0b17e66ac2592dbe1afcbe0ad855f/pa/WA05631_bdd93abae45806d5532949817ae5ef1c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84994043-29e3-5bff-9fe1-4d4f8e69dcc8/84994043-29e3-5bff-9fe1-4d4f8e69dcc8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57167,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/d0/fad0b17e66ac2592dbe1afcbe0ad855f/pa/WA05631_c91d6c2985b43fe48aafbd44a4d56416.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84994043-29e3-5bff-9fe1-4d4f8e69dcc8/84994043-29e3-5bff-9fe1-4d4f8e69dcc8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62104,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/d0/fad0b17e66ac2592dbe1afcbe0ad855f/pa/WA05631_1bf2aea7a5edfdcaa3c914962ccedd9c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84994043-29e3-5bff-9fe1-4d4f8e69dcc8/84994043-29e3-5bff-9fe1-4d4f8e69dcc8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67361,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/d0/fad0b17e66ac2592dbe1afcbe0ad855f/pa/WA05631_02720b37284bf3642b721ac7acd9f367.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84994043-29e3-5bff-9fe1-4d4f8e69dcc8/84994043-29e3-5bff-9fe1-4d4f8e69dcc8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55692,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/d0/fad0b17e66ac2592dbe1afcbe0ad855f/pa/WA05631_8cb1551e199a9dc64aee99268dce4651.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84994043-29e3-5bff-9fe1-4d4f8e69dcc8/84994043-29e3-5bff-9fe1-4d4f8e69dcc8_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65704,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/d0/fad0b17e66ac2592dbe1afcbe0ad855f/pa/WA05631_1b90fdb6e347f2020b8645338732ac70.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84994043-29e3-5bff-9fe1-4d4f8e69dcc8/84994043-29e3-5bff-9fe1-4d4f8e69dcc8_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63161,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/d0/fad0b17e66ac2592dbe1afcbe0ad855f/pa/WA05631_7095755c363bb449666aa89233b16938.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84994043-29e3-5bff-9fe1-4d4f8e69dcc8/84994043-29e3-5bff-9fe1-4d4f8e69dcc8_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60806,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/d0/fad0b17e66ac2592dbe1afcbe0ad855f/pa/WA05631_63f5c2ee919dad7feca482e57c445c46.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84994043-29e3-5bff-9fe1-4d4f8e69dcc8/84994043-29e3-5bff-9fe1-4d4f8e69dcc8_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54694,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/d0/fad0b17e66ac2592dbe1afcbe0ad855f/pa/WA05631_e95095cccf34d4be1668f5fa5b16e8a1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84994043-29e3-5bff-9fe1-4d4f8e69dcc8/84994043-29e3-5bff-9fe1-4d4f8e69dcc8_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58594,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/d0/fad0b17e66ac2592dbe1afcbe0ad855f/pa/WA05631_30f5daa351a3aac908412424f5a0e348.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-04-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Range Rover Velar 2.0 Diesel S',
 'transmission': 'automatic',
 'trim': 'S',
 'year': 2019}
2026-01-28 20:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WA05631%27 HTTP/1.1" 200 None
2026-01-28 20:00:50 [auto1.it] INFO: Saving data for WA05631: {'created_time': 1769630450.041685, 'last_price_update_time': 1769630450.041696, 'auction_closing_time': 1769705812.0}
2026-01-28 20:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WA05631') HTTP/1.1" 204 0
2026-01-28 20:00:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 15f4eb87-fd88-5b8d-a1b2-57d01cde0e0e with identifier: TR68531
2026-01-28 20:00:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 15f4eb87-fd88-5b8d-a1b2-57d01cde0e0e with identifier: TR68531
2026-01-28 20:00:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 15f4eb87-fd88-5b8d-a1b2-57d01cde0e0e with identifier: TR68531 to the API
2026-01-28 20:00:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:00:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:00:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TR68531>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.0L',
 'engine_horse_power': 110,
 'expiration_date': '2026-01-29T16:26:19Z',
 'fuel_type': 'petrol',
 'id': '15f4eb87-fd88-5b8d-a1b2-57d01cde0e0e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TR68531',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'Volkswagen',
 'model': 'T-Cross',
 'odometer': 20830,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img99/42/9942f7bd2dd5e605d268467eb1689c1f/pa/TR68531_99f84e9f848cf45a15b4c853c439bf2a.jpg',
                'https://img-pa.auto1.com/img99/42/9942f7bd2dd5e605d268467eb1689c1f/pa/TR68531_f2bd1eee68cb484bd041ef62db7ec001.jpg',
                'https://img-pa.auto1.com/img99/42/9942f7bd2dd5e605d268467eb1689c1f/pa/TR68531_a7896c1ea2fda7359a5c8dfbe3931628.jpg',
                'https://img-pa.auto1.com/img99/42/9942f7bd2dd5e605d268467eb1689c1f/pa/TR68531_c2a35e65d05dcb30cd1cf23d09546c2f.jpg',
                'https://img-pa.auto1.com/img99/42/9942f7bd2dd5e605d268467eb1689c1f/pa/TR68531_ccfb416b3eaa1c22454142a81f8d5499.jpg',
                'https://img-pa.auto1.com/img99/42/9942f7bd2dd5e605d268467eb1689c1f/pa/TR68531_53765635931c30ce27724ea89569d206.jpg',
                'https://img-pa.auto1.com/img99/42/9942f7bd2dd5e605d268467eb1689c1f/pa/TR68531_8cbbe50cff8a1cfca0a0dd441bac4eb8.jpg',
                'https://img-pa.auto1.com/img99/42/9942f7bd2dd5e605d268467eb1689c1f/pa/TR68531_8cbd730090f6a691ed11a82b2eebe264.jpg',
                'https://img-pa.auto1.com/img99/42/9942f7bd2dd5e605d268467eb1689c1f/pa/TR68531_dfa1f1748b17d2ce1406f6d5618b28db.jpg',
                'https://img-pa.auto1.com/img99/42/9942f7bd2dd5e605d268467eb1689c1f/pa/TR68531_bd7ebfded768d8525ab4012a751d587d.jpg',
                'https://img-pa.auto1.com/img99/42/9942f7bd2dd5e605d268467eb1689c1f/pa/TR68531_6b4da8bc67cb7d542509c928cff0129f.jpg',
                'https://img-pa.auto1.com/img99/42/9942f7bd2dd5e605d268467eb1689c1f/pa/TR68531_274ab2f455fc61e8185099bb7966f650.jpg',
                'https://img-pa.auto1.com/img99/42/9942f7bd2dd5e605d268467eb1689c1f/pa/TR68531_bfb379802ddbfc14297111167fd7be23.jpg',
                'https://img-pa.auto1.com/img99/42/9942f7bd2dd5e605d268467eb1689c1f/pa/TR68531_a409a5216389c63fd7d0ffc2e3ee084b.jpg',
                'https://img-pa.auto1.com/img99/42/9942f7bd2dd5e605d268467eb1689c1f/pa/TR68531_fd42a3717643451393596268e148c778.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15f4eb87-fd88-5b8d-a1b2-57d01cde0e0e/15f4eb87-fd88-5b8d-a1b2-57d01cde0e0e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2962866,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img99/42/9942f7bd2dd5e605d268467eb1689c1f/pa/TR68531_99f84e9f848cf45a15b4c853c439bf2a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15f4eb87-fd88-5b8d-a1b2-57d01cde0e0e/15f4eb87-fd88-5b8d-a1b2-57d01cde0e0e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2552404,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img99/42/9942f7bd2dd5e605d268467eb1689c1f/pa/TR68531_f2bd1eee68cb484bd041ef62db7ec001.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15f4eb87-fd88-5b8d-a1b2-57d01cde0e0e/15f4eb87-fd88-5b8d-a1b2-57d01cde0e0e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2752233,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img99/42/9942f7bd2dd5e605d268467eb1689c1f/pa/TR68531_a7896c1ea2fda7359a5c8dfbe3931628.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15f4eb87-fd88-5b8d-a1b2-57d01cde0e0e/15f4eb87-fd88-5b8d-a1b2-57d01cde0e0e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2378606,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img99/42/9942f7bd2dd5e605d268467eb1689c1f/pa/TR68531_c2a35e65d05dcb30cd1cf23d09546c2f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15f4eb87-fd88-5b8d-a1b2-57d01cde0e0e/15f4eb87-fd88-5b8d-a1b2-57d01cde0e0e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2953708,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img99/42/9942f7bd2dd5e605d268467eb1689c1f/pa/TR68531_ccfb416b3eaa1c22454142a81f8d5499.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15f4eb87-fd88-5b8d-a1b2-57d01cde0e0e/15f4eb87-fd88-5b8d-a1b2-57d01cde0e0e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2591077,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img99/42/9942f7bd2dd5e605d268467eb1689c1f/pa/TR68531_53765635931c30ce27724ea89569d206.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15f4eb87-fd88-5b8d-a1b2-57d01cde0e0e/15f4eb87-fd88-5b8d-a1b2-57d01cde0e0e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2245217,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img99/42/9942f7bd2dd5e605d268467eb1689c1f/pa/TR68531_8cbbe50cff8a1cfca0a0dd441bac4eb8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15f4eb87-fd88-5b8d-a1b2-57d01cde0e0e/15f4eb87-fd88-5b8d-a1b2-57d01cde0e0e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2517521,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img99/42/9942f7bd2dd5e605d268467eb1689c1f/pa/TR68531_8cbd730090f6a691ed11a82b2eebe264.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15f4eb87-fd88-5b8d-a1b2-57d01cde0e0e/15f4eb87-fd88-5b8d-a1b2-57d01cde0e0e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2731543,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img99/42/9942f7bd2dd5e605d268467eb1689c1f/pa/TR68531_dfa1f1748b17d2ce1406f6d5618b28db.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15f4eb87-fd88-5b8d-a1b2-57d01cde0e0e/15f4eb87-fd88-5b8d-a1b2-57d01cde0e0e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2522486,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img99/42/9942f7bd2dd5e605d268467eb1689c1f/pa/TR68531_bd7ebfded768d8525ab4012a751d587d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15f4eb87-fd88-5b8d-a1b2-57d01cde0e0e/15f4eb87-fd88-5b8d-a1b2-57d01cde0e0e_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2302825,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img99/42/9942f7bd2dd5e605d268467eb1689c1f/pa/TR68531_6b4da8bc67cb7d542509c928cff0129f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15f4eb87-fd88-5b8d-a1b2-57d01cde0e0e/15f4eb87-fd88-5b8d-a1b2-57d01cde0e0e_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2672601,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img99/42/9942f7bd2dd5e605d268467eb1689c1f/pa/TR68531_274ab2f455fc61e8185099bb7966f650.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15f4eb87-fd88-5b8d-a1b2-57d01cde0e0e/15f4eb87-fd88-5b8d-a1b2-57d01cde0e0e_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79227,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/42/9942f7bd2dd5e605d268467eb1689c1f/pa/TR68531_bfb379802ddbfc14297111167fd7be23.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15f4eb87-fd88-5b8d-a1b2-57d01cde0e0e/15f4eb87-fd88-5b8d-a1b2-57d01cde0e0e_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2214265,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img99/42/9942f7bd2dd5e605d268467eb1689c1f/pa/TR68531_a409a5216389c63fd7d0ffc2e3ee084b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15f4eb87-fd88-5b8d-a1b2-57d01cde0e0e/15f4eb87-fd88-5b8d-a1b2-57d01cde0e0e_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64476,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/42/9942f7bd2dd5e605d268467eb1689c1f/pa/TR68531_fd42a3717643451393596268e148c778.jpg',
             'Width': 450}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-12-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen T-Cross 1.0 TSI Advanced',
 'transmission': 'manual',
 'trim': 'Advanced',
 'year': 2022}
2026-01-28 20:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TR68531%27 HTTP/1.1" 200 None
2026-01-28 20:00:50 [auto1.it] INFO: Saving data for TR68531: {'created_time': 1769630450.906639, 'last_price_update_time': 1769630450.906651, 'auction_closing_time': 1769703979.0}
2026-01-28 20:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TR68531') HTTP/1.1" 204 0
2026-01-28 20:00:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 128a829e-94fe-5020-be5b-ed14f1ecc9b9 with identifier: NR29634
2026-01-28 20:00:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 128a829e-94fe-5020-be5b-ed14f1ecc9b9 with identifier: NR29634
2026-01-28 20:00:51 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 168746 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    168746
2026-01-28 20:00:51 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 128a829e-94fe-5020-be5b-ed14f1ecc9b9 spider: auto1.it
2026-01-28 20:00:51 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 128a829e-94fe-5020-be5b-ed14f1ecc9b9 due to rule: high_mileage_for_country.json, error: 168746 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    168746
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6D',
 'engine': '1.5L',
 'engine_horse_power': 116,
 'expiration_date': '2026-01-29T16:47:16Z',
 'fuel_type': 'diesel',
 'id': '128a829e-94fe-5020-be5b-ed14f1ecc9b9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NR29634',
 'listing': 'auction',
 'location': 'IT, Bentivoglio (BO)',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 168746,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-09-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 180 d Premium',
 'transmission': 'automatic',
 'trim': 'Premium',
 'year': 2020}
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NR29634%27 HTTP/1.1" 200 None
2026-01-28 20:00:51 [auto1.it] INFO: Saving data for NR29634: {'auction_closing_time': 1769705236.0, 'created_time': 1768990066.694197, 'last_price_update_time': 1769630451.173498}
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NR29634') HTTP/1.1" 204 0
2026-01-28 20:00:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252Fa6%252F27a657fee4c38facf349d22de315ad81%252Fpa%252FDJ22210_2b1607897a8d16f8a381268e1f6daf43.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/a6/27a657fee4c38facf349d22de315ad81/pa/DJ22210_2b1607897a8d16f8a381268e1f6daf43.jpg not downloaded yet
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F52%252F265278f2bef552d5057c2293e62259ec%252Fpa%252FVP25370_925f2117809b5dc69a3e5774f88324b6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/52/265278f2bef552d5057c2293e62259ec/pa/VP25370_925f2117809b5dc69a3e5774f88324b6.jpg not downloaded yet
2026-01-28 20:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WR27841> (referer: https://www.auto1.com/v1/car-details-view/WR27841/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TE33165/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GD75064/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RX31393> (referer: https://www.auto1.com/v1/car-details-view/RX31393/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252Fa6%252F27a657fee4c38facf349d22de315ad81%252Fpa%252FDJ22210_4cf77547272c72daf5d67c0c0acc536f.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/a6/27a657fee4c38facf349d22de315ad81/pa/DJ22210_4cf77547272c72daf5d67c0c0acc536f.jpg not downloaded yet
2026-01-28 20:00:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:00:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:00:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:00:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F52%252F265278f2bef552d5057c2293e62259ec%252Fpa%252FVP25370_cca1b8e58a28fe2b3a0fbfa9d296f028.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/52/265278f2bef552d5057c2293e62259ec/pa/VP25370_cca1b8e58a28fe2b3a0fbfa9d296f028.jpg not downloaded yet
2026-01-28 20:00:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0456157c-5e46-5233-9b30-29463aaf3359 with identifier: JX24929
2026-01-28 20:00:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0456157c-5e46-5233-9b30-29463aaf3359 with scrape type 1
2026-01-28 20:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 0456157c-5e46-5233-9b30-29463aaf3359
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F26%252Fe826845b193d0c0369229d76ebae73a9%252Fpa%252FJX24929_4aefc1042cfac7f27f575ffa39952eda.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/26/e826845b193d0c0369229d76ebae73a9/pa/JX24929_4aefc1042cfac7f27f575ffa39952eda.jpg already downloaded
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F26%252Fe826845b193d0c0369229d76ebae73a9%252Fpa%252FJX24929_1eedc7dbc756088b9cc4407b8693ae1d.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/26/e826845b193d0c0369229d76ebae73a9/pa/JX24929_1eedc7dbc756088b9cc4407b8693ae1d.jpg already downloaded
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F26%252Fe826845b193d0c0369229d76ebae73a9%252Fpa%252FJX24929_c107aa9507ed0ae4460e2e740aeaa8e6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/26/e826845b193d0c0369229d76ebae73a9/pa/JX24929_c107aa9507ed0ae4460e2e740aeaa8e6.jpg already downloaded
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F26%252Fe826845b193d0c0369229d76ebae73a9%252Fpa%252FJX24929_645277802914c946a75afe3f88f96ebe.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/26/e826845b193d0c0369229d76ebae73a9/pa/JX24929_645277802914c946a75afe3f88f96ebe.jpg already downloaded
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F26%252Fe826845b193d0c0369229d76ebae73a9%252Fpa%252FJX24929_c44d3989d3f62495ed57bb041d1a675b.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/26/e826845b193d0c0369229d76ebae73a9/pa/JX24929_c44d3989d3f62495ed57bb041d1a675b.jpg already downloaded
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F26%252Fe826845b193d0c0369229d76ebae73a9%252Fpa%252FJX24929_794e37ee05252cf1644672990551fe2e.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/26/e826845b193d0c0369229d76ebae73a9/pa/JX24929_794e37ee05252cf1644672990551fe2e.jpg already downloaded
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F26%252Fe826845b193d0c0369229d76ebae73a9%252Fpa%252FJX24929_dd558c8dfc4ce77158b2abc94585ce8d.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/26/e826845b193d0c0369229d76ebae73a9/pa/JX24929_dd558c8dfc4ce77158b2abc94585ce8d.jpg already downloaded
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F26%252Fe826845b193d0c0369229d76ebae73a9%252Fpa%252FJX24929_5e0a6620f06738c413b2e58b0adcd233.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/26/e826845b193d0c0369229d76ebae73a9/pa/JX24929_5e0a6620f06738c413b2e58b0adcd233.jpg already downloaded
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F26%252Fe826845b193d0c0369229d76ebae73a9%252Fpa%252FJX24929_32c04daebd4c8a0f5c7c6dd7f5f9ed93.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/26/e826845b193d0c0369229d76ebae73a9/pa/JX24929_32c04daebd4c8a0f5c7c6dd7f5f9ed93.jpg already downloaded
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F26%252Fe826845b193d0c0369229d76ebae73a9%252Fpa%252FJX24929_91b1c3394894a98f6277929c3dfd6379.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/26/e826845b193d0c0369229d76ebae73a9/pa/JX24929_91b1c3394894a98f6277929c3dfd6379.jpg already downloaded
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F26%252Fe826845b193d0c0369229d76ebae73a9%252Fpa%252FJX24929_305a6a0aae362538ab60386890f0133a.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/26/e826845b193d0c0369229d76ebae73a9/pa/JX24929_305a6a0aae362538ab60386890f0133a.jpg already downloaded
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F26%252Fe826845b193d0c0369229d76ebae73a9%252Fpa%252FJX24929_8181f72d71be136449318746e2759368.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/26/e826845b193d0c0369229d76ebae73a9/pa/JX24929_8181f72d71be136449318746e2759368.jpg already downloaded
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F26%252Fe826845b193d0c0369229d76ebae73a9%252Fpa%252FJX24929_9781e82dff0926f40b543b0d5b466022.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/26/e826845b193d0c0369229d76ebae73a9/pa/JX24929_9781e82dff0926f40b543b0d5b466022.jpg already downloaded
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F26%252Fe826845b193d0c0369229d76ebae73a9%252Fpa%252FJX24929_24fece996195d6282f1898842e4a6e47.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/26/e826845b193d0c0369229d76ebae73a9/pa/JX24929_24fece996195d6282f1898842e4a6e47.jpg already downloaded
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F26%252Fe826845b193d0c0369229d76ebae73a9%252Fpa%252FJX24929_ee56cac456d69b377d321d42ab1e984d.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/26/e826845b193d0c0369229d76ebae73a9/pa/JX24929_ee56cac456d69b377d321d42ab1e984d.jpg already downloaded
2026-01-28 20:00:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0456157c-5e46-5233-9b30-29463aaf3359, identifier: JX24929
2026-01-28 20:00:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 33faea0f-7631-5e73-9aed-f0d0e76badba with identifier: LU91869
2026-01-28 20:00:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33faea0f-7631-5e73-9aed-f0d0e76badba with scrape type 1
2026-01-28 20:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 33faea0f-7631-5e73-9aed-f0d0e76badba
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fa5%252F4aa578b8ee6ab8e538ebf823da90417d%252Fpa%252FLU91869_93b438f3b21b324ce9f77e95d3835e4d.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/a5/4aa578b8ee6ab8e538ebf823da90417d/pa/LU91869_93b438f3b21b324ce9f77e95d3835e4d.jpg already downloaded
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fa5%252F4aa578b8ee6ab8e538ebf823da90417d%252Fpa%252FLU91869_b5e6fc5db5ccf6a3090254dc9a231227.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/a5/4aa578b8ee6ab8e538ebf823da90417d/pa/LU91869_b5e6fc5db5ccf6a3090254dc9a231227.jpg already downloaded
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fa5%252F4aa578b8ee6ab8e538ebf823da90417d%252Fpa%252FLU91869_3ce5762684ffd57d8c8dd5238cec8917.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/a5/4aa578b8ee6ab8e538ebf823da90417d/pa/LU91869_3ce5762684ffd57d8c8dd5238cec8917.jpg already downloaded
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fa5%252F4aa578b8ee6ab8e538ebf823da90417d%252Fpa%252FLU91869_293cde1063a7d111dd6674ac0181e2f2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/a5/4aa578b8ee6ab8e538ebf823da90417d/pa/LU91869_293cde1063a7d111dd6674ac0181e2f2.jpg already downloaded
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fa5%252F4aa578b8ee6ab8e538ebf823da90417d%252Fpa%252FLU91869_ef240df3a68f18b6f5a66550fa0bd8eb.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/a5/4aa578b8ee6ab8e538ebf823da90417d/pa/LU91869_ef240df3a68f18b6f5a66550fa0bd8eb.jpg already downloaded
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fa5%252F4aa578b8ee6ab8e538ebf823da90417d%252Fpa%252FLU91869_1550a6dfa43dfe58a1595090ed6e96ad.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/a5/4aa578b8ee6ab8e538ebf823da90417d/pa/LU91869_1550a6dfa43dfe58a1595090ed6e96ad.jpg already downloaded
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fa5%252F4aa578b8ee6ab8e538ebf823da90417d%252Fpa%252FLU91869_79202a5ee3613e6553d9372311de6c76.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/a5/4aa578b8ee6ab8e538ebf823da90417d/pa/LU91869_79202a5ee3613e6553d9372311de6c76.jpg already downloaded
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fa5%252F4aa578b8ee6ab8e538ebf823da90417d%252Fpa%252FLU91869_c508a61c182abc0dcb93c219b356de30.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/a5/4aa578b8ee6ab8e538ebf823da90417d/pa/LU91869_c508a61c182abc0dcb93c219b356de30.jpg already downloaded
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fa5%252F4aa578b8ee6ab8e538ebf823da90417d%252Fpa%252FLU91869_8238258a74bc166137b6844ccbd3aaf0.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/a5/4aa578b8ee6ab8e538ebf823da90417d/pa/LU91869_8238258a74bc166137b6844ccbd3aaf0.jpg already downloaded
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fa5%252F4aa578b8ee6ab8e538ebf823da90417d%252Fpa%252FLU91869_d415ceb4aa76e212789518fabec9d8d5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/a5/4aa578b8ee6ab8e538ebf823da90417d/pa/LU91869_d415ceb4aa76e212789518fabec9d8d5.jpg already downloaded
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fa5%252F4aa578b8ee6ab8e538ebf823da90417d%252Fpa%252FLU91869_0b96cf7e50d8178f5038dc58a1dfde30.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/a5/4aa578b8ee6ab8e538ebf823da90417d/pa/LU91869_0b96cf7e50d8178f5038dc58a1dfde30.jpg already downloaded
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fa5%252F4aa578b8ee6ab8e538ebf823da90417d%252Fpa%252FLU91869_5f737855fcae2ec2365f8f30bb6cac40.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/a5/4aa578b8ee6ab8e538ebf823da90417d/pa/LU91869_5f737855fcae2ec2365f8f30bb6cac40.jpg already downloaded
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fa5%252F4aa578b8ee6ab8e538ebf823da90417d%252Fpa%252FLU91869_dbeaff54bf6ae76fd040790bd3ef6161.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/a5/4aa578b8ee6ab8e538ebf823da90417d/pa/LU91869_dbeaff54bf6ae76fd040790bd3ef6161.jpg already downloaded
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fa5%252F4aa578b8ee6ab8e538ebf823da90417d%252Fpa%252FLU91869_46d89b40e54b9794ce20c31088bcd78d.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/a5/4aa578b8ee6ab8e538ebf823da90417d/pa/LU91869_46d89b40e54b9794ce20c31088bcd78d.jpg already downloaded
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fa5%252F4aa578b8ee6ab8e538ebf823da90417d%252Fpa%252FLU91869_1fbd83af15879d678cf0cba4a54d8960.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/a5/4aa578b8ee6ab8e538ebf823da90417d/pa/LU91869_1fbd83af15879d678cf0cba4a54d8960.jpg already downloaded
2026-01-28 20:00:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 33faea0f-7631-5e73-9aed-f0d0e76badba, identifier: LU91869
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252Fa6%252F27a657fee4c38facf349d22de315ad81%252Fpa%252FDJ22210_69cf42e9465bc533269626054e497f6a.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/a6/27a657fee4c38facf349d22de315ad81/pa/DJ22210_69cf42e9465bc533269626054e497f6a.jpg not downloaded yet
2026-01-28 20:00:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0456157c-5e46-5233-9b30-29463aaf3359 with identifier: JX24929
2026-01-28 20:00:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0456157c-5e46-5233-9b30-29463aaf3359 with identifier: JX24929
2026-01-28 20:00:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0456157c-5e46-5233-9b30-29463aaf3359 with identifier: JX24929 to the API
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:00:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JX24929>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.0L',
 'engine_horse_power': 114,
 'expiration_date': '2026-01-29T16:25:40Z',
 'fuel_type': 'petrol',
 'id': '0456157c-5e46-5233-9b30-29463aaf3359',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JX24929',
 'listing': 'auction',
 'location': 'IT, Milazzo',
 'make': 'Nissan',
 'model': 'Juke',
 'odometer': 64025,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imge8/26/e826845b193d0c0369229d76ebae73a9/pa/JX24929_4aefc1042cfac7f27f575ffa39952eda.jpg',
                'https://img-pa.auto1.com/imge8/26/e826845b193d0c0369229d76ebae73a9/pa/JX24929_1eedc7dbc756088b9cc4407b8693ae1d.jpg',
                'https://img-pa.auto1.com/imge8/26/e826845b193d0c0369229d76ebae73a9/pa/JX24929_c107aa9507ed0ae4460e2e740aeaa8e6.jpg',
                'https://img-pa.auto1.com/imge8/26/e826845b193d0c0369229d76ebae73a9/pa/JX24929_645277802914c946a75afe3f88f96ebe.jpg',
                'https://img-pa.auto1.com/imge8/26/e826845b193d0c0369229d76ebae73a9/pa/JX24929_c44d3989d3f62495ed57bb041d1a675b.jpg',
                'https://img-pa.auto1.com/imge8/26/e826845b193d0c0369229d76ebae73a9/pa/JX24929_794e37ee05252cf1644672990551fe2e.jpg',
                'https://img-pa.auto1.com/imge8/26/e826845b193d0c0369229d76ebae73a9/pa/JX24929_dd558c8dfc4ce77158b2abc94585ce8d.jpg',
                'https://img-pa.auto1.com/imge8/26/e826845b193d0c0369229d76ebae73a9/pa/JX24929_5e0a6620f06738c413b2e58b0adcd233.jpg',
                'https://img-pa.auto1.com/imge8/26/e826845b193d0c0369229d76ebae73a9/pa/JX24929_32c04daebd4c8a0f5c7c6dd7f5f9ed93.jpg',
                'https://img-pa.auto1.com/imge8/26/e826845b193d0c0369229d76ebae73a9/pa/JX24929_91b1c3394894a98f6277929c3dfd6379.jpg',
                'https://img-pa.auto1.com/imge8/26/e826845b193d0c0369229d76ebae73a9/pa/JX24929_305a6a0aae362538ab60386890f0133a.jpg',
                'https://img-pa.auto1.com/imge8/26/e826845b193d0c0369229d76ebae73a9/pa/JX24929_8181f72d71be136449318746e2759368.jpg',
                'https://img-pa.auto1.com/imge8/26/e826845b193d0c0369229d76ebae73a9/pa/JX24929_9781e82dff0926f40b543b0d5b466022.jpg',
                'https://img-pa.auto1.com/imge8/26/e826845b193d0c0369229d76ebae73a9/pa/JX24929_24fece996195d6282f1898842e4a6e47.jpg',
                'https://img-pa.auto1.com/imge8/26/e826845b193d0c0369229d76ebae73a9/pa/JX24929_ee56cac456d69b377d321d42ab1e984d.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0456157c-5e46-5233-9b30-29463aaf3359/0456157c-5e46-5233-9b30-29463aaf3359_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94572,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/26/e826845b193d0c0369229d76ebae73a9/pa/JX24929_4aefc1042cfac7f27f575ffa39952eda.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0456157c-5e46-5233-9b30-29463aaf3359/0456157c-5e46-5233-9b30-29463aaf3359_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91485,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/26/e826845b193d0c0369229d76ebae73a9/pa/JX24929_1eedc7dbc756088b9cc4407b8693ae1d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0456157c-5e46-5233-9b30-29463aaf3359/0456157c-5e46-5233-9b30-29463aaf3359_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86395,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/26/e826845b193d0c0369229d76ebae73a9/pa/JX24929_c107aa9507ed0ae4460e2e740aeaa8e6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0456157c-5e46-5233-9b30-29463aaf3359/0456157c-5e46-5233-9b30-29463aaf3359_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80353,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/26/e826845b193d0c0369229d76ebae73a9/pa/JX24929_645277802914c946a75afe3f88f96ebe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0456157c-5e46-5233-9b30-29463aaf3359/0456157c-5e46-5233-9b30-29463aaf3359_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75756,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/26/e826845b193d0c0369229d76ebae73a9/pa/JX24929_c44d3989d3f62495ed57bb041d1a675b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0456157c-5e46-5233-9b30-29463aaf3359/0456157c-5e46-5233-9b30-29463aaf3359_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93387,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/26/e826845b193d0c0369229d76ebae73a9/pa/JX24929_794e37ee05252cf1644672990551fe2e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0456157c-5e46-5233-9b30-29463aaf3359/0456157c-5e46-5233-9b30-29463aaf3359_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2894701,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/26/e826845b193d0c0369229d76ebae73a9/pa/JX24929_dd558c8dfc4ce77158b2abc94585ce8d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0456157c-5e46-5233-9b30-29463aaf3359/0456157c-5e46-5233-9b30-29463aaf3359_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83993,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/26/e826845b193d0c0369229d76ebae73a9/pa/JX24929_5e0a6620f06738c413b2e58b0adcd233.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0456157c-5e46-5233-9b30-29463aaf3359/0456157c-5e46-5233-9b30-29463aaf3359_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91137,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/26/e826845b193d0c0369229d76ebae73a9/pa/JX24929_32c04daebd4c8a0f5c7c6dd7f5f9ed93.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0456157c-5e46-5233-9b30-29463aaf3359/0456157c-5e46-5233-9b30-29463aaf3359_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2916448,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/26/e826845b193d0c0369229d76ebae73a9/pa/JX24929_91b1c3394894a98f6277929c3dfd6379.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0456157c-5e46-5233-9b30-29463aaf3359/0456157c-5e46-5233-9b30-29463aaf3359_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60758,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/26/e826845b193d0c0369229d76ebae73a9/pa/JX24929_305a6a0aae362538ab60386890f0133a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0456157c-5e46-5233-9b30-29463aaf3359/0456157c-5e46-5233-9b30-29463aaf3359_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2879103,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/26/e826845b193d0c0369229d76ebae73a9/pa/JX24929_8181f72d71be136449318746e2759368.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0456157c-5e46-5233-9b30-29463aaf3359/0456157c-5e46-5233-9b30-29463aaf3359_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63425,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/26/e826845b193d0c0369229d76ebae73a9/pa/JX24929_9781e82dff0926f40b543b0d5b466022.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0456157c-5e46-5233-9b30-29463aaf3359/0456157c-5e46-5233-9b30-29463aaf3359_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2919255,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/26/e826845b193d0c0369229d76ebae73a9/pa/JX24929_24fece996195d6282f1898842e4a6e47.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0456157c-5e46-5233-9b30-29463aaf3359/0456157c-5e46-5233-9b30-29463aaf3359_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99097,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/26/e826845b193d0c0369229d76ebae73a9/pa/JX24929_ee56cac456d69b377d321d42ab1e984d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-06-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Juke 1.0 DIG-T N-Connecta',
 'transmission': 'manual',
 'trim': 'N-Connecta',
 'year': 2021}
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JX24929%27 HTTP/1.1" 200 None
2026-01-28 20:00:52 [auto1.it] INFO: Saving data for JX24929: {'created_time': 1769630452.598857, 'last_price_update_time': 1769630452.59887, 'auction_closing_time': 1769703940.0}
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JX24929') HTTP/1.1" 204 0
2026-01-28 20:00:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 33faea0f-7631-5e73-9aed-f0d0e76badba with identifier: LU91869
2026-01-28 20:00:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 33faea0f-7631-5e73-9aed-f0d0e76badba with identifier: LU91869
2026-01-28 20:00:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 33faea0f-7631-5e73-9aed-f0d0e76badba with identifier: LU91869 to the API
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:00:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LU91869>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '2.0L',
 'engine_horse_power': 258,
 'expiration_date': '2026-01-29T16:54:37Z',
 'fuel_type': 'petrol',
 'id': '33faea0f-7631-5e73-9aed-f0d0e76badba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LU91869',
 'listing': 'auction',
 'location': 'IT, Reggio Emilia',
 'make': 'BMW',
 'model': 'Z4',
 'odometer': 50402,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img4a/a5/4aa578b8ee6ab8e538ebf823da90417d/pa/LU91869_93b438f3b21b324ce9f77e95d3835e4d.jpg',
                'https://img-pa.auto1.com/img4a/a5/4aa578b8ee6ab8e538ebf823da90417d/pa/LU91869_b5e6fc5db5ccf6a3090254dc9a231227.jpg',
                'https://img-pa.auto1.com/img4a/a5/4aa578b8ee6ab8e538ebf823da90417d/pa/LU91869_3ce5762684ffd57d8c8dd5238cec8917.jpg',
                'https://img-pa.auto1.com/img4a/a5/4aa578b8ee6ab8e538ebf823da90417d/pa/LU91869_293cde1063a7d111dd6674ac0181e2f2.jpg',
                'https://img-pa.auto1.com/img4a/a5/4aa578b8ee6ab8e538ebf823da90417d/pa/LU91869_ef240df3a68f18b6f5a66550fa0bd8eb.jpg',
                'https://img-pa.auto1.com/img4a/a5/4aa578b8ee6ab8e538ebf823da90417d/pa/LU91869_1550a6dfa43dfe58a1595090ed6e96ad.jpg',
                'https://img-pa.auto1.com/img4a/a5/4aa578b8ee6ab8e538ebf823da90417d/pa/LU91869_79202a5ee3613e6553d9372311de6c76.jpg',
                'https://img-pa.auto1.com/img4a/a5/4aa578b8ee6ab8e538ebf823da90417d/pa/LU91869_c508a61c182abc0dcb93c219b356de30.jpg',
                'https://img-pa.auto1.com/img4a/a5/4aa578b8ee6ab8e538ebf823da90417d/pa/LU91869_8238258a74bc166137b6844ccbd3aaf0.jpg',
                'https://img-pa.auto1.com/img4a/a5/4aa578b8ee6ab8e538ebf823da90417d/pa/LU91869_d415ceb4aa76e212789518fabec9d8d5.jpg',
                'https://img-pa.auto1.com/img4a/a5/4aa578b8ee6ab8e538ebf823da90417d/pa/LU91869_0b96cf7e50d8178f5038dc58a1dfde30.jpg',
                'https://img-pa.auto1.com/img4a/a5/4aa578b8ee6ab8e538ebf823da90417d/pa/LU91869_5f737855fcae2ec2365f8f30bb6cac40.jpg',
                'https://img-pa.auto1.com/img4a/a5/4aa578b8ee6ab8e538ebf823da90417d/pa/LU91869_dbeaff54bf6ae76fd040790bd3ef6161.jpg',
                'https://img-pa.auto1.com/img4a/a5/4aa578b8ee6ab8e538ebf823da90417d/pa/LU91869_46d89b40e54b9794ce20c31088bcd78d.jpg',
                'https://img-pa.auto1.com/img4a/a5/4aa578b8ee6ab8e538ebf823da90417d/pa/LU91869_1fbd83af15879d678cf0cba4a54d8960.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33faea0f-7631-5e73-9aed-f0d0e76badba/33faea0f-7631-5e73-9aed-f0d0e76badba_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2931144,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/a5/4aa578b8ee6ab8e538ebf823da90417d/pa/LU91869_93b438f3b21b324ce9f77e95d3835e4d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33faea0f-7631-5e73-9aed-f0d0e76badba/33faea0f-7631-5e73-9aed-f0d0e76badba_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2920616,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/a5/4aa578b8ee6ab8e538ebf823da90417d/pa/LU91869_b5e6fc5db5ccf6a3090254dc9a231227.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33faea0f-7631-5e73-9aed-f0d0e76badba/33faea0f-7631-5e73-9aed-f0d0e76badba_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2860253,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/a5/4aa578b8ee6ab8e538ebf823da90417d/pa/LU91869_3ce5762684ffd57d8c8dd5238cec8917.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33faea0f-7631-5e73-9aed-f0d0e76badba/33faea0f-7631-5e73-9aed-f0d0e76badba_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2810450,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/a5/4aa578b8ee6ab8e538ebf823da90417d/pa/LU91869_293cde1063a7d111dd6674ac0181e2f2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33faea0f-7631-5e73-9aed-f0d0e76badba/33faea0f-7631-5e73-9aed-f0d0e76badba_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2858530,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/a5/4aa578b8ee6ab8e538ebf823da90417d/pa/LU91869_ef240df3a68f18b6f5a66550fa0bd8eb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33faea0f-7631-5e73-9aed-f0d0e76badba/33faea0f-7631-5e73-9aed-f0d0e76badba_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2950826,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/a5/4aa578b8ee6ab8e538ebf823da90417d/pa/LU91869_1550a6dfa43dfe58a1595090ed6e96ad.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33faea0f-7631-5e73-9aed-f0d0e76badba/33faea0f-7631-5e73-9aed-f0d0e76badba_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2906614,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/a5/4aa578b8ee6ab8e538ebf823da90417d/pa/LU91869_79202a5ee3613e6553d9372311de6c76.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33faea0f-7631-5e73-9aed-f0d0e76badba/33faea0f-7631-5e73-9aed-f0d0e76badba_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2928446,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/a5/4aa578b8ee6ab8e538ebf823da90417d/pa/LU91869_c508a61c182abc0dcb93c219b356de30.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33faea0f-7631-5e73-9aed-f0d0e76badba/33faea0f-7631-5e73-9aed-f0d0e76badba_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2931312,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/a5/4aa578b8ee6ab8e538ebf823da90417d/pa/LU91869_8238258a74bc166137b6844ccbd3aaf0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33faea0f-7631-5e73-9aed-f0d0e76badba/33faea0f-7631-5e73-9aed-f0d0e76badba_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2922308,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/a5/4aa578b8ee6ab8e538ebf823da90417d/pa/LU91869_d415ceb4aa76e212789518fabec9d8d5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33faea0f-7631-5e73-9aed-f0d0e76badba/33faea0f-7631-5e73-9aed-f0d0e76badba_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3061130,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/a5/4aa578b8ee6ab8e538ebf823da90417d/pa/LU91869_0b96cf7e50d8178f5038dc58a1dfde30.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33faea0f-7631-5e73-9aed-f0d0e76badba/33faea0f-7631-5e73-9aed-f0d0e76badba_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3036158,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/a5/4aa578b8ee6ab8e538ebf823da90417d/pa/LU91869_5f737855fcae2ec2365f8f30bb6cac40.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33faea0f-7631-5e73-9aed-f0d0e76badba/33faea0f-7631-5e73-9aed-f0d0e76badba_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68364,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/a5/4aa578b8ee6ab8e538ebf823da90417d/pa/LU91869_dbeaff54bf6ae76fd040790bd3ef6161.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33faea0f-7631-5e73-9aed-f0d0e76badba/33faea0f-7631-5e73-9aed-f0d0e76badba_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2452793,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/a5/4aa578b8ee6ab8e538ebf823da90417d/pa/LU91869_46d89b40e54b9794ce20c31088bcd78d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33faea0f-7631-5e73-9aed-f0d0e76badba/33faea0f-7631-5e73-9aed-f0d0e76badba_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38865,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/a5/4aa578b8ee6ab8e538ebf823da90417d/pa/LU91869_1fbd83af15879d678cf0cba4a54d8960.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-02-11',
 'seats_number': 2,
 'seller_name': None,
 'title': 'BMW Z4 sDrive 30i M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2019}
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LU91869%27 HTTP/1.1" 200 None
2026-01-28 20:00:53 [auto1.it] INFO: Saving data for LU91869: {'created_time': 1769630453.043176, 'last_price_update_time': 1769630453.043191, 'auction_closing_time': 1769705677.0}
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LU91869') HTTP/1.1" 204 0
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F52%252F265278f2bef552d5057c2293e62259ec%252Fpa%252FVP25370_cef630487eae6b67a5a0a7955dcb1d8e.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/52/265278f2bef552d5057c2293e62259ec/pa/VP25370_cef630487eae6b67a5a0a7955dcb1d8e.jpg not downloaded yet
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252Fa6%252F27a657fee4c38facf349d22de315ad81%252Fpa%252FDJ22210_ac8e09de710cebb7cb2bf30d90bb5997.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/a6/27a657fee4c38facf349d22de315ad81/pa/DJ22210_ac8e09de710cebb7cb2bf30d90bb5997.jpg not downloaded yet
2026-01-28 20:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZG67214/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RD52267/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:00:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c26857a-129d-57a4-aed2-b5f943beb006 with identifier: WR27841
2026-01-28 20:00:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c26857a-129d-57a4-aed2-b5f943beb006 with scrape type 1
2026-01-28 20:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 14 photos for item 2c26857a-129d-57a4-aed2-b5f943beb006
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fc3%252F01c32690846ab59b6aee6ff29273b63b%252Fpa%252FWR27841_3d9ad56c30d5760083caaa3b9b75318b.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/c3/01c32690846ab59b6aee6ff29273b63b/pa/WR27841_3d9ad56c30d5760083caaa3b9b75318b.jpg already downloaded
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fc3%252F01c32690846ab59b6aee6ff29273b63b%252Fpa%252FWR27841_3d2c2450d8522853c690e248b55fc563.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/c3/01c32690846ab59b6aee6ff29273b63b/pa/WR27841_3d2c2450d8522853c690e248b55fc563.jpg already downloaded
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fc3%252F01c32690846ab59b6aee6ff29273b63b%252Fpa%252FWR27841_08761e11d45ecbeae9703bef06c9f81d.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/c3/01c32690846ab59b6aee6ff29273b63b/pa/WR27841_08761e11d45ecbeae9703bef06c9f81d.jpg already downloaded
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fc3%252F01c32690846ab59b6aee6ff29273b63b%252Fpa%252FWR27841_d31480687973cfcb88e13a38bed5d6d1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/c3/01c32690846ab59b6aee6ff29273b63b/pa/WR27841_d31480687973cfcb88e13a38bed5d6d1.jpg already downloaded
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fc3%252F01c32690846ab59b6aee6ff29273b63b%252Fpa%252FWR27841_4565fb2f88e3866412c37327fd3fd775.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/c3/01c32690846ab59b6aee6ff29273b63b/pa/WR27841_4565fb2f88e3866412c37327fd3fd775.jpg already downloaded
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fc3%252F01c32690846ab59b6aee6ff29273b63b%252Fpa%252FWR27841_681edc980a11bd40c98cb84650caeaf2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/c3/01c32690846ab59b6aee6ff29273b63b/pa/WR27841_681edc980a11bd40c98cb84650caeaf2.jpg already downloaded
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fc3%252F01c32690846ab59b6aee6ff29273b63b%252Fpa%252FWR27841_5cb0a4fbbc12ed28fba6d8546bb23506.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/c3/01c32690846ab59b6aee6ff29273b63b/pa/WR27841_5cb0a4fbbc12ed28fba6d8546bb23506.jpg already downloaded
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fc3%252F01c32690846ab59b6aee6ff29273b63b%252Fpa%252FWR27841_efc606751b393a23fded762584248f43.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/c3/01c32690846ab59b6aee6ff29273b63b/pa/WR27841_efc606751b393a23fded762584248f43.jpg already downloaded
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fc3%252F01c32690846ab59b6aee6ff29273b63b%252Fpa%252FWR27841_7ad84c5dbb2675ce44f7e6dba0715f47.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/c3/01c32690846ab59b6aee6ff29273b63b/pa/WR27841_7ad84c5dbb2675ce44f7e6dba0715f47.jpg already downloaded
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fc3%252F01c32690846ab59b6aee6ff29273b63b%252Fpa%252FWR27841_79b4e1f40c27a1c9fec0506404449909.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/c3/01c32690846ab59b6aee6ff29273b63b/pa/WR27841_79b4e1f40c27a1c9fec0506404449909.jpg already downloaded
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fc3%252F01c32690846ab59b6aee6ff29273b63b%252Fpa%252FWR27841_95441032988926568dd170a958b60504.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/c3/01c32690846ab59b6aee6ff29273b63b/pa/WR27841_95441032988926568dd170a958b60504.jpg already downloaded
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fc3%252F01c32690846ab59b6aee6ff29273b63b%252Fpa%252FWR27841_0798b871f63e14aabf6594d40cf11cd3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/c3/01c32690846ab59b6aee6ff29273b63b/pa/WR27841_0798b871f63e14aabf6594d40cf11cd3.jpg already downloaded
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fc3%252F01c32690846ab59b6aee6ff29273b63b%252Fpa%252FWR27841_5d62d6ebf950fe97685869fa9e47e543.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/c3/01c32690846ab59b6aee6ff29273b63b/pa/WR27841_5d62d6ebf950fe97685869fa9e47e543.jpg already downloaded
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fc3%252F01c32690846ab59b6aee6ff29273b63b%252Fpa%252FWR27841_dd9a1b5e1673e92830399281729bec54.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/c3/01c32690846ab59b6aee6ff29273b63b/pa/WR27841_dd9a1b5e1673e92830399281729bec54.jpg already downloaded
2026-01-28 20:00:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2c26857a-129d-57a4-aed2-b5f943beb006, identifier: WR27841
2026-01-28 20:00:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bcac54e6-4a4a-5b26-b2ee-2a3c007937d7 with identifier: RX31393
2026-01-28 20:00:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bcac54e6-4a4a-5b26-b2ee-2a3c007937d7 with scrape type 2
2026-01-28 20:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bcac54e6-4a4a-5b26-b2ee-2a3c007937d7 with scrape type 2
2026-01-28 20:00:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: bcac54e6-4a4a-5b26-b2ee-2a3c007937d7, identifier: RX31393
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F52%252F265278f2bef552d5057c2293e62259ec%252Fpa%252FVP25370_7ae6085fc949de64f2f3a7101d9ffcc7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/52/265278f2bef552d5057c2293e62259ec/pa/VP25370_7ae6085fc949de64f2f3a7101d9ffcc7.jpg not downloaded yet
2026-01-28 20:00:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:00:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:00:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2c26857a-129d-57a4-aed2-b5f943beb006 with identifier: WR27841
2026-01-28 20:00:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2c26857a-129d-57a4-aed2-b5f943beb006 with identifier: WR27841
2026-01-28 20:00:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2c26857a-129d-57a4-aed2-b5f943beb006 with identifier: WR27841 to the API
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:00:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WR27841>
{'auction_title': '',
 'c_o_2_emission_value': 227,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 245,
 'expiration_date': '2026-01-29T16:20:32Z',
 'fuel_type': 'petrol',
 'id': '2c26857a-129d-57a4-aed2-b5f943beb006',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WR27841',
 'listing': 'auction',
 'location': 'IT',
 'make': 'Porsche',
 'model': 'Macan',
 'odometer': 73039,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 14,
 'photo_urls': ['https://img-pa.auto1.com/img01/c3/01c32690846ab59b6aee6ff29273b63b/pa/WR27841_3d9ad56c30d5760083caaa3b9b75318b.jpg',
                'https://img-pa.auto1.com/img01/c3/01c32690846ab59b6aee6ff29273b63b/pa/WR27841_3d2c2450d8522853c690e248b55fc563.jpg',
                'https://img-pa.auto1.com/img01/c3/01c32690846ab59b6aee6ff29273b63b/pa/WR27841_08761e11d45ecbeae9703bef06c9f81d.jpg',
                'https://img-pa.auto1.com/img01/c3/01c32690846ab59b6aee6ff29273b63b/pa/WR27841_d31480687973cfcb88e13a38bed5d6d1.jpg',
                'https://img-pa.auto1.com/img01/c3/01c32690846ab59b6aee6ff29273b63b/pa/WR27841_4565fb2f88e3866412c37327fd3fd775.jpg',
                'https://img-pa.auto1.com/img01/c3/01c32690846ab59b6aee6ff29273b63b/pa/WR27841_681edc980a11bd40c98cb84650caeaf2.jpg',
                'https://img-pa.auto1.com/img01/c3/01c32690846ab59b6aee6ff29273b63b/pa/WR27841_5cb0a4fbbc12ed28fba6d8546bb23506.jpg',
                'https://img-pa.auto1.com/img01/c3/01c32690846ab59b6aee6ff29273b63b/pa/WR27841_efc606751b393a23fded762584248f43.jpg',
                'https://img-pa.auto1.com/img01/c3/01c32690846ab59b6aee6ff29273b63b/pa/WR27841_7ad84c5dbb2675ce44f7e6dba0715f47.jpg',
                'https://img-pa.auto1.com/img01/c3/01c32690846ab59b6aee6ff29273b63b/pa/WR27841_79b4e1f40c27a1c9fec0506404449909.jpg',
                'https://img-pa.auto1.com/img01/c3/01c32690846ab59b6aee6ff29273b63b/pa/WR27841_95441032988926568dd170a958b60504.jpg',
                'https://img-pa.auto1.com/img01/c3/01c32690846ab59b6aee6ff29273b63b/pa/WR27841_0798b871f63e14aabf6594d40cf11cd3.jpg',
                'https://img-pa.auto1.com/img01/c3/01c32690846ab59b6aee6ff29273b63b/pa/WR27841_5d62d6ebf950fe97685869fa9e47e543.jpg',
                'https://img-pa.auto1.com/img01/c3/01c32690846ab59b6aee6ff29273b63b/pa/WR27841_dd9a1b5e1673e92830399281729bec54.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c26857a-129d-57a4-aed2-b5f943beb006/2c26857a-129d-57a4-aed2-b5f943beb006_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 5716873,
             'Height': 3000,
             'OriginUrl': 'https://img-pa.auto1.com/img01/c3/01c32690846ab59b6aee6ff29273b63b/pa/WR27841_3d9ad56c30d5760083caaa3b9b75318b.jpg',
             'Width': 4000},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c26857a-129d-57a4-aed2-b5f943beb006/2c26857a-129d-57a4-aed2-b5f943beb006_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 5716873,
             'Height': 3000,
             'OriginUrl': 'https://img-pa.auto1.com/img01/c3/01c32690846ab59b6aee6ff29273b63b/pa/WR27841_3d2c2450d8522853c690e248b55fc563.jpg',
             'Width': 4000},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c26857a-129d-57a4-aed2-b5f943beb006/2c26857a-129d-57a4-aed2-b5f943beb006_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 4637296,
             'Height': 3000,
             'OriginUrl': 'https://img-pa.auto1.com/img01/c3/01c32690846ab59b6aee6ff29273b63b/pa/WR27841_08761e11d45ecbeae9703bef06c9f81d.jpg',
             'Width': 4000},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c26857a-129d-57a4-aed2-b5f943beb006/2c26857a-129d-57a4-aed2-b5f943beb006_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 5609205,
             'Height': 3000,
             'OriginUrl': 'https://img-pa.auto1.com/img01/c3/01c32690846ab59b6aee6ff29273b63b/pa/WR27841_d31480687973cfcb88e13a38bed5d6d1.jpg',
             'Width': 4000},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c26857a-129d-57a4-aed2-b5f943beb006/2c26857a-129d-57a4-aed2-b5f943beb006_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 5103266,
             'Height': 3000,
             'OriginUrl': 'https://img-pa.auto1.com/img01/c3/01c32690846ab59b6aee6ff29273b63b/pa/WR27841_4565fb2f88e3866412c37327fd3fd775.jpg',
             'Width': 4000},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c26857a-129d-57a4-aed2-b5f943beb006/2c26857a-129d-57a4-aed2-b5f943beb006_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 5044779,
             'Height': 3000,
             'OriginUrl': 'https://img-pa.auto1.com/img01/c3/01c32690846ab59b6aee6ff29273b63b/pa/WR27841_681edc980a11bd40c98cb84650caeaf2.jpg',
             'Width': 4000},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c26857a-129d-57a4-aed2-b5f943beb006/2c26857a-129d-57a4-aed2-b5f943beb006_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 5420196,
             'Height': 3000,
             'OriginUrl': 'https://img-pa.auto1.com/img01/c3/01c32690846ab59b6aee6ff29273b63b/pa/WR27841_5cb0a4fbbc12ed28fba6d8546bb23506.jpg',
             'Width': 4000},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c26857a-129d-57a4-aed2-b5f943beb006/2c26857a-129d-57a4-aed2-b5f943beb006_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 4861381,
             'Height': 3000,
             'OriginUrl': 'https://img-pa.auto1.com/img01/c3/01c32690846ab59b6aee6ff29273b63b/pa/WR27841_efc606751b393a23fded762584248f43.jpg',
             'Width': 4000},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c26857a-129d-57a4-aed2-b5f943beb006/2c26857a-129d-57a4-aed2-b5f943beb006_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 4556027,
             'Height': 3000,
             'OriginUrl': 'https://img-pa.auto1.com/img01/c3/01c32690846ab59b6aee6ff29273b63b/pa/WR27841_7ad84c5dbb2675ce44f7e6dba0715f47.jpg',
             'Width': 4000},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c26857a-129d-57a4-aed2-b5f943beb006/2c26857a-129d-57a4-aed2-b5f943beb006_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 4665698,
             'Height': 3000,
             'OriginUrl': 'https://img-pa.auto1.com/img01/c3/01c32690846ab59b6aee6ff29273b63b/pa/WR27841_79b4e1f40c27a1c9fec0506404449909.jpg',
             'Width': 4000},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c26857a-129d-57a4-aed2-b5f943beb006/2c26857a-129d-57a4-aed2-b5f943beb006_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 4542132,
             'Height': 3000,
             'OriginUrl': 'https://img-pa.auto1.com/img01/c3/01c32690846ab59b6aee6ff29273b63b/pa/WR27841_95441032988926568dd170a958b60504.jpg',
             'Width': 4000},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c26857a-129d-57a4-aed2-b5f943beb006/2c26857a-129d-57a4-aed2-b5f943beb006_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3146514,
             'Height': 3000,
             'OriginUrl': 'https://img-pa.auto1.com/img01/c3/01c32690846ab59b6aee6ff29273b63b/pa/WR27841_0798b871f63e14aabf6594d40cf11cd3.jpg',
             'Width': 4000},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c26857a-129d-57a4-aed2-b5f943beb006/2c26857a-129d-57a4-aed2-b5f943beb006_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3905932,
             'Height': 3000,
             'OriginUrl': 'https://img-pa.auto1.com/img01/c3/01c32690846ab59b6aee6ff29273b63b/pa/WR27841_5d62d6ebf950fe97685869fa9e47e543.jpg',
             'Width': 4000},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c26857a-129d-57a4-aed2-b5f943beb006/2c26857a-129d-57a4-aed2-b5f943beb006_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 4145647,
             'Height': 3000,
             'OriginUrl': 'https://img-pa.auto1.com/img01/c3/01c32690846ab59b6aee6ff29273b63b/pa/WR27841_dd9a1b5e1673e92830399281729bec54.jpg',
             'Width': 4000}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-12-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Porsche Macan Basis',
 'transmission': 'automatic',
 'trim': '',
 'year': 2018}
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WR27841%27 HTTP/1.1" 200 None
2026-01-28 20:00:53 [auto1.it] INFO: Saving data for WR27841: {'created_time': 1769630453.999101, 'last_price_update_time': 1769630453.999111, 'auction_closing_time': 1769703632.0}
2026-01-28 20:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WR27841') HTTP/1.1" 204 0
2026-01-28 20:00:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: bcac54e6-4a4a-5b26-b2ee-2a3c007937d7 with identifier: RX31393
2026-01-28 20:00:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: bcac54e6-4a4a-5b26-b2ee-2a3c007937d7 with identifier: RX31393
2026-01-28 20:00:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: bcac54e6-4a4a-5b26-b2ee-2a3c007937d7 with identifier: RX31393 to the API
2026-01-28 20:00:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:00:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:00:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RX31393>
{'auction_title': '',
 'c_o_2_emission_value': 146,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:10:31Z',
 'fuel_type': 'diesel',
 'id': 'bcac54e6-4a4a-5b26-b2ee-2a3c007937d7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RX31393',
 'listing': 'auction',
 'location': 'IT, Bentivoglio (BO)',
 'make': 'Seat',
 'model': 'Tarraco',
 'odometer': 50270,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-04-26',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Seat Tarraco 2.0 TDI FR',
 'transmission': 'automatic',
 'trim': 'FR',
 'year': 2023}
2026-01-28 20:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RX31393%27 HTTP/1.1" 200 None
2026-01-28 20:00:54 [auto1.it] INFO: Saving data for RX31393: {'auction_closing_time': 1769703031.0, 'created_time': 1767693762.300912, 'last_price_update_time': 1769630454.999642}
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RX31393') HTTP/1.1" 204 0
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252Fa6%252F27a657fee4c38facf349d22de315ad81%252Fpa%252FDJ22210_b1add6775a0ac1f0194239ca8673d9c1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/a6/27a657fee4c38facf349d22de315ad81/pa/DJ22210_b1add6775a0ac1f0194239ca8673d9c1.jpg not downloaded yet
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F52%252F265278f2bef552d5057c2293e62259ec%252Fpa%252FVP25370_13a8b1a6ea2218aeade93584634a52f7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/52/265278f2bef552d5057c2293e62259ec/pa/VP25370_13a8b1a6ea2218aeade93584634a52f7.jpg not downloaded yet
2026-01-28 20:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DT01319/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252Fa6%252F27a657fee4c38facf349d22de315ad81%252Fpa%252FDJ22210_860b41f9228b41f1d236804371f4d584.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/a6/27a657fee4c38facf349d22de315ad81/pa/DJ22210_860b41f9228b41f1d236804371f4d584.jpg not downloaded yet
2026-01-28 20:00:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F52%252F265278f2bef552d5057c2293e62259ec%252Fpa%252FVP25370_4a1f6abd760e56d0f6d294851824b664.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/52/265278f2bef552d5057c2293e62259ec/pa/VP25370_4a1f6abd760e56d0f6d294851824b664.jpg not downloaded yet
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252Fa6%252F27a657fee4c38facf349d22de315ad81%252Fpa%252FDJ22210_1951b2dde5ee0d84f60ee58c7fed5528.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/a6/27a657fee4c38facf349d22de315ad81/pa/DJ22210_1951b2dde5ee0d84f60ee58c7fed5528.jpg not downloaded yet
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F52%252F265278f2bef552d5057c2293e62259ec%252Fpa%252FVP25370_532fa6ebe0065f087ce41ffb856d7178.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/52/265278f2bef552d5057c2293e62259ec/pa/VP25370_532fa6ebe0065f087ce41ffb856d7178.jpg not downloaded yet
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252Fa6%252F27a657fee4c38facf349d22de315ad81%252Fpa%252FDJ22210_2cc48d3de482b5f54f13a404e6d982c3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/a6/27a657fee4c38facf349d22de315ad81/pa/DJ22210_2cc48d3de482b5f54f13a404e6d982c3.jpg not downloaded yet
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F52%252F265278f2bef552d5057c2293e62259ec%252Fpa%252FVP25370_877c875e691a261dcd823c8c3b0b2b8c.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/52/265278f2bef552d5057c2293e62259ec/pa/VP25370_877c875e691a261dcd823c8c3b0b2b8c.jpg not downloaded yet
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252Fa6%252F27a657fee4c38facf349d22de315ad81%252Fpa%252FDJ22210_8f8b295f1b305e052decf49ae3b777e1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/a6/27a657fee4c38facf349d22de315ad81/pa/DJ22210_8f8b295f1b305e052decf49ae3b777e1.jpg not downloaded yet
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F52%252F265278f2bef552d5057c2293e62259ec%252Fpa%252FVP25370_acfe9f3b5878fd56961e8143073f4f42.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/52/265278f2bef552d5057c2293e62259ec/pa/VP25370_acfe9f3b5878fd56961e8143073f4f42.jpg not downloaded yet
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252Fa6%252F27a657fee4c38facf349d22de315ad81%252Fpa%252FDJ22210_b169544b95f9f50840b1952150fc64e5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/a6/27a657fee4c38facf349d22de315ad81/pa/DJ22210_b169544b95f9f50840b1952150fc64e5.jpg not downloaded yet
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F52%252F265278f2bef552d5057c2293e62259ec%252Fpa%252FVP25370_e645300d98e44f48b4f58d06f5cc1b03.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/52/265278f2bef552d5057c2293e62259ec/pa/VP25370_e645300d98e44f48b4f58d06f5cc1b03.jpg not downloaded yet
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252Fa6%252F27a657fee4c38facf349d22de315ad81%252Fpa%252FDJ22210_2dbd1ac3f3fc4b34aea2971653241d55.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/a6/27a657fee4c38facf349d22de315ad81/pa/DJ22210_2dbd1ac3f3fc4b34aea2971653241d55.jpg not downloaded yet
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F52%252F265278f2bef552d5057c2293e62259ec%252Fpa%252FVP25370_825fc72eb9671996a5703a3bf7fec756.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/52/265278f2bef552d5057c2293e62259ec/pa/VP25370_825fc72eb9671996a5703a3bf7fec756.jpg not downloaded yet
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252Fa6%252F27a657fee4c38facf349d22de315ad81%252Fpa%252FDJ22210_84590d3e74fda22927037ac14b4750e2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/a6/27a657fee4c38facf349d22de315ad81/pa/DJ22210_84590d3e74fda22927037ac14b4750e2.jpg not downloaded yet
2026-01-28 20:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/52/265278f2bef552d5057c2293e62259ec/pa/VP25370_6334ec9fd14f4db6d94965152a8caae2.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/52/265278f2bef552d5057c2293e62259ec/pa/VP25370_925f2117809b5dc69a3e5774f88324b6.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252Fa6%252F27a657fee4c38facf349d22de315ad81%252Fpa%252FDJ22210_fe407c5608223d3a52d7ba3787172781.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/a6/27a657fee4c38facf349d22de315ad81/pa/DJ22210_fe407c5608223d3a52d7ba3787172781.jpg not downloaded yet
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252Fa6%252F27a657fee4c38facf349d22de315ad81%252Fpa%252FDJ22210_b42d4b601783960f8a82db062c0fb5e5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/a6/27a657fee4c38facf349d22de315ad81/pa/DJ22210_b42d4b601783960f8a82db062c0fb5e5.jpg not downloaded yet
2026-01-28 20:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/52/265278f2bef552d5057c2293e62259ec/pa/VP25370_cd9a55e4161699c14fe1880718aaed03.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/a6/27a657fee4c38facf349d22de315ad81/pa/DJ22210_84590d3e74fda22927037ac14b4750e2.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HE46295/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:00:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/52/265278f2bef552d5057c2293e62259ec/pa/VP25370_36080cd7e735b14c341bcf02ffe429af.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/52/265278f2bef552d5057c2293e62259ec/pa/VP25370_13a8b1a6ea2218aeade93584634a52f7.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:00:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:00:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:00:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:00:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09d75ad0>
2026-01-28 20:00:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:00:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_191bba90-0f82-54b1-88fa-cbe17ff9a5a0/191bba90-0f82-54b1-88fa-cbe17ff9a5a0_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F52%252F265278f2bef552d5057c2293e62259ec%252Fpa%252FVP25370_6334ec9fd14f4db6d94965152a8caae2.jpg') HTTP/1.1" 204 0
2026-01-28 20:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/52/265278f2bef552d5057c2293e62259ec/pa/VP25370_6334ec9fd14f4db6d94965152a8caae2.jpg saved to cache
2026-01-28 20:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 191bba90-0f82-54b1-88fa-cbe17ff9a5a0
2026-01-28 20:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/52/265278f2bef552d5057c2293e62259ec/pa/VP25370_825fc72eb9671996a5703a3bf7fec756.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/a6/27a657fee4c38facf349d22de315ad81/pa/DJ22210_b42d4b601783960f8a82db062c0fb5e5.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/52/265278f2bef552d5057c2293e62259ec/pa/VP25370_e645300d98e44f48b4f58d06f5cc1b03.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:00:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:00:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:00:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:00:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09ea8f90>
2026-01-28 20:00:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:00:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_191bba90-0f82-54b1-88fa-cbe17ff9a5a0/191bba90-0f82-54b1-88fa-cbe17ff9a5a0_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F52%252F265278f2bef552d5057c2293e62259ec%252Fpa%252FVP25370_925f2117809b5dc69a3e5774f88324b6.jpg') HTTP/1.1" 204 0
2026-01-28 20:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/52/265278f2bef552d5057c2293e62259ec/pa/VP25370_925f2117809b5dc69a3e5774f88324b6.jpg saved to cache
2026-01-28 20:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 191bba90-0f82-54b1-88fa-cbe17ff9a5a0
2026-01-28 20:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KW99798/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HF12865/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LM18187> (referer: https://www.auto1.com/v1/car-details-view/LM18187/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AW68260/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:00:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GN63531/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:00:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:00:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:00:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:00:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:00:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08cb8890>
2026-01-28 20:00:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:00:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_191bba90-0f82-54b1-88fa-cbe17ff9a5a0/191bba90-0f82-54b1-88fa-cbe17ff9a5a0_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F52%252F265278f2bef552d5057c2293e62259ec%252Fpa%252FVP25370_cd9a55e4161699c14fe1880718aaed03.jpg') HTTP/1.1" 204 0
2026-01-28 20:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/52/265278f2bef552d5057c2293e62259ec/pa/VP25370_cd9a55e4161699c14fe1880718aaed03.jpg saved to cache
2026-01-28 20:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 191bba90-0f82-54b1-88fa-cbe17ff9a5a0
2026-01-28 20:00:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:00:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:00:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:00:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08cc5cd0>
2026-01-28 20:00:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:00:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8aea567-3ec2-586f-8165-3ba50fde04ea/e8aea567-3ec2-586f-8165-3ba50fde04ea_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252Fa6%252F27a657fee4c38facf349d22de315ad81%252Fpa%252FDJ22210_84590d3e74fda22927037ac14b4750e2.jpg') HTTP/1.1" 204 0
2026-01-28 20:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/a6/27a657fee4c38facf349d22de315ad81/pa/DJ22210_84590d3e74fda22927037ac14b4750e2.jpg saved to cache
2026-01-28 20:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item e8aea567-3ec2-586f-8165-3ba50fde04ea
2026-01-28 20:00:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:00:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:00:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:00:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08cbec10>
2026-01-28 20:00:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:00:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:00:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:00:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:00:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:00:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_191bba90-0f82-54b1-88fa-cbe17ff9a5a0/191bba90-0f82-54b1-88fa-cbe17ff9a5a0_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F52%252F265278f2bef552d5057c2293e62259ec%252Fpa%252FVP25370_36080cd7e735b14c341bcf02ffe429af.jpg') HTTP/1.1" 204 0
2026-01-28 20:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/52/265278f2bef552d5057c2293e62259ec/pa/VP25370_36080cd7e735b14c341bcf02ffe429af.jpg saved to cache
2026-01-28 20:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 191bba90-0f82-54b1-88fa-cbe17ff9a5a0
2026-01-28 20:00:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:00:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:00:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:00:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08cd40d0>
2026-01-28 20:00:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:00:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:00:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:00:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:00:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:00:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:00:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_191bba90-0f82-54b1-88fa-cbe17ff9a5a0/191bba90-0f82-54b1-88fa-cbe17ff9a5a0_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F52%252F265278f2bef552d5057c2293e62259ec%252Fpa%252FVP25370_13a8b1a6ea2218aeade93584634a52f7.jpg') HTTP/1.1" 204 0
2026-01-28 20:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/52/265278f2bef552d5057c2293e62259ec/pa/VP25370_13a8b1a6ea2218aeade93584634a52f7.jpg saved to cache
2026-01-28 20:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 191bba90-0f82-54b1-88fa-cbe17ff9a5a0
2026-01-28 20:00:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:00:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:00:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:00:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08cd5c50>
2026-01-28 20:00:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:00:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:00:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:00:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:00:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:00:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:00:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_191bba90-0f82-54b1-88fa-cbe17ff9a5a0/191bba90-0f82-54b1-88fa-cbe17ff9a5a0_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F52%252F265278f2bef552d5057c2293e62259ec%252Fpa%252FVP25370_825fc72eb9671996a5703a3bf7fec756.jpg') HTTP/1.1" 204 0
2026-01-28 20:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/52/265278f2bef552d5057c2293e62259ec/pa/VP25370_825fc72eb9671996a5703a3bf7fec756.jpg saved to cache
2026-01-28 20:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 191bba90-0f82-54b1-88fa-cbe17ff9a5a0
2026-01-28 20:00:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:00:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:00:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:00:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08cd7dd0>
2026-01-28 20:00:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:00:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:00:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:00:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:00:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8aea567-3ec2-586f-8165-3ba50fde04ea/e8aea567-3ec2-586f-8165-3ba50fde04ea_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252Fa6%252F27a657fee4c38facf349d22de315ad81%252Fpa%252FDJ22210_b42d4b601783960f8a82db062c0fb5e5.jpg') HTTP/1.1" 204 0
2026-01-28 20:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/a6/27a657fee4c38facf349d22de315ad81/pa/DJ22210_b42d4b601783960f8a82db062c0fb5e5.jpg saved to cache
2026-01-28 20:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item e8aea567-3ec2-586f-8165-3ba50fde04ea
2026-01-28 20:00:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:00:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:00:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:00:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08ce9510>
2026-01-28 20:00:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:00:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:00:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:00:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:00:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_191bba90-0f82-54b1-88fa-cbe17ff9a5a0/191bba90-0f82-54b1-88fa-cbe17ff9a5a0_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F52%252F265278f2bef552d5057c2293e62259ec%252Fpa%252FVP25370_e645300d98e44f48b4f58d06f5cc1b03.jpg') HTTP/1.1" 204 0
2026-01-28 20:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/52/265278f2bef552d5057c2293e62259ec/pa/VP25370_e645300d98e44f48b4f58d06f5cc1b03.jpg saved to cache
2026-01-28 20:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 191bba90-0f82-54b1-88fa-cbe17ff9a5a0
2026-01-28 20:00:58 [auto1.it] INFO: Parsing search results for channel: 24h
2026-01-28 20:00:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:00:58 [auto1.it] INFO: Found listing with ID: DG14106
2026-01-28 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DG14106%27 HTTP/1.1" 200 None
2026-01-28 20:00:58 [auto1.it] INFO: Scrape type for DG14106: 0
2026-01-28 20:00:58 [auto1.it] INFO: Found listing with ID: HM97674
2026-01-28 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HM97674%27 HTTP/1.1" 200 None
2026-01-28 20:00:58 [auto1.it] INFO: Scrape type for HM97674: 0
2026-01-28 20:00:58 [auto1.it] INFO: Found listing with ID: GY89378
2026-01-28 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GY89378%27 HTTP/1.1" 200 None
2026-01-28 20:00:58 [auto1.it] INFO: Scrape type for GY89378: 0
2026-01-28 20:00:58 [auto1.it] INFO: Found listing with ID: FT66355
2026-01-28 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FT66355%27 HTTP/1.1" 200 None
2026-01-28 20:00:58 [auto1.it] INFO: Scrape type for FT66355: 0
2026-01-28 20:00:58 [auto1.it] INFO: Found listing with ID: UH26467
2026-01-28 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UH26467%27 HTTP/1.1" 200 None
2026-01-28 20:00:58 [auto1.it] INFO: Scrape type for UH26467: 0
2026-01-28 20:00:58 [auto1.it] INFO: Found listing with ID: EH01069
2026-01-28 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EH01069%27 HTTP/1.1" 200 None
2026-01-28 20:00:58 [auto1.it] INFO: Scrape type for EH01069: 0
2026-01-28 20:00:58 [auto1.it] INFO: Found listing with ID: SP36812
2026-01-28 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SP36812%27 HTTP/1.1" 200 None
2026-01-28 20:00:58 [auto1.it] INFO: Scrape type for SP36812: 0
2026-01-28 20:00:58 [auto1.it] INFO: Found listing with ID: ZB40645
2026-01-28 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZB40645%27 HTTP/1.1" 200 None
2026-01-28 20:00:58 [auto1.it] INFO: Scrape type for ZB40645: 0
2026-01-28 20:00:58 [auto1.it] INFO: Found listing with ID: PW41874
2026-01-28 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PW41874%27 HTTP/1.1" 200 None
2026-01-28 20:00:58 [auto1.it] INFO: Scrape type for PW41874: 2
2026-01-28 20:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/52/265278f2bef552d5057c2293e62259ec/pa/VP25370_acfe9f3b5878fd56961e8143073f4f42.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/52/265278f2bef552d5057c2293e62259ec/pa/VP25370_877c875e691a261dcd823c8c3b0b2b8c.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/a6/27a657fee4c38facf349d22de315ad81/pa/DJ22210_8f8b295f1b305e052decf49ae3b777e1.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GD75064> (referer: https://www.auto1.com/v1/car-details-view/GD75064/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:00:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:00:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:00:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f94eb59-79a1-5b19-acdb-80dde67f1f1f with identifier: LM18187
2026-01-28 20:00:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f94eb59-79a1-5b19-acdb-80dde67f1f1f with scrape type 1
2026-01-28 20:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 7f94eb59-79a1-5b19-acdb-80dde67f1f1f
2026-01-28 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F35%252F6c357bcdbe4e3e390bc49d66e1be4a06%252Fpa%252FLM18187_62f019c9ae01ed518a8bec714bc5792b.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/35/6c357bcdbe4e3e390bc49d66e1be4a06/pa/LM18187_62f019c9ae01ed518a8bec714bc5792b.jpg not downloaded yet
2026-01-28 20:00:58 [auto1.it] INFO: Found listing with ID: NB38092
2026-01-28 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NB38092%27 HTTP/1.1" 200 None
2026-01-28 20:00:58 [auto1.it] INFO: Scrape type for NB38092: 0
2026-01-28 20:00:58 [auto1.it] INFO: Found listing with ID: HZ16886
2026-01-28 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HZ16886%27 HTTP/1.1" 200 None
2026-01-28 20:00:58 [auto1.it] INFO: Scrape type for HZ16886: 0
2026-01-28 20:00:58 [auto1.it] INFO: Found listing with ID: MG41952
2026-01-28 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MG41952%27 HTTP/1.1" 200 None
2026-01-28 20:00:58 [auto1.it] INFO: Scrape type for MG41952: 0
2026-01-28 20:00:58 [auto1.it] INFO: Found listing with ID: GM98091
2026-01-28 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GM98091%27 HTTP/1.1" 200 None
2026-01-28 20:00:58 [auto1.it] INFO: Scrape type for GM98091: 0
2026-01-28 20:00:58 [auto1.it] INFO: Found listing with ID: AL67393
2026-01-28 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AL67393%27 HTTP/1.1" 200 None
2026-01-28 20:00:58 [auto1.it] INFO: Scrape type for AL67393: 0
2026-01-28 20:00:58 [auto1.it] INFO: Found listing with ID: TM67998
2026-01-28 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TM67998%27 HTTP/1.1" 200 None
2026-01-28 20:00:58 [auto1.it] INFO: Scrape type for TM67998: 0
2026-01-28 20:00:58 [auto1.it] INFO: Found listing with ID: ZZ39119
2026-01-28 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZZ39119%27 HTTP/1.1" 200 None
2026-01-28 20:00:58 [auto1.it] INFO: Scrape type for ZZ39119: 0
2026-01-28 20:00:58 [auto1.it] INFO: Found listing with ID: EB83930
2026-01-28 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EB83930%27 HTTP/1.1" 200 None
2026-01-28 20:00:58 [auto1.it] INFO: Scrape type for EB83930: 0
2026-01-28 20:00:58 [auto1.it] INFO: Found listing with ID: RZ37041
2026-01-28 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RZ37041%27 HTTP/1.1" 200 None
2026-01-28 20:00:58 [auto1.it] INFO: Scrape type for RZ37041: 0
2026-01-28 20:00:58 [auto1.it] INFO: Found listing with ID: YL53737
2026-01-28 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YL53737%27 HTTP/1.1" 200 None
2026-01-28 20:00:59 [auto1.it] INFO: Scrape type for YL53737: 0
2026-01-28 20:00:59 [auto1.it] INFO: Found listing with ID: LZ25760
2026-01-28 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LZ25760%27 HTTP/1.1" 200 None
2026-01-28 20:00:59 [auto1.it] INFO: Scrape type for LZ25760: 0
2026-01-28 20:00:59 [auto1.it] INFO: Found listing with ID: RX14856
2026-01-28 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RX14856%27 HTTP/1.1" 200 None
2026-01-28 20:00:59 [auto1.it] INFO: Scrape type for RX14856: 0
2026-01-28 20:00:59 [auto1.it] INFO: Found listing with ID: VJ83989
2026-01-28 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VJ83989%27 HTTP/1.1" 200 None
2026-01-28 20:00:59 [auto1.it] INFO: Scrape type for VJ83989: 0
2026-01-28 20:00:59 [auto1.it] INFO: Found listing with ID: RL06920
2026-01-28 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RL06920%27 HTTP/1.1" 200 None
2026-01-28 20:00:59 [auto1.it] INFO: Scrape type for RL06920: 0
2026-01-28 20:00:59 [auto1.it] INFO: Found listing with ID: DL90680
2026-01-28 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DL90680%27 HTTP/1.1" 200 None
2026-01-28 20:00:59 [auto1.it] INFO: Scrape type for DL90680: 0
2026-01-28 20:00:59 [auto1.it] INFO: Found listing with ID: HP27763
2026-01-28 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HP27763%27 HTTP/1.1" 200 None
2026-01-28 20:00:59 [auto1.it] INFO: Scrape type for HP27763: 0
2026-01-28 20:00:59 [auto1.it] INFO: Found listing with ID: JK71326
2026-01-28 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JK71326%27 HTTP/1.1" 200 None
2026-01-28 20:00:59 [auto1.it] INFO: Scrape type for JK71326: 0
2026-01-28 20:00:59 [auto1.it] INFO: Found listing with ID: WR69312
2026-01-28 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WR69312%27 HTTP/1.1" 200 None
2026-01-28 20:00:59 [auto1.it] INFO: Scrape type for WR69312: 2
2026-01-28 20:00:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F35%252F6c357bcdbe4e3e390bc49d66e1be4a06%252Fpa%252FLM18187_9515e36501b606ad4c3e03bf12777381.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/35/6c357bcdbe4e3e390bc49d66e1be4a06/pa/LM18187_9515e36501b606ad4c3e03bf12777381.jpg not downloaded yet
2026-01-28 20:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/52/265278f2bef552d5057c2293e62259ec/pa/VP25370_532fa6ebe0065f087ce41ffb856d7178.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:00:59 [auto1.it] INFO: Found listing with ID: LD57265
2026-01-28 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LD57265%27 HTTP/1.1" 200 None
2026-01-28 20:00:59 [auto1.it] INFO: Scrape type for LD57265: 0
2026-01-28 20:00:59 [auto1.it] INFO: Found listing with ID: RD80125
2026-01-28 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RD80125%27 HTTP/1.1" 200 None
2026-01-28 20:00:59 [auto1.it] INFO: Scrape type for RD80125: 0
2026-01-28 20:00:59 [auto1.it] INFO: Found listing with ID: LB68878
2026-01-28 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LB68878%27 HTTP/1.1" 200 None
2026-01-28 20:00:59 [auto1.it] INFO: Scrape type for LB68878: 0
2026-01-28 20:00:59 [auto1.it] INFO: Found listing with ID: BE02866
2026-01-28 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BE02866%27 HTTP/1.1" 200 None
2026-01-28 20:00:59 [auto1.it] INFO: Scrape type for BE02866: 0
2026-01-28 20:00:59 [auto1.it] INFO: Found listing with ID: JE72665
2026-01-28 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JE72665%27 HTTP/1.1" 200 None
2026-01-28 20:00:59 [auto1.it] INFO: Scrape type for JE72665: 0
2026-01-28 20:00:59 [auto1.it] INFO: Found listing with ID: LC12522
2026-01-28 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LC12522%27 HTTP/1.1" 200 None
2026-01-28 20:00:59 [auto1.it] INFO: Scrape type for LC12522: 2
2026-01-28 20:00:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/a6/27a657fee4c38facf349d22de315ad81/pa/DJ22210_1951b2dde5ee0d84f60ee58c7fed5528.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F35%252F6c357bcdbe4e3e390bc49d66e1be4a06%252Fpa%252FLM18187_98f16c4e3c1dda26bfb2dc7eb0f05dbb.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/35/6c357bcdbe4e3e390bc49d66e1be4a06/pa/LM18187_98f16c4e3c1dda26bfb2dc7eb0f05dbb.jpg not downloaded yet
2026-01-28 20:00:59 [auto1.it] INFO: Found listing with ID: DE55553
2026-01-28 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DE55553%27 HTTP/1.1" 200 None
2026-01-28 20:00:59 [auto1.it] INFO: Scrape type for DE55553: 0
2026-01-28 20:00:59 [auto1.it] INFO: Found listing with ID: RN24419
2026-01-28 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RN24419%27 HTTP/1.1" 200 None
2026-01-28 20:00:59 [auto1.it] INFO: Scrape type for RN24419: 0
2026-01-28 20:00:59 [auto1.it] INFO: Found listing with ID: LA77465
2026-01-28 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LA77465%27 HTTP/1.1" 200 None
2026-01-28 20:00:59 [auto1.it] INFO: Scrape type for LA77465: 0
2026-01-28 20:00:59 [auto1.it] INFO: Found listing with ID: YM48404
2026-01-28 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YM48404%27 HTTP/1.1" 200 None
2026-01-28 20:00:59 [auto1.it] INFO: Scrape type for YM48404: 0
2026-01-28 20:00:59 [auto1.it] INFO: Found listing with ID: WT86652
2026-01-28 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WT86652%27 HTTP/1.1" 200 None
2026-01-28 20:00:59 [auto1.it] INFO: Scrape type for WT86652: 0
2026-01-28 20:00:59 [auto1.it] INFO: Found listing with ID: FA52335
2026-01-28 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FA52335%27 HTTP/1.1" 200 None
2026-01-28 20:00:59 [auto1.it] INFO: Scrape type for FA52335: 0
2026-01-28 20:00:59 [auto1.it] INFO: Found listing with ID: GX74312
2026-01-28 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GX74312%27 HTTP/1.1" 200 None
2026-01-28 20:00:59 [auto1.it] INFO: Scrape type for GX74312: 0
2026-01-28 20:00:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:00:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:00:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:00:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08706510>
2026-01-28 20:00:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:00:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:00:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:00:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:00:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_191bba90-0f82-54b1-88fa-cbe17ff9a5a0/191bba90-0f82-54b1-88fa-cbe17ff9a5a0_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F52%252F265278f2bef552d5057c2293e62259ec%252Fpa%252FVP25370_acfe9f3b5878fd56961e8143073f4f42.jpg') HTTP/1.1" 204 0
2026-01-28 20:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/52/265278f2bef552d5057c2293e62259ec/pa/VP25370_acfe9f3b5878fd56961e8143073f4f42.jpg saved to cache
2026-01-28 20:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 191bba90-0f82-54b1-88fa-cbe17ff9a5a0
2026-01-28 20:00:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:00:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:00:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:00:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08730510>
2026-01-28 20:00:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:00:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:01:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_191bba90-0f82-54b1-88fa-cbe17ff9a5a0/191bba90-0f82-54b1-88fa-cbe17ff9a5a0_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F52%252F265278f2bef552d5057c2293e62259ec%252Fpa%252FVP25370_877c875e691a261dcd823c8c3b0b2b8c.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/52/265278f2bef552d5057c2293e62259ec/pa/VP25370_877c875e691a261dcd823c8c3b0b2b8c.jpg saved to cache
2026-01-28 20:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 191bba90-0f82-54b1-88fa-cbe17ff9a5a0
2026-01-28 20:01:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b086bb110>
2026-01-28 20:01:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:01:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8aea567-3ec2-586f-8165-3ba50fde04ea/e8aea567-3ec2-586f-8165-3ba50fde04ea_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252Fa6%252F27a657fee4c38facf349d22de315ad81%252Fpa%252FDJ22210_8f8b295f1b305e052decf49ae3b777e1.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/a6/27a657fee4c38facf349d22de315ad81/pa/DJ22210_8f8b295f1b305e052decf49ae3b777e1.jpg saved to cache
2026-01-28 20:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e8aea567-3ec2-586f-8165-3ba50fde04ea
2026-01-28 20:01:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a4ade2a-43a4-5e83-acd2-77ef438cc98d with identifier: GD75064
2026-01-28 20:01:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a4ade2a-43a4-5e83-acd2-77ef438cc98d with scrape type 2
2026-01-28 20:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0a4ade2a-43a4-5e83-acd2-77ef438cc98d with scrape type 2
2026-01-28 20:01:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0a4ade2a-43a4-5e83-acd2-77ef438cc98d, identifier: GD75064
2026-01-28 20:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F35%252F6c357bcdbe4e3e390bc49d66e1be4a06%252Fpa%252FLM18187_995303f815bde779c10e5eb801b0cfc1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/35/6c357bcdbe4e3e390bc49d66e1be4a06/pa/LM18187_995303f815bde779c10e5eb801b0cfc1.jpg not downloaded yet
2026-01-28 20:01:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0a4ade2a-43a4-5e83-acd2-77ef438cc98d with identifier: GD75064
2026-01-28 20:01:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0a4ade2a-43a4-5e83-acd2-77ef438cc98d with identifier: GD75064
2026-01-28 20:01:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0a4ade2a-43a4-5e83-acd2-77ef438cc98d with identifier: GD75064 to the API
2026-01-28 20:01:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:01:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:01:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GD75064>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.0L',
 'engine_horse_power': 115,
 'expiration_date': '2026-01-29T16:30:26Z',
 'fuel_type': 'petrol',
 'id': '0a4ade2a-43a4-5e83-acd2-77ef438cc98d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GD75064',
 'listing': 'auction',
 'location': 'IT, Roma',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 118589,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-10-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.0 TSI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2018}
2026-01-28 20:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GD75064%27 HTTP/1.1" 200 None
2026-01-28 20:01:01 [auto1.it] INFO: Saving data for GD75064: {'auction_closing_time': 1769704226.0, 'created_time': 1769198870.665133, 'last_price_update_time': 1769630461.472931}
2026-01-28 20:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GD75064') HTTP/1.1" 204 0
2026-01-28 20:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/52/265278f2bef552d5057c2293e62259ec/pa/VP25370_4a1f6abd760e56d0f6d294851824b664.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F35%252F6c357bcdbe4e3e390bc49d66e1be4a06%252Fpa%252FLM18187_20dc83d045afb9d535d84e44ebf23822.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/35/6c357bcdbe4e3e390bc49d66e1be4a06/pa/LM18187_20dc83d045afb9d535d84e44ebf23822.jpg not downloaded yet
2026-01-28 20:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DT01319> (referer: https://www.auto1.com/v1/car-details-view/DT01319/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RD52267> (referer: https://www.auto1.com/v1/car-details-view/RD52267/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TE33165> (referer: https://www.auto1.com/v1/car-details-view/TE33165/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:01:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09d34910>
2026-01-28 20:01:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:01:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_191bba90-0f82-54b1-88fa-cbe17ff9a5a0/191bba90-0f82-54b1-88fa-cbe17ff9a5a0_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F52%252F265278f2bef552d5057c2293e62259ec%252Fpa%252FVP25370_532fa6ebe0065f087ce41ffb856d7178.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/52/265278f2bef552d5057c2293e62259ec/pa/VP25370_532fa6ebe0065f087ce41ffb856d7178.jpg saved to cache
2026-01-28 20:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 191bba90-0f82-54b1-88fa-cbe17ff9a5a0
2026-01-28 20:01:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0a0b88d0>
2026-01-28 20:01:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8aea567-3ec2-586f-8165-3ba50fde04ea/e8aea567-3ec2-586f-8165-3ba50fde04ea_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252Fa6%252F27a657fee4c38facf349d22de315ad81%252Fpa%252FDJ22210_1951b2dde5ee0d84f60ee58c7fed5528.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/a6/27a657fee4c38facf349d22de315ad81/pa/DJ22210_1951b2dde5ee0d84f60ee58c7fed5528.jpg saved to cache
2026-01-28 20:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e8aea567-3ec2-586f-8165-3ba50fde04ea
2026-01-28 20:01:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:01:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F35%252F6c357bcdbe4e3e390bc49d66e1be4a06%252Fpa%252FLM18187_623107f9e4d19d6c4df86817c89514e0.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/35/6c357bcdbe4e3e390bc49d66e1be4a06/pa/LM18187_623107f9e4d19d6c4df86817c89514e0.jpg not downloaded yet
2026-01-28 20:01:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZG67214> (referer: https://www.auto1.com/v1/car-details-view/ZG67214/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:01:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09f14a10>
2026-01-28 20:01:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_191bba90-0f82-54b1-88fa-cbe17ff9a5a0/191bba90-0f82-54b1-88fa-cbe17ff9a5a0_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F52%252F265278f2bef552d5057c2293e62259ec%252Fpa%252FVP25370_4a1f6abd760e56d0f6d294851824b664.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/52/265278f2bef552d5057c2293e62259ec/pa/VP25370_4a1f6abd760e56d0f6d294851824b664.jpg saved to cache
2026-01-28 20:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 191bba90-0f82-54b1-88fa-cbe17ff9a5a0
2026-01-28 20:01:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 06562d43-54c7-5384-9120-73a6f85a3726 with identifier: DT01319
2026-01-28 20:01:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 06562d43-54c7-5384-9120-73a6f85a3726 with scrape type 1
2026-01-28 20:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 06562d43-54c7-5384-9120-73a6f85a3726
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Ffd%252F6dfd074bc8aa27b5d1e451429ee6253b%252Fpa%252FDT01319_a779893e29a7a17991c644be5252f175.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/fd/6dfd074bc8aa27b5d1e451429ee6253b/pa/DT01319_a779893e29a7a17991c644be5252f175.jpg not downloaded yet
2026-01-28 20:01:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 65c86be2-71de-54c3-bc14-36ee123c85bf with identifier: RD52267
2026-01-28 20:01:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65c86be2-71de-54c3-bc14-36ee123c85bf with scrape type 2
2026-01-28 20:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 65c86be2-71de-54c3-bc14-36ee123c85bf with scrape type 2
2026-01-28 20:01:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 65c86be2-71de-54c3-bc14-36ee123c85bf, identifier: RD52267
2026-01-28 20:01:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 37ff9b72-9484-5d56-b922-1ebd23a5a7c5 with identifier: TE33165
2026-01-28 20:01:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 37ff9b72-9484-5d56-b922-1ebd23a5a7c5 with scrape type 1
2026-01-28 20:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 13 photos for item 37ff9b72-9484-5d56-b922-1ebd23a5a7c5
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F8d%252F3b8d265f4d71cb3f59c4a351f9b2bd44%252Fpa%252FTE33165_dd944153b521ed17cc9576fdea592344.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/8d/3b8d265f4d71cb3f59c4a351f9b2bd44/pa/TE33165_dd944153b521ed17cc9576fdea592344.jpg already downloaded
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F8d%252F3b8d265f4d71cb3f59c4a351f9b2bd44%252Fpa%252FTE33165_a54a91b655f594e2bd59b6fb811f37b4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/8d/3b8d265f4d71cb3f59c4a351f9b2bd44/pa/TE33165_a54a91b655f594e2bd59b6fb811f37b4.jpg already downloaded
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F8d%252F3b8d265f4d71cb3f59c4a351f9b2bd44%252Fpa%252FTE33165_7f0735e0ff50fc0002ad153bd339cd4e.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/8d/3b8d265f4d71cb3f59c4a351f9b2bd44/pa/TE33165_7f0735e0ff50fc0002ad153bd339cd4e.jpg already downloaded
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F8d%252F3b8d265f4d71cb3f59c4a351f9b2bd44%252Fpa%252FTE33165_e21f0bfe8bc63f798aef2d8f9e7605f1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/8d/3b8d265f4d71cb3f59c4a351f9b2bd44/pa/TE33165_e21f0bfe8bc63f798aef2d8f9e7605f1.jpg already downloaded
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F8d%252F3b8d265f4d71cb3f59c4a351f9b2bd44%252Fpa%252FTE33165_0a275307c78ec97f379a65210e78c454.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/8d/3b8d265f4d71cb3f59c4a351f9b2bd44/pa/TE33165_0a275307c78ec97f379a65210e78c454.jpg already downloaded
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F8d%252F3b8d265f4d71cb3f59c4a351f9b2bd44%252Fpa%252FTE33165_ec243278b431decc9abf055d16c4f0d7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/8d/3b8d265f4d71cb3f59c4a351f9b2bd44/pa/TE33165_ec243278b431decc9abf055d16c4f0d7.jpg already downloaded
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F8d%252F3b8d265f4d71cb3f59c4a351f9b2bd44%252Fpa%252FTE33165_69d63b83d0842a07ea1cccfc8a02437c.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/8d/3b8d265f4d71cb3f59c4a351f9b2bd44/pa/TE33165_69d63b83d0842a07ea1cccfc8a02437c.jpg already downloaded
2026-01-28 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F8d%252F3b8d265f4d71cb3f59c4a351f9b2bd44%252Fpa%252FTE33165_e3fd30bf2cb6db1c55faf45be6afc74c.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/8d/3b8d265f4d71cb3f59c4a351f9b2bd44/pa/TE33165_e3fd30bf2cb6db1c55faf45be6afc74c.jpg already downloaded
2026-01-28 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F8d%252F3b8d265f4d71cb3f59c4a351f9b2bd44%252Fpa%252FTE33165_055cc6902b487a13c9a5dea55ef31755.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/8d/3b8d265f4d71cb3f59c4a351f9b2bd44/pa/TE33165_055cc6902b487a13c9a5dea55ef31755.jpg already downloaded
2026-01-28 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F8d%252F3b8d265f4d71cb3f59c4a351f9b2bd44%252Fpa%252FTE33165_b9db3108052e0d2b420e9878f845d968.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/8d/3b8d265f4d71cb3f59c4a351f9b2bd44/pa/TE33165_b9db3108052e0d2b420e9878f845d968.jpg already downloaded
2026-01-28 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F8d%252F3b8d265f4d71cb3f59c4a351f9b2bd44%252Fpa%252FTE33165_411f895012dc5b91bc22d03db4d2141d.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/8d/3b8d265f4d71cb3f59c4a351f9b2bd44/pa/TE33165_411f895012dc5b91bc22d03db4d2141d.jpg already downloaded
2026-01-28 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F8d%252F3b8d265f4d71cb3f59c4a351f9b2bd44%252Fpa%252FTE33165_bfd65d7d5ffcbf9a8696e70a3049b4aa.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/8d/3b8d265f4d71cb3f59c4a351f9b2bd44/pa/TE33165_bfd65d7d5ffcbf9a8696e70a3049b4aa.jpg already downloaded
2026-01-28 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F8d%252F3b8d265f4d71cb3f59c4a351f9b2bd44%252Fpa%252FTE33165_5451f0648f482b6df3a5784ba8c9c196.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/8d/3b8d265f4d71cb3f59c4a351f9b2bd44/pa/TE33165_5451f0648f482b6df3a5784ba8c9c196.jpg already downloaded
2026-01-28 20:01:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 37ff9b72-9484-5d56-b922-1ebd23a5a7c5, identifier: TE33165
2026-01-28 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F35%252F6c357bcdbe4e3e390bc49d66e1be4a06%252Fpa%252FLM18187_5f3991c16bc7d1bbfd1fab7c6936b1bb.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/35/6c357bcdbe4e3e390bc49d66e1be4a06/pa/LM18187_5f3991c16bc7d1bbfd1fab7c6936b1bb.jpg not downloaded yet
2026-01-28 20:01:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 65c86be2-71de-54c3-bc14-36ee123c85bf with identifier: RD52267
2026-01-28 20:01:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 65c86be2-71de-54c3-bc14-36ee123c85bf with identifier: RD52267
2026-01-28 20:01:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 65c86be2-71de-54c3-bc14-36ee123c85bf with identifier: RD52267 to the API
2026-01-28 20:01:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:01:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:01:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RD52267>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-01-29T16:49:31Z',
 'fuel_type': 'diesel',
 'id': '65c86be2-71de-54c3-bc14-36ee123c85bf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RD52267',
 'listing': 'auction',
 'location': 'IT, Milazzo',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 94228,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-02-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q5 2.0 TDI quattro Sport',
 'transmission': 'automatic',
 'trim': 'quattro Sport',
 'year': 2018}
2026-01-28 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RD52267%27 HTTP/1.1" 200 None
2026-01-28 20:01:03 [auto1.it] INFO: Saving data for RD52267: {'auction_closing_time': 1769705371.0, 'created_time': 1768334639.462628, 'last_price_update_time': 1769630463.613828}
2026-01-28 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RD52267') HTTP/1.1" 204 0
2026-01-28 20:01:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 37ff9b72-9484-5d56-b922-1ebd23a5a7c5 with identifier: TE33165
2026-01-28 20:01:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 37ff9b72-9484-5d56-b922-1ebd23a5a7c5 with identifier: TE33165
2026-01-28 20:01:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 37ff9b72-9484-5d56-b922-1ebd23a5a7c5 with identifier: TE33165 to the API
2026-01-28 20:01:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:01:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TE33165>
{'auction_title': '',
 'c_o_2_emission_value': 219,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 231,
 'expiration_date': '2026-01-29T16:20:37Z',
 'fuel_type': 'diesel',
 'id': '37ff9b72-9484-5d56-b922-1ebd23a5a7c5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TE33165',
 'listing': 'auction',
 'location': 'IT',
 'make': 'Volkswagen',
 'model': 'Touareg',
 'odometer': 91117,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 13,
 'photo_urls': ['https://img-pa.auto1.com/img3b/8d/3b8d265f4d71cb3f59c4a351f9b2bd44/pa/TE33165_dd944153b521ed17cc9576fdea592344.jpg',
                'https://img-pa.auto1.com/img3b/8d/3b8d265f4d71cb3f59c4a351f9b2bd44/pa/TE33165_a54a91b655f594e2bd59b6fb811f37b4.jpg',
                'https://img-pa.auto1.com/img3b/8d/3b8d265f4d71cb3f59c4a351f9b2bd44/pa/TE33165_7f0735e0ff50fc0002ad153bd339cd4e.jpg',
                'https://img-pa.auto1.com/img3b/8d/3b8d265f4d71cb3f59c4a351f9b2bd44/pa/TE33165_e21f0bfe8bc63f798aef2d8f9e7605f1.jpg',
                'https://img-pa.auto1.com/img3b/8d/3b8d265f4d71cb3f59c4a351f9b2bd44/pa/TE33165_0a275307c78ec97f379a65210e78c454.jpg',
                'https://img-pa.auto1.com/img3b/8d/3b8d265f4d71cb3f59c4a351f9b2bd44/pa/TE33165_ec243278b431decc9abf055d16c4f0d7.jpg',
                'https://img-pa.auto1.com/img3b/8d/3b8d265f4d71cb3f59c4a351f9b2bd44/pa/TE33165_69d63b83d0842a07ea1cccfc8a02437c.jpg',
                'https://img-pa.auto1.com/img3b/8d/3b8d265f4d71cb3f59c4a351f9b2bd44/pa/TE33165_e3fd30bf2cb6db1c55faf45be6afc74c.jpg',
                'https://img-pa.auto1.com/img3b/8d/3b8d265f4d71cb3f59c4a351f9b2bd44/pa/TE33165_055cc6902b487a13c9a5dea55ef31755.jpg',
                'https://img-pa.auto1.com/img3b/8d/3b8d265f4d71cb3f59c4a351f9b2bd44/pa/TE33165_b9db3108052e0d2b420e9878f845d968.jpg',
                'https://img-pa.auto1.com/img3b/8d/3b8d265f4d71cb3f59c4a351f9b2bd44/pa/TE33165_411f895012dc5b91bc22d03db4d2141d.jpg',
                'https://img-pa.auto1.com/img3b/8d/3b8d265f4d71cb3f59c4a351f9b2bd44/pa/TE33165_bfd65d7d5ffcbf9a8696e70a3049b4aa.jpg',
                'https://img-pa.auto1.com/img3b/8d/3b8d265f4d71cb3f59c4a351f9b2bd44/pa/TE33165_5451f0648f482b6df3a5784ba8c9c196.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37ff9b72-9484-5d56-b922-1ebd23a5a7c5/37ff9b72-9484-5d56-b922-1ebd23a5a7c5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3056346,
             'Height': 3024,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/8d/3b8d265f4d71cb3f59c4a351f9b2bd44/pa/TE33165_dd944153b521ed17cc9576fdea592344.jpg',
             'Width': 4032},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37ff9b72-9484-5d56-b922-1ebd23a5a7c5/37ff9b72-9484-5d56-b922-1ebd23a5a7c5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3056346,
             'Height': 3024,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/8d/3b8d265f4d71cb3f59c4a351f9b2bd44/pa/TE33165_a54a91b655f594e2bd59b6fb811f37b4.jpg',
             'Width': 4032},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37ff9b72-9484-5d56-b922-1ebd23a5a7c5/37ff9b72-9484-5d56-b922-1ebd23a5a7c5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73672,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/8d/3b8d265f4d71cb3f59c4a351f9b2bd44/pa/TE33165_7f0735e0ff50fc0002ad153bd339cd4e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37ff9b72-9484-5d56-b922-1ebd23a5a7c5/37ff9b72-9484-5d56-b922-1ebd23a5a7c5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58692,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/8d/3b8d265f4d71cb3f59c4a351f9b2bd44/pa/TE33165_e21f0bfe8bc63f798aef2d8f9e7605f1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37ff9b72-9484-5d56-b922-1ebd23a5a7c5/37ff9b72-9484-5d56-b922-1ebd23a5a7c5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62857,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/8d/3b8d265f4d71cb3f59c4a351f9b2bd44/pa/TE33165_0a275307c78ec97f379a65210e78c454.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37ff9b72-9484-5d56-b922-1ebd23a5a7c5/37ff9b72-9484-5d56-b922-1ebd23a5a7c5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72274,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/8d/3b8d265f4d71cb3f59c4a351f9b2bd44/pa/TE33165_ec243278b431decc9abf055d16c4f0d7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37ff9b72-9484-5d56-b922-1ebd23a5a7c5/37ff9b72-9484-5d56-b922-1ebd23a5a7c5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67430,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/8d/3b8d265f4d71cb3f59c4a351f9b2bd44/pa/TE33165_69d63b83d0842a07ea1cccfc8a02437c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37ff9b72-9484-5d56-b922-1ebd23a5a7c5/37ff9b72-9484-5d56-b922-1ebd23a5a7c5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3108081,
             'Height': 3024,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/8d/3b8d265f4d71cb3f59c4a351f9b2bd44/pa/TE33165_e3fd30bf2cb6db1c55faf45be6afc74c.jpg',
             'Width': 4032},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37ff9b72-9484-5d56-b922-1ebd23a5a7c5/37ff9b72-9484-5d56-b922-1ebd23a5a7c5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3011897,
             'Height': 3024,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/8d/3b8d265f4d71cb3f59c4a351f9b2bd44/pa/TE33165_055cc6902b487a13c9a5dea55ef31755.jpg',
             'Width': 4032},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37ff9b72-9484-5d56-b922-1ebd23a5a7c5/37ff9b72-9484-5d56-b922-1ebd23a5a7c5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3371331,
             'Height': 3024,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/8d/3b8d265f4d71cb3f59c4a351f9b2bd44/pa/TE33165_b9db3108052e0d2b420e9878f845d968.jpg',
             'Width': 4032},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37ff9b72-9484-5d56-b922-1ebd23a5a7c5/37ff9b72-9484-5d56-b922-1ebd23a5a7c5_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3118622,
             'Height': 3024,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/8d/3b8d265f4d71cb3f59c4a351f9b2bd44/pa/TE33165_411f895012dc5b91bc22d03db4d2141d.jpg',
             'Width': 4032},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37ff9b72-9484-5d56-b922-1ebd23a5a7c5/37ff9b72-9484-5d56-b922-1ebd23a5a7c5_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66826,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/8d/3b8d265f4d71cb3f59c4a351f9b2bd44/pa/TE33165_bfd65d7d5ffcbf9a8696e70a3049b4aa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37ff9b72-9484-5d56-b922-1ebd23a5a7c5/37ff9b72-9484-5d56-b922-1ebd23a5a7c5_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62683,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/8d/3b8d265f4d71cb3f59c4a351f9b2bd44/pa/TE33165_5451f0648f482b6df3a5784ba8c9c196.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-05-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Touareg 3.0 V6 TDI Advanced 4Motion',
 'transmission': 'automatic',
 'trim': 'Advanced 4Motion',
 'year': 2020}
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TE33165%27 HTTP/1.1" 200 None
2026-01-28 20:01:04 [auto1.it] INFO: Saving data for TE33165: {'created_time': 1769630464.574367, 'last_price_update_time': 1769630464.574376, 'auction_closing_time': 1769703637.0}
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TE33165') HTTP/1.1" 204 0
2026-01-28 20:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/35/6c357bcdbe4e3e390bc49d66e1be4a06/pa/LM18187_98f16c4e3c1dda26bfb2dc7eb0f05dbb.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/35/6c357bcdbe4e3e390bc49d66e1be4a06/pa/LM18187_995303f815bde779c10e5eb801b0cfc1.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Ffd%252F6dfd074bc8aa27b5d1e451429ee6253b%252Fpa%252FDT01319_7fdb4cb20f22238684eca3abcfa47a16.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/fd/6dfd074bc8aa27b5d1e451429ee6253b/pa/DT01319_7fdb4cb20f22238684eca3abcfa47a16.jpg not downloaded yet
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F35%252F6c357bcdbe4e3e390bc49d66e1be4a06%252Fpa%252FLM18187_8d5286088b0329ca48c968573e02c722.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/35/6c357bcdbe4e3e390bc49d66e1be4a06/pa/LM18187_8d5286088b0329ca48c968573e02c722.jpg not downloaded yet
2026-01-28 20:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WR69312/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HE46295> (referer: https://www.auto1.com/v1/car-details-view/HE46295/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PW41874/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/a6/27a657fee4c38facf349d22de315ad81/pa/DJ22210_80874957cc4fe48b8c50bebc0a24e51a.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/a6/27a657fee4c38facf349d22de315ad81/pa/DJ22210_2b1607897a8d16f8a381268e1f6daf43.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Ffd%252F6dfd074bc8aa27b5d1e451429ee6253b%252Fpa%252FDT01319_195eac85e592815d3915ca50a7977a16.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/fd/6dfd074bc8aa27b5d1e451429ee6253b/pa/DT01319_195eac85e592815d3915ca50a7977a16.jpg not downloaded yet
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F35%252F6c357bcdbe4e3e390bc49d66e1be4a06%252Fpa%252FLM18187_d7cffb4be74093f7c42f04f86fcab56a.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/35/6c357bcdbe4e3e390bc49d66e1be4a06/pa/LM18187_d7cffb4be74093f7c42f04f86fcab56a.jpg not downloaded yet
2026-01-28 20:01:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eafbe243-b9f9-56af-9443-29e635be0b35 with identifier: ZG67214
2026-01-28 20:01:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eafbe243-b9f9-56af-9443-29e635be0b35 with scrape type 2
2026-01-28 20:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eafbe243-b9f9-56af-9443-29e635be0b35 with scrape type 2
2026-01-28 20:01:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: eafbe243-b9f9-56af-9443-29e635be0b35, identifier: ZG67214
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Ffd%252F6dfd074bc8aa27b5d1e451429ee6253b%252Fpa%252FDT01319_67f2add221a0cf8fbd23644568f0942a.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/fd/6dfd074bc8aa27b5d1e451429ee6253b/pa/DT01319_67f2add221a0cf8fbd23644568f0942a.jpg not downloaded yet
2026-01-28 20:01:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: eafbe243-b9f9-56af-9443-29e635be0b35 with identifier: ZG67214
2026-01-28 20:01:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: eafbe243-b9f9-56af-9443-29e635be0b35 with identifier: ZG67214
2026-01-28 20:01:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: eafbe243-b9f9-56af-9443-29e635be0b35 with identifier: ZG67214 to the API
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:01:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:01:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZG67214>
{'auction_title': '',
 'c_o_2_emission_value': 246,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '3.0L',
 'engine_horse_power': 457,
 'expiration_date': '2026-01-29T16:44:53Z',
 'fuel_type': 'petrol',
 'id': 'eafbe243-b9f9-56af-9443-29e635be0b35',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZG67214',
 'listing': 'auction',
 'location': 'IT, Varedo (MB)',
 'make': 'Mercedes-Benz',
 'model': 'GLE-Klasse',
 'odometer': 137331,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-06-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLE-Klasse GLE 53 AMG Mild-Hybrid 4Matic+',
 'transmission': 'automatic',
 'trim': '4Matic+',
 'year': 2021}
2026-01-28 20:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZG67214%27 HTTP/1.1" 200 None
2026-01-28 20:01:05 [auto1.it] INFO: Saving data for ZG67214: {'auction_closing_time': 1769705093.0, 'created_time': 1766002168.591508, 'last_price_update_time': 1769630465.181549}
2026-01-28 20:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZG67214') HTTP/1.1" 204 0
2026-01-28 20:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/fd/6dfd074bc8aa27b5d1e451429ee6253b/pa/DT01319_a779893e29a7a17991c644be5252f175.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F35%252F6c357bcdbe4e3e390bc49d66e1be4a06%252Fpa%252FLM18187_8a86cd6875741c499ccacb49ae70cbee.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/35/6c357bcdbe4e3e390bc49d66e1be4a06/pa/LM18187_8a86cd6875741c499ccacb49ae70cbee.jpg not downloaded yet
2026-01-28 20:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/35/6c357bcdbe4e3e390bc49d66e1be4a06/pa/LM18187_9515e36501b606ad4c3e03bf12777381.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Ffd%252F6dfd074bc8aa27b5d1e451429ee6253b%252Fpa%252FDT01319_94d2b413365ece5240f1f2c415ae4aed.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/fd/6dfd074bc8aa27b5d1e451429ee6253b/pa/DT01319_94d2b413365ece5240f1f2c415ae4aed.jpg not downloaded yet
2026-01-28 20:01:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09ea1410>
2026-01-28 20:01:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:01:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f94eb59-79a1-5b19-acdb-80dde67f1f1f/7f94eb59-79a1-5b19-acdb-80dde67f1f1f_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F35%252F6c357bcdbe4e3e390bc49d66e1be4a06%252Fpa%252FLM18187_98f16c4e3c1dda26bfb2dc7eb0f05dbb.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/35/6c357bcdbe4e3e390bc49d66e1be4a06/pa/LM18187_98f16c4e3c1dda26bfb2dc7eb0f05dbb.jpg saved to cache
2026-01-28 20:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7f94eb59-79a1-5b19-acdb-80dde67f1f1f
2026-01-28 20:01:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09e3e7d0>
2026-01-28 20:01:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:01:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f94eb59-79a1-5b19-acdb-80dde67f1f1f/7f94eb59-79a1-5b19-acdb-80dde67f1f1f_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F35%252F6c357bcdbe4e3e390bc49d66e1be4a06%252Fpa%252FLM18187_995303f815bde779c10e5eb801b0cfc1.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/35/6c357bcdbe4e3e390bc49d66e1be4a06/pa/LM18187_995303f815bde779c10e5eb801b0cfc1.jpg saved to cache
2026-01-28 20:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7f94eb59-79a1-5b19-acdb-80dde67f1f1f
2026-01-28 20:01:05 [auto1.it] INFO: Parsing search results for channel: 24h
2026-01-28 20:01:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e880455b-6b04-52f8-9912-be2ee3772888 with identifier: HE46295
2026-01-28 20:01:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e880455b-6b04-52f8-9912-be2ee3772888 with scrape type 2
2026-01-28 20:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e880455b-6b04-52f8-9912-be2ee3772888 with scrape type 2
2026-01-28 20:01:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e880455b-6b04-52f8-9912-be2ee3772888, identifier: HE46295
2026-01-28 20:01:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:01:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08cbcc50>
2026-01-28 20:01:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:01:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8aea567-3ec2-586f-8165-3ba50fde04ea/e8aea567-3ec2-586f-8165-3ba50fde04ea_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252Fa6%252F27a657fee4c38facf349d22de315ad81%252Fpa%252FDJ22210_80874957cc4fe48b8c50bebc0a24e51a.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/a6/27a657fee4c38facf349d22de315ad81/pa/DJ22210_80874957cc4fe48b8c50bebc0a24e51a.jpg saved to cache
2026-01-28 20:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e8aea567-3ec2-586f-8165-3ba50fde04ea
2026-01-28 20:01:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:01:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0a02c890>
2026-01-28 20:01:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:01:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8aea567-3ec2-586f-8165-3ba50fde04ea/e8aea567-3ec2-586f-8165-3ba50fde04ea_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252Fa6%252F27a657fee4c38facf349d22de315ad81%252Fpa%252FDJ22210_2b1607897a8d16f8a381268e1f6daf43.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/a6/27a657fee4c38facf349d22de315ad81/pa/DJ22210_2b1607897a8d16f8a381268e1f6daf43.jpg saved to cache
2026-01-28 20:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e8aea567-3ec2-586f-8165-3ba50fde04ea
2026-01-28 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F35%252F6c357bcdbe4e3e390bc49d66e1be4a06%252Fpa%252FLM18187_45137831250d47120405b781724d026f.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/35/6c357bcdbe4e3e390bc49d66e1be4a06/pa/LM18187_45137831250d47120405b781724d026f.jpg not downloaded yet
2026-01-28 20:01:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e880455b-6b04-52f8-9912-be2ee3772888 with identifier: HE46295
2026-01-28 20:01:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-28 20:01:06 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=blue HTTP/1.1" 200 None
2026-01-28 20:01:06 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-28 20:01:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e880455b-6b04-52f8-9912-be2ee3772888 with identifier: HE46295
2026-01-28 20:01:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e880455b-6b04-52f8-9912-be2ee3772888 with identifier: HE46295 to the API
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:01:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HE46295>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:08:39Z',
 'fuel_type': 'petrol',
 'id': 'e880455b-6b04-52f8-9912-be2ee3772888',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HE46295',
 'listing': 'auction',
 'location': 'IT, Milano',
 'make': 'Fiat',
 'model': '500X',
 'odometer': 4534,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-06-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat 500X 1.5 Mild-Hybrid',
 'transmission': 'automatic',
 'trim': '',
 'year': 2024}
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HE46295%27 HTTP/1.1" 200 None
2026-01-28 20:01:07 [auto1.it] INFO: Saving data for HE46295: {'auction_closing_time': 1769702919.0, 'created_time': 1768471317.824667, 'last_price_update_time': 1769630467.56274}
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HE46295') HTTP/1.1" 204 0
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Ffd%252F6dfd074bc8aa27b5d1e451429ee6253b%252Fpa%252FDT01319_5045a4e3974fe3bddba9cec162094e90.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/fd/6dfd074bc8aa27b5d1e451429ee6253b/pa/DT01319_5045a4e3974fe3bddba9cec162094e90.jpg not downloaded yet
2026-01-28 20:01:07 [auto1.it] INFO: Found listing with ID: DZ39731
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DZ39731%27 HTTP/1.1" 200 None
2026-01-28 20:01:07 [auto1.it] INFO: Scrape type for DZ39731: 0
2026-01-28 20:01:07 [auto1.it] INFO: Found listing with ID: XH51228
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XH51228%27 HTTP/1.1" 200 None
2026-01-28 20:01:07 [auto1.it] INFO: Scrape type for XH51228: 0
2026-01-28 20:01:07 [auto1.it] INFO: Found listing with ID: YW17704
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YW17704%27 HTTP/1.1" 200 None
2026-01-28 20:01:07 [auto1.it] INFO: Scrape type for YW17704: 0
2026-01-28 20:01:07 [auto1.it] INFO: Found listing with ID: WA99422
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WA99422%27 HTTP/1.1" 200 None
2026-01-28 20:01:07 [auto1.it] INFO: Scrape type for WA99422: 0
2026-01-28 20:01:07 [auto1.it] INFO: Found listing with ID: BS57464
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BS57464%27 HTTP/1.1" 200 None
2026-01-28 20:01:07 [auto1.it] INFO: Scrape type for BS57464: 1
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F35%252F6c357bcdbe4e3e390bc49d66e1be4a06%252Fpa%252FLM18187_04a34f80e58ad03451d23758ee05e7b6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/35/6c357bcdbe4e3e390bc49d66e1be4a06/pa/LM18187_04a34f80e58ad03451d23758ee05e7b6.jpg not downloaded yet
2026-01-28 20:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LC12522/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GN63531> (referer: https://www.auto1.com/v1/car-details-view/GN63531/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:01:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:01:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:01:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Ffd%252F6dfd074bc8aa27b5d1e451429ee6253b%252Fpa%252FDT01319_9a948d898c8a85cf1d4801060b8c9abd.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/fd/6dfd074bc8aa27b5d1e451429ee6253b/pa/DT01319_9a948d898c8a85cf1d4801060b8c9abd.jpg not downloaded yet
2026-01-28 20:01:07 [auto1.it] INFO: Found listing with ID: SX06852
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SX06852%27 HTTP/1.1" 200 None
2026-01-28 20:01:07 [auto1.it] INFO: Scrape type for SX06852: 0
2026-01-28 20:01:07 [auto1.it] INFO: Found listing with ID: RY80591
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RY80591%27 HTTP/1.1" 200 None
2026-01-28 20:01:07 [auto1.it] INFO: Scrape type for RY80591: 1
2026-01-28 20:01:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:01:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09e75090>
2026-01-28 20:01:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06562d43-54c7-5384-9120-73a6f85a3726/06562d43-54c7-5384-9120-73a6f85a3726_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Ffd%252F6dfd074bc8aa27b5d1e451429ee6253b%252Fpa%252FDT01319_a779893e29a7a17991c644be5252f175.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/fd/6dfd074bc8aa27b5d1e451429ee6253b/pa/DT01319_a779893e29a7a17991c644be5252f175.jpg saved to cache
2026-01-28 20:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 06562d43-54c7-5384-9120-73a6f85a3726
2026-01-28 20:01:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0a03bad0>
2026-01-28 20:01:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f94eb59-79a1-5b19-acdb-80dde67f1f1f/7f94eb59-79a1-5b19-acdb-80dde67f1f1f_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F35%252F6c357bcdbe4e3e390bc49d66e1be4a06%252Fpa%252FLM18187_9515e36501b606ad4c3e03bf12777381.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/35/6c357bcdbe4e3e390bc49d66e1be4a06/pa/LM18187_9515e36501b606ad4c3e03bf12777381.jpg saved to cache
2026-01-28 20:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7f94eb59-79a1-5b19-acdb-80dde67f1f1f
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F35%252F6c357bcdbe4e3e390bc49d66e1be4a06%252Fpa%252FLM18187_efaa2a49bbeacde0369a46a213b2c2dd.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/35/6c357bcdbe4e3e390bc49d66e1be4a06/pa/LM18187_efaa2a49bbeacde0369a46a213b2c2dd.jpg not downloaded yet
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Ffd%252F6dfd074bc8aa27b5d1e451429ee6253b%252Fpa%252FDT01319_39cebffaaa6c7485b5a6e9da0cb41a7b.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/fd/6dfd074bc8aa27b5d1e451429ee6253b/pa/DT01319_39cebffaaa6c7485b5a6e9da0cb41a7b.jpg not downloaded yet
2026-01-28 20:01:08 [auto1.it] INFO: Found listing with ID: YS06791
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YS06791%27 HTTP/1.1" 200 None
2026-01-28 20:01:08 [auto1.it] INFO: Scrape type for YS06791: 1
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F35%252F6c357bcdbe4e3e390bc49d66e1be4a06%252Fpa%252FLM18187_cdabf6ed57e6263fdfb88c82bf22acef.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/35/6c357bcdbe4e3e390bc49d66e1be4a06/pa/LM18187_cdabf6ed57e6263fdfb88c82bf22acef.jpg not downloaded yet
2026-01-28 20:01:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7152cf4d-6142-55e9-a1be-673016451dd9 with identifier: GN63531
2026-01-28 20:01:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7152cf4d-6142-55e9-a1be-673016451dd9 with scrape type 1
2026-01-28 20:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 7152cf4d-6142-55e9-a1be-673016451dd9
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fe3%252F9fe360ec2b747e196835a6fe2c93af08%252Fpa%252FGN63531_6e50189b8733fc0518bbe7e397c183b2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/e3/9fe360ec2b747e196835a6fe2c93af08/pa/GN63531_6e50189b8733fc0518bbe7e397c183b2.jpg already downloaded
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fe3%252F9fe360ec2b747e196835a6fe2c93af08%252Fpa%252FGN63531_963ad902796d73f655e0c5053fc8f931.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/e3/9fe360ec2b747e196835a6fe2c93af08/pa/GN63531_963ad902796d73f655e0c5053fc8f931.jpg already downloaded
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fe3%252F9fe360ec2b747e196835a6fe2c93af08%252Fpa%252FGN63531_36cb7dc5717b3ab4f36e7b391e23e3d1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/e3/9fe360ec2b747e196835a6fe2c93af08/pa/GN63531_36cb7dc5717b3ab4f36e7b391e23e3d1.jpg already downloaded
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fe3%252F9fe360ec2b747e196835a6fe2c93af08%252Fpa%252FGN63531_b460c4c462253597f630c98ab9b04141.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/e3/9fe360ec2b747e196835a6fe2c93af08/pa/GN63531_b460c4c462253597f630c98ab9b04141.jpg already downloaded
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fe3%252F9fe360ec2b747e196835a6fe2c93af08%252Fpa%252FGN63531_9ce53ccf10a8f803eb240645ec490355.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/e3/9fe360ec2b747e196835a6fe2c93af08/pa/GN63531_9ce53ccf10a8f803eb240645ec490355.jpg already downloaded
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fe3%252F9fe360ec2b747e196835a6fe2c93af08%252Fpa%252FGN63531_1bf96b08fafecf12c879514f6568eb44.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/e3/9fe360ec2b747e196835a6fe2c93af08/pa/GN63531_1bf96b08fafecf12c879514f6568eb44.jpg already downloaded
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fe3%252F9fe360ec2b747e196835a6fe2c93af08%252Fpa%252FGN63531_b8d0d62772bf60e03c69773055de96f5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/e3/9fe360ec2b747e196835a6fe2c93af08/pa/GN63531_b8d0d62772bf60e03c69773055de96f5.jpg already downloaded
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fe3%252F9fe360ec2b747e196835a6fe2c93af08%252Fpa%252FGN63531_83bfac9a6c7d59141f9fcc992b8bec9d.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/e3/9fe360ec2b747e196835a6fe2c93af08/pa/GN63531_83bfac9a6c7d59141f9fcc992b8bec9d.jpg already downloaded
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fe3%252F9fe360ec2b747e196835a6fe2c93af08%252Fpa%252FGN63531_a26e9b69607277ebaddb4121f4c8dde9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/e3/9fe360ec2b747e196835a6fe2c93af08/pa/GN63531_a26e9b69607277ebaddb4121f4c8dde9.jpg already downloaded
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fe3%252F9fe360ec2b747e196835a6fe2c93af08%252Fpa%252FGN63531_4f0a607d5b5b5181bf22d4079bdec04f.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/e3/9fe360ec2b747e196835a6fe2c93af08/pa/GN63531_4f0a607d5b5b5181bf22d4079bdec04f.jpg already downloaded
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fe3%252F9fe360ec2b747e196835a6fe2c93af08%252Fpa%252FGN63531_f710d2df64b5c3a20e50f0680006bdde.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/e3/9fe360ec2b747e196835a6fe2c93af08/pa/GN63531_f710d2df64b5c3a20e50f0680006bdde.jpg already downloaded
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fe3%252F9fe360ec2b747e196835a6fe2c93af08%252Fpa%252FGN63531_09704bc1058f953869e72b91daf35809.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/e3/9fe360ec2b747e196835a6fe2c93af08/pa/GN63531_09704bc1058f953869e72b91daf35809.jpg already downloaded
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fe3%252F9fe360ec2b747e196835a6fe2c93af08%252Fpa%252FGN63531_62c1ca81e7cb6fa18a0b72e7d80c5b45.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/e3/9fe360ec2b747e196835a6fe2c93af08/pa/GN63531_62c1ca81e7cb6fa18a0b72e7d80c5b45.jpg already downloaded
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fe3%252F9fe360ec2b747e196835a6fe2c93af08%252Fpa%252FGN63531_89e70b758e5569a8893618ba0cf59674.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/e3/9fe360ec2b747e196835a6fe2c93af08/pa/GN63531_89e70b758e5569a8893618ba0cf59674.jpg already downloaded
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fe3%252F9fe360ec2b747e196835a6fe2c93af08%252Fpa%252FGN63531_e226670fa678998743c6658382971df4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/e3/9fe360ec2b747e196835a6fe2c93af08/pa/GN63531_e226670fa678998743c6658382971df4.jpg already downloaded
2026-01-28 20:01:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7152cf4d-6142-55e9-a1be-673016451dd9, identifier: GN63531
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Ffd%252F6dfd074bc8aa27b5d1e451429ee6253b%252Fpa%252FDT01319_c34e56cba8999176cd467741a0a6ba89.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/fd/6dfd074bc8aa27b5d1e451429ee6253b/pa/DT01319_c34e56cba8999176cd467741a0a6ba89.jpg not downloaded yet
2026-01-28 20:01:08 [auto1.it] INFO: Found listing with ID: UA07437
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UA07437%27 HTTP/1.1" 200 None
2026-01-28 20:01:08 [auto1.it] INFO: Scrape type for UA07437: 0
2026-01-28 20:01:08 [auto1.it] INFO: Found listing with ID: KT64780
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KT64780%27 HTTP/1.1" 200 None
2026-01-28 20:01:08 [auto1.it] INFO: Scrape type for KT64780: 2
2026-01-28 20:01:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7152cf4d-6142-55e9-a1be-673016451dd9 with identifier: GN63531
2026-01-28 20:01:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7152cf4d-6142-55e9-a1be-673016451dd9 with identifier: GN63531
2026-01-28 20:01:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7152cf4d-6142-55e9-a1be-673016451dd9 with identifier: GN63531 to the API
2026-01-28 20:01:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:01:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:01:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GN63531>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.2L',
 'engine_horse_power': 83,
 'expiration_date': '2026-01-29T16:33:05Z',
 'fuel_type': 'petrol',
 'id': '7152cf4d-6142-55e9-a1be-673016451dd9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GN63531',
 'listing': 'auction',
 'location': 'IT, Varedo (MB)',
 'make': 'Suzuki',
 'model': 'Ignis',
 'odometer': 3351,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img9f/e3/9fe360ec2b747e196835a6fe2c93af08/pa/GN63531_6e50189b8733fc0518bbe7e397c183b2.jpg',
                'https://img-pa.auto1.com/img9f/e3/9fe360ec2b747e196835a6fe2c93af08/pa/GN63531_963ad902796d73f655e0c5053fc8f931.jpg',
                'https://img-pa.auto1.com/img9f/e3/9fe360ec2b747e196835a6fe2c93af08/pa/GN63531_36cb7dc5717b3ab4f36e7b391e23e3d1.jpg',
                'https://img-pa.auto1.com/img9f/e3/9fe360ec2b747e196835a6fe2c93af08/pa/GN63531_b460c4c462253597f630c98ab9b04141.jpg',
                'https://img-pa.auto1.com/img9f/e3/9fe360ec2b747e196835a6fe2c93af08/pa/GN63531_9ce53ccf10a8f803eb240645ec490355.jpg',
                'https://img-pa.auto1.com/img9f/e3/9fe360ec2b747e196835a6fe2c93af08/pa/GN63531_1bf96b08fafecf12c879514f6568eb44.jpg',
                'https://img-pa.auto1.com/img9f/e3/9fe360ec2b747e196835a6fe2c93af08/pa/GN63531_b8d0d62772bf60e03c69773055de96f5.jpg',
                'https://img-pa.auto1.com/img9f/e3/9fe360ec2b747e196835a6fe2c93af08/pa/GN63531_83bfac9a6c7d59141f9fcc992b8bec9d.jpg',
                'https://img-pa.auto1.com/img9f/e3/9fe360ec2b747e196835a6fe2c93af08/pa/GN63531_a26e9b69607277ebaddb4121f4c8dde9.jpg',
                'https://img-pa.auto1.com/img9f/e3/9fe360ec2b747e196835a6fe2c93af08/pa/GN63531_4f0a607d5b5b5181bf22d4079bdec04f.jpg',
                'https://img-pa.auto1.com/img9f/e3/9fe360ec2b747e196835a6fe2c93af08/pa/GN63531_f710d2df64b5c3a20e50f0680006bdde.jpg',
                'https://img-pa.auto1.com/img9f/e3/9fe360ec2b747e196835a6fe2c93af08/pa/GN63531_09704bc1058f953869e72b91daf35809.jpg',
                'https://img-pa.auto1.com/img9f/e3/9fe360ec2b747e196835a6fe2c93af08/pa/GN63531_62c1ca81e7cb6fa18a0b72e7d80c5b45.jpg',
                'https://img-pa.auto1.com/img9f/e3/9fe360ec2b747e196835a6fe2c93af08/pa/GN63531_89e70b758e5569a8893618ba0cf59674.jpg',
                'https://img-pa.auto1.com/img9f/e3/9fe360ec2b747e196835a6fe2c93af08/pa/GN63531_e226670fa678998743c6658382971df4.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7152cf4d-6142-55e9-a1be-673016451dd9/7152cf4d-6142-55e9-a1be-673016451dd9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2660155,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/e3/9fe360ec2b747e196835a6fe2c93af08/pa/GN63531_6e50189b8733fc0518bbe7e397c183b2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7152cf4d-6142-55e9-a1be-673016451dd9/7152cf4d-6142-55e9-a1be-673016451dd9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2634509,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/e3/9fe360ec2b747e196835a6fe2c93af08/pa/GN63531_963ad902796d73f655e0c5053fc8f931.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7152cf4d-6142-55e9-a1be-673016451dd9/7152cf4d-6142-55e9-a1be-673016451dd9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2478529,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/e3/9fe360ec2b747e196835a6fe2c93af08/pa/GN63531_36cb7dc5717b3ab4f36e7b391e23e3d1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7152cf4d-6142-55e9-a1be-673016451dd9/7152cf4d-6142-55e9-a1be-673016451dd9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2425453,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/e3/9fe360ec2b747e196835a6fe2c93af08/pa/GN63531_b460c4c462253597f630c98ab9b04141.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7152cf4d-6142-55e9-a1be-673016451dd9/7152cf4d-6142-55e9-a1be-673016451dd9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2344166,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/e3/9fe360ec2b747e196835a6fe2c93af08/pa/GN63531_9ce53ccf10a8f803eb240645ec490355.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7152cf4d-6142-55e9-a1be-673016451dd9/7152cf4d-6142-55e9-a1be-673016451dd9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2410496,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/e3/9fe360ec2b747e196835a6fe2c93af08/pa/GN63531_1bf96b08fafecf12c879514f6568eb44.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7152cf4d-6142-55e9-a1be-673016451dd9/7152cf4d-6142-55e9-a1be-673016451dd9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2287638,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/e3/9fe360ec2b747e196835a6fe2c93af08/pa/GN63531_b8d0d62772bf60e03c69773055de96f5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7152cf4d-6142-55e9-a1be-673016451dd9/7152cf4d-6142-55e9-a1be-673016451dd9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2574323,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/e3/9fe360ec2b747e196835a6fe2c93af08/pa/GN63531_83bfac9a6c7d59141f9fcc992b8bec9d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7152cf4d-6142-55e9-a1be-673016451dd9/7152cf4d-6142-55e9-a1be-673016451dd9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2704340,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/e3/9fe360ec2b747e196835a6fe2c93af08/pa/GN63531_a26e9b69607277ebaddb4121f4c8dde9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7152cf4d-6142-55e9-a1be-673016451dd9/7152cf4d-6142-55e9-a1be-673016451dd9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2602744,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/e3/9fe360ec2b747e196835a6fe2c93af08/pa/GN63531_4f0a607d5b5b5181bf22d4079bdec04f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7152cf4d-6142-55e9-a1be-673016451dd9/7152cf4d-6142-55e9-a1be-673016451dd9_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2817941,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/e3/9fe360ec2b747e196835a6fe2c93af08/pa/GN63531_f710d2df64b5c3a20e50f0680006bdde.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7152cf4d-6142-55e9-a1be-673016451dd9/7152cf4d-6142-55e9-a1be-673016451dd9_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2648569,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/e3/9fe360ec2b747e196835a6fe2c93af08/pa/GN63531_09704bc1058f953869e72b91daf35809.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7152cf4d-6142-55e9-a1be-673016451dd9/7152cf4d-6142-55e9-a1be-673016451dd9_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60171,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/e3/9fe360ec2b747e196835a6fe2c93af08/pa/GN63531_62c1ca81e7cb6fa18a0b72e7d80c5b45.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7152cf4d-6142-55e9-a1be-673016451dd9/7152cf4d-6142-55e9-a1be-673016451dd9_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2644592,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/e3/9fe360ec2b747e196835a6fe2c93af08/pa/GN63531_89e70b758e5569a8893618ba0cf59674.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7152cf4d-6142-55e9-a1be-673016451dd9/7152cf4d-6142-55e9-a1be-673016451dd9_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74369,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/e3/9fe360ec2b747e196835a6fe2c93af08/pa/GN63531_e226670fa678998743c6658382971df4.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-06-16',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Suzuki Ignis 1.2 DualJet Mild-Hybrid Top',
 'transmission': 'automatic',
 'trim': 'Top',
 'year': 2024}
2026-01-28 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GN63531%27 HTTP/1.1" 200 None
2026-01-28 20:01:09 [auto1.it] INFO: Saving data for GN63531: {'created_time': 1769630469.344905, 'last_price_update_time': 1769630469.344917, 'auction_closing_time': 1769704385.0}
2026-01-28 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GN63531') HTTP/1.1" 204 0
2026-01-28 20:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/fd/6dfd074bc8aa27b5d1e451429ee6253b/pa/DT01319_94d2b413365ece5240f1f2c415ae4aed.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/35/6c357bcdbe4e3e390bc49d66e1be4a06/pa/LM18187_45137831250d47120405b781724d026f.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F35%252F6c357bcdbe4e3e390bc49d66e1be4a06%252Fpa%252FLM18187_8da48b6263acb71d1283880f989c8208.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/35/6c357bcdbe4e3e390bc49d66e1be4a06/pa/LM18187_8da48b6263acb71d1283880f989c8208.jpg not downloaded yet
2026-01-28 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Ffd%252F6dfd074bc8aa27b5d1e451429ee6253b%252Fpa%252FDT01319_e1daa212f57d19f2ddb374e3bd1816bc.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/fd/6dfd074bc8aa27b5d1e451429ee6253b/pa/DT01319_e1daa212f57d19f2ddb374e3bd1816bc.jpg not downloaded yet
2026-01-28 20:01:09 [auto1.it] INFO: Found listing with ID: TC41624
2026-01-28 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TC41624%27 HTTP/1.1" 200 None
2026-01-28 20:01:09 [auto1.it] INFO: Scrape type for TC41624: 0
2026-01-28 20:01:09 [auto1.it] INFO: Found listing with ID: XN08896
2026-01-28 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XN08896%27 HTTP/1.1" 200 None
2026-01-28 20:01:09 [auto1.it] INFO: Scrape type for XN08896: 0
2026-01-28 20:01:09 [auto1.it] INFO: Found listing with ID: LU29351
2026-01-28 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LU29351%27 HTTP/1.1" 200 None
2026-01-28 20:01:09 [auto1.it] INFO: Scrape type for LU29351: 0
2026-01-28 20:01:09 [auto1.it] INFO: Found listing with ID: DH39383
2026-01-28 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DH39383%27 HTTP/1.1" 200 None
2026-01-28 20:01:09 [auto1.it] INFO: Scrape type for DH39383: 0
2026-01-28 20:01:09 [auto1.it] INFO: Found listing with ID: MU64340
2026-01-28 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MU64340%27 HTTP/1.1" 200 None
2026-01-28 20:01:09 [auto1.it] INFO: Scrape type for MU64340: 0
2026-01-28 20:01:09 [auto1.it] INFO: Found listing with ID: LB25725
2026-01-28 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LB25725%27 HTTP/1.1" 200 None
2026-01-28 20:01:09 [auto1.it] INFO: Scrape type for LB25725: 0
2026-01-28 20:01:09 [auto1.it] INFO: Found listing with ID: AL26589
2026-01-28 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AL26589%27 HTTP/1.1" 200 None
2026-01-28 20:01:09 [auto1.it] INFO: Scrape type for AL26589: 1
2026-01-28 20:01:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Ffd%252F6dfd074bc8aa27b5d1e451429ee6253b%252Fpa%252FDT01319_03eeb3edadff23fd5e8ffe88d492027e.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/fd/6dfd074bc8aa27b5d1e451429ee6253b/pa/DT01319_03eeb3edadff23fd5e8ffe88d492027e.jpg not downloaded yet
2026-01-28 20:01:09 [auto1.it] INFO: Found listing with ID: KL52080
2026-01-28 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KL52080%27 HTTP/1.1" 200 None
2026-01-28 20:01:09 [auto1.it] INFO: Scrape type for KL52080: 0
2026-01-28 20:01:09 [auto1.it] INFO: Found listing with ID: TZ83605
2026-01-28 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TZ83605%27 HTTP/1.1" 200 None
2026-01-28 20:01:09 [auto1.it] INFO: Scrape type for TZ83605: 1
2026-01-28 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Ffd%252F6dfd074bc8aa27b5d1e451429ee6253b%252Fpa%252FDT01319_9d386f8bc285aff651deb78cac0cca13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/fd/6dfd074bc8aa27b5d1e451429ee6253b/pa/DT01319_9d386f8bc285aff651deb78cac0cca13.jpg not downloaded yet
2026-01-28 20:01:09 [auto1.it] INFO: Found listing with ID: EZ39176
2026-01-28 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EZ39176%27 HTTP/1.1" 200 None
2026-01-28 20:01:09 [auto1.it] INFO: Scrape type for EZ39176: 0
2026-01-28 20:01:09 [auto1.it] INFO: Found listing with ID: DK89708
2026-01-28 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DK89708%27 HTTP/1.1" 200 None
2026-01-28 20:01:09 [auto1.it] INFO: Scrape type for DK89708: 0
2026-01-28 20:01:09 [auto1.it] INFO: Found listing with ID: MX37166
2026-01-28 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MX37166%27 HTTP/1.1" 200 None
2026-01-28 20:01:09 [auto1.it] INFO: Scrape type for MX37166: 0
2026-01-28 20:01:09 [auto1.it] INFO: Found listing with ID: JA19624
2026-01-28 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JA19624%27 HTTP/1.1" 200 None
2026-01-28 20:01:09 [auto1.it] INFO: Scrape type for JA19624: 0
2026-01-28 20:01:09 [auto1.it] INFO: Found listing with ID: JH21247
2026-01-28 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JH21247%27 HTTP/1.1" 200 None
2026-01-28 20:01:09 [auto1.it] INFO: Scrape type for JH21247: 0
2026-01-28 20:01:09 [auto1.it] INFO: Found listing with ID: DR27606
2026-01-28 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DR27606%27 HTTP/1.1" 200 None
2026-01-28 20:01:09 [auto1.it] INFO: Scrape type for DR27606: 0
2026-01-28 20:01:09 [auto1.it] INFO: Found listing with ID: WP90453
2026-01-28 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WP90453%27 HTTP/1.1" 200 None
2026-01-28 20:01:09 [auto1.it] INFO: Scrape type for WP90453: 1
2026-01-28 20:01:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b086f0190>
2026-01-28 20:01:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06562d43-54c7-5384-9120-73a6f85a3726/06562d43-54c7-5384-9120-73a6f85a3726_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Ffd%252F6dfd074bc8aa27b5d1e451429ee6253b%252Fpa%252FDT01319_94d2b413365ece5240f1f2c415ae4aed.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/fd/6dfd074bc8aa27b5d1e451429ee6253b/pa/DT01319_94d2b413365ece5240f1f2c415ae4aed.jpg saved to cache
2026-01-28 20:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 06562d43-54c7-5384-9120-73a6f85a3726
2026-01-28 20:01:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09d10050>
2026-01-28 20:01:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:01:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f94eb59-79a1-5b19-acdb-80dde67f1f1f/7f94eb59-79a1-5b19-acdb-80dde67f1f1f_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F35%252F6c357bcdbe4e3e390bc49d66e1be4a06%252Fpa%252FLM18187_45137831250d47120405b781724d026f.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/35/6c357bcdbe4e3e390bc49d66e1be4a06/pa/LM18187_45137831250d47120405b781724d026f.jpg saved to cache
2026-01-28 20:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 7f94eb59-79a1-5b19-acdb-80dde67f1f1f
2026-01-28 20:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/fd/6dfd074bc8aa27b5d1e451429ee6253b/pa/DT01319_67f2add221a0cf8fbd23644568f0942a.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/35/6c357bcdbe4e3e390bc49d66e1be4a06/pa/LM18187_8a86cd6875741c499ccacb49ae70cbee.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Ffd%252F6dfd074bc8aa27b5d1e451429ee6253b%252Fpa%252FDT01319_3fe3f28292e67d93e7bbb6c1406e6d04.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/fd/6dfd074bc8aa27b5d1e451429ee6253b/pa/DT01319_3fe3f28292e67d93e7bbb6c1406e6d04.jpg not downloaded yet
2026-01-28 20:01:10 [auto1.it] INFO: Found listing with ID: TH12767
2026-01-28 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TH12767%27 HTTP/1.1" 200 None
2026-01-28 20:01:10 [auto1.it] INFO: Scrape type for TH12767: 0
2026-01-28 20:01:10 [auto1.it] INFO: Found listing with ID: KW94897
2026-01-28 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KW94897%27 HTTP/1.1" 200 None
2026-01-28 20:01:10 [auto1.it] INFO: Scrape type for KW94897: 0
2026-01-28 20:01:10 [auto1.it] INFO: Found listing with ID: YJ87014
2026-01-28 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YJ87014%27 HTTP/1.1" 200 None
2026-01-28 20:01:10 [auto1.it] INFO: Scrape type for YJ87014: 0
2026-01-28 20:01:10 [auto1.it] INFO: Found listing with ID: CN82812
2026-01-28 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CN82812%27 HTTP/1.1" 200 None
2026-01-28 20:01:10 [auto1.it] INFO: Scrape type for CN82812: 0
2026-01-28 20:01:10 [auto1.it] INFO: Found listing with ID: EY68102
2026-01-28 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EY68102%27 HTTP/1.1" 200 None
2026-01-28 20:01:10 [auto1.it] INFO: Scrape type for EY68102: 0
2026-01-28 20:01:10 [auto1.it] INFO: Found listing with ID: NP55119
2026-01-28 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NP55119%27 HTTP/1.1" 200 None
2026-01-28 20:01:10 [auto1.it] INFO: Scrape type for NP55119: 0
2026-01-28 20:01:10 [auto1.it] INFO: Found listing with ID: XU61631
2026-01-28 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XU61631%27 HTTP/1.1" 200 None
2026-01-28 20:01:10 [auto1.it] INFO: Scrape type for XU61631: 0
2026-01-28 20:01:10 [auto1.it] INFO: Found listing with ID: CL92988
2026-01-28 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CL92988%27 HTTP/1.1" 200 None
2026-01-28 20:01:10 [auto1.it] INFO: Scrape type for CL92988: 0
2026-01-28 20:01:10 [auto1.it] INFO: Found listing with ID: AH34632
2026-01-28 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AH34632%27 HTTP/1.1" 200 None
2026-01-28 20:01:10 [auto1.it] INFO: Scrape type for AH34632: 0
2026-01-28 20:01:10 [auto1.it] INFO: Found listing with ID: YV35644
2026-01-28 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YV35644%27 HTTP/1.1" 200 None
2026-01-28 20:01:10 [auto1.it] INFO: Scrape type for YV35644: 1
2026-01-28 20:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/a6/27a657fee4c38facf349d22de315ad81/pa/DJ22210_fe407c5608223d3a52d7ba3787172781.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:01:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:01:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Ffd%252F6dfd074bc8aa27b5d1e451429ee6253b%252Fpa%252FDT01319_28fb05d4adc10b40c2f2b71f5c40d64e.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/fd/6dfd074bc8aa27b5d1e451429ee6253b/pa/DT01319_28fb05d4adc10b40c2f2b71f5c40d64e.jpg not downloaded yet
2026-01-28 20:01:10 [auto1.it] INFO: Found listing with ID: GC68845
2026-01-28 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GC68845%27 HTTP/1.1" 200 None
2026-01-28 20:01:10 [auto1.it] INFO: Scrape type for GC68845: 0
2026-01-28 20:01:10 [auto1.it] INFO: Found listing with ID: HW78995
2026-01-28 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HW78995%27 HTTP/1.1" 200 None
2026-01-28 20:01:10 [auto1.it] INFO: Scrape type for HW78995: 0
2026-01-28 20:01:10 [auto1.it] INFO: Found listing with ID: AZ36136
2026-01-28 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AZ36136%27 HTTP/1.1" 200 None
2026-01-28 20:01:10 [auto1.it] INFO: Scrape type for AZ36136: 0
2026-01-28 20:01:10 [auto1.it] INFO: Found listing with ID: KD59831
2026-01-28 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KD59831%27 HTTP/1.1" 200 None
2026-01-28 20:01:10 [auto1.it] INFO: Scrape type for KD59831: 2
2026-01-28 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Ffd%252F6dfd074bc8aa27b5d1e451429ee6253b%252Fpa%252FDT01319_dee52115e18157084d46a5882f423894.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/fd/6dfd074bc8aa27b5d1e451429ee6253b/pa/DT01319_dee52115e18157084d46a5882f423894.jpg not downloaded yet
2026-01-28 20:01:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09ddaa10>
2026-01-28 20:01:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06562d43-54c7-5384-9120-73a6f85a3726/06562d43-54c7-5384-9120-73a6f85a3726_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Ffd%252F6dfd074bc8aa27b5d1e451429ee6253b%252Fpa%252FDT01319_67f2add221a0cf8fbd23644568f0942a.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/fd/6dfd074bc8aa27b5d1e451429ee6253b/pa/DT01319_67f2add221a0cf8fbd23644568f0942a.jpg saved to cache
2026-01-28 20:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 06562d43-54c7-5384-9120-73a6f85a3726
2026-01-28 20:01:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09e4c390>
2026-01-28 20:01:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f94eb59-79a1-5b19-acdb-80dde67f1f1f/7f94eb59-79a1-5b19-acdb-80dde67f1f1f_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F35%252F6c357bcdbe4e3e390bc49d66e1be4a06%252Fpa%252FLM18187_8a86cd6875741c499ccacb49ae70cbee.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/35/6c357bcdbe4e3e390bc49d66e1be4a06/pa/LM18187_8a86cd6875741c499ccacb49ae70cbee.jpg saved to cache
2026-01-28 20:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7f94eb59-79a1-5b19-acdb-80dde67f1f1f
2026-01-28 20:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/a6/27a657fee4c38facf349d22de315ad81/pa/DJ22210_b169544b95f9f50840b1952150fc64e5.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/fd/6dfd074bc8aa27b5d1e451429ee6253b/pa/DT01319_5045a4e3974fe3bddba9cec162094e90.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/35/6c357bcdbe4e3e390bc49d66e1be4a06/pa/LM18187_d7cffb4be74093f7c42f04f86fcab56a.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:01:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:01:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08c3d5d0>
2026-01-28 20:01:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8aea567-3ec2-586f-8165-3ba50fde04ea/e8aea567-3ec2-586f-8165-3ba50fde04ea_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252Fa6%252F27a657fee4c38facf349d22de315ad81%252Fpa%252FDJ22210_fe407c5608223d3a52d7ba3787172781.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/a6/27a657fee4c38facf349d22de315ad81/pa/DJ22210_fe407c5608223d3a52d7ba3787172781.jpg saved to cache
2026-01-28 20:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item e8aea567-3ec2-586f-8165-3ba50fde04ea
2026-01-28 20:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PW41874> (referer: https://www.auto1.com/v1/car-details-view/PW41874/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:01:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:01:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:01:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09f0ce90>
2026-01-28 20:01:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8aea567-3ec2-586f-8165-3ba50fde04ea/e8aea567-3ec2-586f-8165-3ba50fde04ea_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252Fa6%252F27a657fee4c38facf349d22de315ad81%252Fpa%252FDJ22210_b169544b95f9f50840b1952150fc64e5.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/a6/27a657fee4c38facf349d22de315ad81/pa/DJ22210_b169544b95f9f50840b1952150fc64e5.jpg saved to cache
2026-01-28 20:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item e8aea567-3ec2-586f-8165-3ba50fde04ea
2026-01-28 20:01:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0a0cced0>
2026-01-28 20:01:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06562d43-54c7-5384-9120-73a6f85a3726/06562d43-54c7-5384-9120-73a6f85a3726_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Ffd%252F6dfd074bc8aa27b5d1e451429ee6253b%252Fpa%252FDT01319_5045a4e3974fe3bddba9cec162094e90.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/fd/6dfd074bc8aa27b5d1e451429ee6253b/pa/DT01319_5045a4e3974fe3bddba9cec162094e90.jpg saved to cache
2026-01-28 20:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 06562d43-54c7-5384-9120-73a6f85a3726
2026-01-28 20:01:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0a038450>
2026-01-28 20:01:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f94eb59-79a1-5b19-acdb-80dde67f1f1f/7f94eb59-79a1-5b19-acdb-80dde67f1f1f_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F35%252F6c357bcdbe4e3e390bc49d66e1be4a06%252Fpa%252FLM18187_d7cffb4be74093f7c42f04f86fcab56a.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/35/6c357bcdbe4e3e390bc49d66e1be4a06/pa/LM18187_d7cffb4be74093f7c42f04f86fcab56a.jpg saved to cache
2026-01-28 20:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7f94eb59-79a1-5b19-acdb-80dde67f1f1f
2026-01-28 20:01:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BS57464/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WP90453/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KT64780/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WR69312> (referer: https://www.auto1.com/v1/car-details-view/WR69312/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:01:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89205ba6-b09b-5bb8-a212-abd4809142c9 with identifier: PW41874
2026-01-28 20:01:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89205ba6-b09b-5bb8-a212-abd4809142c9 with scrape type 2
2026-01-28 20:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 89205ba6-b09b-5bb8-a212-abd4809142c9 with scrape type 2
2026-01-28 20:01:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 89205ba6-b09b-5bb8-a212-abd4809142c9, identifier: PW41874
2026-01-28 20:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/a6/27a657fee4c38facf349d22de315ad81/pa/DJ22210_2cc48d3de482b5f54f13a404e6d982c3.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:01:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 89205ba6-b09b-5bb8-a212-abd4809142c9 with identifier: PW41874
2026-01-28 20:01:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 89205ba6-b09b-5bb8-a212-abd4809142c9 with identifier: PW41874
2026-01-28 20:01:13 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 186467 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    186467
2026-01-28 20:01:13 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 89205ba6-b09b-5bb8-a212-abd4809142c9 spider: auto1.it
2026-01-28 20:01:13 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 89205ba6-b09b-5bb8-a212-abd4809142c9 due to rule: high_mileage_for_country.json, error: 186467 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    186467
{'auction_title': '',
 'c_o_2_emission_value': 49,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.9L',
 'engine_horse_power': 306,
 'expiration_date': '2026-01-29T16:35:39Z',
 'fuel_type': 'hybrid',
 'id': '89205ba6-b09b-5bb8-a212-abd4809142c9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PW41874',
 'listing': 'auction',
 'location': 'IT',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 186467,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-05-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 300de 4Matic Premium',
 'transmission': 'automatic',
 'trim': '4Matic Premium',
 'year': 2021}
2026-01-28 20:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PW41874%27 HTTP/1.1" 200 None
2026-01-28 20:01:13 [auto1.it] INFO: Saving data for PW41874: {'auction_closing_time': 1769704539.0, 'created_time': 1769458066.999023, 'last_price_update_time': 1769630473.174848}
2026-01-28 20:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PW41874') HTTP/1.1" 204 0
2026-01-28 20:01:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:01:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/a6/27a657fee4c38facf349d22de315ad81/pa/DJ22210_2dbd1ac3f3fc4b34aea2971653241d55.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/fd/6dfd074bc8aa27b5d1e451429ee6253b/pa/DT01319_28fb05d4adc10b40c2f2b71f5c40d64e.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/fd/6dfd074bc8aa27b5d1e451429ee6253b/pa/DT01319_dee52115e18157084d46a5882f423894.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:01:13 [auto1.it] INFO: Parsing search results for channel: 24h
2026-01-28 20:01:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5c06b55-3ca4-5d5c-8ac5-4663d0d9259d with identifier: WR69312
2026-01-28 20:01:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5c06b55-3ca4-5d5c-8ac5-4663d0d9259d with scrape type 2
2026-01-28 20:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f5c06b55-3ca4-5d5c-8ac5-4663d0d9259d with scrape type 2
2026-01-28 20:01:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f5c06b55-3ca4-5d5c-8ac5-4663d0d9259d, identifier: WR69312
2026-01-28 20:01:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:01:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09e48890>
2026-01-28 20:01:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:01:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8aea567-3ec2-586f-8165-3ba50fde04ea/e8aea567-3ec2-586f-8165-3ba50fde04ea_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252Fa6%252F27a657fee4c38facf349d22de315ad81%252Fpa%252FDJ22210_2cc48d3de482b5f54f13a404e6d982c3.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/a6/27a657fee4c38facf349d22de315ad81/pa/DJ22210_2cc48d3de482b5f54f13a404e6d982c3.jpg saved to cache
2026-01-28 20:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e8aea567-3ec2-586f-8165-3ba50fde04ea
2026-01-28 20:01:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f5c06b55-3ca4-5d5c-8ac5-4663d0d9259d with identifier: WR69312
2026-01-28 20:01:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f5c06b55-3ca4-5d5c-8ac5-4663d0d9259d with identifier: WR69312
2026-01-28 20:01:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f5c06b55-3ca4-5d5c-8ac5-4663d0d9259d with identifier: WR69312 to the API
2026-01-28 20:01:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:01:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:01:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WR69312>
{'auction_title': '',
 'c_o_2_emission_value': 165,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 204,
 'expiration_date': '2026-01-29T16:45:38Z',
 'fuel_type': 'diesel',
 'id': 'f5c06b55-3ca4-5d5c-8ac5-4663d0d9259d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WR69312',
 'listing': 'auction',
 'location': 'IT, Milazzo',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 82535,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-09-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q5 40 TDI Mild-Hybrid quattro advanced',
 'transmission': 'automatic',
 'trim': 'quattro advanced',
 'year': 2022}
2026-01-28 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WR69312%27 HTTP/1.1" 200 None
2026-01-28 20:01:14 [auto1.it] INFO: Saving data for WR69312: {'auction_closing_time': 1769705138.0, 'created_time': 1769544039.597595, 'last_price_update_time': 1769630474.294923}
2026-01-28 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WR69312') HTTP/1.1" 204 0
2026-01-28 20:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/fd/6dfd074bc8aa27b5d1e451429ee6253b/pa/DT01319_e1daa212f57d19f2ddb374e3bd1816bc.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:01:14 [auto1.it] INFO: Found listing with ID: AK95829
2026-01-28 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AK95829%27 HTTP/1.1" 200 None
2026-01-28 20:01:14 [auto1.it] INFO: Scrape type for AK95829: 0
2026-01-28 20:01:14 [auto1.it] INFO: Found listing with ID: JE15416
2026-01-28 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JE15416%27 HTTP/1.1" 200 None
2026-01-28 20:01:14 [auto1.it] INFO: Scrape type for JE15416: 0
2026-01-28 20:01:14 [auto1.it] INFO: Found listing with ID: RB81856
2026-01-28 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RB81856%27 HTTP/1.1" 200 None
2026-01-28 20:01:14 [auto1.it] INFO: Scrape type for RB81856: 0
2026-01-28 20:01:14 [auto1.it] INFO: Found listing with ID: SG87196
2026-01-28 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SG87196%27 HTTP/1.1" 200 None
2026-01-28 20:01:14 [auto1.it] INFO: Scrape type for SG87196: 0
2026-01-28 20:01:14 [auto1.it] INFO: Found listing with ID: SG78459
2026-01-28 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SG78459%27 HTTP/1.1" 200 None
2026-01-28 20:01:14 [auto1.it] INFO: Scrape type for SG78459: 0
2026-01-28 20:01:14 [auto1.it] INFO: Found listing with ID: PS84479
2026-01-28 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PS84479%27 HTTP/1.1" 200 None
2026-01-28 20:01:14 [auto1.it] INFO: Scrape type for PS84479: 0
2026-01-28 20:01:14 [auto1.it] INFO: Found listing with ID: WT09600
2026-01-28 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WT09600%27 HTTP/1.1" 200 None
2026-01-28 20:01:14 [auto1.it] INFO: Scrape type for WT09600: 0
2026-01-28 20:01:14 [auto1.it] INFO: Found listing with ID: AS00040
2026-01-28 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AS00040%27 HTTP/1.1" 200 None
2026-01-28 20:01:14 [auto1.it] INFO: Scrape type for AS00040: 0
2026-01-28 20:01:14 [auto1.it] INFO: Found listing with ID: NK32002
2026-01-28 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NK32002%27 HTTP/1.1" 200 None
2026-01-28 20:01:14 [auto1.it] INFO: Scrape type for NK32002: 0
2026-01-28 20:01:14 [auto1.it] INFO: Found listing with ID: BG40682
2026-01-28 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BG40682%27 HTTP/1.1" 200 None
2026-01-28 20:01:14 [auto1.it] INFO: Scrape type for BG40682: 0
2026-01-28 20:01:14 [auto1.it] INFO: Found listing with ID: PM87024
2026-01-28 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PM87024%27 HTTP/1.1" 200 None
2026-01-28 20:01:14 [auto1.it] INFO: Scrape type for PM87024: 0
2026-01-28 20:01:14 [auto1.it] INFO: Found listing with ID: NG74900
2026-01-28 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NG74900%27 HTTP/1.1" 200 None
2026-01-28 20:01:14 [auto1.it] INFO: Scrape type for NG74900: 0
2026-01-28 20:01:14 [auto1.it] INFO: Found listing with ID: SY35335
2026-01-28 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SY35335%27 HTTP/1.1" 200 None
2026-01-28 20:01:14 [auto1.it] INFO: Scrape type for SY35335: 0
2026-01-28 20:01:14 [auto1.it] INFO: Found listing with ID: TL58155
2026-01-28 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TL58155%27 HTTP/1.1" 200 None
2026-01-28 20:01:14 [auto1.it] INFO: Scrape type for TL58155: 0
2026-01-28 20:01:14 [auto1.it] INFO: Found listing with ID: VP20298
2026-01-28 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VP20298%27 HTTP/1.1" 200 None
2026-01-28 20:01:14 [auto1.it] INFO: Scrape type for VP20298: 1
2026-01-28 20:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/35/6c357bcdbe4e3e390bc49d66e1be4a06/pa/LM18187_8da48b6263acb71d1283880f989c8208.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/fd/6dfd074bc8aa27b5d1e451429ee6253b/pa/DT01319_3fe3f28292e67d93e7bbb6c1406e6d04.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KD59831/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TZ83605/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:01:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:01:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b086e3bd0>
2026-01-28 20:01:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:01:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8aea567-3ec2-586f-8165-3ba50fde04ea/e8aea567-3ec2-586f-8165-3ba50fde04ea_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252Fa6%252F27a657fee4c38facf349d22de315ad81%252Fpa%252FDJ22210_2dbd1ac3f3fc4b34aea2971653241d55.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/a6/27a657fee4c38facf349d22de315ad81/pa/DJ22210_2dbd1ac3f3fc4b34aea2971653241d55.jpg saved to cache
2026-01-28 20:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item e8aea567-3ec2-586f-8165-3ba50fde04ea
2026-01-28 20:01:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b086fca50>
2026-01-28 20:01:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06562d43-54c7-5384-9120-73a6f85a3726/06562d43-54c7-5384-9120-73a6f85a3726_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Ffd%252F6dfd074bc8aa27b5d1e451429ee6253b%252Fpa%252FDT01319_28fb05d4adc10b40c2f2b71f5c40d64e.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/fd/6dfd074bc8aa27b5d1e451429ee6253b/pa/DT01319_28fb05d4adc10b40c2f2b71f5c40d64e.jpg saved to cache
2026-01-28 20:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 06562d43-54c7-5384-9120-73a6f85a3726
2026-01-28 20:01:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b086fd610>
2026-01-28 20:01:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06562d43-54c7-5384-9120-73a6f85a3726/06562d43-54c7-5384-9120-73a6f85a3726_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Ffd%252F6dfd074bc8aa27b5d1e451429ee6253b%252Fpa%252FDT01319_dee52115e18157084d46a5882f423894.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/fd/6dfd074bc8aa27b5d1e451429ee6253b/pa/DT01319_dee52115e18157084d46a5882f423894.jpg saved to cache
2026-01-28 20:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 06562d43-54c7-5384-9120-73a6f85a3726
2026-01-28 20:01:15 [auto1.it] INFO: Found listing with ID: NA73854
2026-01-28 20:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NA73854%27 HTTP/1.1" 200 None
2026-01-28 20:01:15 [auto1.it] INFO: Scrape type for NA73854: 0
2026-01-28 20:01:15 [auto1.it] INFO: Found listing with ID: YA41341
2026-01-28 20:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YA41341%27 HTTP/1.1" 200 None
2026-01-28 20:01:15 [auto1.it] INFO: Scrape type for YA41341: 0
2026-01-28 20:01:15 [auto1.it] INFO: Found listing with ID: WW83392
2026-01-28 20:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WW83392%27 HTTP/1.1" 200 None
2026-01-28 20:01:15 [auto1.it] INFO: Scrape type for WW83392: 0
2026-01-28 20:01:15 [auto1.it] INFO: Found listing with ID: LT39464
2026-01-28 20:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LT39464%27 HTTP/1.1" 200 None
2026-01-28 20:01:15 [auto1.it] INFO: Scrape type for LT39464: 0
2026-01-28 20:01:15 [auto1.it] INFO: Found listing with ID: SB54869
2026-01-28 20:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SB54869%27 HTTP/1.1" 200 None
2026-01-28 20:01:15 [auto1.it] INFO: Scrape type for SB54869: 0
2026-01-28 20:01:15 [auto1.it] INFO: Found listing with ID: DP76328
2026-01-28 20:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DP76328%27 HTTP/1.1" 200 None
2026-01-28 20:01:15 [auto1.it] INFO: Scrape type for DP76328: 0
2026-01-28 20:01:15 [auto1.it] INFO: Found listing with ID: ZP37659
2026-01-28 20:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZP37659%27 HTTP/1.1" 200 None
2026-01-28 20:01:15 [auto1.it] INFO: Scrape type for ZP37659: 0
2026-01-28 20:01:15 [auto1.it] INFO: Found listing with ID: LX93740
2026-01-28 20:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LX93740%27 HTTP/1.1" 200 None
2026-01-28 20:01:15 [auto1.it] INFO: Scrape type for LX93740: 0
2026-01-28 20:01:15 [auto1.it] INFO: Found listing with ID: VW84140
2026-01-28 20:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VW84140%27 HTTP/1.1" 200 None
2026-01-28 20:01:15 [auto1.it] INFO: Scrape type for VW84140: 0
2026-01-28 20:01:15 [auto1.it] INFO: Found listing with ID: EG40810
2026-01-28 20:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EG40810%27 HTTP/1.1" 200 None
2026-01-28 20:01:15 [auto1.it] INFO: Scrape type for EG40810: 0
2026-01-28 20:01:15 [auto1.it] INFO: Found listing with ID: SB20175
2026-01-28 20:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SB20175%27 HTTP/1.1" 200 None
2026-01-28 20:01:15 [auto1.it] INFO: Scrape type for SB20175: 0
2026-01-28 20:01:15 [auto1.it] INFO: Found listing with ID: FT72404
2026-01-28 20:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FT72404%27 HTTP/1.1" 200 None
2026-01-28 20:01:15 [auto1.it] INFO: Scrape type for FT72404: 0
2026-01-28 20:01:15 [auto1.it] INFO: Found listing with ID: DY55087
2026-01-28 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DY55087%27 HTTP/1.1" 200 None
2026-01-28 20:01:16 [auto1.it] INFO: Scrape type for DY55087: 2
2026-01-28 20:01:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:01:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:01:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:01:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:01:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YV35644/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:01:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09ee2a10>
2026-01-28 20:01:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:01:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06562d43-54c7-5384-9120-73a6f85a3726/06562d43-54c7-5384-9120-73a6f85a3726_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Ffd%252F6dfd074bc8aa27b5d1e451429ee6253b%252Fpa%252FDT01319_e1daa212f57d19f2ddb374e3bd1816bc.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/fd/6dfd074bc8aa27b5d1e451429ee6253b/pa/DT01319_e1daa212f57d19f2ddb374e3bd1816bc.jpg saved to cache
2026-01-28 20:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 06562d43-54c7-5384-9120-73a6f85a3726
2026-01-28 20:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/35/6c357bcdbe4e3e390bc49d66e1be4a06/pa/LM18187_623107f9e4d19d6c4df86817c89514e0.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:01:16 [auto1.it] INFO: Found listing with ID: WB82138
2026-01-28 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WB82138%27 HTTP/1.1" 200 None
2026-01-28 20:01:16 [auto1.it] INFO: Scrape type for WB82138: 0
2026-01-28 20:01:16 [auto1.it] INFO: Found listing with ID: HD77272
2026-01-28 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HD77272%27 HTTP/1.1" 200 None
2026-01-28 20:01:16 [auto1.it] INFO: Scrape type for HD77272: 0
2026-01-28 20:01:16 [auto1.it] INFO: Found listing with ID: UA81726
2026-01-28 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UA81726%27 HTTP/1.1" 200 None
2026-01-28 20:01:16 [auto1.it] INFO: Scrape type for UA81726: 0
2026-01-28 20:01:16 [auto1.it] INFO: Found listing with ID: SK32602
2026-01-28 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SK32602%27 HTTP/1.1" 200 None
2026-01-28 20:01:16 [auto1.it] INFO: Scrape type for SK32602: 0
2026-01-28 20:01:16 [auto1.it] INFO: Found listing with ID: RD39232
2026-01-28 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RD39232%27 HTTP/1.1" 200 None
2026-01-28 20:01:16 [auto1.it] INFO: Scrape type for RD39232: 0
2026-01-28 20:01:16 [auto1.it] INFO: Found listing with ID: FG75193
2026-01-28 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FG75193%27 HTTP/1.1" 200 None
2026-01-28 20:01:16 [auto1.it] INFO: Scrape type for FG75193: 0
2026-01-28 20:01:16 [auto1.it] INFO: Found listing with ID: YM26268
2026-01-28 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YM26268%27 HTTP/1.1" 200 None
2026-01-28 20:01:16 [auto1.it] INFO: Scrape type for YM26268: 0
2026-01-28 20:01:16 [auto1.it] INFO: Found listing with ID: NK14048
2026-01-28 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NK14048%27 HTTP/1.1" 200 None
2026-01-28 20:01:16 [auto1.it] INFO: Scrape type for NK14048: 0
2026-01-28 20:01:16 [auto1.it] INFO: Found listing with ID: KZ89733
2026-01-28 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KZ89733%27 HTTP/1.1" 200 None
2026-01-28 20:01:16 [auto1.it] INFO: Scrape type for KZ89733: 0
2026-01-28 20:01:16 [auto1.it] INFO: Found listing with ID: GW95975
2026-01-28 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GW95975%27 HTTP/1.1" 200 None
2026-01-28 20:01:16 [auto1.it] INFO: Scrape type for GW95975: 0
2026-01-28 20:01:16 [auto1.it] INFO: Found listing with ID: FK29975
2026-01-28 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FK29975%27 HTTP/1.1" 200 None
2026-01-28 20:01:16 [auto1.it] INFO: Scrape type for FK29975: 0
2026-01-28 20:01:16 [auto1.it] INFO: Found listing with ID: ZC30818
2026-01-28 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZC30818%27 HTTP/1.1" 200 None
2026-01-28 20:01:16 [auto1.it] INFO: Scrape type for ZC30818: 0
2026-01-28 20:01:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:01:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08cd2fd0>
2026-01-28 20:01:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:01:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f94eb59-79a1-5b19-acdb-80dde67f1f1f/7f94eb59-79a1-5b19-acdb-80dde67f1f1f_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F35%252F6c357bcdbe4e3e390bc49d66e1be4a06%252Fpa%252FLM18187_8da48b6263acb71d1283880f989c8208.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/35/6c357bcdbe4e3e390bc49d66e1be4a06/pa/LM18187_8da48b6263acb71d1283880f989c8208.jpg saved to cache
2026-01-28 20:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 7f94eb59-79a1-5b19-acdb-80dde67f1f1f
2026-01-28 20:01:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0a042210>
2026-01-28 20:01:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06562d43-54c7-5384-9120-73a6f85a3726/06562d43-54c7-5384-9120-73a6f85a3726_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Ffd%252F6dfd074bc8aa27b5d1e451429ee6253b%252Fpa%252FDT01319_3fe3f28292e67d93e7bbb6c1406e6d04.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/fd/6dfd074bc8aa27b5d1e451429ee6253b/pa/DT01319_3fe3f28292e67d93e7bbb6c1406e6d04.jpg saved to cache
2026-01-28 20:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 06562d43-54c7-5384-9120-73a6f85a3726
2026-01-28 20:01:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/35/6c357bcdbe4e3e390bc49d66e1be4a06/pa/LM18187_20dc83d045afb9d535d84e44ebf23822.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:01:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/fd/6dfd074bc8aa27b5d1e451429ee6253b/pa/DT01319_39cebffaaa6c7485b5a6e9da0cb41a7b.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:01:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/35/6c357bcdbe4e3e390bc49d66e1be4a06/pa/LM18187_cdabf6ed57e6263fdfb88c82bf22acef.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:01:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:01:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09f23550>
2026-01-28 20:01:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f94eb59-79a1-5b19-acdb-80dde67f1f1f/7f94eb59-79a1-5b19-acdb-80dde67f1f1f_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F35%252F6c357bcdbe4e3e390bc49d66e1be4a06%252Fpa%252FLM18187_623107f9e4d19d6c4df86817c89514e0.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/35/6c357bcdbe4e3e390bc49d66e1be4a06/pa/LM18187_623107f9e4d19d6c4df86817c89514e0.jpg saved to cache
2026-01-28 20:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7f94eb59-79a1-5b19-acdb-80dde67f1f1f
2026-01-28 20:01:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/35/6c357bcdbe4e3e390bc49d66e1be4a06/pa/LM18187_efaa2a49bbeacde0369a46a213b2c2dd.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:01:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AL26589/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:01:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LC12522> (referer: https://www.auto1.com/v1/car-details-view/LC12522/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:01:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:01:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:01:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:01:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0a0403d0>
2026-01-28 20:01:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f94eb59-79a1-5b19-acdb-80dde67f1f1f/7f94eb59-79a1-5b19-acdb-80dde67f1f1f_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F35%252F6c357bcdbe4e3e390bc49d66e1be4a06%252Fpa%252FLM18187_20dc83d045afb9d535d84e44ebf23822.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/35/6c357bcdbe4e3e390bc49d66e1be4a06/pa/LM18187_20dc83d045afb9d535d84e44ebf23822.jpg saved to cache
2026-01-28 20:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7f94eb59-79a1-5b19-acdb-80dde67f1f1f
2026-01-28 20:01:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08c79650>
2026-01-28 20:01:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06562d43-54c7-5384-9120-73a6f85a3726/06562d43-54c7-5384-9120-73a6f85a3726_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Ffd%252F6dfd074bc8aa27b5d1e451429ee6253b%252Fpa%252FDT01319_39cebffaaa6c7485b5a6e9da0cb41a7b.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/fd/6dfd074bc8aa27b5d1e451429ee6253b/pa/DT01319_39cebffaaa6c7485b5a6e9da0cb41a7b.jpg saved to cache
2026-01-28 20:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 06562d43-54c7-5384-9120-73a6f85a3726
2026-01-28 20:01:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b086cd950>
2026-01-28 20:01:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f94eb59-79a1-5b19-acdb-80dde67f1f1f/7f94eb59-79a1-5b19-acdb-80dde67f1f1f_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F35%252F6c357bcdbe4e3e390bc49d66e1be4a06%252Fpa%252FLM18187_cdabf6ed57e6263fdfb88c82bf22acef.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/35/6c357bcdbe4e3e390bc49d66e1be4a06/pa/LM18187_cdabf6ed57e6263fdfb88c82bf22acef.jpg saved to cache
2026-01-28 20:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 7f94eb59-79a1-5b19-acdb-80dde67f1f1f
2026-01-28 20:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WP90453> (referer: https://www.auto1.com/v1/car-details-view/WP90453/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VP20298/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BS57464> (referer: https://www.auto1.com/v1/car-details-view/BS57464/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YS06791/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KT64780> (referer: https://www.auto1.com/v1/car-details-view/KT64780/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:01:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0a040690>
2026-01-28 20:01:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f94eb59-79a1-5b19-acdb-80dde67f1f1f/7f94eb59-79a1-5b19-acdb-80dde67f1f1f_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F35%252F6c357bcdbe4e3e390bc49d66e1be4a06%252Fpa%252FLM18187_efaa2a49bbeacde0369a46a213b2c2dd.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/35/6c357bcdbe4e3e390bc49d66e1be4a06/pa/LM18187_efaa2a49bbeacde0369a46a213b2c2dd.jpg saved to cache
2026-01-28 20:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 7f94eb59-79a1-5b19-acdb-80dde67f1f1f
2026-01-28 20:01:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a855096-1ac1-5d47-8353-29846549155a with identifier: LC12522
2026-01-28 20:01:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a855096-1ac1-5d47-8353-29846549155a with scrape type 2
2026-01-28 20:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6a855096-1ac1-5d47-8353-29846549155a with scrape type 2
2026-01-28 20:01:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6a855096-1ac1-5d47-8353-29846549155a, identifier: LC12522
2026-01-28 20:01:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:01:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:01:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:01:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6a855096-1ac1-5d47-8353-29846549155a with identifier: LC12522
2026-01-28 20:01:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6a855096-1ac1-5d47-8353-29846549155a with identifier: LC12522
2026-01-28 20:01:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6a855096-1ac1-5d47-8353-29846549155a with identifier: LC12522 to the API
2026-01-28 20:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:01:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:01:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LC12522>
{'auction_title': '',
 'c_o_2_emission_value': 141,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.9L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:29:42Z',
 'fuel_type': 'diesel',
 'id': '6a855096-1ac1-5d47-8353-29846549155a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LC12522',
 'listing': 'auction',
 'location': 'IT, Roma',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 42890,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-01-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 200 d AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2023}
2026-01-28 20:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LC12522%27 HTTP/1.1" 200 None
2026-01-28 20:01:19 [auto1.it] INFO: Saving data for LC12522: {'auction_closing_time': 1769704182.0, 'created_time': 1769544033.613558, 'last_price_update_time': 1769630479.755011}
2026-01-28 20:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LC12522') HTTP/1.1" 204 0
2026-01-28 20:01:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:01:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 051ddf36-eff8-5c80-8634-fb09358064b3 with identifier: WP90453
2026-01-28 20:01:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 051ddf36-eff8-5c80-8634-fb09358064b3 with scrape type 1
2026-01-28 20:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 051ddf36-eff8-5c80-8634-fb09358064b3
2026-01-28 20:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F4b%252Fdf4bfd14ecccad2e28acc7936a8ce0e3%252Fpa%252FWP90453_93a4dafe946475f3bb4535183e6f5343.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/4b/df4bfd14ecccad2e28acc7936a8ce0e3/pa/WP90453_93a4dafe946475f3bb4535183e6f5343.jpg not downloaded yet
2026-01-28 20:01:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab2b9426-2a4e-5843-bea9-eeabb5e12b74 with identifier: BS57464
2026-01-28 20:01:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab2b9426-2a4e-5843-bea9-eeabb5e12b74 with scrape type 1
2026-01-28 20:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 14 photos for item ab2b9426-2a4e-5843-bea9-eeabb5e12b74
2026-01-28 20:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F02%252F0902ecd716da7e9c1590d287d6183135%252Fpa%252FBS57464_8c47502173140b0ee15658cce1ae7adf.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/02/0902ecd716da7e9c1590d287d6183135/pa/BS57464_8c47502173140b0ee15658cce1ae7adf.jpg not downloaded yet
2026-01-28 20:01:19 [auto1.it] INFO: Parsing search results for channel: 24h
2026-01-28 20:01:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54a4c410-3212-5907-a52d-1093ec273562 with identifier: KT64780
2026-01-28 20:01:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54a4c410-3212-5907-a52d-1093ec273562 with scrape type 2
2026-01-28 20:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 54a4c410-3212-5907-a52d-1093ec273562 with scrape type 2
2026-01-28 20:01:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 54a4c410-3212-5907-a52d-1093ec273562, identifier: KT64780
2026-01-28 20:01:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 54a4c410-3212-5907-a52d-1093ec273562 with identifier: KT64780
2026-01-28 20:01:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 54a4c410-3212-5907-a52d-1093ec273562 with identifier: KT64780
2026-01-28 20:01:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 54a4c410-3212-5907-a52d-1093ec273562 with identifier: KT64780 to the API
2026-01-28 20:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:01:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:01:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KT64780>
{'auction_title': '',
 'c_o_2_emission_value': 155,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.4L',
 'engine_horse_power': 140,
 'expiration_date': '2026-01-29T16:13:17Z',
 'fuel_type': 'petrol',
 'id': '54a4c410-3212-5907-a52d-1093ec273562',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KT64780',
 'listing': 'auction',
 'location': 'IT, Senago (MI)',
 'make': 'Jeep',
 'model': 'Compass',
 'odometer': 75640,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-05-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jeep Compass 1.4 M-Air Limited FWD',
 'transmission': 'manual',
 'trim': 'Limited FWD',
 'year': 2019}
2026-01-28 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KT64780%27 HTTP/1.1" 200 None
2026-01-28 20:01:20 [auto1.it] INFO: Saving data for KT64780: {'auction_closing_time': 1769703197.0, 'created_time': 1769544048.043589, 'last_price_update_time': 1769630480.364989}
2026-01-28 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KT64780') HTTP/1.1" 204 0
2026-01-28 20:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/fd/6dfd074bc8aa27b5d1e451429ee6253b/pa/DT01319_195eac85e592815d3915ca50a7977a16.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F4b%252Fdf4bfd14ecccad2e28acc7936a8ce0e3%252Fpa%252FWP90453_dfb1e70fadcb2a19438a01fe0f85e092.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/4b/df4bfd14ecccad2e28acc7936a8ce0e3/pa/WP90453_dfb1e70fadcb2a19438a01fe0f85e092.jpg not downloaded yet
2026-01-28 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F02%252F0902ecd716da7e9c1590d287d6183135%252Fpa%252FBS57464_a0a58758a4b55f2e0c30fa759ae302c4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/02/0902ecd716da7e9c1590d287d6183135/pa/BS57464_a0a58758a4b55f2e0c30fa759ae302c4.jpg not downloaded yet
2026-01-28 20:01:20 [auto1.it] INFO: Found listing with ID: PM64669
2026-01-28 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PM64669%27 HTTP/1.1" 200 None
2026-01-28 20:01:20 [auto1.it] INFO: Scrape type for PM64669: 0
2026-01-28 20:01:20 [auto1.it] INFO: Found listing with ID: PY58438
2026-01-28 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PY58438%27 HTTP/1.1" 200 None
2026-01-28 20:01:20 [auto1.it] INFO: Scrape type for PY58438: 0
2026-01-28 20:01:20 [auto1.it] INFO: Found listing with ID: RZ31448
2026-01-28 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RZ31448%27 HTTP/1.1" 200 None
2026-01-28 20:01:20 [auto1.it] INFO: Scrape type for RZ31448: 0
2026-01-28 20:01:20 [auto1.it] INFO: Found listing with ID: PG92884
2026-01-28 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PG92884%27 HTTP/1.1" 200 None
2026-01-28 20:01:20 [auto1.it] INFO: Scrape type for PG92884: 1
2026-01-28 20:01:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/35/6c357bcdbe4e3e390bc49d66e1be4a06/pa/LM18187_8d5286088b0329ca48c968573e02c722.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F4b%252Fdf4bfd14ecccad2e28acc7936a8ce0e3%252Fpa%252FWP90453_3c79d8ec805bb6743173939b52aa0f93.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/4b/df4bfd14ecccad2e28acc7936a8ce0e3/pa/WP90453_3c79d8ec805bb6743173939b52aa0f93.jpg not downloaded yet
2026-01-28 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F02%252F0902ecd716da7e9c1590d287d6183135%252Fpa%252FBS57464_5e0e3f2d669b247d044e56b60a41490e.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/02/0902ecd716da7e9c1590d287d6183135/pa/BS57464_5e0e3f2d669b247d044e56b60a41490e.jpg not downloaded yet
2026-01-28 20:01:20 [auto1.it] INFO: Found listing with ID: BY77891
2026-01-28 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BY77891%27 HTTP/1.1" 200 None
2026-01-28 20:01:20 [auto1.it] INFO: Scrape type for BY77891: 0
2026-01-28 20:01:20 [auto1.it] INFO: Found listing with ID: EG37801
2026-01-28 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EG37801%27 HTTP/1.1" 200 None
2026-01-28 20:01:20 [auto1.it] INFO: Scrape type for EG37801: 0
2026-01-28 20:01:20 [auto1.it] INFO: Found listing with ID: KR39875
2026-01-28 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KR39875%27 HTTP/1.1" 200 None
2026-01-28 20:01:20 [auto1.it] INFO: Scrape type for KR39875: 0
2026-01-28 20:01:20 [auto1.it] INFO: Found listing with ID: DL88006
2026-01-28 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DL88006%27 HTTP/1.1" 200 None
2026-01-28 20:01:20 [auto1.it] INFO: Scrape type for DL88006: 0
2026-01-28 20:01:20 [auto1.it] INFO: Found listing with ID: NC33689
2026-01-28 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NC33689%27 HTTP/1.1" 200 None
2026-01-28 20:01:20 [auto1.it] INFO: Scrape type for NC33689: 0
2026-01-28 20:01:20 [auto1.it] INFO: Found listing with ID: KW61095
2026-01-28 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KW61095%27 HTTP/1.1" 200 None
2026-01-28 20:01:20 [auto1.it] INFO: Scrape type for KW61095: 2
2026-01-28 20:01:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F4b%252Fdf4bfd14ecccad2e28acc7936a8ce0e3%252Fpa%252FWP90453_cd4ae1c953a019779a5647319e95d14d.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/4b/df4bfd14ecccad2e28acc7936a8ce0e3/pa/WP90453_cd4ae1c953a019779a5647319e95d14d.jpg not downloaded yet
2026-01-28 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F02%252F0902ecd716da7e9c1590d287d6183135%252Fpa%252FBS57464_daeb323d5d299421c411d03473aa4470.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/02/0902ecd716da7e9c1590d287d6183135/pa/BS57464_daeb323d5d299421c411d03473aa4470.jpg not downloaded yet
2026-01-28 20:01:20 [auto1.it] INFO: Found listing with ID: GT57275
2026-01-28 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GT57275%27 HTTP/1.1" 200 None
2026-01-28 20:01:20 [auto1.it] INFO: Scrape type for GT57275: 0
2026-01-28 20:01:20 [auto1.it] INFO: Found listing with ID: JY88451
2026-01-28 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JY88451%27 HTTP/1.1" 200 None
2026-01-28 20:01:20 [auto1.it] INFO: Scrape type for JY88451: 2
2026-01-28 20:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YV35644> (referer: https://www.auto1.com/v1/car-details-view/YV35644/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DY55087/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:01:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08c7a590>
2026-01-28 20:01:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06562d43-54c7-5384-9120-73a6f85a3726/06562d43-54c7-5384-9120-73a6f85a3726_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Ffd%252F6dfd074bc8aa27b5d1e451429ee6253b%252Fpa%252FDT01319_195eac85e592815d3915ca50a7977a16.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/fd/6dfd074bc8aa27b5d1e451429ee6253b/pa/DT01319_195eac85e592815d3915ca50a7977a16.jpg saved to cache
2026-01-28 20:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 06562d43-54c7-5384-9120-73a6f85a3726
2026-01-28 20:01:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09fd5b10>
2026-01-28 20:01:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f94eb59-79a1-5b19-acdb-80dde67f1f1f/7f94eb59-79a1-5b19-acdb-80dde67f1f1f_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F35%252F6c357bcdbe4e3e390bc49d66e1be4a06%252Fpa%252FLM18187_8d5286088b0329ca48c968573e02c722.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/35/6c357bcdbe4e3e390bc49d66e1be4a06/pa/LM18187_8d5286088b0329ca48c968573e02c722.jpg saved to cache
2026-01-28 20:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7f94eb59-79a1-5b19-acdb-80dde67f1f1f
2026-01-28 20:01:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/35/6c357bcdbe4e3e390bc49d66e1be4a06/pa/LM18187_5f3991c16bc7d1bbfd1fab7c6936b1bb.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F4b%252Fdf4bfd14ecccad2e28acc7936a8ce0e3%252Fpa%252FWP90453_5eb44a84a27f959e88a9a4663d369ad6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/4b/df4bfd14ecccad2e28acc7936a8ce0e3/pa/WP90453_5eb44a84a27f959e88a9a4663d369ad6.jpg not downloaded yet
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F02%252F0902ecd716da7e9c1590d287d6183135%252Fpa%252FBS57464_ec60430e4516f5cc54b2f908b8073105.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/02/0902ecd716da7e9c1590d287d6183135/pa/BS57464_ec60430e4516f5cc54b2f908b8073105.jpg not downloaded yet
2026-01-28 20:01:21 [auto1.it] INFO: Found listing with ID: TD32917
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TD32917%27 HTTP/1.1" 200 None
2026-01-28 20:01:21 [auto1.it] INFO: Scrape type for TD32917: 0
2026-01-28 20:01:21 [auto1.it] INFO: Found listing with ID: WY47347
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WY47347%27 HTTP/1.1" 200 None
2026-01-28 20:01:21 [auto1.it] INFO: Scrape type for WY47347: 0
2026-01-28 20:01:21 [auto1.it] INFO: Found listing with ID: SX21988
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SX21988%27 HTTP/1.1" 200 None
2026-01-28 20:01:21 [auto1.it] INFO: Scrape type for SX21988: 0
2026-01-28 20:01:21 [auto1.it] INFO: Found listing with ID: EJ52499
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EJ52499%27 HTTP/1.1" 200 None
2026-01-28 20:01:21 [auto1.it] INFO: Scrape type for EJ52499: 0
2026-01-28 20:01:21 [auto1.it] INFO: Found listing with ID: NV95469
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NV95469%27 HTTP/1.1" 200 None
2026-01-28 20:01:21 [auto1.it] INFO: Scrape type for NV95469: 0
2026-01-28 20:01:21 [auto1.it] INFO: Found listing with ID: MB19199
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MB19199%27 HTTP/1.1" 200 None
2026-01-28 20:01:21 [auto1.it] INFO: Scrape type for MB19199: 0
2026-01-28 20:01:21 [auto1.it] INFO: Found listing with ID: TS00967
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TS00967%27 HTTP/1.1" 200 None
2026-01-28 20:01:21 [auto1.it] INFO: Scrape type for TS00967: 0
2026-01-28 20:01:21 [auto1.it] INFO: Found listing with ID: JD91728
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JD91728%27 HTTP/1.1" 200 None
2026-01-28 20:01:21 [auto1.it] INFO: Scrape type for JD91728: 0
2026-01-28 20:01:21 [auto1.it] INFO: Found listing with ID: HT84614
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HT84614%27 HTTP/1.1" 200 None
2026-01-28 20:01:21 [auto1.it] INFO: Scrape type for HT84614: 0
2026-01-28 20:01:21 [auto1.it] INFO: Found listing with ID: JG91942
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JG91942%27 HTTP/1.1" 200 None
2026-01-28 20:01:21 [auto1.it] INFO: Scrape type for JG91942: 0
2026-01-28 20:01:21 [auto1.it] INFO: Found listing with ID: TB86864
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TB86864%27 HTTP/1.1" 200 None
2026-01-28 20:01:21 [auto1.it] INFO: Scrape type for TB86864: 0
2026-01-28 20:01:21 [auto1.it] INFO: Found listing with ID: BL38298
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BL38298%27 HTTP/1.1" 200 None
2026-01-28 20:01:21 [auto1.it] INFO: Scrape type for BL38298: 0
2026-01-28 20:01:21 [auto1.it] INFO: Found listing with ID: VB04697
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VB04697%27 HTTP/1.1" 200 None
2026-01-28 20:01:21 [auto1.it] INFO: Scrape type for VB04697: 0
2026-01-28 20:01:21 [auto1.it] INFO: Found listing with ID: GN66049
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GN66049%27 HTTP/1.1" 200 None
2026-01-28 20:01:21 [auto1.it] INFO: Scrape type for GN66049: 0
2026-01-28 20:01:21 [auto1.it] INFO: Found listing with ID: JF49505
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JF49505%27 HTTP/1.1" 200 None
2026-01-28 20:01:21 [auto1.it] INFO: Scrape type for JF49505: 0
2026-01-28 20:01:21 [auto1.it] INFO: Found listing with ID: XX93574
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XX93574%27 HTTP/1.1" 200 None
2026-01-28 20:01:21 [auto1.it] INFO: Scrape type for XX93574: 0
2026-01-28 20:01:21 [auto1.it] INFO: Found listing with ID: PT59724
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PT59724%27 HTTP/1.1" 200 None
2026-01-28 20:01:21 [auto1.it] INFO: Scrape type for PT59724: 0
2026-01-28 20:01:21 [auto1.it] INFO: Found listing with ID: AF71631
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AF71631%27 HTTP/1.1" 200 None
2026-01-28 20:01:21 [auto1.it] INFO: Scrape type for AF71631: 1
2026-01-28 20:01:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/35/6c357bcdbe4e3e390bc49d66e1be4a06/pa/LM18187_62f019c9ae01ed518a8bec714bc5792b.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:01:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:01:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F4b%252Fdf4bfd14ecccad2e28acc7936a8ce0e3%252Fpa%252FWP90453_a5aae7f7740956d281e94fcbe9f7cb97.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/4b/df4bfd14ecccad2e28acc7936a8ce0e3/pa/WP90453_a5aae7f7740956d281e94fcbe9f7cb97.jpg not downloaded yet
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F02%252F0902ecd716da7e9c1590d287d6183135%252Fpa%252FBS57464_163865abeb1170b2d8b9b95d51ae1483.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/02/0902ecd716da7e9c1590d287d6183135/pa/BS57464_163865abeb1170b2d8b9b95d51ae1483.jpg not downloaded yet
2026-01-28 20:01:21 [auto1.it] INFO: Found listing with ID: AV53381
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AV53381%27 HTTP/1.1" 200 None
2026-01-28 20:01:21 [auto1.it] INFO: Scrape type for AV53381: 0
2026-01-28 20:01:21 [auto1.it] INFO: Found listing with ID: WN11922
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WN11922%27 HTTP/1.1" 200 None
2026-01-28 20:01:21 [auto1.it] INFO: Scrape type for WN11922: 0
2026-01-28 20:01:21 [auto1.it] INFO: Found listing with ID: FX76200
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FX76200%27 HTTP/1.1" 200 None
2026-01-28 20:01:21 [auto1.it] INFO: Scrape type for FX76200: 0
2026-01-28 20:01:21 [auto1.it] INFO: Found listing with ID: FY62272
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FY62272%27 HTTP/1.1" 200 None
2026-01-28 20:01:21 [auto1.it] INFO: Scrape type for FY62272: 1
2026-01-28 20:01:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/fd/6dfd074bc8aa27b5d1e451429ee6253b/pa/DT01319_c34e56cba8999176cd467741a0a6ba89.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F4b%252Fdf4bfd14ecccad2e28acc7936a8ce0e3%252Fpa%252FWP90453_a5bca5bc69063a238a8e72798e72ade8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/4b/df4bfd14ecccad2e28acc7936a8ce0e3/pa/WP90453_a5bca5bc69063a238a8e72798e72ade8.jpg not downloaded yet
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F02%252F0902ecd716da7e9c1590d287d6183135%252Fpa%252FBS57464_c1b70dbbb06b6e666d45e02d6851c3c7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/02/0902ecd716da7e9c1590d287d6183135/pa/BS57464_c1b70dbbb06b6e666d45e02d6851c3c7.jpg not downloaded yet
2026-01-28 20:01:21 [auto1.it] INFO: Found listing with ID: ZL90358
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZL90358%27 HTTP/1.1" 200 None
2026-01-28 20:01:21 [auto1.it] INFO: Scrape type for ZL90358: 0
2026-01-28 20:01:21 [auto1.it] INFO: Found listing with ID: LM64931
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LM64931%27 HTTP/1.1" 200 None
2026-01-28 20:01:21 [auto1.it] INFO: Scrape type for LM64931: 0
2026-01-28 20:01:21 [auto1.it] INFO: Found listing with ID: AR75288
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AR75288%27 HTTP/1.1" 200 None
2026-01-28 20:01:21 [auto1.it] INFO: Scrape type for AR75288: 0
2026-01-28 20:01:21 [auto1.it] INFO: Found listing with ID: JP83347
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JP83347%27 HTTP/1.1" 200 None
2026-01-28 20:01:22 [auto1.it] INFO: Scrape type for JP83347: 0
2026-01-28 20:01:22 [auto1.it] INFO: Found listing with ID: AD90482
2026-01-28 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AD90482%27 HTTP/1.1" 200 None
2026-01-28 20:01:22 [auto1.it] INFO: Scrape type for AD90482: 0
2026-01-28 20:01:22 [auto1.it] INFO: Found listing with ID: RL99937
2026-01-28 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RL99937%27 HTTP/1.1" 200 None
2026-01-28 20:01:22 [auto1.it] INFO: Scrape type for RL99937: 0
2026-01-28 20:01:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 51fb1d92-1234-50fe-89b8-6f4c9311091e with identifier: YV35644
2026-01-28 20:01:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 51fb1d92-1234-50fe-89b8-6f4c9311091e with scrape type 1
2026-01-28 20:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 51fb1d92-1234-50fe-89b8-6f4c9311091e
2026-01-28 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252Fc9%252Fdbc9e5cdd071f8987a905146f61d20c5%252Fpa%252FYV35644_eb5aacf9606a0cc9bc41a7eee4c8c9b5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/c9/dbc9e5cdd071f8987a905146f61d20c5/pa/YV35644_eb5aacf9606a0cc9bc41a7eee4c8c9b5.jpg already downloaded
2026-01-28 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252Fc9%252Fdbc9e5cdd071f8987a905146f61d20c5%252Fpa%252FYV35644_1b3ae552cf3a779588eeadeea54a4020.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/c9/dbc9e5cdd071f8987a905146f61d20c5/pa/YV35644_1b3ae552cf3a779588eeadeea54a4020.jpg already downloaded
2026-01-28 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252Fc9%252Fdbc9e5cdd071f8987a905146f61d20c5%252Fpa%252FYV35644_3759d4af81b2f59725d87778c8441417.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/c9/dbc9e5cdd071f8987a905146f61d20c5/pa/YV35644_3759d4af81b2f59725d87778c8441417.jpg already downloaded
2026-01-28 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252Fc9%252Fdbc9e5cdd071f8987a905146f61d20c5%252Fpa%252FYV35644_b8204b2b9afc56371bac9420d8b13bab.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/c9/dbc9e5cdd071f8987a905146f61d20c5/pa/YV35644_b8204b2b9afc56371bac9420d8b13bab.jpg already downloaded
2026-01-28 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252Fc9%252Fdbc9e5cdd071f8987a905146f61d20c5%252Fpa%252FYV35644_50929a99fb9bc5f7f1f6338ce6ed04f2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/c9/dbc9e5cdd071f8987a905146f61d20c5/pa/YV35644_50929a99fb9bc5f7f1f6338ce6ed04f2.jpg already downloaded
2026-01-28 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252Fc9%252Fdbc9e5cdd071f8987a905146f61d20c5%252Fpa%252FYV35644_575a02e453b6eb93b27f2dd0f98170cf.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/c9/dbc9e5cdd071f8987a905146f61d20c5/pa/YV35644_575a02e453b6eb93b27f2dd0f98170cf.jpg already downloaded
2026-01-28 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252Fc9%252Fdbc9e5cdd071f8987a905146f61d20c5%252Fpa%252FYV35644_1cd6704de11596e3866f0dab96ad4b65.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/c9/dbc9e5cdd071f8987a905146f61d20c5/pa/YV35644_1cd6704de11596e3866f0dab96ad4b65.jpg already downloaded
2026-01-28 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252Fc9%252Fdbc9e5cdd071f8987a905146f61d20c5%252Fpa%252FYV35644_35e81a6833ef92ec7bea1f53b9d58509.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/c9/dbc9e5cdd071f8987a905146f61d20c5/pa/YV35644_35e81a6833ef92ec7bea1f53b9d58509.jpg already downloaded
2026-01-28 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252Fc9%252Fdbc9e5cdd071f8987a905146f61d20c5%252Fpa%252FYV35644_8b5ad670f7de59091e7ce2d8c1864f5f.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/c9/dbc9e5cdd071f8987a905146f61d20c5/pa/YV35644_8b5ad670f7de59091e7ce2d8c1864f5f.jpg already downloaded
2026-01-28 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252Fc9%252Fdbc9e5cdd071f8987a905146f61d20c5%252Fpa%252FYV35644_ca8894b47cd1055e840ab57e4c7453ed.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/c9/dbc9e5cdd071f8987a905146f61d20c5/pa/YV35644_ca8894b47cd1055e840ab57e4c7453ed.jpg already downloaded
2026-01-28 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252Fc9%252Fdbc9e5cdd071f8987a905146f61d20c5%252Fpa%252FYV35644_348b22ac96d90a1cfd8b32f3c574931c.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/c9/dbc9e5cdd071f8987a905146f61d20c5/pa/YV35644_348b22ac96d90a1cfd8b32f3c574931c.jpg already downloaded
2026-01-28 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252Fc9%252Fdbc9e5cdd071f8987a905146f61d20c5%252Fpa%252FYV35644_163e130b127a2d3ca3705b50decbed43.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/c9/dbc9e5cdd071f8987a905146f61d20c5/pa/YV35644_163e130b127a2d3ca3705b50decbed43.jpg already downloaded
2026-01-28 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252Fc9%252Fdbc9e5cdd071f8987a905146f61d20c5%252Fpa%252FYV35644_bc2fd12ea6c860fc782afa216045a29b.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/c9/dbc9e5cdd071f8987a905146f61d20c5/pa/YV35644_bc2fd12ea6c860fc782afa216045a29b.jpg already downloaded
2026-01-28 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252Fc9%252Fdbc9e5cdd071f8987a905146f61d20c5%252Fpa%252FYV35644_d99c0c1926f16edb11bb50c85395d2b0.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/c9/dbc9e5cdd071f8987a905146f61d20c5/pa/YV35644_d99c0c1926f16edb11bb50c85395d2b0.jpg already downloaded
2026-01-28 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252Fc9%252Fdbc9e5cdd071f8987a905146f61d20c5%252Fpa%252FYV35644_74b31bc3cbb7db114b4f5319ed233f7c.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/c9/dbc9e5cdd071f8987a905146f61d20c5/pa/YV35644_74b31bc3cbb7db114b4f5319ed233f7c.jpg already downloaded
2026-01-28 20:01:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 51fb1d92-1234-50fe-89b8-6f4c9311091e, identifier: YV35644
2026-01-28 20:01:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0a035f90>
2026-01-28 20:01:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f94eb59-79a1-5b19-acdb-80dde67f1f1f/7f94eb59-79a1-5b19-acdb-80dde67f1f1f_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F35%252F6c357bcdbe4e3e390bc49d66e1be4a06%252Fpa%252FLM18187_5f3991c16bc7d1bbfd1fab7c6936b1bb.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/35/6c357bcdbe4e3e390bc49d66e1be4a06/pa/LM18187_5f3991c16bc7d1bbfd1fab7c6936b1bb.jpg saved to cache
2026-01-28 20:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7f94eb59-79a1-5b19-acdb-80dde67f1f1f
2026-01-28 20:01:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 51fb1d92-1234-50fe-89b8-6f4c9311091e with identifier: YV35644
2026-01-28 20:01:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 51fb1d92-1234-50fe-89b8-6f4c9311091e with identifier: YV35644
2026-01-28 20:01:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 51fb1d92-1234-50fe-89b8-6f4c9311091e with identifier: YV35644 to the API
2026-01-28 20:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:01:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:01:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YV35644>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.0L',
 'engine_horse_power': 120,
 'expiration_date': '2026-01-29T16:31:14Z',
 'fuel_type': 'petrol',
 'id': '51fb1d92-1234-50fe-89b8-6f4c9311091e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YV35644',
 'listing': 'auction',
 'location': 'IT, Roma',
 'make': 'Hyundai',
 'model': 'Kona',
 'odometer': 86501,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgdb/c9/dbc9e5cdd071f8987a905146f61d20c5/pa/YV35644_eb5aacf9606a0cc9bc41a7eee4c8c9b5.jpg',
                'https://img-pa.auto1.com/imgdb/c9/dbc9e5cdd071f8987a905146f61d20c5/pa/YV35644_1b3ae552cf3a779588eeadeea54a4020.jpg',
                'https://img-pa.auto1.com/imgdb/c9/dbc9e5cdd071f8987a905146f61d20c5/pa/YV35644_3759d4af81b2f59725d87778c8441417.jpg',
                'https://img-pa.auto1.com/imgdb/c9/dbc9e5cdd071f8987a905146f61d20c5/pa/YV35644_b8204b2b9afc56371bac9420d8b13bab.jpg',
                'https://img-pa.auto1.com/imgdb/c9/dbc9e5cdd071f8987a905146f61d20c5/pa/YV35644_50929a99fb9bc5f7f1f6338ce6ed04f2.jpg',
                'https://img-pa.auto1.com/imgdb/c9/dbc9e5cdd071f8987a905146f61d20c5/pa/YV35644_575a02e453b6eb93b27f2dd0f98170cf.jpg',
                'https://img-pa.auto1.com/imgdb/c9/dbc9e5cdd071f8987a905146f61d20c5/pa/YV35644_1cd6704de11596e3866f0dab96ad4b65.jpg',
                'https://img-pa.auto1.com/imgdb/c9/dbc9e5cdd071f8987a905146f61d20c5/pa/YV35644_35e81a6833ef92ec7bea1f53b9d58509.jpg',
                'https://img-pa.auto1.com/imgdb/c9/dbc9e5cdd071f8987a905146f61d20c5/pa/YV35644_8b5ad670f7de59091e7ce2d8c1864f5f.jpg',
                'https://img-pa.auto1.com/imgdb/c9/dbc9e5cdd071f8987a905146f61d20c5/pa/YV35644_ca8894b47cd1055e840ab57e4c7453ed.jpg',
                'https://img-pa.auto1.com/imgdb/c9/dbc9e5cdd071f8987a905146f61d20c5/pa/YV35644_348b22ac96d90a1cfd8b32f3c574931c.jpg',
                'https://img-pa.auto1.com/imgdb/c9/dbc9e5cdd071f8987a905146f61d20c5/pa/YV35644_163e130b127a2d3ca3705b50decbed43.jpg',
                'https://img-pa.auto1.com/imgdb/c9/dbc9e5cdd071f8987a905146f61d20c5/pa/YV35644_bc2fd12ea6c860fc782afa216045a29b.jpg',
                'https://img-pa.auto1.com/imgdb/c9/dbc9e5cdd071f8987a905146f61d20c5/pa/YV35644_d99c0c1926f16edb11bb50c85395d2b0.jpg',
                'https://img-pa.auto1.com/imgdb/c9/dbc9e5cdd071f8987a905146f61d20c5/pa/YV35644_74b31bc3cbb7db114b4f5319ed233f7c.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51fb1d92-1234-50fe-89b8-6f4c9311091e/51fb1d92-1234-50fe-89b8-6f4c9311091e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2475961,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/c9/dbc9e5cdd071f8987a905146f61d20c5/pa/YV35644_eb5aacf9606a0cc9bc41a7eee4c8c9b5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51fb1d92-1234-50fe-89b8-6f4c9311091e/51fb1d92-1234-50fe-89b8-6f4c9311091e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68073,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/c9/dbc9e5cdd071f8987a905146f61d20c5/pa/YV35644_1b3ae552cf3a779588eeadeea54a4020.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51fb1d92-1234-50fe-89b8-6f4c9311091e/51fb1d92-1234-50fe-89b8-6f4c9311091e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60061,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/c9/dbc9e5cdd071f8987a905146f61d20c5/pa/YV35644_3759d4af81b2f59725d87778c8441417.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51fb1d92-1234-50fe-89b8-6f4c9311091e/51fb1d92-1234-50fe-89b8-6f4c9311091e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56297,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/c9/dbc9e5cdd071f8987a905146f61d20c5/pa/YV35644_b8204b2b9afc56371bac9420d8b13bab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51fb1d92-1234-50fe-89b8-6f4c9311091e/51fb1d92-1234-50fe-89b8-6f4c9311091e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58245,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/c9/dbc9e5cdd071f8987a905146f61d20c5/pa/YV35644_50929a99fb9bc5f7f1f6338ce6ed04f2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51fb1d92-1234-50fe-89b8-6f4c9311091e/51fb1d92-1234-50fe-89b8-6f4c9311091e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59480,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/c9/dbc9e5cdd071f8987a905146f61d20c5/pa/YV35644_575a02e453b6eb93b27f2dd0f98170cf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51fb1d92-1234-50fe-89b8-6f4c9311091e/51fb1d92-1234-50fe-89b8-6f4c9311091e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52554,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/c9/dbc9e5cdd071f8987a905146f61d20c5/pa/YV35644_1cd6704de11596e3866f0dab96ad4b65.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51fb1d92-1234-50fe-89b8-6f4c9311091e/51fb1d92-1234-50fe-89b8-6f4c9311091e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63383,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/c9/dbc9e5cdd071f8987a905146f61d20c5/pa/YV35644_35e81a6833ef92ec7bea1f53b9d58509.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51fb1d92-1234-50fe-89b8-6f4c9311091e/51fb1d92-1234-50fe-89b8-6f4c9311091e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2559016,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/c9/dbc9e5cdd071f8987a905146f61d20c5/pa/YV35644_8b5ad670f7de59091e7ce2d8c1864f5f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51fb1d92-1234-50fe-89b8-6f4c9311091e/51fb1d92-1234-50fe-89b8-6f4c9311091e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51492,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/c9/dbc9e5cdd071f8987a905146f61d20c5/pa/YV35644_ca8894b47cd1055e840ab57e4c7453ed.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51fb1d92-1234-50fe-89b8-6f4c9311091e/51fb1d92-1234-50fe-89b8-6f4c9311091e_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62811,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/c9/dbc9e5cdd071f8987a905146f61d20c5/pa/YV35644_348b22ac96d90a1cfd8b32f3c574931c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51fb1d92-1234-50fe-89b8-6f4c9311091e/51fb1d92-1234-50fe-89b8-6f4c9311091e_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62756,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/c9/dbc9e5cdd071f8987a905146f61d20c5/pa/YV35644_163e130b127a2d3ca3705b50decbed43.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51fb1d92-1234-50fe-89b8-6f4c9311091e/51fb1d92-1234-50fe-89b8-6f4c9311091e_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45192,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/c9/dbc9e5cdd071f8987a905146f61d20c5/pa/YV35644_bc2fd12ea6c860fc782afa216045a29b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51fb1d92-1234-50fe-89b8-6f4c9311091e/51fb1d92-1234-50fe-89b8-6f4c9311091e_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47132,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/c9/dbc9e5cdd071f8987a905146f61d20c5/pa/YV35644_d99c0c1926f16edb11bb50c85395d2b0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51fb1d92-1234-50fe-89b8-6f4c9311091e/51fb1d92-1234-50fe-89b8-6f4c9311091e_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80688,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/c9/dbc9e5cdd071f8987a905146f61d20c5/pa/YV35644_74b31bc3cbb7db114b4f5319ed233f7c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-09-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai Kona 1.0 TGDI Xpossible 2WD',
 'transmission': 'manual',
 'trim': 'Xpossible 2WD',
 'year': 2018}
2026-01-28 20:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YV35644%27 HTTP/1.1" 200 None
2026-01-28 20:01:23 [auto1.it] INFO: Saving data for YV35644: {'created_time': 1769630483.326473, 'last_price_update_time': 1769630483.326486, 'auction_closing_time': 1769704274.0}
2026-01-28 20:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YV35644') HTTP/1.1" 204 0
2026-01-28 20:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/02/0902ecd716da7e9c1590d287d6183135/pa/BS57464_daeb323d5d299421c411d03473aa4470.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F4b%252Fdf4bfd14ecccad2e28acc7936a8ce0e3%252Fpa%252FWP90453_93b110262fd9a10dc7b9c6b4fbac7272.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/4b/df4bfd14ecccad2e28acc7936a8ce0e3/pa/WP90453_93b110262fd9a10dc7b9c6b4fbac7272.jpg not downloaded yet
2026-01-28 20:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F02%252F0902ecd716da7e9c1590d287d6183135%252Fpa%252FBS57464_302398b64755b6ca6907b589f779f9e7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/02/0902ecd716da7e9c1590d287d6183135/pa/BS57464_302398b64755b6ca6907b589f779f9e7.jpg not downloaded yet
2026-01-28 20:01:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08cb3290>
2026-01-28 20:01:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f94eb59-79a1-5b19-acdb-80dde67f1f1f/7f94eb59-79a1-5b19-acdb-80dde67f1f1f_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F35%252F6c357bcdbe4e3e390bc49d66e1be4a06%252Fpa%252FLM18187_62f019c9ae01ed518a8bec714bc5792b.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/35/6c357bcdbe4e3e390bc49d66e1be4a06/pa/LM18187_62f019c9ae01ed518a8bec714bc5792b.jpg saved to cache
2026-01-28 20:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7f94eb59-79a1-5b19-acdb-80dde67f1f1f
2026-01-28 20:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TZ83605> (referer: https://www.auto1.com/v1/car-details-view/TZ83605/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F4b%252Fdf4bfd14ecccad2e28acc7936a8ce0e3%252Fpa%252FWP90453_5164512a0e4869a656b3f1948f45a465.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/4b/df4bfd14ecccad2e28acc7936a8ce0e3/pa/WP90453_5164512a0e4869a656b3f1948f45a465.jpg not downloaded yet
2026-01-28 20:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F02%252F0902ecd716da7e9c1590d287d6183135%252Fpa%252FBS57464_3ff61e0f1aa47ff8b1ff339c847d1df4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/02/0902ecd716da7e9c1590d287d6183135/pa/BS57464_3ff61e0f1aa47ff8b1ff339c847d1df4.jpg not downloaded yet
2026-01-28 20:01:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:01:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/fd/6dfd074bc8aa27b5d1e451429ee6253b/pa/DT01319_9d386f8bc285aff651deb78cac0cca13.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:01:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:01:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08cb2c50>
2026-01-28 20:01:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06562d43-54c7-5384-9120-73a6f85a3726/06562d43-54c7-5384-9120-73a6f85a3726_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Ffd%252F6dfd074bc8aa27b5d1e451429ee6253b%252Fpa%252FDT01319_c34e56cba8999176cd467741a0a6ba89.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/fd/6dfd074bc8aa27b5d1e451429ee6253b/pa/DT01319_c34e56cba8999176cd467741a0a6ba89.jpg saved to cache
2026-01-28 20:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 06562d43-54c7-5384-9120-73a6f85a3726
2026-01-28 20:01:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09d75f50>
2026-01-28 20:01:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab2b9426-2a4e-5843-bea9-eeabb5e12b74/ab2b9426-2a4e-5843-bea9-eeabb5e12b74_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F02%252F0902ecd716da7e9c1590d287d6183135%252Fpa%252FBS57464_daeb323d5d299421c411d03473aa4470.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/02/0902ecd716da7e9c1590d287d6183135/pa/BS57464_daeb323d5d299421c411d03473aa4470.jpg saved to cache
2026-01-28 20:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ab2b9426-2a4e-5843-bea9-eeabb5e12b74
2026-01-28 20:01:24 [scrapy.extensions.logstats] INFO: Crawled 88 pages (at 88 pages/min), scraped 23 items (at 23 items/min)
2026-01-28 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F4b%252Fdf4bfd14ecccad2e28acc7936a8ce0e3%252Fpa%252FWP90453_ccca9d71508fcd7d57abdbce4b6c6fef.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/4b/df4bfd14ecccad2e28acc7936a8ce0e3/pa/WP90453_ccca9d71508fcd7d57abdbce4b6c6fef.jpg not downloaded yet
2026-01-28 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F02%252F0902ecd716da7e9c1590d287d6183135%252Fpa%252FBS57464_cc7d9af4ba3e94dc77983939a6ed99e5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/02/0902ecd716da7e9c1590d287d6183135/pa/BS57464_cc7d9af4ba3e94dc77983939a6ed99e5.jpg not downloaded yet
2026-01-28 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F4b%252Fdf4bfd14ecccad2e28acc7936a8ce0e3%252Fpa%252FWP90453_5b07f13bcb01c664301ec1a6275802a6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/4b/df4bfd14ecccad2e28acc7936a8ce0e3/pa/WP90453_5b07f13bcb01c664301ec1a6275802a6.jpg not downloaded yet
2026-01-28 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F02%252F0902ecd716da7e9c1590d287d6183135%252Fpa%252FBS57464_f1460c21492cd74c610c7d629e277945.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/02/0902ecd716da7e9c1590d287d6183135/pa/BS57464_f1460c21492cd74c610c7d629e277945.jpg not downloaded yet
2026-01-28 20:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KW61095/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JY88451/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PG92884/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RY80591/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KD59831> (referer: https://www.auto1.com/v1/car-details-view/KD59831/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AW68260> (referer: https://www.auto1.com/v1/car-details-view/AW68260/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:01:24 [auto1.it] INFO: Parsing search results for channel: 24h
2026-01-28 20:01:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4b2a49a6-5f2b-5692-a1a2-27ebe5ca1227 with identifier: TZ83605
2026-01-28 20:01:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b2a49a6-5f2b-5692-a1a2-27ebe5ca1227 with scrape type 1
2026-01-28 20:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 4b2a49a6-5f2b-5692-a1a2-27ebe5ca1227
2026-01-28 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Ff1%252Fa9f10ebe41cd775023aa7cea3236430e%252Fpa%252FTZ83605_d71191ed0769835090202c97bb1a49a3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/f1/a9f10ebe41cd775023aa7cea3236430e/pa/TZ83605_d71191ed0769835090202c97bb1a49a3.jpg not downloaded yet
2026-01-28 20:01:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:01:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0a067490>
2026-01-28 20:01:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06562d43-54c7-5384-9120-73a6f85a3726/06562d43-54c7-5384-9120-73a6f85a3726_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Ffd%252F6dfd074bc8aa27b5d1e451429ee6253b%252Fpa%252FDT01319_9d386f8bc285aff651deb78cac0cca13.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/fd/6dfd074bc8aa27b5d1e451429ee6253b/pa/DT01319_9d386f8bc285aff651deb78cac0cca13.jpg saved to cache
2026-01-28 20:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 06562d43-54c7-5384-9120-73a6f85a3726
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F4b%252Fdf4bfd14ecccad2e28acc7936a8ce0e3%252Fpa%252FWP90453_519a5d84b8f8eb2abf29378e0d8e5659.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/4b/df4bfd14ecccad2e28acc7936a8ce0e3/pa/WP90453_519a5d84b8f8eb2abf29378e0d8e5659.jpg not downloaded yet
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F02%252F0902ecd716da7e9c1590d287d6183135%252Fpa%252FBS57464_eaf0156791ad4ad12adf6a9dd987298c.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/02/0902ecd716da7e9c1590d287d6183135/pa/BS57464_eaf0156791ad4ad12adf6a9dd987298c.jpg not downloaded yet
2026-01-28 20:01:25 [auto1.it] INFO: Found listing with ID: YY06074
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YY06074%27 HTTP/1.1" 200 None
2026-01-28 20:01:25 [auto1.it] INFO: Scrape type for YY06074: 0
2026-01-28 20:01:25 [auto1.it] INFO: Found listing with ID: MG24546
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MG24546%27 HTTP/1.1" 200 None
2026-01-28 20:01:25 [auto1.it] INFO: Scrape type for MG24546: 0
2026-01-28 20:01:25 [auto1.it] INFO: Found listing with ID: NF65001
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NF65001%27 HTTP/1.1" 200 None
2026-01-28 20:01:25 [auto1.it] INFO: Scrape type for NF65001: 0
2026-01-28 20:01:25 [auto1.it] INFO: Found listing with ID: JS30214
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JS30214%27 HTTP/1.1" 200 None
2026-01-28 20:01:25 [auto1.it] INFO: Scrape type for JS30214: 0
2026-01-28 20:01:25 [auto1.it] INFO: Found listing with ID: XD70855
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XD70855%27 HTTP/1.1" 200 None
2026-01-28 20:01:25 [auto1.it] INFO: Scrape type for XD70855: 0
2026-01-28 20:01:25 [auto1.it] INFO: Found listing with ID: VY49338
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VY49338%27 HTTP/1.1" 200 None
2026-01-28 20:01:25 [auto1.it] INFO: Scrape type for VY49338: 0
2026-01-28 20:01:25 [auto1.it] INFO: Found listing with ID: FJ86916
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FJ86916%27 HTTP/1.1" 200 None
2026-01-28 20:01:25 [auto1.it] INFO: Scrape type for FJ86916: 2
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Ff1%252Fa9f10ebe41cd775023aa7cea3236430e%252Fpa%252FTZ83605_18f900b8c354bac06c69c28bc9c5fa1d.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/f1/a9f10ebe41cd775023aa7cea3236430e/pa/TZ83605_18f900b8c354bac06c69c28bc9c5fa1d.jpg not downloaded yet
2026-01-28 20:01:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d05731c1-99aa-5314-b95f-8d307b00a380 with identifier: KD59831
2026-01-28 20:01:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d05731c1-99aa-5314-b95f-8d307b00a380 with scrape type 2
2026-01-28 20:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d05731c1-99aa-5314-b95f-8d307b00a380 with scrape type 2
2026-01-28 20:01:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d05731c1-99aa-5314-b95f-8d307b00a380, identifier: KD59831
2026-01-28 20:01:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c5618d2-b669-5ad2-838c-20c123c74357 with identifier: AW68260
2026-01-28 20:01:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c5618d2-b669-5ad2-838c-20c123c74357 with scrape type 1
2026-01-28 20:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 4c5618d2-b669-5ad2-838c-20c123c74357
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F2b%252F032b457b787f642f8a61ead8f33dbc0f%252Fpa%252FAW68260_d7917356b18061b04fbefe02e658d3d1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/2b/032b457b787f642f8a61ead8f33dbc0f/pa/AW68260_d7917356b18061b04fbefe02e658d3d1.jpg not downloaded yet
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F4b%252Fdf4bfd14ecccad2e28acc7936a8ce0e3%252Fpa%252FWP90453_5692ea7a29194d6b76bdb33e983dfd10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/4b/df4bfd14ecccad2e28acc7936a8ce0e3/pa/WP90453_5692ea7a29194d6b76bdb33e983dfd10.jpg not downloaded yet
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F02%252F0902ecd716da7e9c1590d287d6183135%252Fpa%252FBS57464_2d2be8bde02b767e2dc0fb7624bba0c0.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/02/0902ecd716da7e9c1590d287d6183135/pa/BS57464_2d2be8bde02b767e2dc0fb7624bba0c0.jpg not downloaded yet
2026-01-28 20:01:25 [auto1.it] INFO: Found listing with ID: VS63491
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VS63491%27 HTTP/1.1" 200 None
2026-01-28 20:01:25 [auto1.it] INFO: Scrape type for VS63491: 0
2026-01-28 20:01:25 [auto1.it] INFO: Found listing with ID: ML60826
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ML60826%27 HTTP/1.1" 200 None
2026-01-28 20:01:25 [auto1.it] INFO: Scrape type for ML60826: 0
2026-01-28 20:01:25 [auto1.it] INFO: Found listing with ID: FU48439
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FU48439%27 HTTP/1.1" 200 None
2026-01-28 20:01:25 [auto1.it] INFO: Scrape type for FU48439: 0
2026-01-28 20:01:25 [auto1.it] INFO: Found listing with ID: BP48595
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BP48595%27 HTTP/1.1" 200 None
2026-01-28 20:01:25 [auto1.it] INFO: Scrape type for BP48595: 0
2026-01-28 20:01:25 [auto1.it] INFO: Found listing with ID: GX60446
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GX60446%27 HTTP/1.1" 200 None
2026-01-28 20:01:25 [auto1.it] INFO: Scrape type for GX60446: 0
2026-01-28 20:01:25 [auto1.it] INFO: Found listing with ID: UU64650
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UU64650%27 HTTP/1.1" 200 None
2026-01-28 20:01:25 [auto1.it] INFO: Scrape type for UU64650: 0
2026-01-28 20:01:25 [auto1.it] INFO: Found listing with ID: BW17838
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BW17838%27 HTTP/1.1" 200 None
2026-01-28 20:01:25 [auto1.it] INFO: Scrape type for BW17838: 0
2026-01-28 20:01:25 [auto1.it] INFO: Found listing with ID: ZP16966
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZP16966%27 HTTP/1.1" 200 None
2026-01-28 20:01:25 [auto1.it] INFO: Scrape type for ZP16966: 0
2026-01-28 20:01:25 [auto1.it] INFO: Found listing with ID: AY21953
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AY21953%27 HTTP/1.1" 200 None
2026-01-28 20:01:25 [auto1.it] INFO: Scrape type for AY21953: 0
2026-01-28 20:01:25 [auto1.it] INFO: Found listing with ID: KN31697
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KN31697%27 HTTP/1.1" 200 None
2026-01-28 20:01:25 [auto1.it] INFO: Scrape type for KN31697: 0
2026-01-28 20:01:25 [auto1.it] INFO: Found listing with ID: DS86175
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DS86175%27 HTTP/1.1" 200 None
2026-01-28 20:01:25 [auto1.it] INFO: Scrape type for DS86175: 0
2026-01-28 20:01:25 [auto1.it] INFO: Found listing with ID: SJ77848
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SJ77848%27 HTTP/1.1" 200 None
2026-01-28 20:01:25 [auto1.it] INFO: Scrape type for SJ77848: 0
2026-01-28 20:01:25 [auto1.it] INFO: Found listing with ID: ML77651
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ML77651%27 HTTP/1.1" 200 None
2026-01-28 20:01:25 [auto1.it] INFO: Scrape type for ML77651: 0
2026-01-28 20:01:25 [auto1.it] INFO: Found listing with ID: ET25388
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ET25388%27 HTTP/1.1" 200 None
2026-01-28 20:01:25 [auto1.it] INFO: Scrape type for ET25388: 0
2026-01-28 20:01:25 [auto1.it] INFO: Found listing with ID: XW74392
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XW74392%27 HTTP/1.1" 200 None
2026-01-28 20:01:25 [auto1.it] INFO: Scrape type for XW74392: 0
2026-01-28 20:01:25 [auto1.it] INFO: Found listing with ID: WD98953
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WD98953%27 HTTP/1.1" 200 None
2026-01-28 20:01:25 [auto1.it] INFO: Scrape type for WD98953: 2
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Ff1%252Fa9f10ebe41cd775023aa7cea3236430e%252Fpa%252FTZ83605_18953367826cccc341695f99f2395d7b.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/f1/a9f10ebe41cd775023aa7cea3236430e/pa/TZ83605_18953367826cccc341695f99f2395d7b.jpg not downloaded yet
2026-01-28 20:01:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d05731c1-99aa-5314-b95f-8d307b00a380 with identifier: KD59831
2026-01-28 20:01:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d05731c1-99aa-5314-b95f-8d307b00a380 with identifier: KD59831
2026-01-28 20:01:26 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'ssangyong rexton 2.2 e-xdi dream 4wd', 'price': 0, 'currency': 'eur', 'make': 'ssangyong', 'model': 'rexton', 'transmission': 'automatic', 'odometer': 19985, 'odometer_reading_unit': 'km', 'registration_date': '2024-12-15', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/kd59831', 'expiration_date': '2026-01-29t16:19:51z', 'origin_country_code': 'it', 'trim': 'dream 4wd', 'year': 2024, 'fuel_type': 'diesel', 'listing': 'auction', 'engine_horse_power': 202, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '2.2l', 'location': 'it, padova', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6d', 'c_o_2_emission_value': 242, 'id': 'd05731c1-99aa-5314-b95f-8d307b00a380', 'current_year_diff': 2, 'age_in_months': 13, 'make_model': 'ssangyong rexton', 'sanitized_make': 'ssangyong', 'odometer_in_km': 19985}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 13,
     'auction_title': '',
     'c_o_2_emission_value': 242,
     'category': None,
     'color': 'black',
     'currency': 'eur',
     'current_year_diff': 2,
     'doors_number': 5,
     'emission_standard': 'euro 6d',
     'engine': '2.2l',
     'engine_horse_power': 202,
     'expiration_date': '2026-01-29t16:19:51z',
     'fuel_type': 'diesel',
     'id': 'd05731c1-99aa-5314-b95f-8d307b00a380',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/kd59831',
     'listing': 'auction',
     'location': 'it, padova',
     'make': 'ssangyong',
     'make_model': 'ssangyong rexton',
     'model': 'rexton',
     'odometer': 19985,
     'odometer_in_km': 19985,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'it',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2024-12-15',
     'sanitized_make': 'ssangyong',
     'seats_number': 5,
     'seller_name': None,
     'title': 'ssangyong rexton 2.2 e-xdi dream 4wd',
     'transmission': 'automatic',
     'trim': 'dream 4wd',
     'year': 2024}
2026-01-28 20:01:26 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_NOT_ALLOWED failed for item: d05731c1-99aa-5314-b95f-8d307b00a380 spider: auto1.it
2026-01-28 20:01:26 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: d05731c1-99aa-5314-b95f-8d307b00a380 due to rule: makes_not_allowed.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'ssangyong rexton 2.2 e-xdi dream 4wd', 'price': 0, 'currency': 'eur', 'make': 'ssangyong', 'model': 'rexton', 'transmission': 'automatic', 'odometer': 19985, 'odometer_reading_unit': 'km', 'registration_date': '2024-12-15', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/kd59831', 'expiration_date': '2026-01-29t16:19:51z', 'origin_country_code': 'it', 'trim': 'dream 4wd', 'year': 2024, 'fuel_type': 'diesel', 'listing': 'auction', 'engine_horse_power': 202, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '2.2l', 'location': 'it, padova', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6d', 'c_o_2_emission_value': 242, 'id': 'd05731c1-99aa-5314-b95f-8d307b00a380', 'current_year_diff': 2, 'age_in_months': 13, 'make_model': 'ssangyong rexton', 'sanitized_make': 'ssangyong', 'odometer_in_km': 19985}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 13,
     'auction_title': '',
     'c_o_2_emission_value': 242,
     'category': None,
     'color': 'black',
     'currency': 'eur',
     'current_year_diff': 2,
     'doors_number': 5,
     'emission_standard': 'euro 6d',
     'engine': '2.2l',
     'engine_horse_power': 202,
     'expiration_date': '2026-01-29t16:19:51z',
     'fuel_type': 'diesel',
     'id': 'd05731c1-99aa-5314-b95f-8d307b00a380',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/kd59831',
     'listing': 'auction',
     'location': 'it, padova',
     'make': 'ssangyong',
     'make_model': 'ssangyong rexton',
     'model': 'rexton',
     'odometer': 19985,
     'odometer_in_km': 19985,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'it',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2024-12-15',
     'sanitized_make': 'ssangyong',
     'seats_number': 5,
     'seller_name': None,
     'title': 'ssangyong rexton 2.2 e-xdi dream 4wd',
     'transmission': 'automatic',
     'trim': 'dream 4wd',
     'year': 2024}
{'auction_title': '',
 'c_o_2_emission_value': 242,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.2L',
 'engine_horse_power': 202,
 'expiration_date': '2026-01-29T16:19:51Z',
 'fuel_type': 'diesel',
 'id': 'd05731c1-99aa-5314-b95f-8d307b00a380',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KD59831',
 'listing': 'auction',
 'location': 'IT, Padova',
 'make': 'Ssangyong',
 'model': 'Rexton',
 'odometer': 19985,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-12-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ssangyong Rexton 2.2 e-Xdi Dream 4WD',
 'transmission': 'automatic',
 'trim': 'Dream 4WD',
 'year': 2024}
2026-01-28 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KD59831%27 HTTP/1.1" 200 None
2026-01-28 20:01:26 [auto1.it] INFO: Saving data for KD59831: {'auction_closing_time': 1769703591.0, 'created_time': 1769544039.121882, 'last_price_update_time': 1769630486.163133}
2026-01-28 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KD59831') HTTP/1.1" 204 0
2026-01-28 20:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/fd/6dfd074bc8aa27b5d1e451429ee6253b/pa/DT01319_03eeb3edadff23fd5e8ffe88d492027e.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F2b%252F032b457b787f642f8a61ead8f33dbc0f%252Fpa%252FAW68260_8d0a62e280a77cf5ad600e28104434c3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/2b/032b457b787f642f8a61ead8f33dbc0f/pa/AW68260_8d0a62e280a77cf5ad600e28104434c3.jpg not downloaded yet
2026-01-28 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F4b%252Fdf4bfd14ecccad2e28acc7936a8ce0e3%252Fpa%252FWP90453_88b89d76751978fa70ee331dcffbb01f.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/4b/df4bfd14ecccad2e28acc7936a8ce0e3/pa/WP90453_88b89d76751978fa70ee331dcffbb01f.jpg not downloaded yet
2026-01-28 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F02%252F0902ecd716da7e9c1590d287d6183135%252Fpa%252FBS57464_b8c7211807b44ef8b62482d8a517d517.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/02/0902ecd716da7e9c1590d287d6183135/pa/BS57464_b8c7211807b44ef8b62482d8a517d517.jpg not downloaded yet
2026-01-28 20:01:26 [auto1.it] INFO: Found listing with ID: UW51000
2026-01-28 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UW51000%27 HTTP/1.1" 200 None
2026-01-28 20:01:26 [auto1.it] INFO: Scrape type for UW51000: 0
2026-01-28 20:01:26 [auto1.it] INFO: Found listing with ID: JS38459
2026-01-28 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JS38459%27 HTTP/1.1" 200 None
2026-01-28 20:01:26 [auto1.it] INFO: Scrape type for JS38459: 0
2026-01-28 20:01:26 [auto1.it] INFO: Found listing with ID: HA56454
2026-01-28 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HA56454%27 HTTP/1.1" 200 None
2026-01-28 20:01:26 [auto1.it] INFO: Scrape type for HA56454: 0
2026-01-28 20:01:26 [auto1.it] INFO: Found listing with ID: NL47896
2026-01-28 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NL47896%27 HTTP/1.1" 200 None
2026-01-28 20:01:26 [auto1.it] INFO: Scrape type for NL47896: 1
2026-01-28 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Ff1%252Fa9f10ebe41cd775023aa7cea3236430e%252Fpa%252FTZ83605_2f15c463774fb99cf81d3f3a2b471e2f.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/f1/a9f10ebe41cd775023aa7cea3236430e/pa/TZ83605_2f15c463774fb99cf81d3f3a2b471e2f.jpg not downloaded yet
2026-01-28 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F2b%252F032b457b787f642f8a61ead8f33dbc0f%252Fpa%252FAW68260_199d709626359ab90d07f1ba6d8d7e02.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/2b/032b457b787f642f8a61ead8f33dbc0f/pa/AW68260_199d709626359ab90d07f1ba6d8d7e02.jpg not downloaded yet
2026-01-28 20:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FY62272/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DY55087> (referer: https://www.auto1.com/v1/car-details-view/DY55087/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F4b%252Fdf4bfd14ecccad2e28acc7936a8ce0e3%252Fpa%252FWP90453_c1480a6f33c6e3eaf9adc39daec1f61b.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/4b/df4bfd14ecccad2e28acc7936a8ce0e3/pa/WP90453_c1480a6f33c6e3eaf9adc39daec1f61b.jpg not downloaded yet
2026-01-28 20:01:26 [auto1.it] INFO: Found listing with ID: SX30398
2026-01-28 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SX30398%27 HTTP/1.1" 200 None
2026-01-28 20:01:26 [auto1.it] INFO: Scrape type for SX30398: 0
2026-01-28 20:01:26 [auto1.it] INFO: Found listing with ID: NC94766
2026-01-28 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NC94766%27 HTTP/1.1" 200 None
2026-01-28 20:01:26 [auto1.it] INFO: Scrape type for NC94766: 0
2026-01-28 20:01:26 [auto1.it] INFO: Found listing with ID: CH15659
2026-01-28 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CH15659%27 HTTP/1.1" 200 None
2026-01-28 20:01:26 [auto1.it] INFO: Scrape type for CH15659: 0
2026-01-28 20:01:26 [auto1.it] INFO: Found listing with ID: LL61662
2026-01-28 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LL61662%27 HTTP/1.1" 200 None
2026-01-28 20:01:26 [auto1.it] INFO: Scrape type for LL61662: 0
2026-01-28 20:01:26 [auto1.it] INFO: Found listing with ID: EW00290
2026-01-28 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EW00290%27 HTTP/1.1" 200 None
2026-01-28 20:01:26 [auto1.it] INFO: Scrape type for EW00290: 0
2026-01-28 20:01:26 [auto1.it] INFO: Found listing with ID: FP41040
2026-01-28 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FP41040%27 HTTP/1.1" 200 None
2026-01-28 20:01:26 [auto1.it] INFO: Scrape type for FP41040: 1
2026-01-28 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Ff1%252Fa9f10ebe41cd775023aa7cea3236430e%252Fpa%252FTZ83605_b40f13a96d87cd9c21a8e4a73da8da76.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/f1/a9f10ebe41cd775023aa7cea3236430e/pa/TZ83605_b40f13a96d87cd9c21a8e4a73da8da76.jpg not downloaded yet
2026-01-28 20:01:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F2b%252F032b457b787f642f8a61ead8f33dbc0f%252Fpa%252FAW68260_24480b77785dc0f75c4aac45bf1d7343.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/2b/032b457b787f642f8a61ead8f33dbc0f/pa/AW68260_24480b77785dc0f75c4aac45bf1d7343.jpg not downloaded yet
2026-01-28 20:01:26 [auto1.it] INFO: Found listing with ID: FL81040
2026-01-28 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FL81040%27 HTTP/1.1" 200 None
2026-01-28 20:01:26 [auto1.it] INFO: Scrape type for FL81040: 0
2026-01-28 20:01:26 [auto1.it] INFO: Found listing with ID: YA96052
2026-01-28 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YA96052%27 HTTP/1.1" 200 None
2026-01-28 20:01:26 [auto1.it] INFO: Scrape type for YA96052: 1
2026-01-28 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Ff1%252Fa9f10ebe41cd775023aa7cea3236430e%252Fpa%252FTZ83605_1c07b726026d2dd703fe883db828437b.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/f1/a9f10ebe41cd775023aa7cea3236430e/pa/TZ83605_1c07b726026d2dd703fe883db828437b.jpg not downloaded yet
2026-01-28 20:01:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:01:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0ea86f50>
2026-01-28 20:01:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06562d43-54c7-5384-9120-73a6f85a3726/06562d43-54c7-5384-9120-73a6f85a3726_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Ffd%252F6dfd074bc8aa27b5d1e451429ee6253b%252Fpa%252FDT01319_03eeb3edadff23fd5e8ffe88d492027e.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/fd/6dfd074bc8aa27b5d1e451429ee6253b/pa/DT01319_03eeb3edadff23fd5e8ffe88d492027e.jpg saved to cache
2026-01-28 20:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 06562d43-54c7-5384-9120-73a6f85a3726
2026-01-28 20:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/4b/df4bfd14ecccad2e28acc7936a8ce0e3/pa/WP90453_5164512a0e4869a656b3f1948f45a465.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F2b%252F032b457b787f642f8a61ead8f33dbc0f%252Fpa%252FAW68260_aee17fd1b51b465a8d57b6558182f8b5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/2b/032b457b787f642f8a61ead8f33dbc0f/pa/AW68260_aee17fd1b51b465a8d57b6558182f8b5.jpg not downloaded yet
2026-01-28 20:01:27 [auto1.it] INFO: Found listing with ID: UW96033
2026-01-28 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UW96033%27 HTTP/1.1" 200 None
2026-01-28 20:01:27 [auto1.it] INFO: Scrape type for UW96033: 0
2026-01-28 20:01:27 [auto1.it] INFO: Found listing with ID: AD03373
2026-01-28 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AD03373%27 HTTP/1.1" 200 None
2026-01-28 20:01:27 [auto1.it] INFO: Scrape type for AD03373: 0
2026-01-28 20:01:27 [auto1.it] INFO: Found listing with ID: TB52041
2026-01-28 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TB52041%27 HTTP/1.1" 200 None
2026-01-28 20:01:27 [auto1.it] INFO: Scrape type for TB52041: 0
2026-01-28 20:01:27 [auto1.it] INFO: Found listing with ID: AD85366
2026-01-28 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AD85366%27 HTTP/1.1" 200 None
2026-01-28 20:01:27 [auto1.it] INFO: Scrape type for AD85366: 2
2026-01-28 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Ff1%252Fa9f10ebe41cd775023aa7cea3236430e%252Fpa%252FTZ83605_76c82433cd1c813d5c62b47a8b928c51.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/f1/a9f10ebe41cd775023aa7cea3236430e/pa/TZ83605_76c82433cd1c813d5c62b47a8b928c51.jpg not downloaded yet
2026-01-28 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F2b%252F032b457b787f642f8a61ead8f33dbc0f%252Fpa%252FAW68260_2818dc1fd72a3279756d72546d9b7979.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/2b/032b457b787f642f8a61ead8f33dbc0f/pa/AW68260_2818dc1fd72a3279756d72546d9b7979.jpg not downloaded yet
2026-01-28 20:01:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db509aaa-858e-599d-a673-8f5a9513cf8c with identifier: DY55087
2026-01-28 20:01:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db509aaa-858e-599d-a673-8f5a9513cf8c with scrape type 2
2026-01-28 20:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item db509aaa-858e-599d-a673-8f5a9513cf8c with scrape type 2
2026-01-28 20:01:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: db509aaa-858e-599d-a673-8f5a9513cf8c, identifier: DY55087
2026-01-28 20:01:27 [auto1.it] INFO: Found listing with ID: VG35623
2026-01-28 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VG35623%27 HTTP/1.1" 200 None
2026-01-28 20:01:27 [auto1.it] INFO: Scrape type for VG35623: 0
2026-01-28 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Ff1%252Fa9f10ebe41cd775023aa7cea3236430e%252Fpa%252FTZ83605_84d9c97303beb4f04c4fee49cbbdd92a.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/f1/a9f10ebe41cd775023aa7cea3236430e/pa/TZ83605_84d9c97303beb4f04c4fee49cbbdd92a.jpg not downloaded yet
2026-01-28 20:01:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: db509aaa-858e-599d-a673-8f5a9513cf8c with identifier: DY55087
2026-01-28 20:01:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: db509aaa-858e-599d-a673-8f5a9513cf8c with identifier: DY55087
2026-01-28 20:01:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: db509aaa-858e-599d-a673-8f5a9513cf8c with identifier: DY55087 to the API
2026-01-28 20:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:01:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:01:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DY55087>
{'auction_title': '',
 'c_o_2_emission_value': 157,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:28:18Z',
 'fuel_type': 'petrol',
 'id': 'db509aaa-858e-599d-a673-8f5a9513cf8c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DY55087',
 'listing': 'auction',
 'location': 'IT, Capannori (LU)',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 23627,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-01-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.5 TSI ACT R-Line',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2023}
2026-01-28 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DY55087%27 HTTP/1.1" 200 None
2026-01-28 20:01:27 [auto1.it] INFO: Saving data for DY55087: {'auction_closing_time': 1769704098.0, 'created_time': 1766692861.482595, 'last_price_update_time': 1769630487.983028}
2026-01-28 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DY55087') HTTP/1.1" 204 0
2026-01-28 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F2b%252F032b457b787f642f8a61ead8f33dbc0f%252Fpa%252FAW68260_8e3b99b77e2b6bcd600fff107f4cd9c7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/2b/032b457b787f642f8a61ead8f33dbc0f/pa/AW68260_8e3b99b77e2b6bcd600fff107f4cd9c7.jpg not downloaded yet
2026-01-28 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Ff1%252Fa9f10ebe41cd775023aa7cea3236430e%252Fpa%252FTZ83605_cd1ff9fa7745c305a7e961497c9f55b5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/f1/a9f10ebe41cd775023aa7cea3236430e/pa/TZ83605_cd1ff9fa7745c305a7e961497c9f55b5.jpg not downloaded yet
2026-01-28 20:01:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0a033ad0>
2026-01-28 20:01:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_051ddf36-eff8-5c80-8634-fb09358064b3/051ddf36-eff8-5c80-8634-fb09358064b3_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F4b%252Fdf4bfd14ecccad2e28acc7936a8ce0e3%252Fpa%252FWP90453_5164512a0e4869a656b3f1948f45a465.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/4b/df4bfd14ecccad2e28acc7936a8ce0e3/pa/WP90453_5164512a0e4869a656b3f1948f45a465.jpg saved to cache
2026-01-28 20:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 051ddf36-eff8-5c80-8634-fb09358064b3
2026-01-28 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F2b%252F032b457b787f642f8a61ead8f33dbc0f%252Fpa%252FAW68260_7805040769e76f14aca904c21564f911.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/2b/032b457b787f642f8a61ead8f33dbc0f/pa/AW68260_7805040769e76f14aca904c21564f911.jpg not downloaded yet
2026-01-28 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Ff1%252Fa9f10ebe41cd775023aa7cea3236430e%252Fpa%252FTZ83605_8e3f6d0a40efb3b37a04199b87f6c5be.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/f1/a9f10ebe41cd775023aa7cea3236430e/pa/TZ83605_8e3f6d0a40efb3b37a04199b87f6c5be.jpg not downloaded yet
2026-01-28 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F2b%252F032b457b787f642f8a61ead8f33dbc0f%252Fpa%252FAW68260_f38aee3db3c520c12647260b274de874.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/2b/032b457b787f642f8a61ead8f33dbc0f/pa/AW68260_f38aee3db3c520c12647260b274de874.jpg not downloaded yet
2026-01-28 20:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/fd/6dfd074bc8aa27b5d1e451429ee6253b/pa/DT01319_9a948d898c8a85cf1d4801060b8c9abd.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Ff1%252Fa9f10ebe41cd775023aa7cea3236430e%252Fpa%252FTZ83605_dcd697b40eb3ef335afa8fed3dccda7b.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/f1/a9f10ebe41cd775023aa7cea3236430e/pa/TZ83605_dcd697b40eb3ef335afa8fed3dccda7b.jpg not downloaded yet
2026-01-28 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F2b%252F032b457b787f642f8a61ead8f33dbc0f%252Fpa%252FAW68260_03d7a8bd7b82d862e79f4d31d4f11075.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/2b/032b457b787f642f8a61ead8f33dbc0f/pa/AW68260_03d7a8bd7b82d862e79f4d31d4f11075.jpg not downloaded yet
2026-01-28 20:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/35/6c357bcdbe4e3e390bc49d66e1be4a06/pa/LM18187_04a34f80e58ad03451d23758ee05e7b6.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Ff1%252Fa9f10ebe41cd775023aa7cea3236430e%252Fpa%252FTZ83605_c9bae7d4df8faeba9eeabaf28a7ccebf.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/f1/a9f10ebe41cd775023aa7cea3236430e/pa/TZ83605_c9bae7d4df8faeba9eeabaf28a7ccebf.jpg not downloaded yet
2026-01-28 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F2b%252F032b457b787f642f8a61ead8f33dbc0f%252Fpa%252FAW68260_15b220c5bf09cbd996e34b225bd50404.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/2b/032b457b787f642f8a61ead8f33dbc0f/pa/AW68260_15b220c5bf09cbd996e34b225bd50404.jpg not downloaded yet
2026-01-28 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Ff1%252Fa9f10ebe41cd775023aa7cea3236430e%252Fpa%252FTZ83605_6c269296fa158b1baa72afb30aff1445.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/f1/a9f10ebe41cd775023aa7cea3236430e/pa/TZ83605_6c269296fa158b1baa72afb30aff1445.jpg not downloaded yet
2026-01-28 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F2b%252F032b457b787f642f8a61ead8f33dbc0f%252Fpa%252FAW68260_fd76d30f3413da8d3dd367f17f8b89d5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/2b/032b457b787f642f8a61ead8f33dbc0f/pa/AW68260_fd76d30f3413da8d3dd367f17f8b89d5.jpg not downloaded yet
2026-01-28 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Ff1%252Fa9f10ebe41cd775023aa7cea3236430e%252Fpa%252FTZ83605_c85e5c4a04efbd2c2509cd1f4d511465.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/f1/a9f10ebe41cd775023aa7cea3236430e/pa/TZ83605_c85e5c4a04efbd2c2509cd1f4d511465.jpg not downloaded yet
2026-01-28 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F2b%252F032b457b787f642f8a61ead8f33dbc0f%252Fpa%252FAW68260_107d8d944834055323378f6216fe45c2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/2b/032b457b787f642f8a61ead8f33dbc0f/pa/AW68260_107d8d944834055323378f6216fe45c2.jpg not downloaded yet
2026-01-28 20:01:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:01:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08714f90>
2026-01-28 20:01:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06562d43-54c7-5384-9120-73a6f85a3726/06562d43-54c7-5384-9120-73a6f85a3726_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Ffd%252F6dfd074bc8aa27b5d1e451429ee6253b%252Fpa%252FDT01319_9a948d898c8a85cf1d4801060b8c9abd.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/fd/6dfd074bc8aa27b5d1e451429ee6253b/pa/DT01319_9a948d898c8a85cf1d4801060b8c9abd.jpg saved to cache
2026-01-28 20:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 06562d43-54c7-5384-9120-73a6f85a3726
2026-01-28 20:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Ff1%252Fa9f10ebe41cd775023aa7cea3236430e%252Fpa%252FTZ83605_8fa0c4c04079d4bd883748a22ecd5541.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/f1/a9f10ebe41cd775023aa7cea3236430e/pa/TZ83605_8fa0c4c04079d4bd883748a22ecd5541.jpg not downloaded yet
2026-01-28 20:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/fd/6dfd074bc8aa27b5d1e451429ee6253b/pa/DT01319_7fdb4cb20f22238684eca3abcfa47a16.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/4b/df4bfd14ecccad2e28acc7936a8ce0e3/pa/WP90453_93b110262fd9a10dc7b9c6b4fbac7272.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F2b%252F032b457b787f642f8a61ead8f33dbc0f%252Fpa%252FAW68260_574f977a3a78873cbbb6018edebf50c1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/2b/032b457b787f642f8a61ead8f33dbc0f/pa/AW68260_574f977a3a78873cbbb6018edebf50c1.jpg not downloaded yet
2026-01-28 20:01:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:01:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09e261d0>
2026-01-28 20:01:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f94eb59-79a1-5b19-acdb-80dde67f1f1f/7f94eb59-79a1-5b19-acdb-80dde67f1f1f_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F35%252F6c357bcdbe4e3e390bc49d66e1be4a06%252Fpa%252FLM18187_04a34f80e58ad03451d23758ee05e7b6.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/35/6c357bcdbe4e3e390bc49d66e1be4a06/pa/LM18187_04a34f80e58ad03451d23758ee05e7b6.jpg saved to cache
2026-01-28 20:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 7f94eb59-79a1-5b19-acdb-80dde67f1f1f
2026-01-28 20:01:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7f94eb59-79a1-5b19-acdb-80dde67f1f1f, skipping ID generation
2026-01-28 20:01:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f94eb59-79a1-5b19-acdb-80dde67f1f1f with scrape type 1
2026-01-28 20:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 7f94eb59-79a1-5b19-acdb-80dde67f1f1f from tracking dictionaries
2026-01-28 20:01:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7f94eb59-79a1-5b19-acdb-80dde67f1f1f sending to next pipeline
2026-01-28 20:01:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7f94eb59-79a1-5b19-acdb-80dde67f1f1f, identifier: LM18187
2026-01-28 20:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NL47896/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:01:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7f94eb59-79a1-5b19-acdb-80dde67f1f1f with identifier: LM18187
2026-01-28 20:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-28 20:01:29 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=orange HTTP/1.1" 200 None
2026-01-28 20:01:30 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-28 20:01:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7f94eb59-79a1-5b19-acdb-80dde67f1f1f with identifier: LM18187
2026-01-28 20:01:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7f94eb59-79a1-5b19-acdb-80dde67f1f1f with identifier: LM18187 to the API
2026-01-28 20:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:01:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:01:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img6c/35/6c357bcdbe4e3e390bc49d66e1be4a06/pa/LM18187_04a34f80e58ad03451d23758ee05e7b6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'category': None,
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.6L',
 'engine_horse_power': 143,
 'expiration_date': '2026-01-29T16:57:29Z',
 'fuel_type': 'hybrid',
 'id': '7f94eb59-79a1-5b19-acdb-80dde67f1f1f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LM18187',
 'listing': 'auction',
 'location': 'IT, Segrate',
 'make': 'Renault',
 'model': 'Arkana',
 'odometer': 69579,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f94eb59-79a1-5b19-acdb-80dde67f1f1f/7f94eb59-79a1-5b19-acdb-80dde67f1f1f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69506,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/35/6c357bcdbe4e3e390bc49d66e1be4a06/pa/LM18187_62f019c9ae01ed518a8bec714bc5792b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f94eb59-79a1-5b19-acdb-80dde67f1f1f/7f94eb59-79a1-5b19-acdb-80dde67f1f1f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66827,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/35/6c357bcdbe4e3e390bc49d66e1be4a06/pa/LM18187_9515e36501b606ad4c3e03bf12777381.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f94eb59-79a1-5b19-acdb-80dde67f1f1f/7f94eb59-79a1-5b19-acdb-80dde67f1f1f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64269,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/35/6c357bcdbe4e3e390bc49d66e1be4a06/pa/LM18187_98f16c4e3c1dda26bfb2dc7eb0f05dbb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f94eb59-79a1-5b19-acdb-80dde67f1f1f/7f94eb59-79a1-5b19-acdb-80dde67f1f1f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49827,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/35/6c357bcdbe4e3e390bc49d66e1be4a06/pa/LM18187_995303f815bde779c10e5eb801b0cfc1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f94eb59-79a1-5b19-acdb-80dde67f1f1f/7f94eb59-79a1-5b19-acdb-80dde67f1f1f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2637025,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/35/6c357bcdbe4e3e390bc49d66e1be4a06/pa/LM18187_20dc83d045afb9d535d84e44ebf23822.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f94eb59-79a1-5b19-acdb-80dde67f1f1f/7f94eb59-79a1-5b19-acdb-80dde67f1f1f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2602578,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/35/6c357bcdbe4e3e390bc49d66e1be4a06/pa/LM18187_623107f9e4d19d6c4df86817c89514e0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f94eb59-79a1-5b19-acdb-80dde67f1f1f/7f94eb59-79a1-5b19-acdb-80dde67f1f1f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48282,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/35/6c357bcdbe4e3e390bc49d66e1be4a06/pa/LM18187_5f3991c16bc7d1bbfd1fab7c6936b1bb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f94eb59-79a1-5b19-acdb-80dde67f1f1f/7f94eb59-79a1-5b19-acdb-80dde67f1f1f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68987,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/35/6c357bcdbe4e3e390bc49d66e1be4a06/pa/LM18187_8d5286088b0329ca48c968573e02c722.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f94eb59-79a1-5b19-acdb-80dde67f1f1f/7f94eb59-79a1-5b19-acdb-80dde67f1f1f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70480,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/35/6c357bcdbe4e3e390bc49d66e1be4a06/pa/LM18187_d7cffb4be74093f7c42f04f86fcab56a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f94eb59-79a1-5b19-acdb-80dde67f1f1f/7f94eb59-79a1-5b19-acdb-80dde67f1f1f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39533,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/35/6c357bcdbe4e3e390bc49d66e1be4a06/pa/LM18187_8a86cd6875741c499ccacb49ae70cbee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f94eb59-79a1-5b19-acdb-80dde67f1f1f/7f94eb59-79a1-5b19-acdb-80dde67f1f1f_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63581,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/35/6c357bcdbe4e3e390bc49d66e1be4a06/pa/LM18187_45137831250d47120405b781724d026f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f94eb59-79a1-5b19-acdb-80dde67f1f1f/7f94eb59-79a1-5b19-acdb-80dde67f1f1f_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2821753,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/35/6c357bcdbe4e3e390bc49d66e1be4a06/pa/LM18187_04a34f80e58ad03451d23758ee05e7b6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f94eb59-79a1-5b19-acdb-80dde67f1f1f/7f94eb59-79a1-5b19-acdb-80dde67f1f1f_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54609,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/35/6c357bcdbe4e3e390bc49d66e1be4a06/pa/LM18187_efaa2a49bbeacde0369a46a213b2c2dd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f94eb59-79a1-5b19-acdb-80dde67f1f1f/7f94eb59-79a1-5b19-acdb-80dde67f1f1f_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50208,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/35/6c357bcdbe4e3e390bc49d66e1be4a06/pa/LM18187_cdabf6ed57e6263fdfb88c82bf22acef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f94eb59-79a1-5b19-acdb-80dde67f1f1f/7f94eb59-79a1-5b19-acdb-80dde67f1f1f_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55160,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/35/6c357bcdbe4e3e390bc49d66e1be4a06/pa/LM18187_8da48b6263acb71d1283880f989c8208.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-06-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Arkana 1.6 Hybrid E-Tech R.S. Line',
 'transmission': 'automatic',
 'trim': 'R.S. Line',
 'year': 2021}
2026-01-28 20:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LM18187%27 HTTP/1.1" 200 None
2026-01-28 20:01:30 [auto1.it] INFO: Saving data for LM18187: {'created_time': 1769630490.70806, 'last_price_update_time': 1769630490.708072, 'auction_closing_time': 1769705849.0}
2026-01-28 20:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LM18187') HTTP/1.1" 204 0
2026-01-28 20:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F2b%252F032b457b787f642f8a61ead8f33dbc0f%252Fpa%252FAW68260_46ec3bf57c7620daa93b1661d534217f.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/2b/032b457b787f642f8a61ead8f33dbc0f/pa/AW68260_46ec3bf57c7620daa93b1661d534217f.jpg not downloaded yet
2026-01-28 20:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/4b/df4bfd14ecccad2e28acc7936a8ce0e3/pa/WP90453_a5bca5bc69063a238a8e72798e72ade8.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:01:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:01:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08c8e910>
2026-01-28 20:01:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06562d43-54c7-5384-9120-73a6f85a3726/06562d43-54c7-5384-9120-73a6f85a3726_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Ffd%252F6dfd074bc8aa27b5d1e451429ee6253b%252Fpa%252FDT01319_7fdb4cb20f22238684eca3abcfa47a16.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/fd/6dfd074bc8aa27b5d1e451429ee6253b/pa/DT01319_7fdb4cb20f22238684eca3abcfa47a16.jpg saved to cache
2026-01-28 20:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 06562d43-54c7-5384-9120-73a6f85a3726
2026-01-28 20:01:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 06562d43-54c7-5384-9120-73a6f85a3726, skipping ID generation
2026-01-28 20:01:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 06562d43-54c7-5384-9120-73a6f85a3726 with scrape type 1
2026-01-28 20:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 06562d43-54c7-5384-9120-73a6f85a3726 from tracking dictionaries
2026-01-28 20:01:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 06562d43-54c7-5384-9120-73a6f85a3726 sending to next pipeline
2026-01-28 20:01:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 06562d43-54c7-5384-9120-73a6f85a3726, identifier: DT01319
2026-01-28 20:01:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0a0dd410>
2026-01-28 20:01:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:01:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_051ddf36-eff8-5c80-8634-fb09358064b3/051ddf36-eff8-5c80-8634-fb09358064b3_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F4b%252Fdf4bfd14ecccad2e28acc7936a8ce0e3%252Fpa%252FWP90453_93b110262fd9a10dc7b9c6b4fbac7272.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/4b/df4bfd14ecccad2e28acc7936a8ce0e3/pa/WP90453_93b110262fd9a10dc7b9c6b4fbac7272.jpg saved to cache
2026-01-28 20:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 051ddf36-eff8-5c80-8634-fb09358064b3
2026-01-28 20:01:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 06562d43-54c7-5384-9120-73a6f85a3726 with identifier: DT01319
2026-01-28 20:01:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-28 20:01:31 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=green HTTP/1.1" 200 None
2026-01-28 20:01:31 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-28 20:01:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 06562d43-54c7-5384-9120-73a6f85a3726 with identifier: DT01319
2026-01-28 20:01:32 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 135664 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    135664
2026-01-28 20:01:32 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: 06562d43-54c7-5384-9120-73a6f85a3726 spider: auto1.it
2026-01-28 20:01:32 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 06562d43-54c7-5384-9120-73a6f85a3726 due to rule: high_mileage_for_make.json, error: 135664 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    135664
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'category': None,
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2026-01-29T16:10:59Z',
 'fuel_type': 'diesel',
 'id': '06562d43-54c7-5384-9120-73a6f85a3726',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DT01319',
 'listing': 'auction',
 'location': 'IT, Treviolo',
 'make': 'Fiat',
 'model': '500X',
 'odometer': 135664,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06562d43-54c7-5384-9120-73a6f85a3726/06562d43-54c7-5384-9120-73a6f85a3726_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62736,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/fd/6dfd074bc8aa27b5d1e451429ee6253b/pa/DT01319_a779893e29a7a17991c644be5252f175.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06562d43-54c7-5384-9120-73a6f85a3726/06562d43-54c7-5384-9120-73a6f85a3726_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3126566,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/fd/6dfd074bc8aa27b5d1e451429ee6253b/pa/DT01319_7fdb4cb20f22238684eca3abcfa47a16.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06562d43-54c7-5384-9120-73a6f85a3726/06562d43-54c7-5384-9120-73a6f85a3726_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56590,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/fd/6dfd074bc8aa27b5d1e451429ee6253b/pa/DT01319_195eac85e592815d3915ca50a7977a16.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06562d43-54c7-5384-9120-73a6f85a3726/06562d43-54c7-5384-9120-73a6f85a3726_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45017,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/fd/6dfd074bc8aa27b5d1e451429ee6253b/pa/DT01319_67f2add221a0cf8fbd23644568f0942a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06562d43-54c7-5384-9120-73a6f85a3726/06562d43-54c7-5384-9120-73a6f85a3726_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54505,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/fd/6dfd074bc8aa27b5d1e451429ee6253b/pa/DT01319_94d2b413365ece5240f1f2c415ae4aed.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06562d43-54c7-5384-9120-73a6f85a3726/06562d43-54c7-5384-9120-73a6f85a3726_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59149,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/fd/6dfd074bc8aa27b5d1e451429ee6253b/pa/DT01319_5045a4e3974fe3bddba9cec162094e90.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06562d43-54c7-5384-9120-73a6f85a3726/06562d43-54c7-5384-9120-73a6f85a3726_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2743319,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/fd/6dfd074bc8aa27b5d1e451429ee6253b/pa/DT01319_9a948d898c8a85cf1d4801060b8c9abd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06562d43-54c7-5384-9120-73a6f85a3726/06562d43-54c7-5384-9120-73a6f85a3726_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62916,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/fd/6dfd074bc8aa27b5d1e451429ee6253b/pa/DT01319_39cebffaaa6c7485b5a6e9da0cb41a7b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06562d43-54c7-5384-9120-73a6f85a3726/06562d43-54c7-5384-9120-73a6f85a3726_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2883445,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/fd/6dfd074bc8aa27b5d1e451429ee6253b/pa/DT01319_c34e56cba8999176cd467741a0a6ba89.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06562d43-54c7-5384-9120-73a6f85a3726/06562d43-54c7-5384-9120-73a6f85a3726_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44263,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/fd/6dfd074bc8aa27b5d1e451429ee6253b/pa/DT01319_e1daa212f57d19f2ddb374e3bd1816bc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06562d43-54c7-5384-9120-73a6f85a3726/06562d43-54c7-5384-9120-73a6f85a3726_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2857083,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/fd/6dfd074bc8aa27b5d1e451429ee6253b/pa/DT01319_03eeb3edadff23fd5e8ffe88d492027e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06562d43-54c7-5384-9120-73a6f85a3726/06562d43-54c7-5384-9120-73a6f85a3726_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2787586,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/fd/6dfd074bc8aa27b5d1e451429ee6253b/pa/DT01319_9d386f8bc285aff651deb78cac0cca13.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06562d43-54c7-5384-9120-73a6f85a3726/06562d43-54c7-5384-9120-73a6f85a3726_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75454,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/fd/6dfd074bc8aa27b5d1e451429ee6253b/pa/DT01319_3fe3f28292e67d93e7bbb6c1406e6d04.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06562d43-54c7-5384-9120-73a6f85a3726/06562d43-54c7-5384-9120-73a6f85a3726_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36328,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/fd/6dfd074bc8aa27b5d1e451429ee6253b/pa/DT01319_28fb05d4adc10b40c2f2b71f5c40d64e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06562d43-54c7-5384-9120-73a6f85a3726/06562d43-54c7-5384-9120-73a6f85a3726_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92564,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/fd/6dfd074bc8aa27b5d1e451429ee6253b/pa/DT01319_dee52115e18157084d46a5882f423894.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-03-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat 500X 1.6 JTDM S-Design Cross',
 'transmission': 'manual',
 'trim': 'S-Design Cross',
 'year': 2019}
2026-01-28 20:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DT01319%27 HTTP/1.1" 200 None
2026-01-28 20:01:32 [auto1.it] INFO: Saving data for DT01319: {'created_time': 1769630492.174742, 'last_price_update_time': 1769630492.174754, 'auction_closing_time': 1769703059.0}
2026-01-28 20:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DT01319') HTTP/1.1" 204 0
2026-01-28 20:01:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0bef5fd0>
2026-01-28 20:01:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_051ddf36-eff8-5c80-8634-fb09358064b3/051ddf36-eff8-5c80-8634-fb09358064b3_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F4b%252Fdf4bfd14ecccad2e28acc7936a8ce0e3%252Fpa%252FWP90453_a5bca5bc69063a238a8e72798e72ade8.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/4b/df4bfd14ecccad2e28acc7936a8ce0e3/pa/WP90453_a5bca5bc69063a238a8e72798e72ade8.jpg saved to cache
2026-01-28 20:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 051ddf36-eff8-5c80-8634-fb09358064b3
2026-01-28 20:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/4b/df4bfd14ecccad2e28acc7936a8ce0e3/pa/WP90453_ccca9d71508fcd7d57abdbce4b6c6fef.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/4b/df4bfd14ecccad2e28acc7936a8ce0e3/pa/WP90453_cd4ae1c953a019779a5647319e95d14d.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/02/0902ecd716da7e9c1590d287d6183135/pa/BS57464_3ff61e0f1aa47ff8b1ff339c847d1df4.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/02/0902ecd716da7e9c1590d287d6183135/pa/BS57464_cc7d9af4ba3e94dc77983939a6ed99e5.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/02/0902ecd716da7e9c1590d287d6183135/pa/BS57464_c1b70dbbb06b6e666d45e02d6851c3c7.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/02/0902ecd716da7e9c1590d287d6183135/pa/BS57464_163865abeb1170b2d8b9b95d51ae1483.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/f1/a9f10ebe41cd775023aa7cea3236430e/pa/TZ83605_18953367826cccc341695f99f2395d7b.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/02/0902ecd716da7e9c1590d287d6183135/pa/BS57464_302398b64755b6ca6907b589f779f9e7.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:01:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:01:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08c74cd0>
2026-01-28 20:01:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_051ddf36-eff8-5c80-8634-fb09358064b3/051ddf36-eff8-5c80-8634-fb09358064b3_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F4b%252Fdf4bfd14ecccad2e28acc7936a8ce0e3%252Fpa%252FWP90453_ccca9d71508fcd7d57abdbce4b6c6fef.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/4b/df4bfd14ecccad2e28acc7936a8ce0e3/pa/WP90453_ccca9d71508fcd7d57abdbce4b6c6fef.jpg saved to cache
2026-01-28 20:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 051ddf36-eff8-5c80-8634-fb09358064b3
2026-01-28 20:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/2b/032b457b787f642f8a61ead8f33dbc0f/pa/AW68260_46ec3bf57c7620daa93b1661d534217f.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/f1/a9f10ebe41cd775023aa7cea3236430e/pa/TZ83605_2f15c463774fb99cf81d3f3a2b471e2f.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/2b/032b457b787f642f8a61ead8f33dbc0f/pa/AW68260_24480b77785dc0f75c4aac45bf1d7343.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/f1/a9f10ebe41cd775023aa7cea3236430e/pa/TZ83605_8fa0c4c04079d4bd883748a22ecd5541.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:01:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:01:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09d61650>
2026-01-28 20:01:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_051ddf36-eff8-5c80-8634-fb09358064b3/051ddf36-eff8-5c80-8634-fb09358064b3_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F4b%252Fdf4bfd14ecccad2e28acc7936a8ce0e3%252Fpa%252FWP90453_cd4ae1c953a019779a5647319e95d14d.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/4b/df4bfd14ecccad2e28acc7936a8ce0e3/pa/WP90453_cd4ae1c953a019779a5647319e95d14d.jpg saved to cache
2026-01-28 20:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 051ddf36-eff8-5c80-8634-fb09358064b3
2026-01-28 20:01:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0a034cd0>
2026-01-28 20:01:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab2b9426-2a4e-5843-bea9-eeabb5e12b74/ab2b9426-2a4e-5843-bea9-eeabb5e12b74_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F02%252F0902ecd716da7e9c1590d287d6183135%252Fpa%252FBS57464_3ff61e0f1aa47ff8b1ff339c847d1df4.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/02/0902ecd716da7e9c1590d287d6183135/pa/BS57464_3ff61e0f1aa47ff8b1ff339c847d1df4.jpg saved to cache
2026-01-28 20:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ab2b9426-2a4e-5843-bea9-eeabb5e12b74
2026-01-28 20:01:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09e93d50>
2026-01-28 20:01:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab2b9426-2a4e-5843-bea9-eeabb5e12b74/ab2b9426-2a4e-5843-bea9-eeabb5e12b74_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F02%252F0902ecd716da7e9c1590d287d6183135%252Fpa%252FBS57464_cc7d9af4ba3e94dc77983939a6ed99e5.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/02/0902ecd716da7e9c1590d287d6183135/pa/BS57464_cc7d9af4ba3e94dc77983939a6ed99e5.jpg saved to cache
2026-01-28 20:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ab2b9426-2a4e-5843-bea9-eeabb5e12b74
2026-01-28 20:01:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09db3510>
2026-01-28 20:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab2b9426-2a4e-5843-bea9-eeabb5e12b74/ab2b9426-2a4e-5843-bea9-eeabb5e12b74_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F02%252F0902ecd716da7e9c1590d287d6183135%252Fpa%252FBS57464_c1b70dbbb06b6e666d45e02d6851c3c7.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/02/0902ecd716da7e9c1590d287d6183135/pa/BS57464_c1b70dbbb06b6e666d45e02d6851c3c7.jpg saved to cache
2026-01-28 20:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ab2b9426-2a4e-5843-bea9-eeabb5e12b74
2026-01-28 20:01:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09db1dd0>
2026-01-28 20:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab2b9426-2a4e-5843-bea9-eeabb5e12b74/ab2b9426-2a4e-5843-bea9-eeabb5e12b74_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F02%252F0902ecd716da7e9c1590d287d6183135%252Fpa%252FBS57464_163865abeb1170b2d8b9b95d51ae1483.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/02/0902ecd716da7e9c1590d287d6183135/pa/BS57464_163865abeb1170b2d8b9b95d51ae1483.jpg saved to cache
2026-01-28 20:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ab2b9426-2a4e-5843-bea9-eeabb5e12b74
2026-01-28 20:01:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:01:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0bf9ba10>
2026-01-28 20:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b2a49a6-5f2b-5692-a1a2-27ebe5ca1227/4b2a49a6-5f2b-5692-a1a2-27ebe5ca1227_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Ff1%252Fa9f10ebe41cd775023aa7cea3236430e%252Fpa%252FTZ83605_18953367826cccc341695f99f2395d7b.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/f1/a9f10ebe41cd775023aa7cea3236430e/pa/TZ83605_18953367826cccc341695f99f2395d7b.jpg saved to cache
2026-01-28 20:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4b2a49a6-5f2b-5692-a1a2-27ebe5ca1227
2026-01-28 20:01:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09d6e490>
2026-01-28 20:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab2b9426-2a4e-5843-bea9-eeabb5e12b74/ab2b9426-2a4e-5843-bea9-eeabb5e12b74_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F02%252F0902ecd716da7e9c1590d287d6183135%252Fpa%252FBS57464_302398b64755b6ca6907b589f779f9e7.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/02/0902ecd716da7e9c1590d287d6183135/pa/BS57464_302398b64755b6ca6907b589f779f9e7.jpg saved to cache
2026-01-28 20:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ab2b9426-2a4e-5843-bea9-eeabb5e12b74
2026-01-28 20:01:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09dd8bd0>
2026-01-28 20:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c5618d2-b669-5ad2-838c-20c123c74357/4c5618d2-b669-5ad2-838c-20c123c74357_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F2b%252F032b457b787f642f8a61ead8f33dbc0f%252Fpa%252FAW68260_46ec3bf57c7620daa93b1661d534217f.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/2b/032b457b787f642f8a61ead8f33dbc0f/pa/AW68260_46ec3bf57c7620daa93b1661d534217f.jpg saved to cache
2026-01-28 20:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 4c5618d2-b669-5ad2-838c-20c123c74357
2026-01-28 20:01:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08c18bd0>
2026-01-28 20:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b2a49a6-5f2b-5692-a1a2-27ebe5ca1227/4b2a49a6-5f2b-5692-a1a2-27ebe5ca1227_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Ff1%252Fa9f10ebe41cd775023aa7cea3236430e%252Fpa%252FTZ83605_2f15c463774fb99cf81d3f3a2b471e2f.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/f1/a9f10ebe41cd775023aa7cea3236430e/pa/TZ83605_2f15c463774fb99cf81d3f3a2b471e2f.jpg saved to cache
2026-01-28 20:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4b2a49a6-5f2b-5692-a1a2-27ebe5ca1227
2026-01-28 20:01:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08c44ed0>
2026-01-28 20:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c5618d2-b669-5ad2-838c-20c123c74357/4c5618d2-b669-5ad2-838c-20c123c74357_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F2b%252F032b457b787f642f8a61ead8f33dbc0f%252Fpa%252FAW68260_24480b77785dc0f75c4aac45bf1d7343.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/2b/032b457b787f642f8a61ead8f33dbc0f/pa/AW68260_24480b77785dc0f75c4aac45bf1d7343.jpg saved to cache
2026-01-28 20:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4c5618d2-b669-5ad2-838c-20c123c74357
2026-01-28 20:01:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08732d90>
2026-01-28 20:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b2a49a6-5f2b-5692-a1a2-27ebe5ca1227/4b2a49a6-5f2b-5692-a1a2-27ebe5ca1227_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Ff1%252Fa9f10ebe41cd775023aa7cea3236430e%252Fpa%252FTZ83605_8fa0c4c04079d4bd883748a22ecd5541.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/f1/a9f10ebe41cd775023aa7cea3236430e/pa/TZ83605_8fa0c4c04079d4bd883748a22ecd5541.jpg saved to cache
2026-01-28 20:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 4b2a49a6-5f2b-5692-a1a2-27ebe5ca1227
2026-01-28 20:01:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/2b/032b457b787f642f8a61ead8f33dbc0f/pa/AW68260_107d8d944834055323378f6216fe45c2.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:01:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/2b/032b457b787f642f8a61ead8f33dbc0f/pa/AW68260_f38aee3db3c520c12647260b274de874.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/2b/032b457b787f642f8a61ead8f33dbc0f/pa/AW68260_574f977a3a78873cbbb6018edebf50c1.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/f1/a9f10ebe41cd775023aa7cea3236430e/pa/TZ83605_c85e5c4a04efbd2c2509cd1f4d511465.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:01:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:01:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09fa7210>
2026-01-28 20:01:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c5618d2-b669-5ad2-838c-20c123c74357/4c5618d2-b669-5ad2-838c-20c123c74357_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F2b%252F032b457b787f642f8a61ead8f33dbc0f%252Fpa%252FAW68260_107d8d944834055323378f6216fe45c2.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/2b/032b457b787f642f8a61ead8f33dbc0f/pa/AW68260_107d8d944834055323378f6216fe45c2.jpg saved to cache
2026-01-28 20:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 4c5618d2-b669-5ad2-838c-20c123c74357
2026-01-28 20:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/f1/a9f10ebe41cd775023aa7cea3236430e/pa/TZ83605_6c269296fa158b1baa72afb30aff1445.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/2b/032b457b787f642f8a61ead8f33dbc0f/pa/AW68260_15b220c5bf09cbd996e34b225bd50404.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:01:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:01:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08c79290>
2026-01-28 20:01:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c5618d2-b669-5ad2-838c-20c123c74357/4c5618d2-b669-5ad2-838c-20c123c74357_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F2b%252F032b457b787f642f8a61ead8f33dbc0f%252Fpa%252FAW68260_f38aee3db3c520c12647260b274de874.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/2b/032b457b787f642f8a61ead8f33dbc0f/pa/AW68260_f38aee3db3c520c12647260b274de874.jpg saved to cache
2026-01-28 20:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4c5618d2-b669-5ad2-838c-20c123c74357
2026-01-28 20:01:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:01:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09ea0810>
2026-01-28 20:01:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c5618d2-b669-5ad2-838c-20c123c74357/4c5618d2-b669-5ad2-838c-20c123c74357_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F2b%252F032b457b787f642f8a61ead8f33dbc0f%252Fpa%252FAW68260_574f977a3a78873cbbb6018edebf50c1.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/2b/032b457b787f642f8a61ead8f33dbc0f/pa/AW68260_574f977a3a78873cbbb6018edebf50c1.jpg saved to cache
2026-01-28 20:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 4c5618d2-b669-5ad2-838c-20c123c74357
2026-01-28 20:01:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:01:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09e7d690>
2026-01-28 20:01:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b2a49a6-5f2b-5692-a1a2-27ebe5ca1227/4b2a49a6-5f2b-5692-a1a2-27ebe5ca1227_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Ff1%252Fa9f10ebe41cd775023aa7cea3236430e%252Fpa%252FTZ83605_c85e5c4a04efbd2c2509cd1f4d511465.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/f1/a9f10ebe41cd775023aa7cea3236430e/pa/TZ83605_c85e5c4a04efbd2c2509cd1f4d511465.jpg saved to cache
2026-01-28 20:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 4b2a49a6-5f2b-5692-a1a2-27ebe5ca1227
2026-01-28 20:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/2b/032b457b787f642f8a61ead8f33dbc0f/pa/AW68260_8e3b99b77e2b6bcd600fff107f4cd9c7.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/f1/a9f10ebe41cd775023aa7cea3236430e/pa/TZ83605_cd1ff9fa7745c305a7e961497c9f55b5.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:01:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:01:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NL47896> (referer: https://www.auto1.com/v1/car-details-view/NL47896/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:01:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:01:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0a0f5710>
2026-01-28 20:01:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b2a49a6-5f2b-5692-a1a2-27ebe5ca1227/4b2a49a6-5f2b-5692-a1a2-27ebe5ca1227_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Ff1%252Fa9f10ebe41cd775023aa7cea3236430e%252Fpa%252FTZ83605_6c269296fa158b1baa72afb30aff1445.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/f1/a9f10ebe41cd775023aa7cea3236430e/pa/TZ83605_6c269296fa158b1baa72afb30aff1445.jpg saved to cache
2026-01-28 20:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 4b2a49a6-5f2b-5692-a1a2-27ebe5ca1227
2026-01-28 20:01:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08ccc950>
2026-01-28 20:01:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c5618d2-b669-5ad2-838c-20c123c74357/4c5618d2-b669-5ad2-838c-20c123c74357_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F2b%252F032b457b787f642f8a61ead8f33dbc0f%252Fpa%252FAW68260_15b220c5bf09cbd996e34b225bd50404.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/2b/032b457b787f642f8a61ead8f33dbc0f/pa/AW68260_15b220c5bf09cbd996e34b225bd50404.jpg saved to cache
2026-01-28 20:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 4c5618d2-b669-5ad2-838c-20c123c74357
2026-01-28 20:01:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08ceea10>
2026-01-28 20:01:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c5618d2-b669-5ad2-838c-20c123c74357/4c5618d2-b669-5ad2-838c-20c123c74357_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F2b%252F032b457b787f642f8a61ead8f33dbc0f%252Fpa%252FAW68260_8e3b99b77e2b6bcd600fff107f4cd9c7.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/2b/032b457b787f642f8a61ead8f33dbc0f/pa/AW68260_8e3b99b77e2b6bcd600fff107f4cd9c7.jpg saved to cache
2026-01-28 20:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4c5618d2-b669-5ad2-838c-20c123c74357
2026-01-28 20:01:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0a064d10>
2026-01-28 20:01:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b2a49a6-5f2b-5692-a1a2-27ebe5ca1227/4b2a49a6-5f2b-5692-a1a2-27ebe5ca1227_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Ff1%252Fa9f10ebe41cd775023aa7cea3236430e%252Fpa%252FTZ83605_cd1ff9fa7745c305a7e961497c9f55b5.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/f1/a9f10ebe41cd775023aa7cea3236430e/pa/TZ83605_cd1ff9fa7745c305a7e961497c9f55b5.jpg saved to cache
2026-01-28 20:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4b2a49a6-5f2b-5692-a1a2-27ebe5ca1227
2026-01-28 20:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/f1/a9f10ebe41cd775023aa7cea3236430e/pa/TZ83605_84d9c97303beb4f04c4fee49cbbdd92a.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/2b/032b457b787f642f8a61ead8f33dbc0f/pa/AW68260_2818dc1fd72a3279756d72546d9b7979.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FY62272> (referer: https://www.auto1.com/v1/car-details-view/FY62272/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:01:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef7b06ab-9230-5cf8-b17d-7115b47f0688 with identifier: NL47896
2026-01-28 20:01:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef7b06ab-9230-5cf8-b17d-7115b47f0688 with scrape type 1
2026-01-28 20:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item ef7b06ab-9230-5cf8-b17d-7115b47f0688
2026-01-28 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F27%252F56275b3c0873ab8ae88eeb9caca800c5%252Fpa%252FNL47896_100c733d57bd67e00101683326281763.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/27/56275b3c0873ab8ae88eeb9caca800c5/pa/NL47896_100c733d57bd67e00101683326281763.jpg not downloaded yet
2026-01-28 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F27%252F56275b3c0873ab8ae88eeb9caca800c5%252Fpa%252FNL47896_fd18c12229fc259e976770afa0891d2f.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/27/56275b3c0873ab8ae88eeb9caca800c5/pa/NL47896_fd18c12229fc259e976770afa0891d2f.jpg not downloaded yet
2026-01-28 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F27%252F56275b3c0873ab8ae88eeb9caca800c5%252Fpa%252FNL47896_518d012501bc06bf7facd3235a4f708e.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/27/56275b3c0873ab8ae88eeb9caca800c5/pa/NL47896_518d012501bc06bf7facd3235a4f708e.jpg not downloaded yet
2026-01-28 20:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F27%252F56275b3c0873ab8ae88eeb9caca800c5%252Fpa%252FNL47896_f2cfffa9027c3280113890e585a76078.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/27/56275b3c0873ab8ae88eeb9caca800c5/pa/NL47896_f2cfffa9027c3280113890e585a76078.jpg not downloaded yet
2026-01-28 20:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F27%252F56275b3c0873ab8ae88eeb9caca800c5%252Fpa%252FNL47896_c3ec375f2bf5b426faa756756511adb3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/27/56275b3c0873ab8ae88eeb9caca800c5/pa/NL47896_c3ec375f2bf5b426faa756756511adb3.jpg not downloaded yet
2026-01-28 20:01:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09f2a890>
2026-01-28 20:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b2a49a6-5f2b-5692-a1a2-27ebe5ca1227/4b2a49a6-5f2b-5692-a1a2-27ebe5ca1227_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Ff1%252Fa9f10ebe41cd775023aa7cea3236430e%252Fpa%252FTZ83605_84d9c97303beb4f04c4fee49cbbdd92a.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/f1/a9f10ebe41cd775023aa7cea3236430e/pa/TZ83605_84d9c97303beb4f04c4fee49cbbdd92a.jpg saved to cache
2026-01-28 20:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4b2a49a6-5f2b-5692-a1a2-27ebe5ca1227
2026-01-28 20:01:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09dfbf50>
2026-01-28 20:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c5618d2-b669-5ad2-838c-20c123c74357/4c5618d2-b669-5ad2-838c-20c123c74357_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F2b%252F032b457b787f642f8a61ead8f33dbc0f%252Fpa%252FAW68260_2818dc1fd72a3279756d72546d9b7979.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/2b/032b457b787f642f8a61ead8f33dbc0f/pa/AW68260_2818dc1fd72a3279756d72546d9b7979.jpg saved to cache
2026-01-28 20:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4c5618d2-b669-5ad2-838c-20c123c74357
2026-01-28 20:01:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac8ef3ec-cfd5-5264-b8d0-80d478f6f5c2 with identifier: FY62272
2026-01-28 20:01:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac8ef3ec-cfd5-5264-b8d0-80d478f6f5c2 with scrape type 1
2026-01-28 20:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item ac8ef3ec-cfd5-5264-b8d0-80d478f6f5c2
2026-01-28 20:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F45%252F3545f742e133358ce1635ccbcf6714e7%252Fpa%252FFY62272_c1365263c3ce91d76d365e20465141be.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/45/3545f742e133358ce1635ccbcf6714e7/pa/FY62272_c1365263c3ce91d76d365e20465141be.jpg already downloaded
2026-01-28 20:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F45%252F3545f742e133358ce1635ccbcf6714e7%252Fpa%252FFY62272_060b3ca697ed17d5ac2896410e691955.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/45/3545f742e133358ce1635ccbcf6714e7/pa/FY62272_060b3ca697ed17d5ac2896410e691955.jpg already downloaded
2026-01-28 20:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F45%252F3545f742e133358ce1635ccbcf6714e7%252Fpa%252FFY62272_630987a48d53e2a7f1d85355848e14c5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/45/3545f742e133358ce1635ccbcf6714e7/pa/FY62272_630987a48d53e2a7f1d85355848e14c5.jpg already downloaded
2026-01-28 20:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F45%252F3545f742e133358ce1635ccbcf6714e7%252Fpa%252FFY62272_c103e151cac631ac155560f3d49d901b.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/45/3545f742e133358ce1635ccbcf6714e7/pa/FY62272_c103e151cac631ac155560f3d49d901b.jpg already downloaded
2026-01-28 20:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F45%252F3545f742e133358ce1635ccbcf6714e7%252Fpa%252FFY62272_39b1ab2798c24fc95083f731cc665014.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/45/3545f742e133358ce1635ccbcf6714e7/pa/FY62272_39b1ab2798c24fc95083f731cc665014.jpg already downloaded
2026-01-28 20:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F45%252F3545f742e133358ce1635ccbcf6714e7%252Fpa%252FFY62272_168b3161c16c17e0296ffa32a3e2c6bd.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/45/3545f742e133358ce1635ccbcf6714e7/pa/FY62272_168b3161c16c17e0296ffa32a3e2c6bd.jpg already downloaded
2026-01-28 20:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F45%252F3545f742e133358ce1635ccbcf6714e7%252Fpa%252FFY62272_0bcf41af488d72176e2b1e0f8efbf820.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/45/3545f742e133358ce1635ccbcf6714e7/pa/FY62272_0bcf41af488d72176e2b1e0f8efbf820.jpg already downloaded
2026-01-28 20:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F45%252F3545f742e133358ce1635ccbcf6714e7%252Fpa%252FFY62272_e190a2325fb245404e112fa3bcf5094e.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/45/3545f742e133358ce1635ccbcf6714e7/pa/FY62272_e190a2325fb245404e112fa3bcf5094e.jpg already downloaded
2026-01-28 20:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F45%252F3545f742e133358ce1635ccbcf6714e7%252Fpa%252FFY62272_daaca67c7d68fb96573627b879d590b7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/45/3545f742e133358ce1635ccbcf6714e7/pa/FY62272_daaca67c7d68fb96573627b879d590b7.jpg already downloaded
2026-01-28 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F45%252F3545f742e133358ce1635ccbcf6714e7%252Fpa%252FFY62272_634512d85ea9942715096c7ce1a1ba8d.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/45/3545f742e133358ce1635ccbcf6714e7/pa/FY62272_634512d85ea9942715096c7ce1a1ba8d.jpg already downloaded
2026-01-28 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F45%252F3545f742e133358ce1635ccbcf6714e7%252Fpa%252FFY62272_490b43d305b67e4fae5afe4f98cb0693.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/45/3545f742e133358ce1635ccbcf6714e7/pa/FY62272_490b43d305b67e4fae5afe4f98cb0693.jpg already downloaded
2026-01-28 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F45%252F3545f742e133358ce1635ccbcf6714e7%252Fpa%252FFY62272_51502224e248533f1db97b3ab8ee335f.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/45/3545f742e133358ce1635ccbcf6714e7/pa/FY62272_51502224e248533f1db97b3ab8ee335f.jpg already downloaded
2026-01-28 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F45%252F3545f742e133358ce1635ccbcf6714e7%252Fpa%252FFY62272_c6d6c4ffff4a6ba1cb22a1b70da624b7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/45/3545f742e133358ce1635ccbcf6714e7/pa/FY62272_c6d6c4ffff4a6ba1cb22a1b70da624b7.jpg already downloaded
2026-01-28 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F45%252F3545f742e133358ce1635ccbcf6714e7%252Fpa%252FFY62272_ad4993eec9f19aa1abab459133107439.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/45/3545f742e133358ce1635ccbcf6714e7/pa/FY62272_ad4993eec9f19aa1abab459133107439.jpg already downloaded
2026-01-28 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F45%252F3545f742e133358ce1635ccbcf6714e7%252Fpa%252FFY62272_78ac6debd857ab1809b82606007b2e58.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/45/3545f742e133358ce1635ccbcf6714e7/pa/FY62272_78ac6debd857ab1809b82606007b2e58.jpg already downloaded
2026-01-28 20:01:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ac8ef3ec-cfd5-5264-b8d0-80d478f6f5c2, identifier: FY62272
2026-01-28 20:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/f1/a9f10ebe41cd775023aa7cea3236430e/pa/TZ83605_c9bae7d4df8faeba9eeabaf28a7ccebf.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F27%252F56275b3c0873ab8ae88eeb9caca800c5%252Fpa%252FNL47896_100197e7bb983524e1804de15c54ba96.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/27/56275b3c0873ab8ae88eeb9caca800c5/pa/NL47896_100197e7bb983524e1804de15c54ba96.jpg not downloaded yet
2026-01-28 20:01:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ac8ef3ec-cfd5-5264-b8d0-80d478f6f5c2 with identifier: FY62272
2026-01-28 20:01:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ac8ef3ec-cfd5-5264-b8d0-80d478f6f5c2 with identifier: FY62272
2026-01-28 20:01:42 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 193741 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    193741
2026-01-28 20:01:42 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: ac8ef3ec-cfd5-5264-b8d0-80d478f6f5c2 spider: auto1.it
2026-01-28 20:01:42 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: ac8ef3ec-cfd5-5264-b8d0-80d478f6f5c2 due to rule: high_mileage_for_country.json, error: 193741 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    193741
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.6L',
 'engine_horse_power': 115,
 'expiration_date': '2026-01-29T16:46:07Z',
 'fuel_type': 'diesel',
 'id': 'ac8ef3ec-cfd5-5264-b8d0-80d478f6f5c2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FY62272',
 'listing': 'auction',
 'location': 'IT, Capannori (LU)',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 193741,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img35/45/3545f742e133358ce1635ccbcf6714e7/pa/FY62272_c1365263c3ce91d76d365e20465141be.jpg',
                'https://img-pa.auto1.com/img35/45/3545f742e133358ce1635ccbcf6714e7/pa/FY62272_060b3ca697ed17d5ac2896410e691955.jpg',
                'https://img-pa.auto1.com/img35/45/3545f742e133358ce1635ccbcf6714e7/pa/FY62272_630987a48d53e2a7f1d85355848e14c5.jpg',
                'https://img-pa.auto1.com/img35/45/3545f742e133358ce1635ccbcf6714e7/pa/FY62272_c103e151cac631ac155560f3d49d901b.jpg',
                'https://img-pa.auto1.com/img35/45/3545f742e133358ce1635ccbcf6714e7/pa/FY62272_39b1ab2798c24fc95083f731cc665014.jpg',
                'https://img-pa.auto1.com/img35/45/3545f742e133358ce1635ccbcf6714e7/pa/FY62272_168b3161c16c17e0296ffa32a3e2c6bd.jpg',
                'https://img-pa.auto1.com/img35/45/3545f742e133358ce1635ccbcf6714e7/pa/FY62272_0bcf41af488d72176e2b1e0f8efbf820.jpg',
                'https://img-pa.auto1.com/img35/45/3545f742e133358ce1635ccbcf6714e7/pa/FY62272_e190a2325fb245404e112fa3bcf5094e.jpg',
                'https://img-pa.auto1.com/img35/45/3545f742e133358ce1635ccbcf6714e7/pa/FY62272_daaca67c7d68fb96573627b879d590b7.jpg',
                'https://img-pa.auto1.com/img35/45/3545f742e133358ce1635ccbcf6714e7/pa/FY62272_634512d85ea9942715096c7ce1a1ba8d.jpg',
                'https://img-pa.auto1.com/img35/45/3545f742e133358ce1635ccbcf6714e7/pa/FY62272_490b43d305b67e4fae5afe4f98cb0693.jpg',
                'https://img-pa.auto1.com/img35/45/3545f742e133358ce1635ccbcf6714e7/pa/FY62272_51502224e248533f1db97b3ab8ee335f.jpg',
                'https://img-pa.auto1.com/img35/45/3545f742e133358ce1635ccbcf6714e7/pa/FY62272_c6d6c4ffff4a6ba1cb22a1b70da624b7.jpg',
                'https://img-pa.auto1.com/img35/45/3545f742e133358ce1635ccbcf6714e7/pa/FY62272_ad4993eec9f19aa1abab459133107439.jpg',
                'https://img-pa.auto1.com/img35/45/3545f742e133358ce1635ccbcf6714e7/pa/FY62272_78ac6debd857ab1809b82606007b2e58.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac8ef3ec-cfd5-5264-b8d0-80d478f6f5c2/ac8ef3ec-cfd5-5264-b8d0-80d478f6f5c2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2468245,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img35/45/3545f742e133358ce1635ccbcf6714e7/pa/FY62272_c1365263c3ce91d76d365e20465141be.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac8ef3ec-cfd5-5264-b8d0-80d478f6f5c2/ac8ef3ec-cfd5-5264-b8d0-80d478f6f5c2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2368690,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img35/45/3545f742e133358ce1635ccbcf6714e7/pa/FY62272_060b3ca697ed17d5ac2896410e691955.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac8ef3ec-cfd5-5264-b8d0-80d478f6f5c2/ac8ef3ec-cfd5-5264-b8d0-80d478f6f5c2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2403605,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img35/45/3545f742e133358ce1635ccbcf6714e7/pa/FY62272_630987a48d53e2a7f1d85355848e14c5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac8ef3ec-cfd5-5264-b8d0-80d478f6f5c2/ac8ef3ec-cfd5-5264-b8d0-80d478f6f5c2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2213297,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img35/45/3545f742e133358ce1635ccbcf6714e7/pa/FY62272_c103e151cac631ac155560f3d49d901b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac8ef3ec-cfd5-5264-b8d0-80d478f6f5c2/ac8ef3ec-cfd5-5264-b8d0-80d478f6f5c2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2576205,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img35/45/3545f742e133358ce1635ccbcf6714e7/pa/FY62272_39b1ab2798c24fc95083f731cc665014.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac8ef3ec-cfd5-5264-b8d0-80d478f6f5c2/ac8ef3ec-cfd5-5264-b8d0-80d478f6f5c2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2527549,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img35/45/3545f742e133358ce1635ccbcf6714e7/pa/FY62272_168b3161c16c17e0296ffa32a3e2c6bd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac8ef3ec-cfd5-5264-b8d0-80d478f6f5c2/ac8ef3ec-cfd5-5264-b8d0-80d478f6f5c2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2550896,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img35/45/3545f742e133358ce1635ccbcf6714e7/pa/FY62272_0bcf41af488d72176e2b1e0f8efbf820.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac8ef3ec-cfd5-5264-b8d0-80d478f6f5c2/ac8ef3ec-cfd5-5264-b8d0-80d478f6f5c2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2537800,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img35/45/3545f742e133358ce1635ccbcf6714e7/pa/FY62272_e190a2325fb245404e112fa3bcf5094e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac8ef3ec-cfd5-5264-b8d0-80d478f6f5c2/ac8ef3ec-cfd5-5264-b8d0-80d478f6f5c2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2782039,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img35/45/3545f742e133358ce1635ccbcf6714e7/pa/FY62272_daaca67c7d68fb96573627b879d590b7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac8ef3ec-cfd5-5264-b8d0-80d478f6f5c2/ac8ef3ec-cfd5-5264-b8d0-80d478f6f5c2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2416106,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img35/45/3545f742e133358ce1635ccbcf6714e7/pa/FY62272_634512d85ea9942715096c7ce1a1ba8d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac8ef3ec-cfd5-5264-b8d0-80d478f6f5c2/ac8ef3ec-cfd5-5264-b8d0-80d478f6f5c2_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2520046,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img35/45/3545f742e133358ce1635ccbcf6714e7/pa/FY62272_490b43d305b67e4fae5afe4f98cb0693.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac8ef3ec-cfd5-5264-b8d0-80d478f6f5c2/ac8ef3ec-cfd5-5264-b8d0-80d478f6f5c2_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2732141,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img35/45/3545f742e133358ce1635ccbcf6714e7/pa/FY62272_51502224e248533f1db97b3ab8ee335f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac8ef3ec-cfd5-5264-b8d0-80d478f6f5c2/ac8ef3ec-cfd5-5264-b8d0-80d478f6f5c2_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61392,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/45/3545f742e133358ce1635ccbcf6714e7/pa/FY62272_c6d6c4ffff4a6ba1cb22a1b70da624b7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac8ef3ec-cfd5-5264-b8d0-80d478f6f5c2/ac8ef3ec-cfd5-5264-b8d0-80d478f6f5c2_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2544134,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img35/45/3545f742e133358ce1635ccbcf6714e7/pa/FY62272_ad4993eec9f19aa1abab459133107439.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac8ef3ec-cfd5-5264-b8d0-80d478f6f5c2/ac8ef3ec-cfd5-5264-b8d0-80d478f6f5c2_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44513,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/45/3545f742e133358ce1635ccbcf6714e7/pa/FY62272_78ac6debd857ab1809b82606007b2e58.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-02-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.6 TDI Business BlueMotion',
 'transmission': 'manual',
 'trim': 'Business BlueMotion',
 'year': 2019}
2026-01-28 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FY62272%27 HTTP/1.1" 200 None
2026-01-28 20:01:42 [auto1.it] INFO: Saving data for FY62272: {'created_time': 1769630502.517131, 'last_price_update_time': 1769630502.517139, 'auction_closing_time': 1769705167.0}
2026-01-28 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FY62272') HTTP/1.1" 204 0
2026-01-28 20:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/2b/032b457b787f642f8a61ead8f33dbc0f/pa/AW68260_aee17fd1b51b465a8d57b6558182f8b5.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/f1/a9f10ebe41cd775023aa7cea3236430e/pa/TZ83605_76c82433cd1c813d5c62b47a8b928c51.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F27%252F56275b3c0873ab8ae88eeb9caca800c5%252Fpa%252FNL47896_a1e2cc3215db2b37479827a17b24f73f.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/27/56275b3c0873ab8ae88eeb9caca800c5/pa/NL47896_a1e2cc3215db2b37479827a17b24f73f.jpg not downloaded yet
2026-01-28 20:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YA96052/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F27%252F56275b3c0873ab8ae88eeb9caca800c5%252Fpa%252FNL47896_8a91d77b76a9683706862c485c2d5ca7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/27/56275b3c0873ab8ae88eeb9caca800c5/pa/NL47896_8a91d77b76a9683706862c485c2d5ca7.jpg not downloaded yet
2026-01-28 20:01:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:01:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0a0cf890>
2026-01-28 20:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b2a49a6-5f2b-5692-a1a2-27ebe5ca1227/4b2a49a6-5f2b-5692-a1a2-27ebe5ca1227_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Ff1%252Fa9f10ebe41cd775023aa7cea3236430e%252Fpa%252FTZ83605_c9bae7d4df8faeba9eeabaf28a7ccebf.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/f1/a9f10ebe41cd775023aa7cea3236430e/pa/TZ83605_c9bae7d4df8faeba9eeabaf28a7ccebf.jpg saved to cache
2026-01-28 20:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 4b2a49a6-5f2b-5692-a1a2-27ebe5ca1227
2026-01-28 20:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/4b/df4bfd14ecccad2e28acc7936a8ce0e3/pa/WP90453_c1480a6f33c6e3eaf9adc39daec1f61b.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/f1/a9f10ebe41cd775023aa7cea3236430e/pa/TZ83605_b40f13a96d87cd9c21a8e4a73da8da76.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F27%252F56275b3c0873ab8ae88eeb9caca800c5%252Fpa%252FNL47896_565749d8df8b8d43d4e6fbd8953c6c34.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/27/56275b3c0873ab8ae88eeb9caca800c5/pa/NL47896_565749d8df8b8d43d4e6fbd8953c6c34.jpg not downloaded yet
2026-01-28 20:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FP41040/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AD85366/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F27%252F56275b3c0873ab8ae88eeb9caca800c5%252Fpa%252FNL47896_a43e94c0d7795bf8be403c8c8dbf2ff6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/27/56275b3c0873ab8ae88eeb9caca800c5/pa/NL47896_a43e94c0d7795bf8be403c8c8dbf2ff6.jpg not downloaded yet
2026-01-28 20:01:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09efb650>
2026-01-28 20:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c5618d2-b669-5ad2-838c-20c123c74357/4c5618d2-b669-5ad2-838c-20c123c74357_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F2b%252F032b457b787f642f8a61ead8f33dbc0f%252Fpa%252FAW68260_aee17fd1b51b465a8d57b6558182f8b5.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/2b/032b457b787f642f8a61ead8f33dbc0f/pa/AW68260_aee17fd1b51b465a8d57b6558182f8b5.jpg saved to cache
2026-01-28 20:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4c5618d2-b669-5ad2-838c-20c123c74357
2026-01-28 20:01:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09fc2a10>
2026-01-28 20:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b2a49a6-5f2b-5692-a1a2-27ebe5ca1227/4b2a49a6-5f2b-5692-a1a2-27ebe5ca1227_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Ff1%252Fa9f10ebe41cd775023aa7cea3236430e%252Fpa%252FTZ83605_76c82433cd1c813d5c62b47a8b928c51.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/f1/a9f10ebe41cd775023aa7cea3236430e/pa/TZ83605_76c82433cd1c813d5c62b47a8b928c51.jpg saved to cache
2026-01-28 20:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4b2a49a6-5f2b-5692-a1a2-27ebe5ca1227
2026-01-28 20:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F27%252F56275b3c0873ab8ae88eeb9caca800c5%252Fpa%252FNL47896_11bcebaaa470e236e72710de931ce4ee.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/27/56275b3c0873ab8ae88eeb9caca800c5/pa/NL47896_11bcebaaa470e236e72710de931ce4ee.jpg not downloaded yet
2026-01-28 20:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/02/0902ecd716da7e9c1590d287d6183135/pa/BS57464_b8c7211807b44ef8b62482d8a517d517.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:01:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/2b/032b457b787f642f8a61ead8f33dbc0f/pa/AW68260_199d709626359ab90d07f1ba6d8d7e02.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F27%252F56275b3c0873ab8ae88eeb9caca800c5%252Fpa%252FNL47896_732f9b950d2fe6669ee330e12e7df462.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/27/56275b3c0873ab8ae88eeb9caca800c5/pa/NL47896_732f9b950d2fe6669ee330e12e7df462.jpg not downloaded yet
2026-01-28 20:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/2b/032b457b787f642f8a61ead8f33dbc0f/pa/AW68260_03d7a8bd7b82d862e79f4d31d4f11075.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F27%252F56275b3c0873ab8ae88eeb9caca800c5%252Fpa%252FNL47896_1ba453d45a2721b4613177b630427a90.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/27/56275b3c0873ab8ae88eeb9caca800c5/pa/NL47896_1ba453d45a2721b4613177b630427a90.jpg not downloaded yet
2026-01-28 20:01:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09efaa10>
2026-01-28 20:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_051ddf36-eff8-5c80-8634-fb09358064b3/051ddf36-eff8-5c80-8634-fb09358064b3_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F4b%252Fdf4bfd14ecccad2e28acc7936a8ce0e3%252Fpa%252FWP90453_c1480a6f33c6e3eaf9adc39daec1f61b.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/4b/df4bfd14ecccad2e28acc7936a8ce0e3/pa/WP90453_c1480a6f33c6e3eaf9adc39daec1f61b.jpg saved to cache
2026-01-28 20:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 051ddf36-eff8-5c80-8634-fb09358064b3
2026-01-28 20:01:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b086cded0>
2026-01-28 20:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b2a49a6-5f2b-5692-a1a2-27ebe5ca1227/4b2a49a6-5f2b-5692-a1a2-27ebe5ca1227_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Ff1%252Fa9f10ebe41cd775023aa7cea3236430e%252Fpa%252FTZ83605_b40f13a96d87cd9c21a8e4a73da8da76.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/f1/a9f10ebe41cd775023aa7cea3236430e/pa/TZ83605_b40f13a96d87cd9c21a8e4a73da8da76.jpg saved to cache
2026-01-28 20:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4b2a49a6-5f2b-5692-a1a2-27ebe5ca1227
2026-01-28 20:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/2b/032b457b787f642f8a61ead8f33dbc0f/pa/AW68260_fd76d30f3413da8d3dd367f17f8b89d5.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/27/56275b3c0873ab8ae88eeb9caca800c5/pa/NL47896_c3ec375f2bf5b426faa756756511adb3.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/27/56275b3c0873ab8ae88eeb9caca800c5/pa/NL47896_f2cfffa9027c3280113890e585a76078.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F27%252F56275b3c0873ab8ae88eeb9caca800c5%252Fpa%252FNL47896_da99f7e01640dc89c96ed3e5264bb10f.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/27/56275b3c0873ab8ae88eeb9caca800c5/pa/NL47896_da99f7e01640dc89c96ed3e5264bb10f.jpg not downloaded yet
2026-01-28 20:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/2b/032b457b787f642f8a61ead8f33dbc0f/pa/AW68260_7805040769e76f14aca904c21564f911.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:01:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08c79410>
2026-01-28 20:01:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab2b9426-2a4e-5843-bea9-eeabb5e12b74/ab2b9426-2a4e-5843-bea9-eeabb5e12b74_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F02%252F0902ecd716da7e9c1590d287d6183135%252Fpa%252FBS57464_b8c7211807b44ef8b62482d8a517d517.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/02/0902ecd716da7e9c1590d287d6183135/pa/BS57464_b8c7211807b44ef8b62482d8a517d517.jpg saved to cache
2026-01-28 20:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item ab2b9426-2a4e-5843-bea9-eeabb5e12b74
2026-01-28 20:01:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08710f90>
2026-01-28 20:01:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c5618d2-b669-5ad2-838c-20c123c74357/4c5618d2-b669-5ad2-838c-20c123c74357_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F2b%252F032b457b787f642f8a61ead8f33dbc0f%252Fpa%252FAW68260_199d709626359ab90d07f1ba6d8d7e02.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/2b/032b457b787f642f8a61ead8f33dbc0f/pa/AW68260_199d709626359ab90d07f1ba6d8d7e02.jpg saved to cache
2026-01-28 20:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4c5618d2-b669-5ad2-838c-20c123c74357
2026-01-28 20:01:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:01:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09f20e10>
2026-01-28 20:01:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c5618d2-b669-5ad2-838c-20c123c74357/4c5618d2-b669-5ad2-838c-20c123c74357_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F2b%252F032b457b787f642f8a61ead8f33dbc0f%252Fpa%252FAW68260_03d7a8bd7b82d862e79f4d31d4f11075.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/2b/032b457b787f642f8a61ead8f33dbc0f/pa/AW68260_03d7a8bd7b82d862e79f4d31d4f11075.jpg saved to cache
2026-01-28 20:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4c5618d2-b669-5ad2-838c-20c123c74357
2026-01-28 20:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F27%252F56275b3c0873ab8ae88eeb9caca800c5%252Fpa%252FNL47896_e791bf3f92352ee3606a43a7265414af.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/27/56275b3c0873ab8ae88eeb9caca800c5/pa/NL47896_e791bf3f92352ee3606a43a7265414af.jpg not downloaded yet
2026-01-28 20:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/f1/a9f10ebe41cd775023aa7cea3236430e/pa/TZ83605_8e3f6d0a40efb3b37a04199b87f6c5be.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/27/56275b3c0873ab8ae88eeb9caca800c5/pa/NL47896_518d012501bc06bf7facd3235a4f708e.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/27/56275b3c0873ab8ae88eeb9caca800c5/pa/NL47896_a1e2cc3215db2b37479827a17b24f73f.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F27%252F56275b3c0873ab8ae88eeb9caca800c5%252Fpa%252FNL47896_8b9ec49843ccead327ee92c3f8ba0640.png%27 HTTP/1.1" 200 None
2026-01-28 20:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/27/56275b3c0873ab8ae88eeb9caca800c5/pa/NL47896_8b9ec49843ccead327ee92c3f8ba0640.png not downloaded yet
2026-01-28 20:01:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:01:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0a031150>
2026-01-28 20:01:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c5618d2-b669-5ad2-838c-20c123c74357/4c5618d2-b669-5ad2-838c-20c123c74357_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F2b%252F032b457b787f642f8a61ead8f33dbc0f%252Fpa%252FAW68260_fd76d30f3413da8d3dd367f17f8b89d5.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/2b/032b457b787f642f8a61ead8f33dbc0f/pa/AW68260_fd76d30f3413da8d3dd367f17f8b89d5.jpg saved to cache
2026-01-28 20:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 4c5618d2-b669-5ad2-838c-20c123c74357
2026-01-28 20:01:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08738a50>
2026-01-28 20:01:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef7b06ab-9230-5cf8-b17d-7115b47f0688/ef7b06ab-9230-5cf8-b17d-7115b47f0688_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F27%252F56275b3c0873ab8ae88eeb9caca800c5%252Fpa%252FNL47896_c3ec375f2bf5b426faa756756511adb3.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/27/56275b3c0873ab8ae88eeb9caca800c5/pa/NL47896_c3ec375f2bf5b426faa756756511adb3.jpg saved to cache
2026-01-28 20:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ef7b06ab-9230-5cf8-b17d-7115b47f0688
2026-01-28 20:01:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09d33510>
2026-01-28 20:01:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef7b06ab-9230-5cf8-b17d-7115b47f0688/ef7b06ab-9230-5cf8-b17d-7115b47f0688_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F27%252F56275b3c0873ab8ae88eeb9caca800c5%252Fpa%252FNL47896_f2cfffa9027c3280113890e585a76078.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/27/56275b3c0873ab8ae88eeb9caca800c5/pa/NL47896_f2cfffa9027c3280113890e585a76078.jpg saved to cache
2026-01-28 20:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ef7b06ab-9230-5cf8-b17d-7115b47f0688
2026-01-28 20:01:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:01:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09e44e50>
2026-01-28 20:01:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c5618d2-b669-5ad2-838c-20c123c74357/4c5618d2-b669-5ad2-838c-20c123c74357_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F2b%252F032b457b787f642f8a61ead8f33dbc0f%252Fpa%252FAW68260_7805040769e76f14aca904c21564f911.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/2b/032b457b787f642f8a61ead8f33dbc0f/pa/AW68260_7805040769e76f14aca904c21564f911.jpg saved to cache
2026-01-28 20:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4c5618d2-b669-5ad2-838c-20c123c74357
2026-01-28 20:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/f1/a9f10ebe41cd775023aa7cea3236430e/pa/TZ83605_dcd697b40eb3ef335afa8fed3dccda7b.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/27/56275b3c0873ab8ae88eeb9caca800c5/pa/NL47896_fd18c12229fc259e976770afa0891d2f.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/27/56275b3c0873ab8ae88eeb9caca800c5/pa/NL47896_11bcebaaa470e236e72710de931ce4ee.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/27/56275b3c0873ab8ae88eeb9caca800c5/pa/NL47896_100197e7bb983524e1804de15c54ba96.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/27/56275b3c0873ab8ae88eeb9caca800c5/pa/NL47896_565749d8df8b8d43d4e6fbd8953c6c34.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/27/56275b3c0873ab8ae88eeb9caca800c5/pa/NL47896_8a91d77b76a9683706862c485c2d5ca7.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YA96052> (referer: https://www.auto1.com/v1/car-details-view/YA96052/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:01:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:01:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08c7ba10>
2026-01-28 20:01:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b2a49a6-5f2b-5692-a1a2-27ebe5ca1227/4b2a49a6-5f2b-5692-a1a2-27ebe5ca1227_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Ff1%252Fa9f10ebe41cd775023aa7cea3236430e%252Fpa%252FTZ83605_8e3f6d0a40efb3b37a04199b87f6c5be.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/f1/a9f10ebe41cd775023aa7cea3236430e/pa/TZ83605_8e3f6d0a40efb3b37a04199b87f6c5be.jpg saved to cache
2026-01-28 20:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4b2a49a6-5f2b-5692-a1a2-27ebe5ca1227
2026-01-28 20:01:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08cc5910>
2026-01-28 20:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef7b06ab-9230-5cf8-b17d-7115b47f0688/ef7b06ab-9230-5cf8-b17d-7115b47f0688_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F27%252F56275b3c0873ab8ae88eeb9caca800c5%252Fpa%252FNL47896_518d012501bc06bf7facd3235a4f708e.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/27/56275b3c0873ab8ae88eeb9caca800c5/pa/NL47896_518d012501bc06bf7facd3235a4f708e.jpg saved to cache
2026-01-28 20:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ef7b06ab-9230-5cf8-b17d-7115b47f0688
2026-01-28 20:01:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0a039150>
2026-01-28 20:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef7b06ab-9230-5cf8-b17d-7115b47f0688/ef7b06ab-9230-5cf8-b17d-7115b47f0688_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F27%252F56275b3c0873ab8ae88eeb9caca800c5%252Fpa%252FNL47896_a1e2cc3215db2b37479827a17b24f73f.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/27/56275b3c0873ab8ae88eeb9caca800c5/pa/NL47896_a1e2cc3215db2b37479827a17b24f73f.jpg saved to cache
2026-01-28 20:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ef7b06ab-9230-5cf8-b17d-7115b47f0688
2026-01-28 20:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/27/56275b3c0873ab8ae88eeb9caca800c5/pa/NL47896_732f9b950d2fe6669ee330e12e7df462.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:01:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:01:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:01:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:01:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:01:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:01:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b086d43d0>
2026-01-28 20:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b2a49a6-5f2b-5692-a1a2-27ebe5ca1227/4b2a49a6-5f2b-5692-a1a2-27ebe5ca1227_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Ff1%252Fa9f10ebe41cd775023aa7cea3236430e%252Fpa%252FTZ83605_dcd697b40eb3ef335afa8fed3dccda7b.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/f1/a9f10ebe41cd775023aa7cea3236430e/pa/TZ83605_dcd697b40eb3ef335afa8fed3dccda7b.jpg saved to cache
2026-01-28 20:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 4b2a49a6-5f2b-5692-a1a2-27ebe5ca1227
2026-01-28 20:01:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0a0b9710>
2026-01-28 20:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef7b06ab-9230-5cf8-b17d-7115b47f0688/ef7b06ab-9230-5cf8-b17d-7115b47f0688_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F27%252F56275b3c0873ab8ae88eeb9caca800c5%252Fpa%252FNL47896_fd18c12229fc259e976770afa0891d2f.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/27/56275b3c0873ab8ae88eeb9caca800c5/pa/NL47896_fd18c12229fc259e976770afa0891d2f.jpg saved to cache
2026-01-28 20:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ef7b06ab-9230-5cf8-b17d-7115b47f0688
2026-01-28 20:01:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09eeed10>
2026-01-28 20:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef7b06ab-9230-5cf8-b17d-7115b47f0688/ef7b06ab-9230-5cf8-b17d-7115b47f0688_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F27%252F56275b3c0873ab8ae88eeb9caca800c5%252Fpa%252FNL47896_11bcebaaa470e236e72710de931ce4ee.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/27/56275b3c0873ab8ae88eeb9caca800c5/pa/NL47896_11bcebaaa470e236e72710de931ce4ee.jpg saved to cache
2026-01-28 20:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item ef7b06ab-9230-5cf8-b17d-7115b47f0688
2026-01-28 20:01:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09dde310>
2026-01-28 20:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef7b06ab-9230-5cf8-b17d-7115b47f0688/ef7b06ab-9230-5cf8-b17d-7115b47f0688_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F27%252F56275b3c0873ab8ae88eeb9caca800c5%252Fpa%252FNL47896_100197e7bb983524e1804de15c54ba96.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/27/56275b3c0873ab8ae88eeb9caca800c5/pa/NL47896_100197e7bb983524e1804de15c54ba96.jpg saved to cache
2026-01-28 20:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ef7b06ab-9230-5cf8-b17d-7115b47f0688
2026-01-28 20:01:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08cd6bd0>
2026-01-28 20:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:01:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef7b06ab-9230-5cf8-b17d-7115b47f0688/ef7b06ab-9230-5cf8-b17d-7115b47f0688_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F27%252F56275b3c0873ab8ae88eeb9caca800c5%252Fpa%252FNL47896_565749d8df8b8d43d4e6fbd8953c6c34.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/27/56275b3c0873ab8ae88eeb9caca800c5/pa/NL47896_565749d8df8b8d43d4e6fbd8953c6c34.jpg saved to cache
2026-01-28 20:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ef7b06ab-9230-5cf8-b17d-7115b47f0688
2026-01-28 20:01:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08702a10>
2026-01-28 20:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef7b06ab-9230-5cf8-b17d-7115b47f0688/ef7b06ab-9230-5cf8-b17d-7115b47f0688_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F27%252F56275b3c0873ab8ae88eeb9caca800c5%252Fpa%252FNL47896_8a91d77b76a9683706862c485c2d5ca7.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/27/56275b3c0873ab8ae88eeb9caca800c5/pa/NL47896_8a91d77b76a9683706862c485c2d5ca7.jpg saved to cache
2026-01-28 20:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ef7b06ab-9230-5cf8-b17d-7115b47f0688
2026-01-28 20:01:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3536b64e-adcb-5ddd-8bd0-eb3c9d1d0d25 with identifier: YA96052
2026-01-28 20:01:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3536b64e-adcb-5ddd-8bd0-eb3c9d1d0d25 with scrape type 1
2026-01-28 20:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 3536b64e-adcb-5ddd-8bd0-eb3c9d1d0d25
2026-01-28 20:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F58%252Fbf584e0c6003bbd4bc54ee6710fb8f54%252Fpa%252FYA96052_6669f5696383e9a7ff18fd5c64d45574.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/58/bf584e0c6003bbd4bc54ee6710fb8f54/pa/YA96052_6669f5696383e9a7ff18fd5c64d45574.jpg not downloaded yet
2026-01-28 20:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/27/56275b3c0873ab8ae88eeb9caca800c5/pa/NL47896_da99f7e01640dc89c96ed3e5264bb10f.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/4b/df4bfd14ecccad2e28acc7936a8ce0e3/pa/WP90453_88b89d76751978fa70ee331dcffbb01f.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/27/56275b3c0873ab8ae88eeb9caca800c5/pa/NL47896_a43e94c0d7795bf8be403c8c8dbf2ff6.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F58%252Fbf584e0c6003bbd4bc54ee6710fb8f54%252Fpa%252FYA96052_a911078c9508bcd644a625b38c7f9310.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/58/bf584e0c6003bbd4bc54ee6710fb8f54/pa/YA96052_a911078c9508bcd644a625b38c7f9310.jpg not downloaded yet
2026-01-28 20:01:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:01:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/27/56275b3c0873ab8ae88eeb9caca800c5/pa/NL47896_100c733d57bd67e00101683326281763.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/27/56275b3c0873ab8ae88eeb9caca800c5/pa/NL47896_8b9ec49843ccead327ee92c3f8ba0640.png> (referer: https://www.auto1.com/)
2026-01-28 20:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/27/56275b3c0873ab8ae88eeb9caca800c5/pa/NL47896_e791bf3f92352ee3606a43a7265414af.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/27/56275b3c0873ab8ae88eeb9caca800c5/pa/NL47896_1ba453d45a2721b4613177b630427a90.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F58%252Fbf584e0c6003bbd4bc54ee6710fb8f54%252Fpa%252FYA96052_ff5ed6168cd1dadf033b492048493d8e.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/58/bf584e0c6003bbd4bc54ee6710fb8f54/pa/YA96052_ff5ed6168cd1dadf033b492048493d8e.jpg not downloaded yet
2026-01-28 20:01:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:01:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:01:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b086ec310>
2026-01-28 20:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef7b06ab-9230-5cf8-b17d-7115b47f0688/ef7b06ab-9230-5cf8-b17d-7115b47f0688_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F27%252F56275b3c0873ab8ae88eeb9caca800c5%252Fpa%252FNL47896_732f9b950d2fe6669ee330e12e7df462.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/27/56275b3c0873ab8ae88eeb9caca800c5/pa/NL47896_732f9b950d2fe6669ee330e12e7df462.jpg saved to cache
2026-01-28 20:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item ef7b06ab-9230-5cf8-b17d-7115b47f0688
2026-01-28 20:01:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/4b/df4bfd14ecccad2e28acc7936a8ce0e3/pa/WP90453_5692ea7a29194d6b76bdb33e983dfd10.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F58%252Fbf584e0c6003bbd4bc54ee6710fb8f54%252Fpa%252FYA96052_2703dddeb874c24ffbf28127347aecba.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/58/bf584e0c6003bbd4bc54ee6710fb8f54/pa/YA96052_2703dddeb874c24ffbf28127347aecba.jpg not downloaded yet
2026-01-28 20:01:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08cf5e90>
2026-01-28 20:01:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef7b06ab-9230-5cf8-b17d-7115b47f0688/ef7b06ab-9230-5cf8-b17d-7115b47f0688_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F27%252F56275b3c0873ab8ae88eeb9caca800c5%252Fpa%252FNL47896_da99f7e01640dc89c96ed3e5264bb10f.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/27/56275b3c0873ab8ae88eeb9caca800c5/pa/NL47896_da99f7e01640dc89c96ed3e5264bb10f.jpg saved to cache
2026-01-28 20:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item ef7b06ab-9230-5cf8-b17d-7115b47f0688
2026-01-28 20:01:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09dd8bd0>
2026-01-28 20:01:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_051ddf36-eff8-5c80-8634-fb09358064b3/051ddf36-eff8-5c80-8634-fb09358064b3_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F4b%252Fdf4bfd14ecccad2e28acc7936a8ce0e3%252Fpa%252FWP90453_88b89d76751978fa70ee331dcffbb01f.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/4b/df4bfd14ecccad2e28acc7936a8ce0e3/pa/WP90453_88b89d76751978fa70ee331dcffbb01f.jpg saved to cache
2026-01-28 20:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 051ddf36-eff8-5c80-8634-fb09358064b3
2026-01-28 20:01:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09d6f2d0>
2026-01-28 20:01:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef7b06ab-9230-5cf8-b17d-7115b47f0688/ef7b06ab-9230-5cf8-b17d-7115b47f0688_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F27%252F56275b3c0873ab8ae88eeb9caca800c5%252Fpa%252FNL47896_a43e94c0d7795bf8be403c8c8dbf2ff6.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/27/56275b3c0873ab8ae88eeb9caca800c5/pa/NL47896_a43e94c0d7795bf8be403c8c8dbf2ff6.jpg saved to cache
2026-01-28 20:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ef7b06ab-9230-5cf8-b17d-7115b47f0688
2026-01-28 20:01:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08c37d50>
2026-01-28 20:01:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef7b06ab-9230-5cf8-b17d-7115b47f0688/ef7b06ab-9230-5cf8-b17d-7115b47f0688_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F27%252F56275b3c0873ab8ae88eeb9caca800c5%252Fpa%252FNL47896_100c733d57bd67e00101683326281763.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/27/56275b3c0873ab8ae88eeb9caca800c5/pa/NL47896_100c733d57bd67e00101683326281763.jpg saved to cache
2026-01-28 20:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ef7b06ab-9230-5cf8-b17d-7115b47f0688
2026-01-28 20:01:51 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-01-28 20:01:51 [PIL.PngImagePlugin] DEBUG: STREAM b'eXIf' 41 68
2026-01-28 20:01:51 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 121 9
2026-01-28 20:01:51 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 142 8192
2026-01-28 20:01:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09d97ad0>
2026-01-28 20:01:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:01:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef7b06ab-9230-5cf8-b17d-7115b47f0688/ef7b06ab-9230-5cf8-b17d-7115b47f0688_image_15.png HTTP/1.1" 201 0
2026-01-28 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F27%252F56275b3c0873ab8ae88eeb9caca800c5%252Fpa%252FNL47896_8b9ec49843ccead327ee92c3f8ba0640.png') HTTP/1.1" 204 0
2026-01-28 20:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/27/56275b3c0873ab8ae88eeb9caca800c5/pa/NL47896_8b9ec49843ccead327ee92c3f8ba0640.png saved to cache
2026-01-28 20:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item ef7b06ab-9230-5cf8-b17d-7115b47f0688
2026-01-28 20:01:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09dd8fd0>
2026-01-28 20:01:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:01:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef7b06ab-9230-5cf8-b17d-7115b47f0688/ef7b06ab-9230-5cf8-b17d-7115b47f0688_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F27%252F56275b3c0873ab8ae88eeb9caca800c5%252Fpa%252FNL47896_e791bf3f92352ee3606a43a7265414af.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/27/56275b3c0873ab8ae88eeb9caca800c5/pa/NL47896_e791bf3f92352ee3606a43a7265414af.jpg saved to cache
2026-01-28 20:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item ef7b06ab-9230-5cf8-b17d-7115b47f0688
2026-01-28 20:01:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08ca3050>
2026-01-28 20:01:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:01:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef7b06ab-9230-5cf8-b17d-7115b47f0688/ef7b06ab-9230-5cf8-b17d-7115b47f0688_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F27%252F56275b3c0873ab8ae88eeb9caca800c5%252Fpa%252FNL47896_1ba453d45a2721b4613177b630427a90.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/27/56275b3c0873ab8ae88eeb9caca800c5/pa/NL47896_1ba453d45a2721b4613177b630427a90.jpg saved to cache
2026-01-28 20:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item ef7b06ab-9230-5cf8-b17d-7115b47f0688
2026-01-28 20:01:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ef7b06ab-9230-5cf8-b17d-7115b47f0688, skipping ID generation
2026-01-28 20:01:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef7b06ab-9230-5cf8-b17d-7115b47f0688 with scrape type 1
2026-01-28 20:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Removing item ef7b06ab-9230-5cf8-b17d-7115b47f0688 from tracking dictionaries
2026-01-28 20:01:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ef7b06ab-9230-5cf8-b17d-7115b47f0688 sending to next pipeline
2026-01-28 20:01:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ef7b06ab-9230-5cf8-b17d-7115b47f0688, identifier: NL47896
2026-01-28 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F58%252Fbf584e0c6003bbd4bc54ee6710fb8f54%252Fpa%252FYA96052_efa9aaa7e78eebc73a297477482195cc.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/58/bf584e0c6003bbd4bc54ee6710fb8f54/pa/YA96052_efa9aaa7e78eebc73a297477482195cc.jpg not downloaded yet
2026-01-28 20:01:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ef7b06ab-9230-5cf8-b17d-7115b47f0688 with identifier: NL47896
2026-01-28 20:01:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ef7b06ab-9230-5cf8-b17d-7115b47f0688 with identifier: NL47896
2026-01-28 20:01:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ef7b06ab-9230-5cf8-b17d-7115b47f0688 with identifier: NL47896 to the API
2026-01-28 20:01:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:01:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:01:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img56/27/56275b3c0873ab8ae88eeb9caca800c5/pa/NL47896_1ba453d45a2721b4613177b630427a90.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2026-01-29T16:58:39Z',
 'fuel_type': 'diesel',
 'id': 'ef7b06ab-9230-5cf8-b17d-7115b47f0688',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NL47896',
 'listing': 'auction',
 'location': 'IT, Capannori (LU)',
 'make': 'Jeep',
 'model': 'Renegade',
 'odometer': 93270,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef7b06ab-9230-5cf8-b17d-7115b47f0688/ef7b06ab-9230-5cf8-b17d-7115b47f0688_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67144,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/27/56275b3c0873ab8ae88eeb9caca800c5/pa/NL47896_100c733d57bd67e00101683326281763.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef7b06ab-9230-5cf8-b17d-7115b47f0688/ef7b06ab-9230-5cf8-b17d-7115b47f0688_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64440,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/27/56275b3c0873ab8ae88eeb9caca800c5/pa/NL47896_fd18c12229fc259e976770afa0891d2f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef7b06ab-9230-5cf8-b17d-7115b47f0688/ef7b06ab-9230-5cf8-b17d-7115b47f0688_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63432,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/27/56275b3c0873ab8ae88eeb9caca800c5/pa/NL47896_518d012501bc06bf7facd3235a4f708e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef7b06ab-9230-5cf8-b17d-7115b47f0688/ef7b06ab-9230-5cf8-b17d-7115b47f0688_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62306,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/27/56275b3c0873ab8ae88eeb9caca800c5/pa/NL47896_f2cfffa9027c3280113890e585a76078.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef7b06ab-9230-5cf8-b17d-7115b47f0688/ef7b06ab-9230-5cf8-b17d-7115b47f0688_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59430,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/27/56275b3c0873ab8ae88eeb9caca800c5/pa/NL47896_c3ec375f2bf5b426faa756756511adb3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef7b06ab-9230-5cf8-b17d-7115b47f0688/ef7b06ab-9230-5cf8-b17d-7115b47f0688_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68448,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/27/56275b3c0873ab8ae88eeb9caca800c5/pa/NL47896_100197e7bb983524e1804de15c54ba96.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef7b06ab-9230-5cf8-b17d-7115b47f0688/ef7b06ab-9230-5cf8-b17d-7115b47f0688_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68640,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/27/56275b3c0873ab8ae88eeb9caca800c5/pa/NL47896_a1e2cc3215db2b37479827a17b24f73f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef7b06ab-9230-5cf8-b17d-7115b47f0688/ef7b06ab-9230-5cf8-b17d-7115b47f0688_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74133,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/27/56275b3c0873ab8ae88eeb9caca800c5/pa/NL47896_8a91d77b76a9683706862c485c2d5ca7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef7b06ab-9230-5cf8-b17d-7115b47f0688/ef7b06ab-9230-5cf8-b17d-7115b47f0688_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71299,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/27/56275b3c0873ab8ae88eeb9caca800c5/pa/NL47896_565749d8df8b8d43d4e6fbd8953c6c34.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef7b06ab-9230-5cf8-b17d-7115b47f0688/ef7b06ab-9230-5cf8-b17d-7115b47f0688_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49549,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/27/56275b3c0873ab8ae88eeb9caca800c5/pa/NL47896_a43e94c0d7795bf8be403c8c8dbf2ff6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef7b06ab-9230-5cf8-b17d-7115b47f0688/ef7b06ab-9230-5cf8-b17d-7115b47f0688_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61563,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/27/56275b3c0873ab8ae88eeb9caca800c5/pa/NL47896_11bcebaaa470e236e72710de931ce4ee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef7b06ab-9230-5cf8-b17d-7115b47f0688/ef7b06ab-9230-5cf8-b17d-7115b47f0688_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47553,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/27/56275b3c0873ab8ae88eeb9caca800c5/pa/NL47896_732f9b950d2fe6669ee330e12e7df462.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef7b06ab-9230-5cf8-b17d-7115b47f0688/ef7b06ab-9230-5cf8-b17d-7115b47f0688_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76714,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/27/56275b3c0873ab8ae88eeb9caca800c5/pa/NL47896_1ba453d45a2721b4613177b630427a90.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef7b06ab-9230-5cf8-b17d-7115b47f0688/ef7b06ab-9230-5cf8-b17d-7115b47f0688_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51227,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/27/56275b3c0873ab8ae88eeb9caca800c5/pa/NL47896_da99f7e01640dc89c96ed3e5264bb10f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef7b06ab-9230-5cf8-b17d-7115b47f0688/ef7b06ab-9230-5cf8-b17d-7115b47f0688_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109622,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/27/56275b3c0873ab8ae88eeb9caca800c5/pa/NL47896_e791bf3f92352ee3606a43a7265414af.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef7b06ab-9230-5cf8-b17d-7115b47f0688/ef7b06ab-9230-5cf8-b17d-7115b47f0688_image_15.png',
             'Extension': 'png',
             'FileSizeInBytes': 76592,
             'Height': 525,
             'OriginUrl': 'https://img-pa.auto1.com/img56/27/56275b3c0873ab8ae88eeb9caca800c5/pa/NL47896_8b9ec49843ccead327ee92c3f8ba0640.png',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-05-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jeep Renegade 1.6 M-Jet Limited FWD',
 'transmission': 'manual',
 'trim': 'Limited FWD',
 'year': 2018}
2026-01-28 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NL47896%27 HTTP/1.1" 200 None
2026-01-28 20:01:52 [auto1.it] INFO: Saving data for NL47896: {'created_time': 1769630512.713468, 'last_price_update_time': 1769630512.713479, 'auction_closing_time': 1769705919.0}
2026-01-28 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NL47896') HTTP/1.1" 204 0
2026-01-28 20:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/f1/a9f10ebe41cd775023aa7cea3236430e/pa/TZ83605_18f900b8c354bac06c69c28bc9c5fa1d.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/2b/032b457b787f642f8a61ead8f33dbc0f/pa/AW68260_d7917356b18061b04fbefe02e658d3d1.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F58%252Fbf584e0c6003bbd4bc54ee6710fb8f54%252Fpa%252FYA96052_6d1dd40b21b52d772c17827f2b05436e.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/58/bf584e0c6003bbd4bc54ee6710fb8f54/pa/YA96052_6d1dd40b21b52d772c17827f2b05436e.jpg not downloaded yet
2026-01-28 20:01:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09f61850>
2026-01-28 20:01:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:01:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_051ddf36-eff8-5c80-8634-fb09358064b3/051ddf36-eff8-5c80-8634-fb09358064b3_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F4b%252Fdf4bfd14ecccad2e28acc7936a8ce0e3%252Fpa%252FWP90453_5692ea7a29194d6b76bdb33e983dfd10.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/4b/df4bfd14ecccad2e28acc7936a8ce0e3/pa/WP90453_5692ea7a29194d6b76bdb33e983dfd10.jpg saved to cache
2026-01-28 20:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 051ddf36-eff8-5c80-8634-fb09358064b3
2026-01-28 20:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F58%252Fbf584e0c6003bbd4bc54ee6710fb8f54%252Fpa%252FYA96052_d8879a8dbe4ce1a7ac1a74e41aa78276.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/58/bf584e0c6003bbd4bc54ee6710fb8f54/pa/YA96052_d8879a8dbe4ce1a7ac1a74e41aa78276.jpg not downloaded yet
2026-01-28 20:01:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b086c2110>
2026-01-28 20:01:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b2a49a6-5f2b-5692-a1a2-27ebe5ca1227/4b2a49a6-5f2b-5692-a1a2-27ebe5ca1227_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Ff1%252Fa9f10ebe41cd775023aa7cea3236430e%252Fpa%252FTZ83605_18f900b8c354bac06c69c28bc9c5fa1d.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/f1/a9f10ebe41cd775023aa7cea3236430e/pa/TZ83605_18f900b8c354bac06c69c28bc9c5fa1d.jpg saved to cache
2026-01-28 20:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4b2a49a6-5f2b-5692-a1a2-27ebe5ca1227
2026-01-28 20:01:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0a0f5f90>
2026-01-28 20:01:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:01:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c5618d2-b669-5ad2-838c-20c123c74357/4c5618d2-b669-5ad2-838c-20c123c74357_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F2b%252F032b457b787f642f8a61ead8f33dbc0f%252Fpa%252FAW68260_d7917356b18061b04fbefe02e658d3d1.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/2b/032b457b787f642f8a61ead8f33dbc0f/pa/AW68260_d7917356b18061b04fbefe02e658d3d1.jpg saved to cache
2026-01-28 20:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4c5618d2-b669-5ad2-838c-20c123c74357
2026-01-28 20:01:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/58/bf584e0c6003bbd4bc54ee6710fb8f54/pa/YA96052_a911078c9508bcd644a625b38c7f9310.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F58%252Fbf584e0c6003bbd4bc54ee6710fb8f54%252Fpa%252FYA96052_350a0a128727ea44d7e56b54873f2b25.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/58/bf584e0c6003bbd4bc54ee6710fb8f54/pa/YA96052_350a0a128727ea44d7e56b54873f2b25.jpg not downloaded yet
2026-01-28 20:01:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/58/bf584e0c6003bbd4bc54ee6710fb8f54/pa/YA96052_6669f5696383e9a7ff18fd5c64d45574.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:01:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/58/bf584e0c6003bbd4bc54ee6710fb8f54/pa/YA96052_2703dddeb874c24ffbf28127347aecba.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:01:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/58/bf584e0c6003bbd4bc54ee6710fb8f54/pa/YA96052_efa9aaa7e78eebc73a297477482195cc.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F58%252Fbf584e0c6003bbd4bc54ee6710fb8f54%252Fpa%252FYA96052_13a378052e837a3a7f3b2117c0812c15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/58/bf584e0c6003bbd4bc54ee6710fb8f54/pa/YA96052_13a378052e837a3a7f3b2117c0812c15.jpg not downloaded yet
2026-01-28 20:01:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AD85366> (referer: https://www.auto1.com/v1/car-details-view/AD85366/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:01:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PG92884> (referer: https://www.auto1.com/v1/car-details-view/PG92884/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:01:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FJ86916/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:01:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JY88451> (referer: https://www.auto1.com/v1/car-details-view/JY88451/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:01:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KW61095> (referer: https://www.auto1.com/v1/car-details-view/KW61095/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:01:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F58%252Fbf584e0c6003bbd4bc54ee6710fb8f54%252Fpa%252FYA96052_5a52e757234adc10da75c97a6624497b.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/58/bf584e0c6003bbd4bc54ee6710fb8f54/pa/YA96052_5a52e757234adc10da75c97a6624497b.jpg not downloaded yet
2026-01-28 20:01:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/58/bf584e0c6003bbd4bc54ee6710fb8f54/pa/YA96052_ff5ed6168cd1dadf033b492048493d8e.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:01:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/f1/a9f10ebe41cd775023aa7cea3236430e/pa/TZ83605_1c07b726026d2dd703fe883db828437b.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F58%252Fbf584e0c6003bbd4bc54ee6710fb8f54%252Fpa%252FYA96052_c4df9b1bf69588337db75ec082186d1b.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/58/bf584e0c6003bbd4bc54ee6710fb8f54/pa/YA96052_c4df9b1bf69588337db75ec082186d1b.jpg not downloaded yet
2026-01-28 20:01:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WD98953/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F58%252Fbf584e0c6003bbd4bc54ee6710fb8f54%252Fpa%252FYA96052_d1b1b118ad07eece8a07939f832408d8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/58/bf584e0c6003bbd4bc54ee6710fb8f54/pa/YA96052_d1b1b118ad07eece8a07939f832408d8.jpg not downloaded yet
2026-01-28 20:01:54 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 22 - Data Location: 134 - value: b'Apple\x00'
2026-01-28 20:01:54 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 34 - Data Location: 140 - value: b'iPad mini (A17 Pro)\x00'
2026-01-28 20:01:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-01-28 20:01:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 58 - Data Location: 160 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-01-28 20:01:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 70 - Data Location: 168 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-01-28 20:01:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-01-28 20:01:54 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 94 - Data Location: 176 - value: b'18.6.2\x00'
2026-01-28 20:01:54 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 106 - Data Location: 184 - value: b'2025:11:28 15:04:38\x00'
2026-01-28 20:01:54 [PIL.TiffImagePlugin] DEBUG: tag: HostComputer (316) - type: string (2) Tag Location: 118 - Data Location: 204 - value: b'iPad mini (A17 Pro)\x00'
2026-01-28 20:01:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\xe0'
2026-01-28 20:01:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b086c2150>
2026-01-28 20:01:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3536b64e-adcb-5ddd-8bd0-eb3c9d1d0d25/3536b64e-adcb-5ddd-8bd0-eb3c9d1d0d25_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F58%252Fbf584e0c6003bbd4bc54ee6710fb8f54%252Fpa%252FYA96052_a911078c9508bcd644a625b38c7f9310.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/58/bf584e0c6003bbd4bc54ee6710fb8f54/pa/YA96052_a911078c9508bcd644a625b38c7f9310.jpg saved to cache
2026-01-28 20:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3536b64e-adcb-5ddd-8bd0-eb3c9d1d0d25
2026-01-28 20:01:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/4b/df4bfd14ecccad2e28acc7936a8ce0e3/pa/WP90453_519a5d84b8f8eb2abf29378e0d8e5659.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F58%252Fbf584e0c6003bbd4bc54ee6710fb8f54%252Fpa%252FYA96052_e267081895991f08dfae128524546baf.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/58/bf584e0c6003bbd4bc54ee6710fb8f54/pa/YA96052_e267081895991f08dfae128524546baf.jpg not downloaded yet
2026-01-28 20:01:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/02/0902ecd716da7e9c1590d287d6183135/pa/BS57464_eaf0156791ad4ad12adf6a9dd987298c.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:01:54 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 22 - Data Location: 134 - value: b'Apple\x00'
2026-01-28 20:01:54 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 34 - Data Location: 140 - value: b'iPad mini (A17 Pro)\x00'
2026-01-28 20:01:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-01-28 20:01:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 58 - Data Location: 160 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-01-28 20:01:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 70 - Data Location: 168 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-01-28 20:01:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-01-28 20:01:54 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 94 - Data Location: 176 - value: b'18.6.2\x00'
2026-01-28 20:01:54 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 106 - Data Location: 184 - value: b'2025:11:28 15:04:04\x00'
2026-01-28 20:01:54 [PIL.TiffImagePlugin] DEBUG: tag: HostComputer (316) - type: string (2) Tag Location: 118 - Data Location: 204 - value: b'iPad mini (A17 Pro)\x00'
2026-01-28 20:01:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\xe0'
2026-01-28 20:01:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08c3ff10>
2026-01-28 20:01:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:01:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3536b64e-adcb-5ddd-8bd0-eb3c9d1d0d25/3536b64e-adcb-5ddd-8bd0-eb3c9d1d0d25_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F58%252Fbf584e0c6003bbd4bc54ee6710fb8f54%252Fpa%252FYA96052_6669f5696383e9a7ff18fd5c64d45574.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/58/bf584e0c6003bbd4bc54ee6710fb8f54/pa/YA96052_6669f5696383e9a7ff18fd5c64d45574.jpg saved to cache
2026-01-28 20:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3536b64e-adcb-5ddd-8bd0-eb3c9d1d0d25
2026-01-28 20:01:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08c36a50>
2026-01-28 20:01:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:01:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3536b64e-adcb-5ddd-8bd0-eb3c9d1d0d25/3536b64e-adcb-5ddd-8bd0-eb3c9d1d0d25_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F58%252Fbf584e0c6003bbd4bc54ee6710fb8f54%252Fpa%252FYA96052_2703dddeb874c24ffbf28127347aecba.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/58/bf584e0c6003bbd4bc54ee6710fb8f54/pa/YA96052_2703dddeb874c24ffbf28127347aecba.jpg saved to cache
2026-01-28 20:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3536b64e-adcb-5ddd-8bd0-eb3c9d1d0d25
2026-01-28 20:01:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09db1510>
2026-01-28 20:01:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:01:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3536b64e-adcb-5ddd-8bd0-eb3c9d1d0d25/3536b64e-adcb-5ddd-8bd0-eb3c9d1d0d25_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F58%252Fbf584e0c6003bbd4bc54ee6710fb8f54%252Fpa%252FYA96052_efa9aaa7e78eebc73a297477482195cc.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/58/bf584e0c6003bbd4bc54ee6710fb8f54/pa/YA96052_efa9aaa7e78eebc73a297477482195cc.jpg saved to cache
2026-01-28 20:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3536b64e-adcb-5ddd-8bd0-eb3c9d1d0d25
2026-01-28 20:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/58/bf584e0c6003bbd4bc54ee6710fb8f54/pa/YA96052_350a0a128727ea44d7e56b54873f2b25.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F58%252Fbf584e0c6003bbd4bc54ee6710fb8f54%252Fpa%252FYA96052_c047f84af94f77f149f674adc2fc4917.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/58/bf584e0c6003bbd4bc54ee6710fb8f54/pa/YA96052_c047f84af94f77f149f674adc2fc4917.jpg not downloaded yet
2026-01-28 20:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FP41040> (referer: https://www.auto1.com/v1/car-details-view/FP41040/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RY80591> (referer: https://www.auto1.com/v1/car-details-view/RY80591/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F58%252Fbf584e0c6003bbd4bc54ee6710fb8f54%252Fpa%252FYA96052_14077f44bacaaf6688b1aaacb345eca5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/58/bf584e0c6003bbd4bc54ee6710fb8f54/pa/YA96052_14077f44bacaaf6688b1aaacb345eca5.jpg not downloaded yet
2026-01-28 20:01:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:01:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4329f01-20ce-5e0f-9f3e-36d14ff7e147 with identifier: AD85366
2026-01-28 20:01:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4329f01-20ce-5e0f-9f3e-36d14ff7e147 with scrape type 2
2026-01-28 20:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b4329f01-20ce-5e0f-9f3e-36d14ff7e147 with scrape type 2
2026-01-28 20:01:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b4329f01-20ce-5e0f-9f3e-36d14ff7e147, identifier: AD85366
2026-01-28 20:01:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 39160727-3850-5a0f-8dc2-b5c9a4027d5c with identifier: PG92884
2026-01-28 20:01:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39160727-3850-5a0f-8dc2-b5c9a4027d5c with scrape type 1
2026-01-28 20:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 39160727-3850-5a0f-8dc2-b5c9a4027d5c
2026-01-28 20:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F2e%252Fa32e8e979fb9d56f9c8b69ed7c7d05ef%252Fpa%252FPG92884_6883b0b92b67423946f42afcf562ceff.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/2e/a32e8e979fb9d56f9c8b69ed7c7d05ef/pa/PG92884_6883b0b92b67423946f42afcf562ceff.jpg already downloaded
2026-01-28 20:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F2e%252Fa32e8e979fb9d56f9c8b69ed7c7d05ef%252Fpa%252FPG92884_8dfb9fbf62229beb571de63ad7395b57.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/2e/a32e8e979fb9d56f9c8b69ed7c7d05ef/pa/PG92884_8dfb9fbf62229beb571de63ad7395b57.jpg already downloaded
2026-01-28 20:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F2e%252Fa32e8e979fb9d56f9c8b69ed7c7d05ef%252Fpa%252FPG92884_5865457d568d8536f080df78bd14447e.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/2e/a32e8e979fb9d56f9c8b69ed7c7d05ef/pa/PG92884_5865457d568d8536f080df78bd14447e.jpg already downloaded
2026-01-28 20:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F2e%252Fa32e8e979fb9d56f9c8b69ed7c7d05ef%252Fpa%252FPG92884_4d156d08bc5cfc0f8f65d10c176908d4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/2e/a32e8e979fb9d56f9c8b69ed7c7d05ef/pa/PG92884_4d156d08bc5cfc0f8f65d10c176908d4.jpg already downloaded
2026-01-28 20:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F2e%252Fa32e8e979fb9d56f9c8b69ed7c7d05ef%252Fpa%252FPG92884_3e1f6c46abd6544a93c197ad6de0577e.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/2e/a32e8e979fb9d56f9c8b69ed7c7d05ef/pa/PG92884_3e1f6c46abd6544a93c197ad6de0577e.jpg already downloaded
2026-01-28 20:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F2e%252Fa32e8e979fb9d56f9c8b69ed7c7d05ef%252Fpa%252FPG92884_2b9638906d4d73a279ac1997d0fd0bbe.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/2e/a32e8e979fb9d56f9c8b69ed7c7d05ef/pa/PG92884_2b9638906d4d73a279ac1997d0fd0bbe.jpg already downloaded
2026-01-28 20:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F2e%252Fa32e8e979fb9d56f9c8b69ed7c7d05ef%252Fpa%252FPG92884_f3f61cc28919cb6ec3d590a2f32c75bb.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/2e/a32e8e979fb9d56f9c8b69ed7c7d05ef/pa/PG92884_f3f61cc28919cb6ec3d590a2f32c75bb.jpg already downloaded
2026-01-28 20:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F2e%252Fa32e8e979fb9d56f9c8b69ed7c7d05ef%252Fpa%252FPG92884_843482aa3500a83d8862fa51756d546f.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/2e/a32e8e979fb9d56f9c8b69ed7c7d05ef/pa/PG92884_843482aa3500a83d8862fa51756d546f.jpg already downloaded
2026-01-28 20:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F2e%252Fa32e8e979fb9d56f9c8b69ed7c7d05ef%252Fpa%252FPG92884_37d06227eb87c491611be231e1ecaab7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/2e/a32e8e979fb9d56f9c8b69ed7c7d05ef/pa/PG92884_37d06227eb87c491611be231e1ecaab7.jpg already downloaded
2026-01-28 20:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F2e%252Fa32e8e979fb9d56f9c8b69ed7c7d05ef%252Fpa%252FPG92884_9f870d5f3ccb859dc605df8e00e68aa6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/2e/a32e8e979fb9d56f9c8b69ed7c7d05ef/pa/PG92884_9f870d5f3ccb859dc605df8e00e68aa6.jpg already downloaded
2026-01-28 20:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F2e%252Fa32e8e979fb9d56f9c8b69ed7c7d05ef%252Fpa%252FPG92884_944e8365f21b70f507965d9b2248f1eb.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/2e/a32e8e979fb9d56f9c8b69ed7c7d05ef/pa/PG92884_944e8365f21b70f507965d9b2248f1eb.jpg already downloaded
2026-01-28 20:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F2e%252Fa32e8e979fb9d56f9c8b69ed7c7d05ef%252Fpa%252FPG92884_a741395c22e028681912e0d2c5430e48.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/2e/a32e8e979fb9d56f9c8b69ed7c7d05ef/pa/PG92884_a741395c22e028681912e0d2c5430e48.jpg already downloaded
2026-01-28 20:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F2e%252Fa32e8e979fb9d56f9c8b69ed7c7d05ef%252Fpa%252FPG92884_01a64fdf29777cfed6805693866cac11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/2e/a32e8e979fb9d56f9c8b69ed7c7d05ef/pa/PG92884_01a64fdf29777cfed6805693866cac11.jpg already downloaded
2026-01-28 20:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F2e%252Fa32e8e979fb9d56f9c8b69ed7c7d05ef%252Fpa%252FPG92884_6c33d6f6fdfa671960e5fd2f22643990.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/2e/a32e8e979fb9d56f9c8b69ed7c7d05ef/pa/PG92884_6c33d6f6fdfa671960e5fd2f22643990.jpg already downloaded
2026-01-28 20:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F2e%252Fa32e8e979fb9d56f9c8b69ed7c7d05ef%252Fpa%252FPG92884_cc8cce20fba3217adadfe1dba472d34d.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/2e/a32e8e979fb9d56f9c8b69ed7c7d05ef/pa/PG92884_cc8cce20fba3217adadfe1dba472d34d.jpg already downloaded
2026-01-28 20:01:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 39160727-3850-5a0f-8dc2-b5c9a4027d5c, identifier: PG92884
2026-01-28 20:01:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8df3d25e-580b-50c5-a50b-cf8fbb4fcaf8 with identifier: JY88451
2026-01-28 20:01:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8df3d25e-580b-50c5-a50b-cf8fbb4fcaf8 with scrape type 2
2026-01-28 20:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8df3d25e-580b-50c5-a50b-cf8fbb4fcaf8 with scrape type 2
2026-01-28 20:01:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8df3d25e-580b-50c5-a50b-cf8fbb4fcaf8, identifier: JY88451
2026-01-28 20:01:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54cbbb26-8a04-56bb-a092-f1df1f582809 with identifier: KW61095
2026-01-28 20:01:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54cbbb26-8a04-56bb-a092-f1df1f582809 with scrape type 2
2026-01-28 20:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 54cbbb26-8a04-56bb-a092-f1df1f582809 with scrape type 2
2026-01-28 20:01:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 54cbbb26-8a04-56bb-a092-f1df1f582809, identifier: KW61095
2026-01-28 20:01:56 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 22 - Data Location: 134 - value: b'Apple\x00'
2026-01-28 20:01:56 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 34 - Data Location: 140 - value: b'iPad mini (A17 Pro)\x00'
2026-01-28 20:01:56 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-01-28 20:01:56 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 58 - Data Location: 160 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-01-28 20:01:56 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 70 - Data Location: 168 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-01-28 20:01:56 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-01-28 20:01:56 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 94 - Data Location: 176 - value: b'18.6.2\x00'
2026-01-28 20:01:56 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 106 - Data Location: 184 - value: b'2025:11:28 15:05:04\x00'
2026-01-28 20:01:56 [PIL.TiffImagePlugin] DEBUG: tag: HostComputer (316) - type: string (2) Tag Location: 118 - Data Location: 204 - value: b'iPad mini (A17 Pro)\x00'
2026-01-28 20:01:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\xe0'
2026-01-28 20:01:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0a042490>
2026-01-28 20:01:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3536b64e-adcb-5ddd-8bd0-eb3c9d1d0d25/3536b64e-adcb-5ddd-8bd0-eb3c9d1d0d25_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F58%252Fbf584e0c6003bbd4bc54ee6710fb8f54%252Fpa%252FYA96052_ff5ed6168cd1dadf033b492048493d8e.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/58/bf584e0c6003bbd4bc54ee6710fb8f54/pa/YA96052_ff5ed6168cd1dadf033b492048493d8e.jpg saved to cache
2026-01-28 20:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3536b64e-adcb-5ddd-8bd0-eb3c9d1d0d25
2026-01-28 20:01:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:01:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09e57590>
2026-01-28 20:01:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b2a49a6-5f2b-5692-a1a2-27ebe5ca1227/4b2a49a6-5f2b-5692-a1a2-27ebe5ca1227_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Ff1%252Fa9f10ebe41cd775023aa7cea3236430e%252Fpa%252FTZ83605_1c07b726026d2dd703fe883db828437b.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/f1/a9f10ebe41cd775023aa7cea3236430e/pa/TZ83605_1c07b726026d2dd703fe883db828437b.jpg saved to cache
2026-01-28 20:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4b2a49a6-5f2b-5692-a1a2-27ebe5ca1227
2026-01-28 20:01:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0a0429d0>
2026-01-28 20:01:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_051ddf36-eff8-5c80-8634-fb09358064b3/051ddf36-eff8-5c80-8634-fb09358064b3_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F4b%252Fdf4bfd14ecccad2e28acc7936a8ce0e3%252Fpa%252FWP90453_519a5d84b8f8eb2abf29378e0d8e5659.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/4b/df4bfd14ecccad2e28acc7936a8ce0e3/pa/WP90453_519a5d84b8f8eb2abf29378e0d8e5659.jpg saved to cache
2026-01-28 20:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 051ddf36-eff8-5c80-8634-fb09358064b3
2026-01-28 20:01:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08cd3190>
2026-01-28 20:01:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab2b9426-2a4e-5843-bea9-eeabb5e12b74/ab2b9426-2a4e-5843-bea9-eeabb5e12b74_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F02%252F0902ecd716da7e9c1590d287d6183135%252Fpa%252FBS57464_eaf0156791ad4ad12adf6a9dd987298c.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/02/0902ecd716da7e9c1590d287d6183135/pa/BS57464_eaf0156791ad4ad12adf6a9dd987298c.jpg saved to cache
2026-01-28 20:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item ab2b9426-2a4e-5843-bea9-eeabb5e12b74
2026-01-28 20:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/58/bf584e0c6003bbd4bc54ee6710fb8f54/pa/YA96052_d8879a8dbe4ce1a7ac1a74e41aa78276.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:01:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b4329f01-20ce-5e0f-9f3e-36d14ff7e147 with identifier: AD85366
2026-01-28 20:01:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b4329f01-20ce-5e0f-9f3e-36d14ff7e147 with identifier: AD85366
2026-01-28 20:01:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b4329f01-20ce-5e0f-9f3e-36d14ff7e147 with identifier: AD85366 to the API
2026-01-28 20:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:01:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:01:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AD85366>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'category': None,
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.0L',
 'engine_horse_power': 72,
 'expiration_date': '2026-01-29T16:16:24Z',
 'fuel_type': 'petrol',
 'id': 'b4329f01-20ce-5e0f-9f3e-36d14ff7e147',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AD85366',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'Toyota',
 'model': 'Aygo X',
 'odometer': 5488,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2025-05-29',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Toyota Aygo X 1.0 Trendy',
 'transmission': 'automatic',
 'trim': 'Trendy',
 'year': 2025}
2026-01-28 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AD85366%27 HTTP/1.1" 200 None
2026-01-28 20:01:58 [auto1.it] INFO: Saving data for AD85366: {'auction_closing_time': 1769703384.0, 'created_time': 1769544040.260109, 'last_price_update_time': 1769630518.839181}
2026-01-28 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AD85366') HTTP/1.1" 204 0
2026-01-28 20:01:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 39160727-3850-5a0f-8dc2-b5c9a4027d5c with identifier: PG92884
2026-01-28 20:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-28 20:01:58 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=beige HTTP/1.1" 200 None
2026-01-28 20:01:59 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-28 20:01:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 39160727-3850-5a0f-8dc2-b5c9a4027d5c with identifier: PG92884
2026-01-28 20:01:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 39160727-3850-5a0f-8dc2-b5c9a4027d5c with identifier: PG92884 to the API
2026-01-28 20:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:01:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:01:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PG92884>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2026-01-29T16:56:20Z',
 'fuel_type': 'petrol',
 'id': '39160727-3850-5a0f-8dc2-b5c9a4027d5c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PG92884',
 'listing': 'auction',
 'location': 'IT, Milano',
 'make': 'Lancia',
 'model': 'Ypsilon',
 'odometer': 85558,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imga3/2e/a32e8e979fb9d56f9c8b69ed7c7d05ef/pa/PG92884_6883b0b92b67423946f42afcf562ceff.jpg',
                'https://img-pa.auto1.com/imga3/2e/a32e8e979fb9d56f9c8b69ed7c7d05ef/pa/PG92884_8dfb9fbf62229beb571de63ad7395b57.jpg',
                'https://img-pa.auto1.com/imga3/2e/a32e8e979fb9d56f9c8b69ed7c7d05ef/pa/PG92884_5865457d568d8536f080df78bd14447e.jpg',
                'https://img-pa.auto1.com/imga3/2e/a32e8e979fb9d56f9c8b69ed7c7d05ef/pa/PG92884_4d156d08bc5cfc0f8f65d10c176908d4.jpg',
                'https://img-pa.auto1.com/imga3/2e/a32e8e979fb9d56f9c8b69ed7c7d05ef/pa/PG92884_3e1f6c46abd6544a93c197ad6de0577e.jpg',
                'https://img-pa.auto1.com/imga3/2e/a32e8e979fb9d56f9c8b69ed7c7d05ef/pa/PG92884_2b9638906d4d73a279ac1997d0fd0bbe.jpg',
                'https://img-pa.auto1.com/imga3/2e/a32e8e979fb9d56f9c8b69ed7c7d05ef/pa/PG92884_f3f61cc28919cb6ec3d590a2f32c75bb.jpg',
                'https://img-pa.auto1.com/imga3/2e/a32e8e979fb9d56f9c8b69ed7c7d05ef/pa/PG92884_843482aa3500a83d8862fa51756d546f.jpg',
                'https://img-pa.auto1.com/imga3/2e/a32e8e979fb9d56f9c8b69ed7c7d05ef/pa/PG92884_37d06227eb87c491611be231e1ecaab7.jpg',
                'https://img-pa.auto1.com/imga3/2e/a32e8e979fb9d56f9c8b69ed7c7d05ef/pa/PG92884_9f870d5f3ccb859dc605df8e00e68aa6.jpg',
                'https://img-pa.auto1.com/imga3/2e/a32e8e979fb9d56f9c8b69ed7c7d05ef/pa/PG92884_944e8365f21b70f507965d9b2248f1eb.jpg',
                'https://img-pa.auto1.com/imga3/2e/a32e8e979fb9d56f9c8b69ed7c7d05ef/pa/PG92884_a741395c22e028681912e0d2c5430e48.jpg',
                'https://img-pa.auto1.com/imga3/2e/a32e8e979fb9d56f9c8b69ed7c7d05ef/pa/PG92884_01a64fdf29777cfed6805693866cac11.jpg',
                'https://img-pa.auto1.com/imga3/2e/a32e8e979fb9d56f9c8b69ed7c7d05ef/pa/PG92884_6c33d6f6fdfa671960e5fd2f22643990.jpg',
                'https://img-pa.auto1.com/imga3/2e/a32e8e979fb9d56f9c8b69ed7c7d05ef/pa/PG92884_cc8cce20fba3217adadfe1dba472d34d.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39160727-3850-5a0f-8dc2-b5c9a4027d5c/39160727-3850-5a0f-8dc2-b5c9a4027d5c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63785,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/2e/a32e8e979fb9d56f9c8b69ed7c7d05ef/pa/PG92884_6883b0b92b67423946f42afcf562ceff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39160727-3850-5a0f-8dc2-b5c9a4027d5c/39160727-3850-5a0f-8dc2-b5c9a4027d5c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62663,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/2e/a32e8e979fb9d56f9c8b69ed7c7d05ef/pa/PG92884_8dfb9fbf62229beb571de63ad7395b57.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39160727-3850-5a0f-8dc2-b5c9a4027d5c/39160727-3850-5a0f-8dc2-b5c9a4027d5c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60034,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/2e/a32e8e979fb9d56f9c8b69ed7c7d05ef/pa/PG92884_5865457d568d8536f080df78bd14447e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39160727-3850-5a0f-8dc2-b5c9a4027d5c/39160727-3850-5a0f-8dc2-b5c9a4027d5c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52176,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/2e/a32e8e979fb9d56f9c8b69ed7c7d05ef/pa/PG92884_4d156d08bc5cfc0f8f65d10c176908d4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39160727-3850-5a0f-8dc2-b5c9a4027d5c/39160727-3850-5a0f-8dc2-b5c9a4027d5c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55391,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/2e/a32e8e979fb9d56f9c8b69ed7c7d05ef/pa/PG92884_3e1f6c46abd6544a93c197ad6de0577e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39160727-3850-5a0f-8dc2-b5c9a4027d5c/39160727-3850-5a0f-8dc2-b5c9a4027d5c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58876,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/2e/a32e8e979fb9d56f9c8b69ed7c7d05ef/pa/PG92884_2b9638906d4d73a279ac1997d0fd0bbe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39160727-3850-5a0f-8dc2-b5c9a4027d5c/39160727-3850-5a0f-8dc2-b5c9a4027d5c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2172170,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/2e/a32e8e979fb9d56f9c8b69ed7c7d05ef/pa/PG92884_f3f61cc28919cb6ec3d590a2f32c75bb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39160727-3850-5a0f-8dc2-b5c9a4027d5c/39160727-3850-5a0f-8dc2-b5c9a4027d5c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61284,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/2e/a32e8e979fb9d56f9c8b69ed7c7d05ef/pa/PG92884_843482aa3500a83d8862fa51756d546f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39160727-3850-5a0f-8dc2-b5c9a4027d5c/39160727-3850-5a0f-8dc2-b5c9a4027d5c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2562344,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/2e/a32e8e979fb9d56f9c8b69ed7c7d05ef/pa/PG92884_37d06227eb87c491611be231e1ecaab7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39160727-3850-5a0f-8dc2-b5c9a4027d5c/39160727-3850-5a0f-8dc2-b5c9a4027d5c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56998,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/2e/a32e8e979fb9d56f9c8b69ed7c7d05ef/pa/PG92884_9f870d5f3ccb859dc605df8e00e68aa6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39160727-3850-5a0f-8dc2-b5c9a4027d5c/39160727-3850-5a0f-8dc2-b5c9a4027d5c_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47041,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/2e/a32e8e979fb9d56f9c8b69ed7c7d05ef/pa/PG92884_944e8365f21b70f507965d9b2248f1eb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39160727-3850-5a0f-8dc2-b5c9a4027d5c/39160727-3850-5a0f-8dc2-b5c9a4027d5c_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54283,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/2e/a32e8e979fb9d56f9c8b69ed7c7d05ef/pa/PG92884_a741395c22e028681912e0d2c5430e48.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39160727-3850-5a0f-8dc2-b5c9a4027d5c/39160727-3850-5a0f-8dc2-b5c9a4027d5c_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46586,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/2e/a32e8e979fb9d56f9c8b69ed7c7d05ef/pa/PG92884_01a64fdf29777cfed6805693866cac11.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39160727-3850-5a0f-8dc2-b5c9a4027d5c/39160727-3850-5a0f-8dc2-b5c9a4027d5c_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2810519,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/2e/a32e8e979fb9d56f9c8b69ed7c7d05ef/pa/PG92884_6c33d6f6fdfa671960e5fd2f22643990.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39160727-3850-5a0f-8dc2-b5c9a4027d5c/39160727-3850-5a0f-8dc2-b5c9a4027d5c_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50698,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/2e/a32e8e979fb9d56f9c8b69ed7c7d05ef/pa/PG92884_cc8cce20fba3217adadfe1dba472d34d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-02-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Lancia Ypsilon 1.2 Elefantino Blu',
 'transmission': 'manual',
 'trim': 'Elefantino Blu',
 'year': 2019}
2026-01-28 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PG92884%27 HTTP/1.1" 200 None
2026-01-28 20:01:59 [auto1.it] INFO: Saving data for PG92884: {'created_time': 1769630519.395, 'last_price_update_time': 1769630519.395011, 'auction_closing_time': 1769705780.0}
2026-01-28 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PG92884') HTTP/1.1" 204 0
2026-01-28 20:01:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8df3d25e-580b-50c5-a50b-cf8fbb4fcaf8 with identifier: JY88451
2026-01-28 20:01:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8df3d25e-580b-50c5-a50b-cf8fbb4fcaf8 with identifier: JY88451
2026-01-28 20:01:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8df3d25e-580b-50c5-a50b-cf8fbb4fcaf8 with identifier: JY88451 to the API
2026-01-28 20:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:01:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:01:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JY88451>
{'auction_title': '',
 'c_o_2_emission_value': 87,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.5L',
 'engine_horse_power': 116,
 'expiration_date': '2026-01-29T16:37:48Z',
 'fuel_type': 'hybrid',
 'id': '8df3d25e-580b-50c5-a50b-cf8fbb4fcaf8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JY88451',
 'listing': 'auction',
 'location': 'IT, Settimo Torinese',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 8585,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2025-03-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota Yaris 1.5 Hybrid Active',
 'transmission': 'automatic',
 'trim': 'Active',
 'year': 2025}
2026-01-28 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JY88451%27 HTTP/1.1" 200 None
2026-01-28 20:01:59 [auto1.it] INFO: Saving data for JY88451: {'auction_closing_time': 1769704668.0, 'created_time': 1766088166.250559, 'last_price_update_time': 1769630519.989105}
2026-01-28 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JY88451') HTTP/1.1" 204 0
2026-01-28 20:02:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 54cbbb26-8a04-56bb-a092-f1df1f582809 with identifier: KW61095
2026-01-28 20:02:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 54cbbb26-8a04-56bb-a092-f1df1f582809 with identifier: KW61095
2026-01-28 20:02:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 54cbbb26-8a04-56bb-a092-f1df1f582809 with identifier: KW61095 to the API
2026-01-28 20:02:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:02:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:02:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KW61095>
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.9L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:43:09Z',
 'fuel_type': 'diesel',
 'id': '54cbbb26-8a04-56bb-a092-f1df1f582809',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KW61095',
 'listing': 'auction',
 'location': 'IT, Reggio Emilia',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 76595,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-07-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 200 d Progressive',
 'transmission': 'automatic',
 'trim': 'Progressive',
 'year': 2022}
2026-01-28 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KW61095%27 HTTP/1.1" 200 None
2026-01-28 20:02:00 [auto1.it] INFO: Saving data for KW61095: {'auction_closing_time': 1769704989.0, 'created_time': 1769544036.995269, 'last_price_update_time': 1769630520.418538}
2026-01-28 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KW61095') HTTP/1.1" 204 0
2026-01-28 20:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/58/bf584e0c6003bbd4bc54ee6710fb8f54/pa/YA96052_6d1dd40b21b52d772c17827f2b05436e.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/58/bf584e0c6003bbd4bc54ee6710fb8f54/pa/YA96052_13a378052e837a3a7f3b2117c0812c15.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F58%252Fbf584e0c6003bbd4bc54ee6710fb8f54%252Fpa%252FYA96052_5bde605eec838b59cfe63ef64b3cb7e6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/58/bf584e0c6003bbd4bc54ee6710fb8f54/pa/YA96052_5bde605eec838b59cfe63ef64b3cb7e6.jpg not downloaded yet
2026-01-28 20:02:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:02:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:02:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09f48810>
2026-01-28 20:02:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:02:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3536b64e-adcb-5ddd-8bd0-eb3c9d1d0d25/3536b64e-adcb-5ddd-8bd0-eb3c9d1d0d25_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F58%252Fbf584e0c6003bbd4bc54ee6710fb8f54%252Fpa%252FYA96052_350a0a128727ea44d7e56b54873f2b25.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/58/bf584e0c6003bbd4bc54ee6710fb8f54/pa/YA96052_350a0a128727ea44d7e56b54873f2b25.jpg saved to cache
2026-01-28 20:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3536b64e-adcb-5ddd-8bd0-eb3c9d1d0d25
2026-01-28 20:02:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 42f57244-9ce1-548c-80f9-ba4fc624de0c with identifier: FP41040
2026-01-28 20:02:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 42f57244-9ce1-548c-80f9-ba4fc624de0c with scrape type 1
2026-01-28 20:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 13 photos for item 42f57244-9ce1-548c-80f9-ba4fc624de0c
2026-01-28 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F88%252Fa9886c8c428fd9ace2871b067ea0c3ef%252Fpa%252FFP41040_37901c45050e8173d13520b45d2264e3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/88/a9886c8c428fd9ace2871b067ea0c3ef/pa/FP41040_37901c45050e8173d13520b45d2264e3.jpg not downloaded yet
2026-01-28 20:02:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 156f1f09-454c-5f87-b65b-7e75e942d64a with identifier: RY80591
2026-01-28 20:02:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 156f1f09-454c-5f87-b65b-7e75e942d64a with scrape type 1
2026-01-28 20:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 156f1f09-454c-5f87-b65b-7e75e942d64a
2026-01-28 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F94%252F9d941ce001372b18f7e157f58590b093%252Fpa%252FRY80591_d6a2e1b70e56dc47a2923c26a7c8dd22.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/94/9d941ce001372b18f7e157f58590b093/pa/RY80591_d6a2e1b70e56dc47a2923c26a7c8dd22.jpg already downloaded
2026-01-28 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F94%252F9d941ce001372b18f7e157f58590b093%252Fpa%252FRY80591_b5bb41743521ae8c6d9eb4ba0bf950eb.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/94/9d941ce001372b18f7e157f58590b093/pa/RY80591_b5bb41743521ae8c6d9eb4ba0bf950eb.jpg already downloaded
2026-01-28 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F94%252F9d941ce001372b18f7e157f58590b093%252Fpa%252FRY80591_9023334a5ad586632ae2f3f9ec26e764.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/94/9d941ce001372b18f7e157f58590b093/pa/RY80591_9023334a5ad586632ae2f3f9ec26e764.jpg already downloaded
2026-01-28 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F94%252F9d941ce001372b18f7e157f58590b093%252Fpa%252FRY80591_0c04f6785341fee90c94e5bf971edf70.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/94/9d941ce001372b18f7e157f58590b093/pa/RY80591_0c04f6785341fee90c94e5bf971edf70.jpg already downloaded
2026-01-28 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F94%252F9d941ce001372b18f7e157f58590b093%252Fpa%252FRY80591_8ee071b5625f9f21a2a23c1c9146ef5c.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/94/9d941ce001372b18f7e157f58590b093/pa/RY80591_8ee071b5625f9f21a2a23c1c9146ef5c.jpg already downloaded
2026-01-28 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F94%252F9d941ce001372b18f7e157f58590b093%252Fpa%252FRY80591_e14760ce85da200b03211cf2706915b0.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/94/9d941ce001372b18f7e157f58590b093/pa/RY80591_e14760ce85da200b03211cf2706915b0.jpg already downloaded
2026-01-28 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F94%252F9d941ce001372b18f7e157f58590b093%252Fpa%252FRY80591_c2741103c87e55d368e385aa9e02122c.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/94/9d941ce001372b18f7e157f58590b093/pa/RY80591_c2741103c87e55d368e385aa9e02122c.jpg already downloaded
2026-01-28 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F94%252F9d941ce001372b18f7e157f58590b093%252Fpa%252FRY80591_3456314b4ce10603ca25fefe4513643e.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/94/9d941ce001372b18f7e157f58590b093/pa/RY80591_3456314b4ce10603ca25fefe4513643e.jpg already downloaded
2026-01-28 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F94%252F9d941ce001372b18f7e157f58590b093%252Fpa%252FRY80591_0f90804d7955c8bc03134e3b5670e2d0.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/94/9d941ce001372b18f7e157f58590b093/pa/RY80591_0f90804d7955c8bc03134e3b5670e2d0.jpg already downloaded
2026-01-28 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F94%252F9d941ce001372b18f7e157f58590b093%252Fpa%252FRY80591_ee4de1117b9acbb3df5e1a66c8619d74.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/94/9d941ce001372b18f7e157f58590b093/pa/RY80591_ee4de1117b9acbb3df5e1a66c8619d74.jpg already downloaded
2026-01-28 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F94%252F9d941ce001372b18f7e157f58590b093%252Fpa%252FRY80591_775453a2d0e23d3572814e107638b500.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/94/9d941ce001372b18f7e157f58590b093/pa/RY80591_775453a2d0e23d3572814e107638b500.jpg already downloaded
2026-01-28 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F94%252F9d941ce001372b18f7e157f58590b093%252Fpa%252FRY80591_c65b2cd9b5593a811783d26a52c83d13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/94/9d941ce001372b18f7e157f58590b093/pa/RY80591_c65b2cd9b5593a811783d26a52c83d13.jpg already downloaded
2026-01-28 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F94%252F9d941ce001372b18f7e157f58590b093%252Fpa%252FRY80591_d4d75fca3a63aea29a5f717c9988c51d.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/94/9d941ce001372b18f7e157f58590b093/pa/RY80591_d4d75fca3a63aea29a5f717c9988c51d.jpg already downloaded
2026-01-28 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F94%252F9d941ce001372b18f7e157f58590b093%252Fpa%252FRY80591_33e0f9e526de8fb02d5ac8cf656c4cf2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/94/9d941ce001372b18f7e157f58590b093/pa/RY80591_33e0f9e526de8fb02d5ac8cf656c4cf2.jpg already downloaded
2026-01-28 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F94%252F9d941ce001372b18f7e157f58590b093%252Fpa%252FRY80591_8265d69e45fef9a7ef8d730c60832c16.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/94/9d941ce001372b18f7e157f58590b093/pa/RY80591_8265d69e45fef9a7ef8d730c60832c16.jpg already downloaded
2026-01-28 20:02:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 156f1f09-454c-5f87-b65b-7e75e942d64a, identifier: RY80591
2026-01-28 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F58%252Fbf584e0c6003bbd4bc54ee6710fb8f54%252Fpa%252FYA96052_6f2ad617e623df0234cb1816bcaf3283.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/58/bf584e0c6003bbd4bc54ee6710fb8f54/pa/YA96052_6f2ad617e623df0234cb1816bcaf3283.jpg not downloaded yet
2026-01-28 20:02:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 156f1f09-454c-5f87-b65b-7e75e942d64a with identifier: RY80591
2026-01-28 20:02:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 156f1f09-454c-5f87-b65b-7e75e942d64a with identifier: RY80591
2026-01-28 20:02:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 156f1f09-454c-5f87-b65b-7e75e942d64a with identifier: RY80591 to the API
2026-01-28 20:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:02:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:02:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RY80591>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'category': None,
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.2L',
 'engine_horse_power': 101,
 'expiration_date': '2026-01-29T16:28:23Z',
 'fuel_type': 'petrol',
 'id': '156f1f09-454c-5f87-b65b-7e75e942d64a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RY80591',
 'listing': 'auction',
 'location': 'IT, Roma',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 90965,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img9d/94/9d941ce001372b18f7e157f58590b093/pa/RY80591_d6a2e1b70e56dc47a2923c26a7c8dd22.jpg',
                'https://img-pa.auto1.com/img9d/94/9d941ce001372b18f7e157f58590b093/pa/RY80591_b5bb41743521ae8c6d9eb4ba0bf950eb.jpg',
                'https://img-pa.auto1.com/img9d/94/9d941ce001372b18f7e157f58590b093/pa/RY80591_9023334a5ad586632ae2f3f9ec26e764.jpg',
                'https://img-pa.auto1.com/img9d/94/9d941ce001372b18f7e157f58590b093/pa/RY80591_0c04f6785341fee90c94e5bf971edf70.jpg',
                'https://img-pa.auto1.com/img9d/94/9d941ce001372b18f7e157f58590b093/pa/RY80591_8ee071b5625f9f21a2a23c1c9146ef5c.jpg',
                'https://img-pa.auto1.com/img9d/94/9d941ce001372b18f7e157f58590b093/pa/RY80591_e14760ce85da200b03211cf2706915b0.jpg',
                'https://img-pa.auto1.com/img9d/94/9d941ce001372b18f7e157f58590b093/pa/RY80591_c2741103c87e55d368e385aa9e02122c.jpg',
                'https://img-pa.auto1.com/img9d/94/9d941ce001372b18f7e157f58590b093/pa/RY80591_3456314b4ce10603ca25fefe4513643e.jpg',
                'https://img-pa.auto1.com/img9d/94/9d941ce001372b18f7e157f58590b093/pa/RY80591_0f90804d7955c8bc03134e3b5670e2d0.jpg',
                'https://img-pa.auto1.com/img9d/94/9d941ce001372b18f7e157f58590b093/pa/RY80591_ee4de1117b9acbb3df5e1a66c8619d74.jpg',
                'https://img-pa.auto1.com/img9d/94/9d941ce001372b18f7e157f58590b093/pa/RY80591_775453a2d0e23d3572814e107638b500.jpg',
                'https://img-pa.auto1.com/img9d/94/9d941ce001372b18f7e157f58590b093/pa/RY80591_c65b2cd9b5593a811783d26a52c83d13.jpg',
                'https://img-pa.auto1.com/img9d/94/9d941ce001372b18f7e157f58590b093/pa/RY80591_d4d75fca3a63aea29a5f717c9988c51d.jpg',
                'https://img-pa.auto1.com/img9d/94/9d941ce001372b18f7e157f58590b093/pa/RY80591_33e0f9e526de8fb02d5ac8cf656c4cf2.jpg',
                'https://img-pa.auto1.com/img9d/94/9d941ce001372b18f7e157f58590b093/pa/RY80591_8265d69e45fef9a7ef8d730c60832c16.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_156f1f09-454c-5f87-b65b-7e75e942d64a/156f1f09-454c-5f87-b65b-7e75e942d64a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2245084,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/94/9d941ce001372b18f7e157f58590b093/pa/RY80591_d6a2e1b70e56dc47a2923c26a7c8dd22.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_156f1f09-454c-5f87-b65b-7e75e942d64a/156f1f09-454c-5f87-b65b-7e75e942d64a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90475,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/94/9d941ce001372b18f7e157f58590b093/pa/RY80591_b5bb41743521ae8c6d9eb4ba0bf950eb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_156f1f09-454c-5f87-b65b-7e75e942d64a/156f1f09-454c-5f87-b65b-7e75e942d64a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2268560,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/94/9d941ce001372b18f7e157f58590b093/pa/RY80591_9023334a5ad586632ae2f3f9ec26e764.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_156f1f09-454c-5f87-b65b-7e75e942d64a/156f1f09-454c-5f87-b65b-7e75e942d64a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69456,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/94/9d941ce001372b18f7e157f58590b093/pa/RY80591_0c04f6785341fee90c94e5bf971edf70.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_156f1f09-454c-5f87-b65b-7e75e942d64a/156f1f09-454c-5f87-b65b-7e75e942d64a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57808,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/94/9d941ce001372b18f7e157f58590b093/pa/RY80591_8ee071b5625f9f21a2a23c1c9146ef5c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_156f1f09-454c-5f87-b65b-7e75e942d64a/156f1f09-454c-5f87-b65b-7e75e942d64a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2333127,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/94/9d941ce001372b18f7e157f58590b093/pa/RY80591_e14760ce85da200b03211cf2706915b0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_156f1f09-454c-5f87-b65b-7e75e942d64a/156f1f09-454c-5f87-b65b-7e75e942d64a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2792849,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/94/9d941ce001372b18f7e157f58590b093/pa/RY80591_c2741103c87e55d368e385aa9e02122c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_156f1f09-454c-5f87-b65b-7e75e942d64a/156f1f09-454c-5f87-b65b-7e75e942d64a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100604,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/94/9d941ce001372b18f7e157f58590b093/pa/RY80591_3456314b4ce10603ca25fefe4513643e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_156f1f09-454c-5f87-b65b-7e75e942d64a/156f1f09-454c-5f87-b65b-7e75e942d64a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69102,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/94/9d941ce001372b18f7e157f58590b093/pa/RY80591_0f90804d7955c8bc03134e3b5670e2d0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_156f1f09-454c-5f87-b65b-7e75e942d64a/156f1f09-454c-5f87-b65b-7e75e942d64a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2713222,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/94/9d941ce001372b18f7e157f58590b093/pa/RY80591_ee4de1117b9acbb3df5e1a66c8619d74.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_156f1f09-454c-5f87-b65b-7e75e942d64a/156f1f09-454c-5f87-b65b-7e75e942d64a_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63912,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/94/9d941ce001372b18f7e157f58590b093/pa/RY80591_775453a2d0e23d3572814e107638b500.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_156f1f09-454c-5f87-b65b-7e75e942d64a/156f1f09-454c-5f87-b65b-7e75e942d64a_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71708,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/94/9d941ce001372b18f7e157f58590b093/pa/RY80591_c65b2cd9b5593a811783d26a52c83d13.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_156f1f09-454c-5f87-b65b-7e75e942d64a/156f1f09-454c-5f87-b65b-7e75e942d64a_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49186,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/94/9d941ce001372b18f7e157f58590b093/pa/RY80591_d4d75fca3a63aea29a5f717c9988c51d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_156f1f09-454c-5f87-b65b-7e75e942d64a/156f1f09-454c-5f87-b65b-7e75e942d64a_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62336,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/94/9d941ce001372b18f7e157f58590b093/pa/RY80591_33e0f9e526de8fb02d5ac8cf656c4cf2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_156f1f09-454c-5f87-b65b-7e75e942d64a/156f1f09-454c-5f87-b65b-7e75e942d64a_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77629,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/94/9d941ce001372b18f7e157f58590b093/pa/RY80591_8265d69e45fef9a7ef8d730c60832c16.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-01-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 PureTech Allure Pack',
 'transmission': 'manual',
 'trim': 'Allure Pack',
 'year': 2022}
2026-01-28 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RY80591%27 HTTP/1.1" 200 None
2026-01-28 20:02:01 [auto1.it] INFO: Saving data for RY80591: {'created_time': 1769630521.580119, 'last_price_update_time': 1769630521.58013, 'auction_closing_time': 1769704103.0}
2026-01-28 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RY80591') HTTP/1.1" 204 0
2026-01-28 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F88%252Fa9886c8c428fd9ace2871b067ea0c3ef%252Fpa%252FFP41040_9068be76c77a0a4645361fc7d795c3f3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/88/a9886c8c428fd9ace2871b067ea0c3ef/pa/FP41040_9068be76c77a0a4645361fc7d795c3f3.jpg not downloaded yet
2026-01-28 20:02:01 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 22 - Data Location: 134 - value: b'Apple\x00'
2026-01-28 20:02:01 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 34 - Data Location: 140 - value: b'iPad mini (A17 Pro)\x00'
2026-01-28 20:02:01 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-01-28 20:02:01 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 58 - Data Location: 160 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-01-28 20:02:01 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 70 - Data Location: 168 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-01-28 20:02:01 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-01-28 20:02:01 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 94 - Data Location: 176 - value: b'18.6.2\x00'
2026-01-28 20:02:01 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 106 - Data Location: 184 - value: b'2025:11:28 15:03:48\x00'
2026-01-28 20:02:01 [PIL.TiffImagePlugin] DEBUG: tag: HostComputer (316) - type: string (2) Tag Location: 118 - Data Location: 204 - value: b'iPad mini (A17 Pro)\x00'
2026-01-28 20:02:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\xe0'
2026-01-28 20:02:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09fd1c10>
2026-01-28 20:02:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3536b64e-adcb-5ddd-8bd0-eb3c9d1d0d25/3536b64e-adcb-5ddd-8bd0-eb3c9d1d0d25_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F58%252Fbf584e0c6003bbd4bc54ee6710fb8f54%252Fpa%252FYA96052_d8879a8dbe4ce1a7ac1a74e41aa78276.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/58/bf584e0c6003bbd4bc54ee6710fb8f54/pa/YA96052_d8879a8dbe4ce1a7ac1a74e41aa78276.jpg saved to cache
2026-01-28 20:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3536b64e-adcb-5ddd-8bd0-eb3c9d1d0d25
2026-01-28 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F58%252Fbf584e0c6003bbd4bc54ee6710fb8f54%252Fpa%252FYA96052_ab88035feabb3836518d1bcf8c66dc93.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/58/bf584e0c6003bbd4bc54ee6710fb8f54/pa/YA96052_ab88035feabb3836518d1bcf8c66dc93.jpg not downloaded yet
2026-01-28 20:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:02:02 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 22 - Data Location: 134 - value: b'Apple\x00'
2026-01-28 20:02:02 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 34 - Data Location: 140 - value: b'iPad mini (A17 Pro)\x00'
2026-01-28 20:02:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-01-28 20:02:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 58 - Data Location: 160 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-01-28 20:02:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 70 - Data Location: 168 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-01-28 20:02:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-01-28 20:02:02 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 94 - Data Location: 176 - value: b'18.6.2\x00'
2026-01-28 20:02:02 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 106 - Data Location: 184 - value: b'2025:11:28 15:05:58\x00'
2026-01-28 20:02:02 [PIL.TiffImagePlugin] DEBUG: tag: HostComputer (316) - type: string (2) Tag Location: 118 - Data Location: 204 - value: b'iPad mini (A17 Pro)\x00'
2026-01-28 20:02:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\xe0'
2026-01-28 20:02:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09e5af50>
2026-01-28 20:02:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3536b64e-adcb-5ddd-8bd0-eb3c9d1d0d25/3536b64e-adcb-5ddd-8bd0-eb3c9d1d0d25_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F58%252Fbf584e0c6003bbd4bc54ee6710fb8f54%252Fpa%252FYA96052_6d1dd40b21b52d772c17827f2b05436e.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/58/bf584e0c6003bbd4bc54ee6710fb8f54/pa/YA96052_6d1dd40b21b52d772c17827f2b05436e.jpg saved to cache
2026-01-28 20:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3536b64e-adcb-5ddd-8bd0-eb3c9d1d0d25
2026-01-28 20:02:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09f7b650>
2026-01-28 20:02:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3536b64e-adcb-5ddd-8bd0-eb3c9d1d0d25/3536b64e-adcb-5ddd-8bd0-eb3c9d1d0d25_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F58%252Fbf584e0c6003bbd4bc54ee6710fb8f54%252Fpa%252FYA96052_13a378052e837a3a7f3b2117c0812c15.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/58/bf584e0c6003bbd4bc54ee6710fb8f54/pa/YA96052_13a378052e837a3a7f3b2117c0812c15.jpg saved to cache
2026-01-28 20:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3536b64e-adcb-5ddd-8bd0-eb3c9d1d0d25
2026-01-28 20:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/58/bf584e0c6003bbd4bc54ee6710fb8f54/pa/YA96052_d1b1b118ad07eece8a07939f832408d8.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F88%252Fa9886c8c428fd9ace2871b067ea0c3ef%252Fpa%252FFP41040_68d92b776a58a3e4fc5227a814ce03f7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/88/a9886c8c428fd9ace2871b067ea0c3ef/pa/FP41040_68d92b776a58a3e4fc5227a814ce03f7.jpg not downloaded yet
2026-01-28 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F58%252Fbf584e0c6003bbd4bc54ee6710fb8f54%252Fpa%252FYA96052_8f1f20ade584172a52c2298a06a10a9e.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/58/bf584e0c6003bbd4bc54ee6710fb8f54/pa/YA96052_8f1f20ade584172a52c2298a06a10a9e.jpg not downloaded yet
2026-01-28 20:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AF71631/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F88%252Fa9886c8c428fd9ace2871b067ea0c3ef%252Fpa%252FFP41040_cabd983989e48e752cca9ebd4dedddcb.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/88/a9886c8c428fd9ace2871b067ea0c3ef/pa/FP41040_cabd983989e48e752cca9ebd4dedddcb.jpg not downloaded yet
2026-01-28 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F58%252Fbf584e0c6003bbd4bc54ee6710fb8f54%252Fpa%252FYA96052_ddc765261cffbadbf9327b8f10b888f9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/58/bf584e0c6003bbd4bc54ee6710fb8f54/pa/YA96052_ddc765261cffbadbf9327b8f10b888f9.jpg not downloaded yet
2026-01-28 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F88%252Fa9886c8c428fd9ace2871b067ea0c3ef%252Fpa%252FFP41040_75273429baf6089aea1e0b5c6284c9a2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/88/a9886c8c428fd9ace2871b067ea0c3ef/pa/FP41040_75273429baf6089aea1e0b5c6284c9a2.jpg not downloaded yet
2026-01-28 20:02:02 [auto1.it] INFO: Parsing search results for channel: 24h
2026-01-28 20:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/58/bf584e0c6003bbd4bc54ee6710fb8f54/pa/YA96052_5a52e757234adc10da75c97a6624497b.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/58/bf584e0c6003bbd4bc54ee6710fb8f54/pa/YA96052_c4df9b1bf69588337db75ec082186d1b.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F88%252Fa9886c8c428fd9ace2871b067ea0c3ef%252Fpa%252FFP41040_d2a3377ec9452346f4d9367d7c842a4c.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/88/a9886c8c428fd9ace2871b067ea0c3ef/pa/FP41040_d2a3377ec9452346f4d9367d7c842a4c.jpg not downloaded yet
2026-01-28 20:02:02 [auto1.it] INFO: Found listing with ID: EZ99930
2026-01-28 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EZ99930%27 HTTP/1.1" 200 None
2026-01-28 20:02:02 [auto1.it] INFO: Scrape type for EZ99930: 1
2026-01-28 20:02:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:02:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09d10510>
2026-01-28 20:02:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3536b64e-adcb-5ddd-8bd0-eb3c9d1d0d25/3536b64e-adcb-5ddd-8bd0-eb3c9d1d0d25_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F58%252Fbf584e0c6003bbd4bc54ee6710fb8f54%252Fpa%252FYA96052_d1b1b118ad07eece8a07939f832408d8.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/58/bf584e0c6003bbd4bc54ee6710fb8f54/pa/YA96052_d1b1b118ad07eece8a07939f832408d8.jpg saved to cache
2026-01-28 20:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 3536b64e-adcb-5ddd-8bd0-eb3c9d1d0d25
2026-01-28 20:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F88%252Fa9886c8c428fd9ace2871b067ea0c3ef%252Fpa%252FFP41040_ff78557f924ba202ac80175ad01f9872.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/88/a9886c8c428fd9ace2871b067ea0c3ef/pa/FP41040_ff78557f924ba202ac80175ad01f9872.jpg not downloaded yet
2026-01-28 20:02:03 [auto1.it] INFO: Found listing with ID: SD18142
2026-01-28 20:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SD18142%27 HTTP/1.1" 200 None
2026-01-28 20:02:03 [auto1.it] INFO: Scrape type for SD18142: 0
2026-01-28 20:02:03 [auto1.it] INFO: Found listing with ID: XL62613
2026-01-28 20:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XL62613%27 HTTP/1.1" 200 None
2026-01-28 20:02:03 [auto1.it] INFO: Scrape type for XL62613: 0
2026-01-28 20:02:03 [auto1.it] INFO: Found listing with ID: AD68193
2026-01-28 20:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AD68193%27 HTTP/1.1" 200 None
2026-01-28 20:02:03 [auto1.it] INFO: Scrape type for AD68193: 0
2026-01-28 20:02:03 [auto1.it] INFO: Found listing with ID: VK27211
2026-01-28 20:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VK27211%27 HTTP/1.1" 200 None
2026-01-28 20:02:03 [auto1.it] INFO: Scrape type for VK27211: 0
2026-01-28 20:02:03 [auto1.it] INFO: Found listing with ID: KE54965
2026-01-28 20:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KE54965%27 HTTP/1.1" 200 None
2026-01-28 20:02:03 [auto1.it] INFO: Scrape type for KE54965: 0
2026-01-28 20:02:03 [auto1.it] INFO: Found listing with ID: ZX13232
2026-01-28 20:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZX13232%27 HTTP/1.1" 200 None
2026-01-28 20:02:03 [auto1.it] INFO: Scrape type for ZX13232: 0
2026-01-28 20:02:03 [auto1.it] INFO: Found listing with ID: BM05081
2026-01-28 20:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BM05081%27 HTTP/1.1" 200 None
2026-01-28 20:02:03 [auto1.it] INFO: Scrape type for BM05081: 1
2026-01-28 20:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/58/bf584e0c6003bbd4bc54ee6710fb8f54/pa/YA96052_e267081895991f08dfae128524546baf.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/58/bf584e0c6003bbd4bc54ee6710fb8f54/pa/YA96052_c047f84af94f77f149f674adc2fc4917.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F88%252Fa9886c8c428fd9ace2871b067ea0c3ef%252Fpa%252FFP41040_b805b529baec07590ab41f24b1fb9bf9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/88/a9886c8c428fd9ace2871b067ea0c3ef/pa/FP41040_b805b529baec07590ab41f24b1fb9bf9.jpg not downloaded yet
2026-01-28 20:02:03 [auto1.it] INFO: Found listing with ID: BD24207
2026-01-28 20:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BD24207%27 HTTP/1.1" 200 None
2026-01-28 20:02:03 [auto1.it] INFO: Scrape type for BD24207: 0
2026-01-28 20:02:03 [auto1.it] INFO: Found listing with ID: JW94842
2026-01-28 20:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JW94842%27 HTTP/1.1" 200 None
2026-01-28 20:02:03 [auto1.it] INFO: Scrape type for JW94842: 2
2026-01-28 20:02:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:02:03 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 22 - Data Location: 134 - value: b'Apple\x00'
2026-01-28 20:02:03 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 34 - Data Location: 140 - value: b'iPad mini (A17 Pro)\x00'
2026-01-28 20:02:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-01-28 20:02:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 58 - Data Location: 160 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-01-28 20:02:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 70 - Data Location: 168 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-01-28 20:02:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-01-28 20:02:03 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 94 - Data Location: 176 - value: b'18.6.2\x00'
2026-01-28 20:02:03 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 106 - Data Location: 184 - value: b'2025:11:28 15:08:00\x00'
2026-01-28 20:02:03 [PIL.TiffImagePlugin] DEBUG: tag: HostComputer (316) - type: string (2) Tag Location: 118 - Data Location: 204 - value: b'iPad mini (A17 Pro)\x00'
2026-01-28 20:02:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\xe0'
2026-01-28 20:02:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b086cc1d0>
2026-01-28 20:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3536b64e-adcb-5ddd-8bd0-eb3c9d1d0d25/3536b64e-adcb-5ddd-8bd0-eb3c9d1d0d25_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F58%252Fbf584e0c6003bbd4bc54ee6710fb8f54%252Fpa%252FYA96052_5a52e757234adc10da75c97a6624497b.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/58/bf584e0c6003bbd4bc54ee6710fb8f54/pa/YA96052_5a52e757234adc10da75c97a6624497b.jpg saved to cache
2026-01-28 20:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3536b64e-adcb-5ddd-8bd0-eb3c9d1d0d25
2026-01-28 20:02:03 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 22 - Data Location: 134 - value: b'Apple\x00'
2026-01-28 20:02:03 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 34 - Data Location: 140 - value: b'iPad mini (A17 Pro)\x00'
2026-01-28 20:02:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-01-28 20:02:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 58 - Data Location: 160 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-01-28 20:02:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 70 - Data Location: 168 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-01-28 20:02:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-01-28 20:02:03 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 94 - Data Location: 176 - value: b'18.6.2\x00'
2026-01-28 20:02:03 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 106 - Data Location: 184 - value: b'2025:11:28 15:07:40\x00'
2026-01-28 20:02:03 [PIL.TiffImagePlugin] DEBUG: tag: HostComputer (316) - type: string (2) Tag Location: 118 - Data Location: 204 - value: b'iPad mini (A17 Pro)\x00'
2026-01-28 20:02:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\xe0'
2026-01-28 20:02:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09ef3d10>
2026-01-28 20:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3536b64e-adcb-5ddd-8bd0-eb3c9d1d0d25/3536b64e-adcb-5ddd-8bd0-eb3c9d1d0d25_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F58%252Fbf584e0c6003bbd4bc54ee6710fb8f54%252Fpa%252FYA96052_c4df9b1bf69588337db75ec082186d1b.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/58/bf584e0c6003bbd4bc54ee6710fb8f54/pa/YA96052_c4df9b1bf69588337db75ec082186d1b.jpg saved to cache
2026-01-28 20:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 3536b64e-adcb-5ddd-8bd0-eb3c9d1d0d25
2026-01-28 20:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/2b/032b457b787f642f8a61ead8f33dbc0f/pa/AW68260_8d0a62e280a77cf5ad600e28104434c3.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F88%252Fa9886c8c428fd9ace2871b067ea0c3ef%252Fpa%252FFP41040_b9a0b3efd0bf9ea9494f9586915a3c68.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/88/a9886c8c428fd9ace2871b067ea0c3ef/pa/FP41040_b9a0b3efd0bf9ea9494f9586915a3c68.jpg not downloaded yet
2026-01-28 20:02:03 [auto1.it] INFO: Found listing with ID: DG99374
2026-01-28 20:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DG99374%27 HTTP/1.1" 200 None
2026-01-28 20:02:03 [auto1.it] INFO: Scrape type for DG99374: 0
2026-01-28 20:02:03 [auto1.it] INFO: Found listing with ID: KV39330
2026-01-28 20:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KV39330%27 HTTP/1.1" 200 None
2026-01-28 20:02:03 [auto1.it] INFO: Scrape type for KV39330: 0
2026-01-28 20:02:03 [auto1.it] INFO: Found listing with ID: RR19391
2026-01-28 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RR19391%27 HTTP/1.1" 200 None
2026-01-28 20:02:04 [auto1.it] INFO: Scrape type for RR19391: 0
2026-01-28 20:02:04 [auto1.it] INFO: Found listing with ID: NR38065
2026-01-28 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NR38065%27 HTTP/1.1" 200 None
2026-01-28 20:02:04 [auto1.it] INFO: Scrape type for NR38065: 0
2026-01-28 20:02:04 [auto1.it] INFO: Found listing with ID: ZL05088
2026-01-28 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZL05088%27 HTTP/1.1" 200 None
2026-01-28 20:02:04 [auto1.it] INFO: Scrape type for ZL05088: 0
2026-01-28 20:02:04 [auto1.it] INFO: Found listing with ID: YU15778
2026-01-28 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YU15778%27 HTTP/1.1" 200 None
2026-01-28 20:02:04 [auto1.it] INFO: Scrape type for YU15778: 0
2026-01-28 20:02:04 [auto1.it] INFO: Found listing with ID: XK25205
2026-01-28 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XK25205%27 HTTP/1.1" 200 None
2026-01-28 20:02:04 [auto1.it] INFO: Scrape type for XK25205: 2
2026-01-28 20:02:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/58/bf584e0c6003bbd4bc54ee6710fb8f54/pa/YA96052_ab88035feabb3836518d1bcf8c66dc93.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F88%252Fa9886c8c428fd9ace2871b067ea0c3ef%252Fpa%252FFP41040_b73370070eb1cf24a9a7194f0042c7bc.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/88/a9886c8c428fd9ace2871b067ea0c3ef/pa/FP41040_b73370070eb1cf24a9a7194f0042c7bc.jpg not downloaded yet
2026-01-28 20:02:04 [auto1.it] INFO: Found listing with ID: XF74910
2026-01-28 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XF74910%27 HTTP/1.1" 200 None
2026-01-28 20:02:04 [auto1.it] INFO: Scrape type for XF74910: 0
2026-01-28 20:02:04 [auto1.it] INFO: Found listing with ID: BE54104
2026-01-28 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BE54104%27 HTTP/1.1" 200 None
2026-01-28 20:02:04 [auto1.it] INFO: Scrape type for BE54104: 2
2026-01-28 20:02:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F88%252Fa9886c8c428fd9ace2871b067ea0c3ef%252Fpa%252FFP41040_c3b5359dbfeb085b0df0700cb01cca02.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/88/a9886c8c428fd9ace2871b067ea0c3ef/pa/FP41040_c3b5359dbfeb085b0df0700cb01cca02.jpg not downloaded yet
2026-01-28 20:02:04 [auto1.it] INFO: Found listing with ID: TY85783
2026-01-28 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TY85783%27 HTTP/1.1" 200 None
2026-01-28 20:02:04 [auto1.it] INFO: Scrape type for TY85783: 0
2026-01-28 20:02:04 [auto1.it] INFO: Found listing with ID: CU67286
2026-01-28 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CU67286%27 HTTP/1.1" 200 None
2026-01-28 20:02:04 [auto1.it] INFO: Scrape type for CU67286: 0
2026-01-28 20:02:04 [auto1.it] INFO: Found listing with ID: VB04552
2026-01-28 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VB04552%27 HTTP/1.1" 200 None
2026-01-28 20:02:04 [auto1.it] INFO: Scrape type for VB04552: 0
2026-01-28 20:02:04 [auto1.it] INFO: Found listing with ID: MV48827
2026-01-28 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MV48827%27 HTTP/1.1" 200 None
2026-01-28 20:02:04 [auto1.it] INFO: Scrape type for MV48827: 0
2026-01-28 20:02:04 [auto1.it] INFO: Found listing with ID: UH29837
2026-01-28 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UH29837%27 HTTP/1.1" 200 None
2026-01-28 20:02:04 [auto1.it] INFO: Scrape type for UH29837: 1
2026-01-28 20:02:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b086e1550>
2026-01-28 20:02:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3536b64e-adcb-5ddd-8bd0-eb3c9d1d0d25/3536b64e-adcb-5ddd-8bd0-eb3c9d1d0d25_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F58%252Fbf584e0c6003bbd4bc54ee6710fb8f54%252Fpa%252FYA96052_e267081895991f08dfae128524546baf.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/58/bf584e0c6003bbd4bc54ee6710fb8f54/pa/YA96052_e267081895991f08dfae128524546baf.jpg saved to cache
2026-01-28 20:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 3536b64e-adcb-5ddd-8bd0-eb3c9d1d0d25
2026-01-28 20:02:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0a04d950>
2026-01-28 20:02:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3536b64e-adcb-5ddd-8bd0-eb3c9d1d0d25/3536b64e-adcb-5ddd-8bd0-eb3c9d1d0d25_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F58%252Fbf584e0c6003bbd4bc54ee6710fb8f54%252Fpa%252FYA96052_c047f84af94f77f149f674adc2fc4917.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/58/bf584e0c6003bbd4bc54ee6710fb8f54/pa/YA96052_c047f84af94f77f149f674adc2fc4917.jpg saved to cache
2026-01-28 20:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 3536b64e-adcb-5ddd-8bd0-eb3c9d1d0d25
2026-01-28 20:02:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:02:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09ea0110>
2026-01-28 20:02:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c5618d2-b669-5ad2-838c-20c123c74357/4c5618d2-b669-5ad2-838c-20c123c74357_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F2b%252F032b457b787f642f8a61ead8f33dbc0f%252Fpa%252FAW68260_8d0a62e280a77cf5ad600e28104434c3.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/2b/032b457b787f642f8a61ead8f33dbc0f/pa/AW68260_8d0a62e280a77cf5ad600e28104434c3.jpg saved to cache
2026-01-28 20:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4c5618d2-b669-5ad2-838c-20c123c74357
2026-01-28 20:02:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4c5618d2-b669-5ad2-838c-20c123c74357, skipping ID generation
2026-01-28 20:02:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c5618d2-b669-5ad2-838c-20c123c74357 with scrape type 1
2026-01-28 20:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 4c5618d2-b669-5ad2-838c-20c123c74357 from tracking dictionaries
2026-01-28 20:02:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4c5618d2-b669-5ad2-838c-20c123c74357 sending to next pipeline
2026-01-28 20:02:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4c5618d2-b669-5ad2-838c-20c123c74357, identifier: AW68260
2026-01-28 20:02:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4c5618d2-b669-5ad2-838c-20c123c74357 with identifier: AW68260
2026-01-28 20:02:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4c5618d2-b669-5ad2-838c-20c123c74357 with identifier: AW68260
2026-01-28 20:02:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4c5618d2-b669-5ad2-838c-20c123c74357 with identifier: AW68260 to the API
2026-01-28 20:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:02:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:02:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img03/2b/032b457b787f642f8a61ead8f33dbc0f/pa/AW68260_8d0a62e280a77cf5ad600e28104434c3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.5L',
 'engine_horse_power': 218,
 'expiration_date': '2026-01-29T16:55:45Z',
 'fuel_type': 'hybrid',
 'id': '4c5618d2-b669-5ad2-838c-20c123c74357',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AW68260',
 'listing': 'auction',
 'location': 'IT, Roma RM',
 'make': 'Toyota',
 'model': 'RAV 4',
 'odometer': 62667,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c5618d2-b669-5ad2-838c-20c123c74357/4c5618d2-b669-5ad2-838c-20c123c74357_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67998,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/2b/032b457b787f642f8a61ead8f33dbc0f/pa/AW68260_d7917356b18061b04fbefe02e658d3d1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c5618d2-b669-5ad2-838c-20c123c74357/4c5618d2-b669-5ad2-838c-20c123c74357_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2703101,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img03/2b/032b457b787f642f8a61ead8f33dbc0f/pa/AW68260_8d0a62e280a77cf5ad600e28104434c3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c5618d2-b669-5ad2-838c-20c123c74357/4c5618d2-b669-5ad2-838c-20c123c74357_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65925,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/2b/032b457b787f642f8a61ead8f33dbc0f/pa/AW68260_199d709626359ab90d07f1ba6d8d7e02.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c5618d2-b669-5ad2-838c-20c123c74357/4c5618d2-b669-5ad2-838c-20c123c74357_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53699,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/2b/032b457b787f642f8a61ead8f33dbc0f/pa/AW68260_24480b77785dc0f75c4aac45bf1d7343.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c5618d2-b669-5ad2-838c-20c123c74357/4c5618d2-b669-5ad2-838c-20c123c74357_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63229,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/2b/032b457b787f642f8a61ead8f33dbc0f/pa/AW68260_aee17fd1b51b465a8d57b6558182f8b5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c5618d2-b669-5ad2-838c-20c123c74357/4c5618d2-b669-5ad2-838c-20c123c74357_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70489,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/2b/032b457b787f642f8a61ead8f33dbc0f/pa/AW68260_2818dc1fd72a3279756d72546d9b7979.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c5618d2-b669-5ad2-838c-20c123c74357/4c5618d2-b669-5ad2-838c-20c123c74357_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58354,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/2b/032b457b787f642f8a61ead8f33dbc0f/pa/AW68260_8e3b99b77e2b6bcd600fff107f4cd9c7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c5618d2-b669-5ad2-838c-20c123c74357/4c5618d2-b669-5ad2-838c-20c123c74357_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2820065,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img03/2b/032b457b787f642f8a61ead8f33dbc0f/pa/AW68260_7805040769e76f14aca904c21564f911.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c5618d2-b669-5ad2-838c-20c123c74357/4c5618d2-b669-5ad2-838c-20c123c74357_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2738366,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img03/2b/032b457b787f642f8a61ead8f33dbc0f/pa/AW68260_f38aee3db3c520c12647260b274de874.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c5618d2-b669-5ad2-838c-20c123c74357/4c5618d2-b669-5ad2-838c-20c123c74357_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2777217,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img03/2b/032b457b787f642f8a61ead8f33dbc0f/pa/AW68260_03d7a8bd7b82d862e79f4d31d4f11075.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c5618d2-b669-5ad2-838c-20c123c74357/4c5618d2-b669-5ad2-838c-20c123c74357_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57864,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/2b/032b457b787f642f8a61ead8f33dbc0f/pa/AW68260_15b220c5bf09cbd996e34b225bd50404.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c5618d2-b669-5ad2-838c-20c123c74357/4c5618d2-b669-5ad2-838c-20c123c74357_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2779078,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img03/2b/032b457b787f642f8a61ead8f33dbc0f/pa/AW68260_fd76d30f3413da8d3dd367f17f8b89d5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c5618d2-b669-5ad2-838c-20c123c74357/4c5618d2-b669-5ad2-838c-20c123c74357_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2655650,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img03/2b/032b457b787f642f8a61ead8f33dbc0f/pa/AW68260_107d8d944834055323378f6216fe45c2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c5618d2-b669-5ad2-838c-20c123c74357/4c5618d2-b669-5ad2-838c-20c123c74357_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2673315,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img03/2b/032b457b787f642f8a61ead8f33dbc0f/pa/AW68260_574f977a3a78873cbbb6018edebf50c1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c5618d2-b669-5ad2-838c-20c123c74357/4c5618d2-b669-5ad2-838c-20c123c74357_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73788,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/2b/032b457b787f642f8a61ead8f33dbc0f/pa/AW68260_46ec3bf57c7620daa93b1661d534217f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-09-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota RAV 4 2.5 Hybrid 4x2 Dynamic',
 'transmission': 'automatic',
 'trim': '4x2 Dynamic',
 'year': 2021}
2026-01-28 20:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AW68260%27 HTTP/1.1" 200 None
2026-01-28 20:02:06 [auto1.it] INFO: Saving data for AW68260: {'created_time': 1769630526.008303, 'last_price_update_time': 1769630526.008315, 'auction_closing_time': 1769705745.0}
2026-01-28 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AW68260') HTTP/1.1" 204 0
2026-01-28 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F88%252Fa9886c8c428fd9ace2871b067ea0c3ef%252Fpa%252FFP41040_067a155e5189a89b3b484b00785c924f.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/88/a9886c8c428fd9ace2871b067ea0c3ef/pa/FP41040_067a155e5189a89b3b484b00785c924f.jpg not downloaded yet
2026-01-28 20:02:06 [auto1.it] INFO: Found listing with ID: BB04771
2026-01-28 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BB04771%27 HTTP/1.1" 200 None
2026-01-28 20:02:06 [auto1.it] INFO: Scrape type for BB04771: 0
2026-01-28 20:02:06 [auto1.it] INFO: Found listing with ID: UW70389
2026-01-28 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UW70389%27 HTTP/1.1" 200 None
2026-01-28 20:02:06 [auto1.it] INFO: Scrape type for UW70389: 0
2026-01-28 20:02:06 [auto1.it] INFO: Found listing with ID: AK97065
2026-01-28 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AK97065%27 HTTP/1.1" 200 None
2026-01-28 20:02:06 [auto1.it] INFO: Scrape type for AK97065: 0
2026-01-28 20:02:06 [auto1.it] INFO: Found listing with ID: HG59562
2026-01-28 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HG59562%27 HTTP/1.1" 200 None
2026-01-28 20:02:06 [auto1.it] INFO: Scrape type for HG59562: 0
2026-01-28 20:02:06 [auto1.it] INFO: Found listing with ID: UL75822
2026-01-28 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UL75822%27 HTTP/1.1" 200 None
2026-01-28 20:02:06 [auto1.it] INFO: Scrape type for UL75822: 0
2026-01-28 20:02:06 [auto1.it] INFO: Found listing with ID: GH67198
2026-01-28 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GH67198%27 HTTP/1.1" 200 None
2026-01-28 20:02:06 [auto1.it] INFO: Scrape type for GH67198: 0
2026-01-28 20:02:06 [auto1.it] INFO: Found listing with ID: SL36672
2026-01-28 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SL36672%27 HTTP/1.1" 200 None
2026-01-28 20:02:06 [auto1.it] INFO: Scrape type for SL36672: 0
2026-01-28 20:02:06 [auto1.it] INFO: Found listing with ID: KX95898
2026-01-28 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KX95898%27 HTTP/1.1" 200 None
2026-01-28 20:02:06 [auto1.it] INFO: Scrape type for KX95898: 1
2026-01-28 20:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WD98953> (referer: https://www.auto1.com/v1/car-details-view/WD98953/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FJ86916> (referer: https://www.auto1.com/v1/car-details-view/FJ86916/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/02/0902ecd716da7e9c1590d287d6183135/pa/BS57464_2d2be8bde02b767e2dc0fb7624bba0c0.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F88%252Fa9886c8c428fd9ace2871b067ea0c3ef%252Fpa%252FFP41040_94b77a43da9ebe9f8012e9409d492402.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/88/a9886c8c428fd9ace2871b067ea0c3ef/pa/FP41040_94b77a43da9ebe9f8012e9409d492402.jpg not downloaded yet
2026-01-28 20:02:06 [auto1.it] INFO: Found listing with ID: WN49537
2026-01-28 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WN49537%27 HTTP/1.1" 200 None
2026-01-28 20:02:06 [auto1.it] INFO: Scrape type for WN49537: 0
2026-01-28 20:02:06 [auto1.it] INFO: Found listing with ID: JN76838
2026-01-28 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JN76838%27 HTTP/1.1" 200 None
2026-01-28 20:02:06 [auto1.it] INFO: Scrape type for JN76838: 0
2026-01-28 20:02:06 [auto1.it] INFO: Found listing with ID: ZN65600
2026-01-28 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZN65600%27 HTTP/1.1" 200 None
2026-01-28 20:02:06 [auto1.it] INFO: Scrape type for ZN65600: 0
2026-01-28 20:02:06 [auto1.it] INFO: Found listing with ID: SW68583
2026-01-28 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SW68583%27 HTTP/1.1" 200 None
2026-01-28 20:02:06 [auto1.it] INFO: Scrape type for SW68583: 0
2026-01-28 20:02:06 [auto1.it] INFO: Found listing with ID: JE97171
2026-01-28 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JE97171%27 HTTP/1.1" 200 None
2026-01-28 20:02:06 [auto1.it] INFO: Scrape type for JE97171: 2
2026-01-28 20:02:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09f22110>
2026-01-28 20:02:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3536b64e-adcb-5ddd-8bd0-eb3c9d1d0d25/3536b64e-adcb-5ddd-8bd0-eb3c9d1d0d25_image_17.jpg HTTP/1.1" 201 0
2026-01-28 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F58%252Fbf584e0c6003bbd4bc54ee6710fb8f54%252Fpa%252FYA96052_ab88035feabb3836518d1bcf8c66dc93.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/58/bf584e0c6003bbd4bc54ee6710fb8f54/pa/YA96052_ab88035feabb3836518d1bcf8c66dc93.jpg saved to cache
2026-01-28 20:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 3536b64e-adcb-5ddd-8bd0-eb3c9d1d0d25
2026-01-28 20:02:06 [auto1.it] INFO: Found listing with ID: DA44025
2026-01-28 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DA44025%27 HTTP/1.1" 200 None
2026-01-28 20:02:06 [auto1.it] INFO: Scrape type for DA44025: 0
2026-01-28 20:02:06 [auto1.it] INFO: Found listing with ID: XP01940
2026-01-28 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XP01940%27 HTTP/1.1" 200 None
2026-01-28 20:02:06 [auto1.it] INFO: Scrape type for XP01940: 0
2026-01-28 20:02:06 [auto1.it] INFO: Found listing with ID: CD43232
2026-01-28 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CD43232%27 HTTP/1.1" 200 None
2026-01-28 20:02:06 [auto1.it] INFO: Scrape type for CD43232: 0
2026-01-28 20:02:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:02:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:02:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 07265938-da10-5911-9843-7fae6f5ef686 with identifier: WD98953
2026-01-28 20:02:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 07265938-da10-5911-9843-7fae6f5ef686 with scrape type 2
2026-01-28 20:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 07265938-da10-5911-9843-7fae6f5ef686 with scrape type 2
2026-01-28 20:02:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 07265938-da10-5911-9843-7fae6f5ef686, identifier: WD98953
2026-01-28 20:02:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47574182-9bc7-5010-9524-7692a3da5c21 with identifier: FJ86916
2026-01-28 20:02:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47574182-9bc7-5010-9524-7692a3da5c21 with scrape type 2
2026-01-28 20:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 47574182-9bc7-5010-9524-7692a3da5c21 with scrape type 2
2026-01-28 20:02:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 47574182-9bc7-5010-9524-7692a3da5c21, identifier: FJ86916
2026-01-28 20:02:07 [auto1.it] INFO: Parsing search results for channel: 24h
2026-01-28 20:02:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08940cd0>
2026-01-28 20:02:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab2b9426-2a4e-5843-bea9-eeabb5e12b74/ab2b9426-2a4e-5843-bea9-eeabb5e12b74_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F02%252F0902ecd716da7e9c1590d287d6183135%252Fpa%252FBS57464_2d2be8bde02b767e2dc0fb7624bba0c0.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/02/0902ecd716da7e9c1590d287d6183135/pa/BS57464_2d2be8bde02b767e2dc0fb7624bba0c0.jpg saved to cache
2026-01-28 20:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item ab2b9426-2a4e-5843-bea9-eeabb5e12b74
2026-01-28 20:02:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 07265938-da10-5911-9843-7fae6f5ef686 with identifier: WD98953
2026-01-28 20:02:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 07265938-da10-5911-9843-7fae6f5ef686 with identifier: WD98953
2026-01-28 20:02:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 07265938-da10-5911-9843-7fae6f5ef686 with identifier: WD98953 to the API
2026-01-28 20:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:02:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:02:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WD98953>
{'auction_title': '',
 'c_o_2_emission_value': 166,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '2.0L',
 'engine_horse_power': 247,
 'expiration_date': '2026-01-29T16:38:53Z',
 'fuel_type': 'petrol',
 'id': '07265938-da10-5911-9843-7fae6f5ef686',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WD98953',
 'listing': 'auction',
 'location': 'IT, Settimo Torinese',
 'make': 'Volvo',
 'model': 'XC40',
 'odometer': 19874,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-10-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo XC40 2.0 T5 R-Design AWD',
 'transmission': 'automatic',
 'trim': 'R-Design AWD',
 'year': 2018}
2026-01-28 20:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WD98953%27 HTTP/1.1" 200 None
2026-01-28 20:02:07 [auto1.it] INFO: Saving data for WD98953: {'auction_closing_time': 1769704733.0, 'created_time': 1769199379.004063, 'last_price_update_time': 1769630527.825971}
2026-01-28 20:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WD98953') HTTP/1.1" 204 0
2026-01-28 20:02:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 47574182-9bc7-5010-9524-7692a3da5c21 with identifier: FJ86916
2026-01-28 20:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gas HTTP/1.1" 200 None
2026-01-28 20:02:08 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-28 20:02:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 47574182-9bc7-5010-9524-7692a3da5c21 with identifier: FJ86916
2026-01-28 20:02:08 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 169996 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    169996
2026-01-28 20:02:08 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 47574182-9bc7-5010-9524-7692a3da5c21 spider: auto1.it
2026-01-28 20:02:08 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 47574182-9bc7-5010-9524-7692a3da5c21 due to rule: high_mileage_for_country.json, error: 169996 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    169996
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.4L',
 'engine_horse_power': 90,
 'expiration_date': '2026-01-29T16:00:16Z',
 'fuel_type': 'gas',
 'id': '47574182-9bc7-5010-9524-7692a3da5c21',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FJ86916',
 'listing': 'auction',
 'location': 'IT, Manoppello (PE)',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 169996,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-05-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Corsa 1.4 Benzin / LPG Advance',
 'transmission': 'manual',
 'trim': 'Advance',
 'year': 2018}
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FJ86916%27 HTTP/1.1" 200 None
2026-01-28 20:02:08 [auto1.it] INFO: Saving data for FJ86916: {'auction_closing_time': 1769702416.0, 'created_time': 1768471410.447788, 'last_price_update_time': 1769630528.419418}
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FJ86916') HTTP/1.1" 204 0
2026-01-28 20:02:08 [auto1.it] INFO: Found listing with ID: FX49357
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FX49357%27 HTTP/1.1" 200 None
2026-01-28 20:02:08 [auto1.it] INFO: Scrape type for FX49357: 0
2026-01-28 20:02:08 [auto1.it] INFO: Found listing with ID: AV71014
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AV71014%27 HTTP/1.1" 200 None
2026-01-28 20:02:08 [auto1.it] INFO: Scrape type for AV71014: 0
2026-01-28 20:02:08 [auto1.it] INFO: Found listing with ID: UF13738
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UF13738%27 HTTP/1.1" 200 None
2026-01-28 20:02:08 [auto1.it] INFO: Scrape type for UF13738: 0
2026-01-28 20:02:08 [auto1.it] INFO: Found listing with ID: DP80955
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DP80955%27 HTTP/1.1" 200 None
2026-01-28 20:02:08 [auto1.it] INFO: Scrape type for DP80955: 0
2026-01-28 20:02:08 [auto1.it] INFO: Found listing with ID: AV65430
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AV65430%27 HTTP/1.1" 200 None
2026-01-28 20:02:08 [auto1.it] INFO: Scrape type for AV65430: 0
2026-01-28 20:02:08 [auto1.it] INFO: Found listing with ID: HW92589
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HW92589%27 HTTP/1.1" 200 None
2026-01-28 20:02:08 [auto1.it] INFO: Scrape type for HW92589: 0
2026-01-28 20:02:08 [auto1.it] INFO: Found listing with ID: FW48614
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FW48614%27 HTTP/1.1" 200 None
2026-01-28 20:02:08 [auto1.it] INFO: Scrape type for FW48614: 0
2026-01-28 20:02:08 [auto1.it] INFO: Found listing with ID: UD04779
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UD04779%27 HTTP/1.1" 200 None
2026-01-28 20:02:08 [auto1.it] INFO: Scrape type for UD04779: 0
2026-01-28 20:02:08 [auto1.it] INFO: Found listing with ID: EF33407
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EF33407%27 HTTP/1.1" 200 None
2026-01-28 20:02:08 [auto1.it] INFO: Scrape type for EF33407: 0
2026-01-28 20:02:08 [auto1.it] INFO: Found listing with ID: DT68594
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DT68594%27 HTTP/1.1" 200 None
2026-01-28 20:02:08 [auto1.it] INFO: Scrape type for DT68594: 0
2026-01-28 20:02:08 [auto1.it] INFO: Found listing with ID: BN48518
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BN48518%27 HTTP/1.1" 200 None
2026-01-28 20:02:08 [auto1.it] INFO: Scrape type for BN48518: 0
2026-01-28 20:02:08 [auto1.it] INFO: Found listing with ID: JY28433
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JY28433%27 HTTP/1.1" 200 None
2026-01-28 20:02:08 [auto1.it] INFO: Scrape type for JY28433: 0
2026-01-28 20:02:08 [auto1.it] INFO: Found listing with ID: CE73370
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CE73370%27 HTTP/1.1" 200 None
2026-01-28 20:02:08 [auto1.it] INFO: Scrape type for CE73370: 0
2026-01-28 20:02:08 [auto1.it] INFO: Found listing with ID: EA43401
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EA43401%27 HTTP/1.1" 200 None
2026-01-28 20:02:08 [auto1.it] INFO: Scrape type for EA43401: 0
2026-01-28 20:02:08 [auto1.it] INFO: Found listing with ID: LZ66498
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LZ66498%27 HTTP/1.1" 200 None
2026-01-28 20:02:08 [auto1.it] INFO: Scrape type for LZ66498: 0
2026-01-28 20:02:08 [auto1.it] INFO: Found listing with ID: RN67455
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RN67455%27 HTTP/1.1" 200 None
2026-01-28 20:02:08 [auto1.it] INFO: Scrape type for RN67455: 0
2026-01-28 20:02:08 [auto1.it] INFO: Found listing with ID: UN61928
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UN61928%27 HTTP/1.1" 200 None
2026-01-28 20:02:08 [auto1.it] INFO: Scrape type for UN61928: 0
2026-01-28 20:02:08 [auto1.it] INFO: Found listing with ID: ZK76849
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZK76849%27 HTTP/1.1" 200 None
2026-01-28 20:02:08 [auto1.it] INFO: Scrape type for ZK76849: 0
2026-01-28 20:02:08 [auto1.it] INFO: Found listing with ID: RZ04126
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RZ04126%27 HTTP/1.1" 200 None
2026-01-28 20:02:08 [auto1.it] INFO: Scrape type for RZ04126: 0
2026-01-28 20:02:08 [auto1.it] INFO: Found listing with ID: HW64559
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HW64559%27 HTTP/1.1" 200 None
2026-01-28 20:02:08 [auto1.it] INFO: Scrape type for HW64559: 0
2026-01-28 20:02:08 [auto1.it] INFO: Found listing with ID: NL17147
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NL17147%27 HTTP/1.1" 200 None
2026-01-28 20:02:08 [auto1.it] INFO: Scrape type for NL17147: 0
2026-01-28 20:02:08 [auto1.it] INFO: Found listing with ID: BP77320
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BP77320%27 HTTP/1.1" 200 None
2026-01-28 20:02:08 [auto1.it] INFO: Scrape type for BP77320: 0
2026-01-28 20:02:08 [auto1.it] INFO: Found listing with ID: WA67831
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WA67831%27 HTTP/1.1" 200 None
2026-01-28 20:02:08 [auto1.it] INFO: Scrape type for WA67831: 2
2026-01-28 20:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BM05081/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XK25205/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AF71631> (referer: https://www.auto1.com/v1/car-details-view/AF71631/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:02:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:02:08 [auto1.it] INFO: Found listing with ID: SA07653
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SA07653%27 HTTP/1.1" 200 None
2026-01-28 20:02:08 [auto1.it] INFO: Scrape type for SA07653: 0
2026-01-28 20:02:08 [auto1.it] INFO: Found listing with ID: GC79469
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GC79469%27 HTTP/1.1" 200 None
2026-01-28 20:02:08 [auto1.it] INFO: Scrape type for GC79469: 0
2026-01-28 20:02:08 [auto1.it] INFO: Found listing with ID: LB98702
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LB98702%27 HTTP/1.1" 200 None
2026-01-28 20:02:09 [auto1.it] INFO: Scrape type for LB98702: 0
2026-01-28 20:02:09 [auto1.it] INFO: Found listing with ID: PM18246
2026-01-28 20:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PM18246%27 HTTP/1.1" 200 None
2026-01-28 20:02:09 [auto1.it] INFO: Scrape type for PM18246: 0
2026-01-28 20:02:09 [auto1.it] INFO: Found listing with ID: HB24915
2026-01-28 20:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HB24915%27 HTTP/1.1" 200 None
2026-01-28 20:02:09 [auto1.it] INFO: Scrape type for HB24915: 0
2026-01-28 20:02:09 [auto1.it] INFO: Found listing with ID: EJ52665
2026-01-28 20:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EJ52665%27 HTTP/1.1" 200 None
2026-01-28 20:02:09 [auto1.it] INFO: Scrape type for EJ52665: 0
2026-01-28 20:02:09 [auto1.it] INFO: Found listing with ID: WK84125
2026-01-28 20:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WK84125%27 HTTP/1.1" 200 None
2026-01-28 20:02:09 [auto1.it] INFO: Scrape type for WK84125: 2
2026-01-28 20:02:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:02:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:02:09 [auto1.it] INFO: Found listing with ID: WR93910
2026-01-28 20:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WR93910%27 HTTP/1.1" 200 None
2026-01-28 20:02:09 [auto1.it] INFO: Scrape type for WR93910: 0
2026-01-28 20:02:09 [auto1.it] INFO: Found listing with ID: XM03029
2026-01-28 20:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XM03029%27 HTTP/1.1" 200 None
2026-01-28 20:02:09 [auto1.it] INFO: Scrape type for XM03029: 0
2026-01-28 20:02:09 [auto1.it] INFO: Found listing with ID: CA13828
2026-01-28 20:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CA13828%27 HTTP/1.1" 200 None
2026-01-28 20:02:09 [auto1.it] INFO: Scrape type for CA13828: 0
2026-01-28 20:02:09 [auto1.it] INFO: Found listing with ID: RW40398
2026-01-28 20:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RW40398%27 HTTP/1.1" 200 None
2026-01-28 20:02:09 [auto1.it] INFO: Scrape type for RW40398: 0
2026-01-28 20:02:09 [auto1.it] INFO: Found listing with ID: VH04520
2026-01-28 20:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VH04520%27 HTTP/1.1" 200 None
2026-01-28 20:02:09 [auto1.it] INFO: Scrape type for VH04520: 0
2026-01-28 20:02:09 [auto1.it] INFO: Found listing with ID: FF86857
2026-01-28 20:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FF86857%27 HTTP/1.1" 200 None
2026-01-28 20:02:09 [auto1.it] INFO: Scrape type for FF86857: 0
2026-01-28 20:02:09 [auto1.it] INFO: Found listing with ID: HG00560
2026-01-28 20:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HG00560%27 HTTP/1.1" 200 None
2026-01-28 20:02:09 [auto1.it] INFO: Scrape type for HG00560: 0
2026-01-28 20:02:09 [auto1.it] INFO: Found listing with ID: MJ74552
2026-01-28 20:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MJ74552%27 HTTP/1.1" 200 None
2026-01-28 20:02:09 [auto1.it] INFO: Scrape type for MJ74552: 0
2026-01-28 20:02:09 [auto1.it] INFO: Found listing with ID: XS62284
2026-01-28 20:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XS62284%27 HTTP/1.1" 200 None
2026-01-28 20:02:09 [auto1.it] INFO: Scrape type for XS62284: 0
2026-01-28 20:02:09 [auto1.it] INFO: Found listing with ID: AV95910
2026-01-28 20:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AV95910%27 HTTP/1.1" 200 None
2026-01-28 20:02:09 [auto1.it] INFO: Scrape type for AV95910: 0
2026-01-28 20:02:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1dbd296c-a17f-5065-a78b-e19b5947bbd4 with identifier: AF71631
2026-01-28 20:02:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1dbd296c-a17f-5065-a78b-e19b5947bbd4 with scrape type 1
2026-01-28 20:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 1dbd296c-a17f-5065-a78b-e19b5947bbd4
2026-01-28 20:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F40%252Fb640deb920d25bfcde69628b9f380427%252Fpa%252FAF71631_8957772f02e7eabde5eb99b47f2c3eee.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/40/b640deb920d25bfcde69628b9f380427/pa/AF71631_8957772f02e7eabde5eb99b47f2c3eee.jpg not downloaded yet
2026-01-28 20:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F40%252Fb640deb920d25bfcde69628b9f380427%252Fpa%252FAF71631_6f4a6a966d9a00028b24678f38c2959f.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/40/b640deb920d25bfcde69628b9f380427/pa/AF71631_6f4a6a966d9a00028b24678f38c2959f.jpg not downloaded yet
2026-01-28 20:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F40%252Fb640deb920d25bfcde69628b9f380427%252Fpa%252FAF71631_0791efe8bd3790fe0bfd4895096adcff.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/40/b640deb920d25bfcde69628b9f380427/pa/AF71631_0791efe8bd3790fe0bfd4895096adcff.jpg not downloaded yet
2026-01-28 20:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/f1/a9f10ebe41cd775023aa7cea3236430e/pa/TZ83605_d71191ed0769835090202c97bb1a49a3.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F40%252Fb640deb920d25bfcde69628b9f380427%252Fpa%252FAF71631_74cecfbee667c702fea0aab274fc1f65.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/40/b640deb920d25bfcde69628b9f380427/pa/AF71631_74cecfbee667c702fea0aab274fc1f65.jpg not downloaded yet
2026-01-28 20:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/4b/df4bfd14ecccad2e28acc7936a8ce0e3/pa/WP90453_5b07f13bcb01c664301ec1a6275802a6.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F40%252Fb640deb920d25bfcde69628b9f380427%252Fpa%252FAF71631_a7be777bb02f79f8c44592329fce7ebd.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/40/b640deb920d25bfcde69628b9f380427/pa/AF71631_a7be777bb02f79f8c44592329fce7ebd.jpg not downloaded yet
2026-01-28 20:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F40%252Fb640deb920d25bfcde69628b9f380427%252Fpa%252FAF71631_1a046115a9822abe1830f99d6879165f.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/40/b640deb920d25bfcde69628b9f380427/pa/AF71631_1a046115a9822abe1830f99d6879165f.jpg not downloaded yet
2026-01-28 20:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F40%252Fb640deb920d25bfcde69628b9f380427%252Fpa%252FAF71631_789a79cd160abdffd659e7674cdbff08.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/40/b640deb920d25bfcde69628b9f380427/pa/AF71631_789a79cd160abdffd659e7674cdbff08.jpg not downloaded yet
2026-01-28 20:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/02/0902ecd716da7e9c1590d287d6183135/pa/BS57464_f1460c21492cd74c610c7d629e277945.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F40%252Fb640deb920d25bfcde69628b9f380427%252Fpa%252FAF71631_203a6d0e1f390e2faf5f440a2fd58518.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/40/b640deb920d25bfcde69628b9f380427/pa/AF71631_203a6d0e1f390e2faf5f440a2fd58518.jpg not downloaded yet
2026-01-28 20:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/88/a9886c8c428fd9ace2871b067ea0c3ef/pa/FP41040_9068be76c77a0a4645361fc7d795c3f3.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/88/a9886c8c428fd9ace2871b067ea0c3ef/pa/FP41040_68d92b776a58a3e4fc5227a814ce03f7.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/88/a9886c8c428fd9ace2871b067ea0c3ef/pa/FP41040_94b77a43da9ebe9f8012e9409d492402.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:02:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:02:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b086cda50>
2026-01-28 20:02:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b2a49a6-5f2b-5692-a1a2-27ebe5ca1227/4b2a49a6-5f2b-5692-a1a2-27ebe5ca1227_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Ff1%252Fa9f10ebe41cd775023aa7cea3236430e%252Fpa%252FTZ83605_d71191ed0769835090202c97bb1a49a3.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/f1/a9f10ebe41cd775023aa7cea3236430e/pa/TZ83605_d71191ed0769835090202c97bb1a49a3.jpg saved to cache
2026-01-28 20:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4b2a49a6-5f2b-5692-a1a2-27ebe5ca1227
2026-01-28 20:02:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4b2a49a6-5f2b-5692-a1a2-27ebe5ca1227, skipping ID generation
2026-01-28 20:02:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b2a49a6-5f2b-5692-a1a2-27ebe5ca1227 with scrape type 1
2026-01-28 20:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 4b2a49a6-5f2b-5692-a1a2-27ebe5ca1227 from tracking dictionaries
2026-01-28 20:02:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4b2a49a6-5f2b-5692-a1a2-27ebe5ca1227 sending to next pipeline
2026-01-28 20:02:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4b2a49a6-5f2b-5692-a1a2-27ebe5ca1227, identifier: TZ83605
2026-01-28 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F40%252Fb640deb920d25bfcde69628b9f380427%252Fpa%252FAF71631_ad2f33ebf3dd81b80d5531684fb257a4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/40/b640deb920d25bfcde69628b9f380427/pa/AF71631_ad2f33ebf3dd81b80d5531684fb257a4.jpg not downloaded yet
2026-01-28 20:02:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4b2a49a6-5f2b-5692-a1a2-27ebe5ca1227 with identifier: TZ83605
2026-01-28 20:02:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4b2a49a6-5f2b-5692-a1a2-27ebe5ca1227 with identifier: TZ83605
2026-01-28 20:02:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4b2a49a6-5f2b-5692-a1a2-27ebe5ca1227 with identifier: TZ83605 to the API
2026-01-28 20:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:02:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:02:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga9/f1/a9f10ebe41cd775023aa7cea3236430e/pa/TZ83605_d71191ed0769835090202c97bb1a49a3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:43:00Z',
 'fuel_type': 'diesel',
 'id': '4b2a49a6-5f2b-5692-a1a2-27ebe5ca1227',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TZ83605',
 'listing': 'auction',
 'location': 'IT, Torino',
 'make': 'Citroen',
 'model': 'C5 Aircross',
 'odometer': 105980,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b2a49a6-5f2b-5692-a1a2-27ebe5ca1227/4b2a49a6-5f2b-5692-a1a2-27ebe5ca1227_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3095348,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/f1/a9f10ebe41cd775023aa7cea3236430e/pa/TZ83605_d71191ed0769835090202c97bb1a49a3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b2a49a6-5f2b-5692-a1a2-27ebe5ca1227/4b2a49a6-5f2b-5692-a1a2-27ebe5ca1227_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64038,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/f1/a9f10ebe41cd775023aa7cea3236430e/pa/TZ83605_18f900b8c354bac06c69c28bc9c5fa1d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b2a49a6-5f2b-5692-a1a2-27ebe5ca1227/4b2a49a6-5f2b-5692-a1a2-27ebe5ca1227_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3051891,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/f1/a9f10ebe41cd775023aa7cea3236430e/pa/TZ83605_18953367826cccc341695f99f2395d7b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b2a49a6-5f2b-5692-a1a2-27ebe5ca1227/4b2a49a6-5f2b-5692-a1a2-27ebe5ca1227_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51215,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/f1/a9f10ebe41cd775023aa7cea3236430e/pa/TZ83605_2f15c463774fb99cf81d3f3a2b471e2f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b2a49a6-5f2b-5692-a1a2-27ebe5ca1227/4b2a49a6-5f2b-5692-a1a2-27ebe5ca1227_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53523,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/f1/a9f10ebe41cd775023aa7cea3236430e/pa/TZ83605_b40f13a96d87cd9c21a8e4a73da8da76.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b2a49a6-5f2b-5692-a1a2-27ebe5ca1227/4b2a49a6-5f2b-5692-a1a2-27ebe5ca1227_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2912866,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/f1/a9f10ebe41cd775023aa7cea3236430e/pa/TZ83605_1c07b726026d2dd703fe883db828437b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b2a49a6-5f2b-5692-a1a2-27ebe5ca1227/4b2a49a6-5f2b-5692-a1a2-27ebe5ca1227_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58994,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/f1/a9f10ebe41cd775023aa7cea3236430e/pa/TZ83605_76c82433cd1c813d5c62b47a8b928c51.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b2a49a6-5f2b-5692-a1a2-27ebe5ca1227/4b2a49a6-5f2b-5692-a1a2-27ebe5ca1227_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71419,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/f1/a9f10ebe41cd775023aa7cea3236430e/pa/TZ83605_84d9c97303beb4f04c4fee49cbbdd92a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b2a49a6-5f2b-5692-a1a2-27ebe5ca1227/4b2a49a6-5f2b-5692-a1a2-27ebe5ca1227_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59161,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/f1/a9f10ebe41cd775023aa7cea3236430e/pa/TZ83605_cd1ff9fa7745c305a7e961497c9f55b5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b2a49a6-5f2b-5692-a1a2-27ebe5ca1227/4b2a49a6-5f2b-5692-a1a2-27ebe5ca1227_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3096032,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/f1/a9f10ebe41cd775023aa7cea3236430e/pa/TZ83605_8e3f6d0a40efb3b37a04199b87f6c5be.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b2a49a6-5f2b-5692-a1a2-27ebe5ca1227/4b2a49a6-5f2b-5692-a1a2-27ebe5ca1227_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3037473,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/f1/a9f10ebe41cd775023aa7cea3236430e/pa/TZ83605_dcd697b40eb3ef335afa8fed3dccda7b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b2a49a6-5f2b-5692-a1a2-27ebe5ca1227/4b2a49a6-5f2b-5692-a1a2-27ebe5ca1227_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2784741,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/f1/a9f10ebe41cd775023aa7cea3236430e/pa/TZ83605_c9bae7d4df8faeba9eeabaf28a7ccebf.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b2a49a6-5f2b-5692-a1a2-27ebe5ca1227/4b2a49a6-5f2b-5692-a1a2-27ebe5ca1227_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54756,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/f1/a9f10ebe41cd775023aa7cea3236430e/pa/TZ83605_6c269296fa158b1baa72afb30aff1445.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b2a49a6-5f2b-5692-a1a2-27ebe5ca1227/4b2a49a6-5f2b-5692-a1a2-27ebe5ca1227_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2807764,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/f1/a9f10ebe41cd775023aa7cea3236430e/pa/TZ83605_c85e5c4a04efbd2c2509cd1f4d511465.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b2a49a6-5f2b-5692-a1a2-27ebe5ca1227/4b2a49a6-5f2b-5692-a1a2-27ebe5ca1227_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57744,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/f1/a9f10ebe41cd775023aa7cea3236430e/pa/TZ83605_8fa0c4c04079d4bd883748a22ecd5541.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-10-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C5 Aircross 1.5 Blue-HDi Live',
 'transmission': 'manual',
 'trim': 'Live',
 'year': 2019}
2026-01-28 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TZ83605%27 HTTP/1.1" 200 None
2026-01-28 20:02:10 [auto1.it] INFO: Saving data for TZ83605: {'created_time': 1769630530.577822, 'last_price_update_time': 1769630530.577834, 'auction_closing_time': 1769704980.0}
2026-01-28 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TZ83605') HTTP/1.1" 204 0
2026-01-28 20:02:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:02:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09ea9810>
2026-01-28 20:02:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_051ddf36-eff8-5c80-8634-fb09358064b3/051ddf36-eff8-5c80-8634-fb09358064b3_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F4b%252Fdf4bfd14ecccad2e28acc7936a8ce0e3%252Fpa%252FWP90453_5b07f13bcb01c664301ec1a6275802a6.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/4b/df4bfd14ecccad2e28acc7936a8ce0e3/pa/WP90453_5b07f13bcb01c664301ec1a6275802a6.jpg saved to cache
2026-01-28 20:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 051ddf36-eff8-5c80-8634-fb09358064b3
2026-01-28 20:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F40%252Fb640deb920d25bfcde69628b9f380427%252Fpa%252FAF71631_f6ff9be0dcb50739d2badd89e4e95808.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/40/b640deb920d25bfcde69628b9f380427/pa/AF71631_f6ff9be0dcb50739d2badd89e4e95808.jpg not downloaded yet
2026-01-28 20:02:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:02:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WA67831/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:02:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UH29837/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:02:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JE97171/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:02:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/40/b640deb920d25bfcde69628b9f380427/pa/AF71631_6f4a6a966d9a00028b24678f38c2959f.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:02:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KX95898/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:02:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0a06b950>
2026-01-28 20:02:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab2b9426-2a4e-5843-bea9-eeabb5e12b74/ab2b9426-2a4e-5843-bea9-eeabb5e12b74_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F02%252F0902ecd716da7e9c1590d287d6183135%252Fpa%252FBS57464_f1460c21492cd74c610c7d629e277945.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/02/0902ecd716da7e9c1590d287d6183135/pa/BS57464_f1460c21492cd74c610c7d629e277945.jpg saved to cache
2026-01-28 20:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item ab2b9426-2a4e-5843-bea9-eeabb5e12b74
2026-01-28 20:02:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09ddc350>
2026-01-28 20:02:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_42f57244-9ce1-548c-80f9-ba4fc624de0c/42f57244-9ce1-548c-80f9-ba4fc624de0c_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F88%252Fa9886c8c428fd9ace2871b067ea0c3ef%252Fpa%252FFP41040_9068be76c77a0a4645361fc7d795c3f3.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/88/a9886c8c428fd9ace2871b067ea0c3ef/pa/FP41040_9068be76c77a0a4645361fc7d795c3f3.jpg saved to cache
2026-01-28 20:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 42f57244-9ce1-548c-80f9-ba4fc624de0c
2026-01-28 20:02:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09f0ed90>
2026-01-28 20:02:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_42f57244-9ce1-548c-80f9-ba4fc624de0c/42f57244-9ce1-548c-80f9-ba4fc624de0c_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F88%252Fa9886c8c428fd9ace2871b067ea0c3ef%252Fpa%252FFP41040_68d92b776a58a3e4fc5227a814ce03f7.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/88/a9886c8c428fd9ace2871b067ea0c3ef/pa/FP41040_68d92b776a58a3e4fc5227a814ce03f7.jpg saved to cache
2026-01-28 20:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 42f57244-9ce1-548c-80f9-ba4fc624de0c
2026-01-28 20:02:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09d42090>
2026-01-28 20:02:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_42f57244-9ce1-548c-80f9-ba4fc624de0c/42f57244-9ce1-548c-80f9-ba4fc624de0c_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F88%252Fa9886c8c428fd9ace2871b067ea0c3ef%252Fpa%252FFP41040_94b77a43da9ebe9f8012e9409d492402.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/88/a9886c8c428fd9ace2871b067ea0c3ef/pa/FP41040_94b77a43da9ebe9f8012e9409d492402.jpg saved to cache
2026-01-28 20:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 42f57244-9ce1-548c-80f9-ba4fc624de0c
2026-01-28 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F40%252Fb640deb920d25bfcde69628b9f380427%252Fpa%252FAF71631_613919c7c75a50de809a16881b525fa3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/40/b640deb920d25bfcde69628b9f380427/pa/AF71631_613919c7c75a50de809a16881b525fa3.jpg not downloaded yet
2026-01-28 20:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/4b/df4bfd14ecccad2e28acc7936a8ce0e3/pa/WP90453_a5aae7f7740956d281e94fcbe9f7cb97.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F40%252Fb640deb920d25bfcde69628b9f380427%252Fpa%252FAF71631_daecdcaab866b8994f5c4492e1482eb5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/40/b640deb920d25bfcde69628b9f380427/pa/AF71631_daecdcaab866b8994f5c4492e1482eb5.jpg not downloaded yet
2026-01-28 20:02:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:02:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:02:12 [auto1.it] INFO: Parsing search results for channel: 24h
2026-01-28 20:02:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09e45590>
2026-01-28 20:02:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1dbd296c-a17f-5065-a78b-e19b5947bbd4/1dbd296c-a17f-5065-a78b-e19b5947bbd4_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F40%252Fb640deb920d25bfcde69628b9f380427%252Fpa%252FAF71631_6f4a6a966d9a00028b24678f38c2959f.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/40/b640deb920d25bfcde69628b9f380427/pa/AF71631_6f4a6a966d9a00028b24678f38c2959f.jpg saved to cache
2026-01-28 20:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1dbd296c-a17f-5065-a78b-e19b5947bbd4
2026-01-28 20:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/88/a9886c8c428fd9ace2871b067ea0c3ef/pa/FP41040_75273429baf6089aea1e0b5c6284c9a2.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F40%252Fb640deb920d25bfcde69628b9f380427%252Fpa%252FAF71631_3c1fa7194c9bb1a561663d6f39d6db97.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/40/b640deb920d25bfcde69628b9f380427/pa/AF71631_3c1fa7194c9bb1a561663d6f39d6db97.jpg not downloaded yet
2026-01-28 20:02:12 [auto1.it] INFO: Found listing with ID: LX29596
2026-01-28 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LX29596%27 HTTP/1.1" 200 None
2026-01-28 20:02:12 [auto1.it] INFO: Scrape type for LX29596: 0
2026-01-28 20:02:12 [auto1.it] INFO: Found listing with ID: YL06979
2026-01-28 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YL06979%27 HTTP/1.1" 200 None
2026-01-28 20:02:12 [auto1.it] INFO: Scrape type for YL06979: 2
2026-01-28 20:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/02/0902ecd716da7e9c1590d287d6183135/pa/BS57464_ec60430e4516f5cc54b2f908b8073105.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:02:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:02:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09e49790>
2026-01-28 20:02:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_051ddf36-eff8-5c80-8634-fb09358064b3/051ddf36-eff8-5c80-8634-fb09358064b3_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F4b%252Fdf4bfd14ecccad2e28acc7936a8ce0e3%252Fpa%252FWP90453_a5aae7f7740956d281e94fcbe9f7cb97.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/4b/df4bfd14ecccad2e28acc7936a8ce0e3/pa/WP90453_a5aae7f7740956d281e94fcbe9f7cb97.jpg saved to cache
2026-01-28 20:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 051ddf36-eff8-5c80-8634-fb09358064b3
2026-01-28 20:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/40/b640deb920d25bfcde69628b9f380427/pa/AF71631_ad2f33ebf3dd81b80d5531684fb257a4.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/40/b640deb920d25bfcde69628b9f380427/pa/AF71631_789a79cd160abdffd659e7674cdbff08.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/40/b640deb920d25bfcde69628b9f380427/pa/AF71631_613919c7c75a50de809a16881b525fa3.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F40%252Fb640deb920d25bfcde69628b9f380427%252Fpa%252FAF71631_4ffe003e9f7ce04a426902e0ff423d01.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/40/b640deb920d25bfcde69628b9f380427/pa/AF71631_4ffe003e9f7ce04a426902e0ff423d01.jpg not downloaded yet
2026-01-28 20:02:13 [auto1.it] INFO: Found listing with ID: SL26814
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SL26814%27 HTTP/1.1" 200 None
2026-01-28 20:02:13 [auto1.it] INFO: Scrape type for SL26814: 0
2026-01-28 20:02:13 [auto1.it] INFO: Found listing with ID: ES54295
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ES54295%27 HTTP/1.1" 200 None
2026-01-28 20:02:13 [auto1.it] INFO: Scrape type for ES54295: 2
2026-01-28 20:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/88/a9886c8c428fd9ace2871b067ea0c3ef/pa/FP41040_067a155e5189a89b3b484b00785c924f.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/40/b640deb920d25bfcde69628b9f380427/pa/AF71631_f6ff9be0dcb50739d2badd89e4e95808.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/40/b640deb920d25bfcde69628b9f380427/pa/AF71631_203a6d0e1f390e2faf5f440a2fd58518.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F40%252Fb640deb920d25bfcde69628b9f380427%252Fpa%252FAF71631_fa7c18acebead8b2ae5fbb510225e452.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/40/b640deb920d25bfcde69628b9f380427/pa/AF71631_fa7c18acebead8b2ae5fbb510225e452.jpg not downloaded yet
2026-01-28 20:02:13 [auto1.it] INFO: Found listing with ID: FR59611
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FR59611%27 HTTP/1.1" 200 None
2026-01-28 20:02:13 [auto1.it] INFO: Scrape type for FR59611: 0
2026-01-28 20:02:13 [auto1.it] INFO: Found listing with ID: WV97974
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WV97974%27 HTTP/1.1" 200 None
2026-01-28 20:02:13 [auto1.it] INFO: Scrape type for WV97974: 0
2026-01-28 20:02:13 [auto1.it] INFO: Found listing with ID: NF00160
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NF00160%27 HTTP/1.1" 200 None
2026-01-28 20:02:13 [auto1.it] INFO: Scrape type for NF00160: 1
2026-01-28 20:02:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0c1422d0>
2026-01-28 20:02:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_42f57244-9ce1-548c-80f9-ba4fc624de0c/42f57244-9ce1-548c-80f9-ba4fc624de0c_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F88%252Fa9886c8c428fd9ace2871b067ea0c3ef%252Fpa%252FFP41040_75273429baf6089aea1e0b5c6284c9a2.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/88/a9886c8c428fd9ace2871b067ea0c3ef/pa/FP41040_75273429baf6089aea1e0b5c6284c9a2.jpg saved to cache
2026-01-28 20:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 42f57244-9ce1-548c-80f9-ba4fc624de0c
2026-01-28 20:02:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b086e1910>
2026-01-28 20:02:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab2b9426-2a4e-5843-bea9-eeabb5e12b74/ab2b9426-2a4e-5843-bea9-eeabb5e12b74_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F02%252F0902ecd716da7e9c1590d287d6183135%252Fpa%252FBS57464_ec60430e4516f5cc54b2f908b8073105.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/02/0902ecd716da7e9c1590d287d6183135/pa/BS57464_ec60430e4516f5cc54b2f908b8073105.jpg saved to cache
2026-01-28 20:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ab2b9426-2a4e-5843-bea9-eeabb5e12b74
2026-01-28 20:02:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/40/b640deb920d25bfcde69628b9f380427/pa/AF71631_1a046115a9822abe1830f99d6879165f.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:02:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/40/b640deb920d25bfcde69628b9f380427/pa/AF71631_a7be777bb02f79f8c44592329fce7ebd.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:02:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/40/b640deb920d25bfcde69628b9f380427/pa/AF71631_74cecfbee667c702fea0aab274fc1f65.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:02:14 [auto1.it] INFO: Found listing with ID: NF51505
2026-01-28 20:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NF51505%27 HTTP/1.1" 200 None
2026-01-28 20:02:14 [auto1.it] INFO: Scrape type for NF51505: 2
2026-01-28 20:02:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/40/b640deb920d25bfcde69628b9f380427/pa/AF71631_0791efe8bd3790fe0bfd4895096adcff.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:02:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/40/b640deb920d25bfcde69628b9f380427/pa/AF71631_8957772f02e7eabde5eb99b47f2c3eee.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:02:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:02:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:02:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:02:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:02:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:02:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:02:14 [auto1.it] INFO: Found listing with ID: SS94947
2026-01-28 20:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SS94947%27 HTTP/1.1" 200 None
2026-01-28 20:02:14 [auto1.it] INFO: Scrape type for SS94947: 2
2026-01-28 20:02:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0a0c0110>
2026-01-28 20:02:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1dbd296c-a17f-5065-a78b-e19b5947bbd4/1dbd296c-a17f-5065-a78b-e19b5947bbd4_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F40%252Fb640deb920d25bfcde69628b9f380427%252Fpa%252FAF71631_ad2f33ebf3dd81b80d5531684fb257a4.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/40/b640deb920d25bfcde69628b9f380427/pa/AF71631_ad2f33ebf3dd81b80d5531684fb257a4.jpg saved to cache
2026-01-28 20:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1dbd296c-a17f-5065-a78b-e19b5947bbd4
2026-01-28 20:02:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08c3a350>
2026-01-28 20:02:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1dbd296c-a17f-5065-a78b-e19b5947bbd4/1dbd296c-a17f-5065-a78b-e19b5947bbd4_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F40%252Fb640deb920d25bfcde69628b9f380427%252Fpa%252FAF71631_789a79cd160abdffd659e7674cdbff08.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/40/b640deb920d25bfcde69628b9f380427/pa/AF71631_789a79cd160abdffd659e7674cdbff08.jpg saved to cache
2026-01-28 20:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1dbd296c-a17f-5065-a78b-e19b5947bbd4
2026-01-28 20:02:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09e1ba90>
2026-01-28 20:02:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1dbd296c-a17f-5065-a78b-e19b5947bbd4/1dbd296c-a17f-5065-a78b-e19b5947bbd4_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F40%252Fb640deb920d25bfcde69628b9f380427%252Fpa%252FAF71631_613919c7c75a50de809a16881b525fa3.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/40/b640deb920d25bfcde69628b9f380427/pa/AF71631_613919c7c75a50de809a16881b525fa3.jpg saved to cache
2026-01-28 20:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 1dbd296c-a17f-5065-a78b-e19b5947bbd4
2026-01-28 20:02:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:02:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b086e53d0>
2026-01-28 20:02:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_42f57244-9ce1-548c-80f9-ba4fc624de0c/42f57244-9ce1-548c-80f9-ba4fc624de0c_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F88%252Fa9886c8c428fd9ace2871b067ea0c3ef%252Fpa%252FFP41040_067a155e5189a89b3b484b00785c924f.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/88/a9886c8c428fd9ace2871b067ea0c3ef/pa/FP41040_067a155e5189a89b3b484b00785c924f.jpg saved to cache
2026-01-28 20:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 42f57244-9ce1-548c-80f9-ba4fc624de0c
2026-01-28 20:02:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09d08110>
2026-01-28 20:02:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1dbd296c-a17f-5065-a78b-e19b5947bbd4/1dbd296c-a17f-5065-a78b-e19b5947bbd4_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F40%252Fb640deb920d25bfcde69628b9f380427%252Fpa%252FAF71631_f6ff9be0dcb50739d2badd89e4e95808.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/40/b640deb920d25bfcde69628b9f380427/pa/AF71631_f6ff9be0dcb50739d2badd89e4e95808.jpg saved to cache
2026-01-28 20:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1dbd296c-a17f-5065-a78b-e19b5947bbd4
2026-01-28 20:02:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0a07d650>
2026-01-28 20:02:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1dbd296c-a17f-5065-a78b-e19b5947bbd4/1dbd296c-a17f-5065-a78b-e19b5947bbd4_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F40%252Fb640deb920d25bfcde69628b9f380427%252Fpa%252FAF71631_203a6d0e1f390e2faf5f440a2fd58518.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/40/b640deb920d25bfcde69628b9f380427/pa/AF71631_203a6d0e1f390e2faf5f440a2fd58518.jpg saved to cache
2026-01-28 20:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1dbd296c-a17f-5065-a78b-e19b5947bbd4
2026-01-28 20:02:15 [auto1.it] INFO: Found listing with ID: RJ83517
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RJ83517%27 HTTP/1.1" 200 None
2026-01-28 20:02:15 [auto1.it] INFO: Scrape type for RJ83517: 0
2026-01-28 20:02:15 [auto1.it] INFO: Found listing with ID: NR13454
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NR13454%27 HTTP/1.1" 200 None
2026-01-28 20:02:15 [auto1.it] INFO: Scrape type for NR13454: 0
2026-01-28 20:02:15 [auto1.it] INFO: Found listing with ID: RV64842
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RV64842%27 HTTP/1.1" 200 None
2026-01-28 20:02:15 [auto1.it] INFO: Scrape type for RV64842: 2
2026-01-28 20:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/40/b640deb920d25bfcde69628b9f380427/pa/AF71631_daecdcaab866b8994f5c4492e1482eb5.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:02:15 [auto1.it] INFO: Found listing with ID: EA68503
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EA68503%27 HTTP/1.1" 200 None
2026-01-28 20:02:15 [auto1.it] INFO: Scrape type for EA68503: 0
2026-01-28 20:02:15 [auto1.it] INFO: Found listing with ID: AF06947
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AF06947%27 HTTP/1.1" 200 None
2026-01-28 20:02:15 [auto1.it] INFO: Scrape type for AF06947: 0
2026-01-28 20:02:15 [auto1.it] INFO: Found listing with ID: WM90697
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WM90697%27 HTTP/1.1" 200 None
2026-01-28 20:02:15 [auto1.it] INFO: Scrape type for WM90697: 0
2026-01-28 20:02:15 [auto1.it] INFO: Found listing with ID: LY72233
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LY72233%27 HTTP/1.1" 200 None
2026-01-28 20:02:15 [auto1.it] INFO: Scrape type for LY72233: 0
2026-01-28 20:02:15 [auto1.it] INFO: Found listing with ID: PJ38306
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PJ38306%27 HTTP/1.1" 200 None
2026-01-28 20:02:15 [auto1.it] INFO: Scrape type for PJ38306: 0
2026-01-28 20:02:15 [auto1.it] INFO: Found listing with ID: DA91703
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DA91703%27 HTTP/1.1" 200 None
2026-01-28 20:02:15 [auto1.it] INFO: Scrape type for DA91703: 0
2026-01-28 20:02:15 [auto1.it] INFO: Found listing with ID: HH00112
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HH00112%27 HTTP/1.1" 200 None
2026-01-28 20:02:15 [auto1.it] INFO: Scrape type for HH00112: 0
2026-01-28 20:02:15 [auto1.it] INFO: Found listing with ID: ZA06304
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZA06304%27 HTTP/1.1" 200 None
2026-01-28 20:02:15 [auto1.it] INFO: Scrape type for ZA06304: 0
2026-01-28 20:02:15 [auto1.it] INFO: Found listing with ID: ZA57365
2026-01-28 20:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZA57365%27 HTTP/1.1" 200 None
2026-01-28 20:02:16 [auto1.it] INFO: Scrape type for ZA57365: 0
2026-01-28 20:02:16 [auto1.it] INFO: Found listing with ID: XR33042
2026-01-28 20:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XR33042%27 HTTP/1.1" 200 None
2026-01-28 20:02:16 [auto1.it] INFO: Scrape type for XR33042: 0
2026-01-28 20:02:16 [auto1.it] INFO: Found listing with ID: KK65649
2026-01-28 20:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KK65649%27 HTTP/1.1" 200 None
2026-01-28 20:02:16 [auto1.it] INFO: Scrape type for KK65649: 0
2026-01-28 20:02:16 [auto1.it] INFO: Found listing with ID: DC19441
2026-01-28 20:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DC19441%27 HTTP/1.1" 200 None
2026-01-28 20:02:16 [auto1.it] INFO: Scrape type for DC19441: 0
2026-01-28 20:02:16 [auto1.it] INFO: Found listing with ID: EC80373
2026-01-28 20:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EC80373%27 HTTP/1.1" 200 None
2026-01-28 20:02:16 [auto1.it] INFO: Scrape type for EC80373: 1
2026-01-28 20:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/40/b640deb920d25bfcde69628b9f380427/pa/AF71631_3c1fa7194c9bb1a561663d6f39d6db97.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:02:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09fb5d10>
2026-01-28 20:02:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1dbd296c-a17f-5065-a78b-e19b5947bbd4/1dbd296c-a17f-5065-a78b-e19b5947bbd4_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F40%252Fb640deb920d25bfcde69628b9f380427%252Fpa%252FAF71631_1a046115a9822abe1830f99d6879165f.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/40/b640deb920d25bfcde69628b9f380427/pa/AF71631_1a046115a9822abe1830f99d6879165f.jpg saved to cache
2026-01-28 20:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1dbd296c-a17f-5065-a78b-e19b5947bbd4
2026-01-28 20:02:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b086a4a90>
2026-01-28 20:02:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1dbd296c-a17f-5065-a78b-e19b5947bbd4/1dbd296c-a17f-5065-a78b-e19b5947bbd4_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F40%252Fb640deb920d25bfcde69628b9f380427%252Fpa%252FAF71631_a7be777bb02f79f8c44592329fce7ebd.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/40/b640deb920d25bfcde69628b9f380427/pa/AF71631_a7be777bb02f79f8c44592329fce7ebd.jpg saved to cache
2026-01-28 20:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1dbd296c-a17f-5065-a78b-e19b5947bbd4
2026-01-28 20:02:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08707ed0>
2026-01-28 20:02:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1dbd296c-a17f-5065-a78b-e19b5947bbd4/1dbd296c-a17f-5065-a78b-e19b5947bbd4_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F40%252Fb640deb920d25bfcde69628b9f380427%252Fpa%252FAF71631_74cecfbee667c702fea0aab274fc1f65.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/40/b640deb920d25bfcde69628b9f380427/pa/AF71631_74cecfbee667c702fea0aab274fc1f65.jpg saved to cache
2026-01-28 20:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1dbd296c-a17f-5065-a78b-e19b5947bbd4
2026-01-28 20:02:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08c38d90>
2026-01-28 20:02:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1dbd296c-a17f-5065-a78b-e19b5947bbd4/1dbd296c-a17f-5065-a78b-e19b5947bbd4_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F40%252Fb640deb920d25bfcde69628b9f380427%252Fpa%252FAF71631_0791efe8bd3790fe0bfd4895096adcff.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/40/b640deb920d25bfcde69628b9f380427/pa/AF71631_0791efe8bd3790fe0bfd4895096adcff.jpg saved to cache
2026-01-28 20:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1dbd296c-a17f-5065-a78b-e19b5947bbd4
2026-01-28 20:02:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08950910>
2026-01-28 20:02:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1dbd296c-a17f-5065-a78b-e19b5947bbd4/1dbd296c-a17f-5065-a78b-e19b5947bbd4_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F40%252Fb640deb920d25bfcde69628b9f380427%252Fpa%252FAF71631_8957772f02e7eabde5eb99b47f2c3eee.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/40/b640deb920d25bfcde69628b9f380427/pa/AF71631_8957772f02e7eabde5eb99b47f2c3eee.jpg saved to cache
2026-01-28 20:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1dbd296c-a17f-5065-a78b-e19b5947bbd4
2026-01-28 20:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/40/b640deb920d25bfcde69628b9f380427/pa/AF71631_4ffe003e9f7ce04a426902e0ff423d01.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/40/b640deb920d25bfcde69628b9f380427/pa/AF71631_fa7c18acebead8b2ae5fbb510225e452.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:02:17 [auto1.it] INFO: Found listing with ID: CM86326
2026-01-28 20:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CM86326%27 HTTP/1.1" 200 None
2026-01-28 20:02:17 [auto1.it] INFO: Scrape type for CM86326: 0
2026-01-28 20:02:17 [auto1.it] INFO: Found listing with ID: WZ33226
2026-01-28 20:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WZ33226%27 HTTP/1.1" 200 None
2026-01-28 20:02:17 [auto1.it] INFO: Scrape type for WZ33226: 2
2026-01-28 20:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/88/a9886c8c428fd9ace2871b067ea0c3ef/pa/FP41040_ff78557f924ba202ac80175ad01f9872.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XK25205> (referer: https://www.auto1.com/v1/car-details-view/XK25205/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:02:17 [auto1.it] INFO: Found listing with ID: HY00654
2026-01-28 20:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HY00654%27 HTTP/1.1" 200 None
2026-01-28 20:02:17 [auto1.it] INFO: Scrape type for HY00654: 2
2026-01-28 20:02:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:02:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08938290>
2026-01-28 20:02:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1dbd296c-a17f-5065-a78b-e19b5947bbd4/1dbd296c-a17f-5065-a78b-e19b5947bbd4_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F40%252Fb640deb920d25bfcde69628b9f380427%252Fpa%252FAF71631_daecdcaab866b8994f5c4492e1482eb5.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/40/b640deb920d25bfcde69628b9f380427/pa/AF71631_daecdcaab866b8994f5c4492e1482eb5.jpg saved to cache
2026-01-28 20:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 1dbd296c-a17f-5065-a78b-e19b5947bbd4
2026-01-28 20:02:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09d817d0>
2026-01-28 20:02:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1dbd296c-a17f-5065-a78b-e19b5947bbd4/1dbd296c-a17f-5065-a78b-e19b5947bbd4_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F40%252Fb640deb920d25bfcde69628b9f380427%252Fpa%252FAF71631_3c1fa7194c9bb1a561663d6f39d6db97.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/40/b640deb920d25bfcde69628b9f380427/pa/AF71631_3c1fa7194c9bb1a561663d6f39d6db97.jpg saved to cache
2026-01-28 20:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 1dbd296c-a17f-5065-a78b-e19b5947bbd4
2026-01-28 20:02:18 [auto1.it] INFO: Found listing with ID: UD94632
2026-01-28 20:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UD94632%27 HTTP/1.1" 200 None
2026-01-28 20:02:18 [auto1.it] INFO: Scrape type for UD94632: 2
2026-01-28 20:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ES54295/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YL06979/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NF00160/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:02:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08c291d0>
2026-01-28 20:02:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1dbd296c-a17f-5065-a78b-e19b5947bbd4/1dbd296c-a17f-5065-a78b-e19b5947bbd4_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F40%252Fb640deb920d25bfcde69628b9f380427%252Fpa%252FAF71631_4ffe003e9f7ce04a426902e0ff423d01.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/40/b640deb920d25bfcde69628b9f380427/pa/AF71631_4ffe003e9f7ce04a426902e0ff423d01.jpg saved to cache
2026-01-28 20:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 1dbd296c-a17f-5065-a78b-e19b5947bbd4
2026-01-28 20:02:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08cd6910>
2026-01-28 20:02:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1dbd296c-a17f-5065-a78b-e19b5947bbd4/1dbd296c-a17f-5065-a78b-e19b5947bbd4_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F40%252Fb640deb920d25bfcde69628b9f380427%252Fpa%252FAF71631_fa7c18acebead8b2ae5fbb510225e452.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/40/b640deb920d25bfcde69628b9f380427/pa/AF71631_fa7c18acebead8b2ae5fbb510225e452.jpg saved to cache
2026-01-28 20:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 1dbd296c-a17f-5065-a78b-e19b5947bbd4
2026-01-28 20:02:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1dbd296c-a17f-5065-a78b-e19b5947bbd4, skipping ID generation
2026-01-28 20:02:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1dbd296c-a17f-5065-a78b-e19b5947bbd4 with scrape type 1
2026-01-28 20:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 1dbd296c-a17f-5065-a78b-e19b5947bbd4 from tracking dictionaries
2026-01-28 20:02:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1dbd296c-a17f-5065-a78b-e19b5947bbd4 sending to next pipeline
2026-01-28 20:02:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1dbd296c-a17f-5065-a78b-e19b5947bbd4, identifier: AF71631
2026-01-28 20:02:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0f644bd0>
2026-01-28 20:02:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:02:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_42f57244-9ce1-548c-80f9-ba4fc624de0c/42f57244-9ce1-548c-80f9-ba4fc624de0c_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F88%252Fa9886c8c428fd9ace2871b067ea0c3ef%252Fpa%252FFP41040_ff78557f924ba202ac80175ad01f9872.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/88/a9886c8c428fd9ace2871b067ea0c3ef/pa/FP41040_ff78557f924ba202ac80175ad01f9872.jpg saved to cache
2026-01-28 20:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 42f57244-9ce1-548c-80f9-ba4fc624de0c
2026-01-28 20:02:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 83430ec7-dc90-56fc-8fb1-238a9db862c2 with identifier: XK25205
2026-01-28 20:02:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 83430ec7-dc90-56fc-8fb1-238a9db862c2 with scrape type 2
2026-01-28 20:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 83430ec7-dc90-56fc-8fb1-238a9db862c2 with scrape type 2
2026-01-28 20:02:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 83430ec7-dc90-56fc-8fb1-238a9db862c2, identifier: XK25205
2026-01-28 20:02:19 [auto1.it] INFO: Found listing with ID: YJ30752
2026-01-28 20:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YJ30752%27 HTTP/1.1" 200 None
2026-01-28 20:02:19 [auto1.it] INFO: Scrape type for YJ30752: 2
2026-01-28 20:02:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:02:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:02:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:02:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1dbd296c-a17f-5065-a78b-e19b5947bbd4 with identifier: AF71631
2026-01-28 20:02:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-28 20:02:19 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=electro HTTP/1.1" 200 None
2026-01-28 20:02:20 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-28 20:02:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1dbd296c-a17f-5065-a78b-e19b5947bbd4 with identifier: AF71631
2026-01-28 20:02:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1dbd296c-a17f-5065-a78b-e19b5947bbd4 with identifier: AF71631 to the API
2026-01-28 20:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:02:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:02:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb6/40/b640deb920d25bfcde69628b9f380427/pa/AF71631_fa7c18acebead8b2ae5fbb510225e452.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'engine_horse_power': 299,
 'expiration_date': '2026-01-29T16:35:02Z',
 'fuel_type': 'electro',
 'id': '1dbd296c-a17f-5065-a78b-e19b5947bbd4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AF71631',
 'listing': 'auction',
 'location': 'IT, Padova',
 'make': 'Tesla',
 'model': 'Model Y',
 'odometer': 27147,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1dbd296c-a17f-5065-a78b-e19b5947bbd4/1dbd296c-a17f-5065-a78b-e19b5947bbd4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74064,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/40/b640deb920d25bfcde69628b9f380427/pa/AF71631_8957772f02e7eabde5eb99b47f2c3eee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1dbd296c-a17f-5065-a78b-e19b5947bbd4/1dbd296c-a17f-5065-a78b-e19b5947bbd4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73829,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/40/b640deb920d25bfcde69628b9f380427/pa/AF71631_6f4a6a966d9a00028b24678f38c2959f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1dbd296c-a17f-5065-a78b-e19b5947bbd4/1dbd296c-a17f-5065-a78b-e19b5947bbd4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74297,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/40/b640deb920d25bfcde69628b9f380427/pa/AF71631_0791efe8bd3790fe0bfd4895096adcff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1dbd296c-a17f-5065-a78b-e19b5947bbd4/1dbd296c-a17f-5065-a78b-e19b5947bbd4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61887,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/40/b640deb920d25bfcde69628b9f380427/pa/AF71631_74cecfbee667c702fea0aab274fc1f65.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1dbd296c-a17f-5065-a78b-e19b5947bbd4/1dbd296c-a17f-5065-a78b-e19b5947bbd4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60777,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/40/b640deb920d25bfcde69628b9f380427/pa/AF71631_a7be777bb02f79f8c44592329fce7ebd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1dbd296c-a17f-5065-a78b-e19b5947bbd4/1dbd296c-a17f-5065-a78b-e19b5947bbd4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72252,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/40/b640deb920d25bfcde69628b9f380427/pa/AF71631_1a046115a9822abe1830f99d6879165f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1dbd296c-a17f-5065-a78b-e19b5947bbd4/1dbd296c-a17f-5065-a78b-e19b5947bbd4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61833,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/40/b640deb920d25bfcde69628b9f380427/pa/AF71631_789a79cd160abdffd659e7674cdbff08.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1dbd296c-a17f-5065-a78b-e19b5947bbd4/1dbd296c-a17f-5065-a78b-e19b5947bbd4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71837,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/40/b640deb920d25bfcde69628b9f380427/pa/AF71631_203a6d0e1f390e2faf5f440a2fd58518.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1dbd296c-a17f-5065-a78b-e19b5947bbd4/1dbd296c-a17f-5065-a78b-e19b5947bbd4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61950,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/40/b640deb920d25bfcde69628b9f380427/pa/AF71631_ad2f33ebf3dd81b80d5531684fb257a4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1dbd296c-a17f-5065-a78b-e19b5947bbd4/1dbd296c-a17f-5065-a78b-e19b5947bbd4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46428,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/40/b640deb920d25bfcde69628b9f380427/pa/AF71631_f6ff9be0dcb50739d2badd89e4e95808.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1dbd296c-a17f-5065-a78b-e19b5947bbd4/1dbd296c-a17f-5065-a78b-e19b5947bbd4_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52637,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/40/b640deb920d25bfcde69628b9f380427/pa/AF71631_613919c7c75a50de809a16881b525fa3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1dbd296c-a17f-5065-a78b-e19b5947bbd4/1dbd296c-a17f-5065-a78b-e19b5947bbd4_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57528,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/40/b640deb920d25bfcde69628b9f380427/pa/AF71631_daecdcaab866b8994f5c4492e1482eb5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1dbd296c-a17f-5065-a78b-e19b5947bbd4/1dbd296c-a17f-5065-a78b-e19b5947bbd4_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77490,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/40/b640deb920d25bfcde69628b9f380427/pa/AF71631_3c1fa7194c9bb1a561663d6f39d6db97.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1dbd296c-a17f-5065-a78b-e19b5947bbd4/1dbd296c-a17f-5065-a78b-e19b5947bbd4_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42850,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/40/b640deb920d25bfcde69628b9f380427/pa/AF71631_4ffe003e9f7ce04a426902e0ff423d01.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1dbd296c-a17f-5065-a78b-e19b5947bbd4/1dbd296c-a17f-5065-a78b-e19b5947bbd4_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64594,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/40/b640deb920d25bfcde69628b9f380427/pa/AF71631_fa7c18acebead8b2ae5fbb510225e452.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-06-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Tesla Model Y Standard Range',
 'transmission': 'automatic',
 'trim': '',
 'year': 2024}
2026-01-28 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AF71631%27 HTTP/1.1" 200 None
2026-01-28 20:02:20 [auto1.it] INFO: Saving data for AF71631: {'created_time': 1769630540.420624, 'last_price_update_time': 1769630540.420634, 'auction_closing_time': 1769704502.0}
2026-01-28 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AF71631') HTTP/1.1" 204 0
2026-01-28 20:02:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 83430ec7-dc90-56fc-8fb1-238a9db862c2 with identifier: XK25205
2026-01-28 20:02:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 83430ec7-dc90-56fc-8fb1-238a9db862c2 with identifier: XK25205
2026-01-28 20:02:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 83430ec7-dc90-56fc-8fb1-238a9db862c2 with identifier: XK25205 to the API
2026-01-28 20:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:02:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:02:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XK25205>
{'auction_title': '',
 'c_o_2_emission_value': 43,
 'category': None,
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.5L',
 'engine_horse_power': 225,
 'expiration_date': '2026-01-29T16:08:01Z',
 'fuel_type': 'hybrid',
 'id': '83430ec7-dc90-56fc-8fb1-238a9db862c2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XK25205',
 'listing': 'auction',
 'location': 'IT, Milano',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 100243,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-07-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI Countryman Cooper S E Hybrid ALL4',
 'transmission': 'automatic',
 'trim': 'ALL4',
 'year': 2020}
2026-01-28 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XK25205%27 HTTP/1.1" 200 None
2026-01-28 20:02:20 [auto1.it] INFO: Saving data for XK25205: {'auction_closing_time': 1769702881.0, 'created_time': 1769544044.037479, 'last_price_update_time': 1769630540.877152}
2026-01-28 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XK25205') HTTP/1.1" 204 0
2026-01-28 20:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BM05081> (referer: https://www.auto1.com/v1/car-details-view/BM05081/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KX95898> (referer: https://www.auto1.com/v1/car-details-view/KX95898/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:02:20 [auto1.it] INFO: Found listing with ID: ZD98375
2026-01-28 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZD98375%27 HTTP/1.1" 200 None
2026-01-28 20:02:20 [auto1.it] INFO: Scrape type for ZD98375: 2
2026-01-28 20:02:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:02:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UH29837> (referer: https://www.auto1.com/v1/car-details-view/UH29837/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JE97171> (referer: https://www.auto1.com/v1/car-details-view/JE97171/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:02:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:02:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:02:20 [auto1.it] INFO: Found listing with ID: YH36098
2026-01-28 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YH36098%27 HTTP/1.1" 200 None
2026-01-28 20:02:20 [auto1.it] INFO: Scrape type for YH36098: 2
2026-01-28 20:02:20 [auto1.it] INFO: Found listing with ID: EZ33602
2026-01-28 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EZ33602%27 HTTP/1.1" 200 None
2026-01-28 20:02:21 [auto1.it] INFO: Scrape type for EZ33602: 2
2026-01-28 20:02:21 [auto1.it] INFO: Found listing with ID: EA92626
2026-01-28 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EA92626%27 HTTP/1.1" 200 None
2026-01-28 20:02:21 [auto1.it] INFO: Scrape type for EA92626: 2
2026-01-28 20:02:21 [auto1.it] INFO: Found listing with ID: MP18514
2026-01-28 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MP18514%27 HTTP/1.1" 200 None
2026-01-28 20:02:21 [auto1.it] INFO: Scrape type for MP18514: 2
2026-01-28 20:02:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 952ac053-e29b-5def-9dce-861a2bf03e69 with identifier: BM05081
2026-01-28 20:02:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 952ac053-e29b-5def-9dce-861a2bf03e69 with scrape type 1
2026-01-28 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 13 photos for item 952ac053-e29b-5def-9dce-861a2bf03e69
2026-01-28 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F1c%252Fe21cfb98a73e65a314352c3a1ce5c145%252Fpa%252FBM05081_1f8ff955862e0330c0cd6126a93e977f.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/1c/e21cfb98a73e65a314352c3a1ce5c145/pa/BM05081_1f8ff955862e0330c0cd6126a93e977f.jpg not downloaded yet
2026-01-28 20:02:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8f04c0b-f98d-50df-a365-6ef5b27ef7fc with identifier: KX95898
2026-01-28 20:02:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8f04c0b-f98d-50df-a365-6ef5b27ef7fc with scrape type 1
2026-01-28 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item d8f04c0b-f98d-50df-a365-6ef5b27ef7fc
2026-01-28 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F0b%252F2c0bb7ccc201057468358464a15bb096%252Fpa%252FKX95898_846fd19f770610642df44b62d04776d8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/0b/2c0bb7ccc201057468358464a15bb096/pa/KX95898_846fd19f770610642df44b62d04776d8.jpg not downloaded yet
2026-01-28 20:02:21 [auto1.it] INFO: Found listing with ID: CC90346
2026-01-28 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CC90346%27 HTTP/1.1" 200 None
2026-01-28 20:02:21 [auto1.it] INFO: Scrape type for CC90346: 2
2026-01-28 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F1c%252Fe21cfb98a73e65a314352c3a1ce5c145%252Fpa%252FBM05081_1d83804e8454903afb78714766c7f201.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/1c/e21cfb98a73e65a314352c3a1ce5c145/pa/BM05081_1d83804e8454903afb78714766c7f201.jpg not downloaded yet
2026-01-28 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F0b%252F2c0bb7ccc201057468358464a15bb096%252Fpa%252FKX95898_daf747ba2233026e74d5f1cf7061fc4e.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/0b/2c0bb7ccc201057468358464a15bb096/pa/KX95898_daf747ba2233026e74d5f1cf7061fc4e.jpg not downloaded yet
2026-01-28 20:02:21 [auto1.it] INFO: Found listing with ID: FN77058
2026-01-28 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FN77058%27 HTTP/1.1" 200 None
2026-01-28 20:02:21 [auto1.it] INFO: Scrape type for FN77058: 2
2026-01-28 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F1c%252Fe21cfb98a73e65a314352c3a1ce5c145%252Fpa%252FBM05081_354cd502d05ee8b9423025294f186afc.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/1c/e21cfb98a73e65a314352c3a1ce5c145/pa/BM05081_354cd502d05ee8b9423025294f186afc.jpg not downloaded yet
2026-01-28 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F0b%252F2c0bb7ccc201057468358464a15bb096%252Fpa%252FKX95898_acc48f0d82e32a50d57c6c1845fe6c60.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/0b/2c0bb7ccc201057468358464a15bb096/pa/KX95898_acc48f0d82e32a50d57c6c1845fe6c60.jpg not downloaded yet
2026-01-28 20:02:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 587e2dac-1d94-5964-96a9-a84650f493b1 with identifier: UH29837
2026-01-28 20:02:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 587e2dac-1d94-5964-96a9-a84650f493b1 with scrape type 1
2026-01-28 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 587e2dac-1d94-5964-96a9-a84650f493b1
2026-01-28 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F05%252Fed0515a90d6efed767e4defc5c867fde%252Fpa%252FUH29837_438b517cfde743a7af5c1e5bf5e230b8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/05/ed0515a90d6efed767e4defc5c867fde/pa/UH29837_438b517cfde743a7af5c1e5bf5e230b8.jpg not downloaded yet
2026-01-28 20:02:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 20a05ac2-36fb-5da7-a760-e0a68c5fd2d9 with identifier: JE97171
2026-01-28 20:02:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20a05ac2-36fb-5da7-a760-e0a68c5fd2d9 with scrape type 2
2026-01-28 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 20a05ac2-36fb-5da7-a760-e0a68c5fd2d9 with scrape type 2
2026-01-28 20:02:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 20a05ac2-36fb-5da7-a760-e0a68c5fd2d9, identifier: JE97171
2026-01-28 20:02:21 [auto1.it] INFO: Found listing with ID: TU05159
2026-01-28 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TU05159%27 HTTP/1.1" 200 None
2026-01-28 20:02:21 [auto1.it] INFO: Scrape type for TU05159: 2
2026-01-28 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F1c%252Fe21cfb98a73e65a314352c3a1ce5c145%252Fpa%252FBM05081_5a63eea88f1d19a3e33e2d31b30d7061.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/1c/e21cfb98a73e65a314352c3a1ce5c145/pa/BM05081_5a63eea88f1d19a3e33e2d31b30d7061.jpg not downloaded yet
2026-01-28 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F0b%252F2c0bb7ccc201057468358464a15bb096%252Fpa%252FKX95898_ba4ca12f41951c737780ca6c2582e63e.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/0b/2c0bb7ccc201057468358464a15bb096/pa/KX95898_ba4ca12f41951c737780ca6c2582e63e.jpg not downloaded yet
2026-01-28 20:02:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 20a05ac2-36fb-5da7-a760-e0a68c5fd2d9 with identifier: JE97171
2026-01-28 20:02:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 20a05ac2-36fb-5da7-a760-e0a68c5fd2d9 with identifier: JE97171
2026-01-28 20:02:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 20a05ac2-36fb-5da7-a760-e0a68c5fd2d9 with identifier: JE97171 to the API
2026-01-28 20:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:02:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JE97171>
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:15:17Z',
 'fuel_type': 'diesel',
 'id': '20a05ac2-36fb-5da7-a760-e0a68c5fd2d9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JE97171',
 'listing': 'auction',
 'location': 'IT, Padova',
 'make': 'Volvo',
 'model': 'XC40',
 'odometer': 135134,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-09-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo XC40 2.0 D3 Business Plus 2WD',
 'transmission': 'automatic',
 'trim': 'Business Plus 2WD',
 'year': 2019}
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JE97171%27 HTTP/1.1" 200 None
2026-01-28 20:02:22 [auto1.it] INFO: Saving data for JE97171: {'auction_closing_time': 1769703317.0, 'created_time': 1769544047.34738, 'last_price_update_time': 1769630542.516542}
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JE97171') HTTP/1.1" 204 0
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F05%252Fed0515a90d6efed767e4defc5c867fde%252Fpa%252FUH29837_c53724e1f72a2a9fa4e349aa79ccd53b.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/05/ed0515a90d6efed767e4defc5c867fde/pa/UH29837_c53724e1f72a2a9fa4e349aa79ccd53b.jpg not downloaded yet
2026-01-28 20:02:22 [auto1.it] INFO: Found listing with ID: SF76565
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SF76565%27 HTTP/1.1" 200 None
2026-01-28 20:02:22 [auto1.it] INFO: Scrape type for SF76565: 1
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F1c%252Fe21cfb98a73e65a314352c3a1ce5c145%252Fpa%252FBM05081_080259e96a3b8eb3051f459a4456132d.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/1c/e21cfb98a73e65a314352c3a1ce5c145/pa/BM05081_080259e96a3b8eb3051f459a4456132d.jpg not downloaded yet
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F0b%252F2c0bb7ccc201057468358464a15bb096%252Fpa%252FKX95898_7210d890d6ab0619f1e66cf376a39a8d.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/0b/2c0bb7ccc201057468358464a15bb096/pa/KX95898_7210d890d6ab0619f1e66cf376a39a8d.jpg not downloaded yet
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F05%252Fed0515a90d6efed767e4defc5c867fde%252Fpa%252FUH29837_05ca72c3ea0b0b3067071d04e8b4f8c4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/05/ed0515a90d6efed767e4defc5c867fde/pa/UH29837_05ca72c3ea0b0b3067071d04e8b4f8c4.jpg not downloaded yet
2026-01-28 20:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WA67831> (referer: https://www.auto1.com/v1/car-details-view/WA67831/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WK84125/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RV64842/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:02:22 [auto1.it] INFO: Found listing with ID: SF52848
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SF52848%27 HTTP/1.1" 200 None
2026-01-28 20:02:22 [auto1.it] INFO: Scrape type for SF52848: 1
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F1c%252Fe21cfb98a73e65a314352c3a1ce5c145%252Fpa%252FBM05081_9a876060d7a98b7390eabfe9169d810c.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/1c/e21cfb98a73e65a314352c3a1ce5c145/pa/BM05081_9a876060d7a98b7390eabfe9169d810c.jpg not downloaded yet
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F0b%252F2c0bb7ccc201057468358464a15bb096%252Fpa%252FKX95898_051b8a398b6a93e55f7e4112919efb41.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/0b/2c0bb7ccc201057468358464a15bb096/pa/KX95898_051b8a398b6a93e55f7e4112919efb41.jpg not downloaded yet
2026-01-28 20:02:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:02:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:02:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:02:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/88/a9886c8c428fd9ace2871b067ea0c3ef/pa/FP41040_c3b5359dbfeb085b0df0700cb01cca02.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F05%252Fed0515a90d6efed767e4defc5c867fde%252Fpa%252FUH29837_8c3015c4691806b62fe433aec1339f6c.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/05/ed0515a90d6efed767e4defc5c867fde/pa/UH29837_8c3015c4691806b62fe433aec1339f6c.jpg not downloaded yet
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F1c%252Fe21cfb98a73e65a314352c3a1ce5c145%252Fpa%252FBM05081_e7be5509c9c3b09ad5ce3e27add3e301.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/1c/e21cfb98a73e65a314352c3a1ce5c145/pa/BM05081_e7be5509c9c3b09ad5ce3e27add3e301.jpg not downloaded yet
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F0b%252F2c0bb7ccc201057468358464a15bb096%252Fpa%252FKX95898_3c82398c417258fd1ad8706c3a0213ea.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/0b/2c0bb7ccc201057468358464a15bb096/pa/KX95898_3c82398c417258fd1ad8706c3a0213ea.jpg not downloaded yet
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F05%252Fed0515a90d6efed767e4defc5c867fde%252Fpa%252FUH29837_defbe6bc4fb4c38991a2947c39a72aab.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/05/ed0515a90d6efed767e4defc5c867fde/pa/UH29837_defbe6bc4fb4c38991a2947c39a72aab.jpg not downloaded yet
2026-01-28 20:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/0b/2c0bb7ccc201057468358464a15bb096/pa/KX95898_7210d890d6ab0619f1e66cf376a39a8d.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F1c%252Fe21cfb98a73e65a314352c3a1ce5c145%252Fpa%252FBM05081_c78f7541bb3996d8ba9be7f4cb21956b.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/1c/e21cfb98a73e65a314352c3a1ce5c145/pa/BM05081_c78f7541bb3996d8ba9be7f4cb21956b.jpg not downloaded yet
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F0b%252F2c0bb7ccc201057468358464a15bb096%252Fpa%252FKX95898_e7f8313fdbcee20d116121faba963a48.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/0b/2c0bb7ccc201057468358464a15bb096/pa/KX95898_e7f8313fdbcee20d116121faba963a48.jpg not downloaded yet
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F05%252Fed0515a90d6efed767e4defc5c867fde%252Fpa%252FUH29837_1eae31bbb273cbddc33513ec25c751df.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/05/ed0515a90d6efed767e4defc5c867fde/pa/UH29837_1eae31bbb273cbddc33513ec25c751df.jpg not downloaded yet
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F1c%252Fe21cfb98a73e65a314352c3a1ce5c145%252Fpa%252FBM05081_5128151f31bb0cac1936d377a8cbfc19.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/1c/e21cfb98a73e65a314352c3a1ce5c145/pa/BM05081_5128151f31bb0cac1936d377a8cbfc19.jpg not downloaded yet
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F0b%252F2c0bb7ccc201057468358464a15bb096%252Fpa%252FKX95898_e27dcb0e34f9fa92bf4ae0097b35941f.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/0b/2c0bb7ccc201057468358464a15bb096/pa/KX95898_e27dcb0e34f9fa92bf4ae0097b35941f.jpg not downloaded yet
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F05%252Fed0515a90d6efed767e4defc5c867fde%252Fpa%252FUH29837_c755823f13a9fe5132fe08fb81c4717d.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/05/ed0515a90d6efed767e4defc5c867fde/pa/UH29837_c755823f13a9fe5132fe08fb81c4717d.jpg not downloaded yet
2026-01-28 20:02:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f17dbbeb-f1f6-515b-8219-01dc5f0fdf05 with identifier: WA67831
2026-01-28 20:02:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f17dbbeb-f1f6-515b-8219-01dc5f0fdf05 with scrape type 2
2026-01-28 20:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f17dbbeb-f1f6-515b-8219-01dc5f0fdf05 with scrape type 2
2026-01-28 20:02:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f17dbbeb-f1f6-515b-8219-01dc5f0fdf05, identifier: WA67831
2026-01-28 20:02:23 [auto1.it] INFO: Parsing search results for channel: 24h
2026-01-28 20:02:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09d44990>
2026-01-28 20:02:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_42f57244-9ce1-548c-80f9-ba4fc624de0c/42f57244-9ce1-548c-80f9-ba4fc624de0c_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F88%252Fa9886c8c428fd9ace2871b067ea0c3ef%252Fpa%252FFP41040_c3b5359dbfeb085b0df0700cb01cca02.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/88/a9886c8c428fd9ace2871b067ea0c3ef/pa/FP41040_c3b5359dbfeb085b0df0700cb01cca02.jpg saved to cache
2026-01-28 20:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 42f57244-9ce1-548c-80f9-ba4fc624de0c
2026-01-28 20:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/88/a9886c8c428fd9ace2871b067ea0c3ef/pa/FP41040_b73370070eb1cf24a9a7194f0042c7bc.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/0b/2c0bb7ccc201057468358464a15bb096/pa/KX95898_3c82398c417258fd1ad8706c3a0213ea.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F1c%252Fe21cfb98a73e65a314352c3a1ce5c145%252Fpa%252FBM05081_2a8a9563b1f574aa55d7588677180781.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/1c/e21cfb98a73e65a314352c3a1ce5c145/pa/BM05081_2a8a9563b1f574aa55d7588677180781.jpg not downloaded yet
2026-01-28 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F0b%252F2c0bb7ccc201057468358464a15bb096%252Fpa%252FKX95898_3bb1a046acfead663c566fa8d66021d0.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/0b/2c0bb7ccc201057468358464a15bb096/pa/KX95898_3bb1a046acfead663c566fa8d66021d0.jpg not downloaded yet
2026-01-28 20:02:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f17dbbeb-f1f6-515b-8219-01dc5f0fdf05 with identifier: WA67831
2026-01-28 20:02:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f17dbbeb-f1f6-515b-8219-01dc5f0fdf05 with identifier: WA67831
2026-01-28 20:02:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f17dbbeb-f1f6-515b-8219-01dc5f0fdf05 with identifier: WA67831 to the API
2026-01-28 20:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:02:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:02:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WA67831>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:28:59Z',
 'fuel_type': 'diesel',
 'id': 'f17dbbeb-f1f6-515b-8219-01dc5f0fdf05',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WA67831',
 'listing': 'auction',
 'location': 'IT, Firenze',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 87261,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-02-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.5 Blue-HDi Allure Pack',
 'transmission': 'manual',
 'trim': 'Allure Pack',
 'year': 2022}
2026-01-28 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WA67831%27 HTTP/1.1" 200 None
2026-01-28 20:02:23 [auto1.it] INFO: Saving data for WA67831: {'auction_closing_time': 1769704139.0, 'created_time': 1769544061.616587, 'last_price_update_time': 1769630543.829122}
2026-01-28 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WA67831') HTTP/1.1" 204 0
2026-01-28 20:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/05/ed0515a90d6efed767e4defc5c867fde/pa/UH29837_c53724e1f72a2a9fa4e349aa79ccd53b.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F05%252Fed0515a90d6efed767e4defc5c867fde%252Fpa%252FUH29837_d7869889a4bcf962405af07ca0c0b1b0.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/05/ed0515a90d6efed767e4defc5c867fde/pa/UH29837_d7869889a4bcf962405af07ca0c0b1b0.jpg not downloaded yet
2026-01-28 20:02:23 [auto1.it] INFO: Found listing with ID: XR19887
2026-01-28 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XR19887%27 HTTP/1.1" 200 None
2026-01-28 20:02:23 [auto1.it] INFO: Scrape type for XR19887: 2
2026-01-28 20:02:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09f461d0>
2026-01-28 20:02:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8f04c0b-f98d-50df-a365-6ef5b27ef7fc/d8f04c0b-f98d-50df-a365-6ef5b27ef7fc_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F0b%252F2c0bb7ccc201057468358464a15bb096%252Fpa%252FKX95898_7210d890d6ab0619f1e66cf376a39a8d.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/0b/2c0bb7ccc201057468358464a15bb096/pa/KX95898_7210d890d6ab0619f1e66cf376a39a8d.jpg saved to cache
2026-01-28 20:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d8f04c0b-f98d-50df-a365-6ef5b27ef7fc
2026-01-28 20:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/88/a9886c8c428fd9ace2871b067ea0c3ef/pa/FP41040_b9a0b3efd0bf9ea9494f9586915a3c68.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/05/ed0515a90d6efed767e4defc5c867fde/pa/UH29837_05ca72c3ea0b0b3067071d04e8b4f8c4.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:02:24 [scrapy.extensions.logstats] INFO: Crawled 140 pages (at 52 pages/min), scraped 38 items (at 15 items/min)
2026-01-28 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F1c%252Fe21cfb98a73e65a314352c3a1ce5c145%252Fpa%252FBM05081_56f9c15ea78a889aaec8b9d0d226f3c8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/1c/e21cfb98a73e65a314352c3a1ce5c145/pa/BM05081_56f9c15ea78a889aaec8b9d0d226f3c8.jpg not downloaded yet
2026-01-28 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F0b%252F2c0bb7ccc201057468358464a15bb096%252Fpa%252FKX95898_2f468249333264dcd954678733784ab1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/0b/2c0bb7ccc201057468358464a15bb096/pa/KX95898_2f468249333264dcd954678733784ab1.jpg not downloaded yet
2026-01-28 20:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EC80373/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SS94947/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NF51505/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F05%252Fed0515a90d6efed767e4defc5c867fde%252Fpa%252FUH29837_15909f3e64080a68eac2adc1e6796c07.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/05/ed0515a90d6efed767e4defc5c867fde/pa/UH29837_15909f3e64080a68eac2adc1e6796c07.jpg not downloaded yet
2026-01-28 20:02:24 [auto1.it] INFO: Found listing with ID: TP74360
2026-01-28 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TP74360%27 HTTP/1.1" 200 None
2026-01-28 20:02:24 [auto1.it] INFO: Scrape type for TP74360: 2
2026-01-28 20:02:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:02:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:02:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WZ33226/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:02:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08700650>
2026-01-28 20:02:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_42f57244-9ce1-548c-80f9-ba4fc624de0c/42f57244-9ce1-548c-80f9-ba4fc624de0c_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F88%252Fa9886c8c428fd9ace2871b067ea0c3ef%252Fpa%252FFP41040_b73370070eb1cf24a9a7194f0042c7bc.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/88/a9886c8c428fd9ace2871b067ea0c3ef/pa/FP41040_b73370070eb1cf24a9a7194f0042c7bc.jpg saved to cache
2026-01-28 20:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 42f57244-9ce1-548c-80f9-ba4fc624de0c
2026-01-28 20:02:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0a0b8290>
2026-01-28 20:02:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8f04c0b-f98d-50df-a365-6ef5b27ef7fc/d8f04c0b-f98d-50df-a365-6ef5b27ef7fc_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F0b%252F2c0bb7ccc201057468358464a15bb096%252Fpa%252FKX95898_3c82398c417258fd1ad8706c3a0213ea.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/0b/2c0bb7ccc201057468358464a15bb096/pa/KX95898_3c82398c417258fd1ad8706c3a0213ea.jpg saved to cache
2026-01-28 20:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d8f04c0b-f98d-50df-a365-6ef5b27ef7fc
2026-01-28 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F1c%252Fe21cfb98a73e65a314352c3a1ce5c145%252Fpa%252FBM05081_a5b7ac33b48aeedb1c306ecdbf998d6a.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/1c/e21cfb98a73e65a314352c3a1ce5c145/pa/BM05081_a5b7ac33b48aeedb1c306ecdbf998d6a.jpg not downloaded yet
2026-01-28 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F0b%252F2c0bb7ccc201057468358464a15bb096%252Fpa%252FKX95898_e7c319bc45f3b05da5e2b98a57e50716.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/0b/2c0bb7ccc201057468358464a15bb096/pa/KX95898_e7c319bc45f3b05da5e2b98a57e50716.jpg not downloaded yet
2026-01-28 20:02:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:02:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09d734d0>
2026-01-28 20:02:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_587e2dac-1d94-5964-96a9-a84650f493b1/587e2dac-1d94-5964-96a9-a84650f493b1_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F05%252Fed0515a90d6efed767e4defc5c867fde%252Fpa%252FUH29837_c53724e1f72a2a9fa4e349aa79ccd53b.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/05/ed0515a90d6efed767e4defc5c867fde/pa/UH29837_c53724e1f72a2a9fa4e349aa79ccd53b.jpg saved to cache
2026-01-28 20:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 587e2dac-1d94-5964-96a9-a84650f493b1
2026-01-28 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F05%252Fed0515a90d6efed767e4defc5c867fde%252Fpa%252FUH29837_972a08aad4dbddadea33727577e154e2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/05/ed0515a90d6efed767e4defc5c867fde/pa/UH29837_972a08aad4dbddadea33727577e154e2.jpg not downloaded yet
2026-01-28 20:02:25 [auto1.it] INFO: Found listing with ID: GK81526
2026-01-28 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GK81526%27 HTTP/1.1" 200 None
2026-01-28 20:02:25 [auto1.it] INFO: Scrape type for GK81526: 2
2026-01-28 20:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/0b/2c0bb7ccc201057468358464a15bb096/pa/KX95898_3bb1a046acfead663c566fa8d66021d0.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F1c%252Fe21cfb98a73e65a314352c3a1ce5c145%252Fpa%252FBM05081_1afa7bc2808a2d4410faefd424b5ef67.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/1c/e21cfb98a73e65a314352c3a1ce5c145/pa/BM05081_1afa7bc2808a2d4410faefd424b5ef67.jpg not downloaded yet
2026-01-28 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F0b%252F2c0bb7ccc201057468358464a15bb096%252Fpa%252FKX95898_9c5d2845c10c9c353e76abff916ed6d3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/0b/2c0bb7ccc201057468358464a15bb096/pa/KX95898_9c5d2845c10c9c353e76abff916ed6d3.jpg not downloaded yet
2026-01-28 20:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HY00654/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YJ30752/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BE54104/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:02:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:02:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0a0648d0>
2026-01-28 20:02:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_42f57244-9ce1-548c-80f9-ba4fc624de0c/42f57244-9ce1-548c-80f9-ba4fc624de0c_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F88%252Fa9886c8c428fd9ace2871b067ea0c3ef%252Fpa%252FFP41040_b9a0b3efd0bf9ea9494f9586915a3c68.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/88/a9886c8c428fd9ace2871b067ea0c3ef/pa/FP41040_b9a0b3efd0bf9ea9494f9586915a3c68.jpg saved to cache
2026-01-28 20:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 42f57244-9ce1-548c-80f9-ba4fc624de0c
2026-01-28 20:02:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09d79150>
2026-01-28 20:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_587e2dac-1d94-5964-96a9-a84650f493b1/587e2dac-1d94-5964-96a9-a84650f493b1_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F05%252Fed0515a90d6efed767e4defc5c867fde%252Fpa%252FUH29837_05ca72c3ea0b0b3067071d04e8b4f8c4.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/05/ed0515a90d6efed767e4defc5c867fde/pa/UH29837_05ca72c3ea0b0b3067071d04e8b4f8c4.jpg saved to cache
2026-01-28 20:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 587e2dac-1d94-5964-96a9-a84650f493b1
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F05%252Fed0515a90d6efed767e4defc5c867fde%252Fpa%252FUH29837_e95760a474364e6c10ef3f142cbdccad.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/05/ed0515a90d6efed767e4defc5c867fde/pa/UH29837_e95760a474364e6c10ef3f142cbdccad.jpg not downloaded yet
2026-01-28 20:02:26 [auto1.it] INFO: Found listing with ID: TC56605
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TC56605%27 HTTP/1.1" 200 None
2026-01-28 20:02:26 [auto1.it] INFO: Scrape type for TC56605: 2
2026-01-28 20:02:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:02:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UD94632/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:02:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/05/ed0515a90d6efed767e4defc5c867fde/pa/UH29837_c755823f13a9fe5132fe08fb81c4717d.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/05/ed0515a90d6efed767e4defc5c867fde/pa/UH29837_d7869889a4bcf962405af07ca0c0b1b0.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F0b%252F2c0bb7ccc201057468358464a15bb096%252Fpa%252FKX95898_79ee016fd542190eba35fae78069f4c5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/0b/2c0bb7ccc201057468358464a15bb096/pa/KX95898_79ee016fd542190eba35fae78069f4c5.jpg not downloaded yet
2026-01-28 20:02:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F05%252Fed0515a90d6efed767e4defc5c867fde%252Fpa%252FUH29837_746d90a28f42e3b455fe04e859982adc.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/05/ed0515a90d6efed767e4defc5c867fde/pa/UH29837_746d90a28f42e3b455fe04e859982adc.jpg not downloaded yet
2026-01-28 20:02:26 [auto1.it] INFO: Found listing with ID: TS20335
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TS20335%27 HTTP/1.1" 200 None
2026-01-28 20:02:26 [auto1.it] INFO: Scrape type for TS20335: 2
2026-01-28 20:02:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09d0fd50>
2026-01-28 20:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8f04c0b-f98d-50df-a365-6ef5b27ef7fc/d8f04c0b-f98d-50df-a365-6ef5b27ef7fc_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F0b%252F2c0bb7ccc201057468358464a15bb096%252Fpa%252FKX95898_3bb1a046acfead663c566fa8d66021d0.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/0b/2c0bb7ccc201057468358464a15bb096/pa/KX95898_3bb1a046acfead663c566fa8d66021d0.jpg saved to cache
2026-01-28 20:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d8f04c0b-f98d-50df-a365-6ef5b27ef7fc
2026-01-28 20:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/1c/e21cfb98a73e65a314352c3a1ce5c145/pa/BM05081_080259e96a3b8eb3051f459a4456132d.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F0b%252F2c0bb7ccc201057468358464a15bb096%252Fpa%252FKX95898_4ddbb3ed8ef36e3e8462039038e7d51a.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/0b/2c0bb7ccc201057468358464a15bb096/pa/KX95898_4ddbb3ed8ef36e3e8462039038e7d51a.jpg not downloaded yet
2026-01-28 20:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/0b/2c0bb7ccc201057468358464a15bb096/pa/KX95898_e7c319bc45f3b05da5e2b98a57e50716.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F05%252Fed0515a90d6efed767e4defc5c867fde%252Fpa%252FUH29837_afad117fa27d7e783505b1f779cfef70.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/05/ed0515a90d6efed767e4defc5c867fde/pa/UH29837_afad117fa27d7e783505b1f779cfef70.jpg not downloaded yet
2026-01-28 20:02:26 [auto1.it] INFO: Found listing with ID: FS42168
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FS42168%27 HTTP/1.1" 200 None
2026-01-28 20:02:26 [auto1.it] INFO: Scrape type for FS42168: 2
2026-01-28 20:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/05/ed0515a90d6efed767e4defc5c867fde/pa/UH29837_972a08aad4dbddadea33727577e154e2.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F05%252Fed0515a90d6efed767e4defc5c867fde%252Fpa%252FUH29837_a6f12c77ee93b698a6a5157188439b11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/05/ed0515a90d6efed767e4defc5c867fde/pa/UH29837_a6f12c77ee93b698a6a5157188439b11.jpg not downloaded yet
2026-01-28 20:02:26 [auto1.it] INFO: Found listing with ID: KF08387
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KF08387%27 HTTP/1.1" 200 None
2026-01-28 20:02:26 [auto1.it] INFO: Scrape type for KF08387: 2
2026-01-28 20:02:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b087409d0>
2026-01-28 20:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_587e2dac-1d94-5964-96a9-a84650f493b1/587e2dac-1d94-5964-96a9-a84650f493b1_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F05%252Fed0515a90d6efed767e4defc5c867fde%252Fpa%252FUH29837_c755823f13a9fe5132fe08fb81c4717d.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/05/ed0515a90d6efed767e4defc5c867fde/pa/UH29837_c755823f13a9fe5132fe08fb81c4717d.jpg saved to cache
2026-01-28 20:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 587e2dac-1d94-5964-96a9-a84650f493b1
2026-01-28 20:02:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08cf7e50>
2026-01-28 20:02:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_587e2dac-1d94-5964-96a9-a84650f493b1/587e2dac-1d94-5964-96a9-a84650f493b1_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F05%252Fed0515a90d6efed767e4defc5c867fde%252Fpa%252FUH29837_d7869889a4bcf962405af07ca0c0b1b0.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/05/ed0515a90d6efed767e4defc5c867fde/pa/UH29837_d7869889a4bcf962405af07ca0c0b1b0.jpg saved to cache
2026-01-28 20:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 587e2dac-1d94-5964-96a9-a84650f493b1
2026-01-28 20:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F05%252Fed0515a90d6efed767e4defc5c867fde%252Fpa%252FUH29837_f435e6f7f5c82f1b4e726fd24900adfa.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/05/ed0515a90d6efed767e4defc5c867fde/pa/UH29837_f435e6f7f5c82f1b4e726fd24900adfa.jpg not downloaded yet
2026-01-28 20:02:27 [auto1.it] INFO: Found listing with ID: RC65604
2026-01-28 20:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RC65604%27 HTTP/1.1" 200 None
2026-01-28 20:02:27 [auto1.it] INFO: Scrape type for RC65604: 0
2026-01-28 20:02:27 [auto1.it] INFO: Found listing with ID: SP33249
2026-01-28 20:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SP33249%27 HTTP/1.1" 200 None
2026-01-28 20:02:27 [auto1.it] INFO: Scrape type for SP33249: 2
2026-01-28 20:02:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09fc1490>
2026-01-28 20:02:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_952ac053-e29b-5def-9dce-861a2bf03e69/952ac053-e29b-5def-9dce-861a2bf03e69_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F1c%252Fe21cfb98a73e65a314352c3a1ce5c145%252Fpa%252FBM05081_080259e96a3b8eb3051f459a4456132d.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/1c/e21cfb98a73e65a314352c3a1ce5c145/pa/BM05081_080259e96a3b8eb3051f459a4456132d.jpg saved to cache
2026-01-28 20:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 952ac053-e29b-5def-9dce-861a2bf03e69
2026-01-28 20:02:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09d08050>
2026-01-28 20:02:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8f04c0b-f98d-50df-a365-6ef5b27ef7fc/d8f04c0b-f98d-50df-a365-6ef5b27ef7fc_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F0b%252F2c0bb7ccc201057468358464a15bb096%252Fpa%252FKX95898_e7c319bc45f3b05da5e2b98a57e50716.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/0b/2c0bb7ccc201057468358464a15bb096/pa/KX95898_e7c319bc45f3b05da5e2b98a57e50716.jpg saved to cache
2026-01-28 20:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item d8f04c0b-f98d-50df-a365-6ef5b27ef7fc
2026-01-28 20:02:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09fc3610>
2026-01-28 20:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_587e2dac-1d94-5964-96a9-a84650f493b1/587e2dac-1d94-5964-96a9-a84650f493b1_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F05%252Fed0515a90d6efed767e4defc5c867fde%252Fpa%252FUH29837_972a08aad4dbddadea33727577e154e2.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/05/ed0515a90d6efed767e4defc5c867fde/pa/UH29837_972a08aad4dbddadea33727577e154e2.jpg saved to cache
2026-01-28 20:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 587e2dac-1d94-5964-96a9-a84650f493b1
2026-01-28 20:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/0b/2c0bb7ccc201057468358464a15bb096/pa/KX95898_4ddbb3ed8ef36e3e8462039038e7d51a.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:02:28 [auto1.it] INFO: Found listing with ID: UD53703
2026-01-28 20:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UD53703%27 HTTP/1.1" 200 None
2026-01-28 20:02:28 [auto1.it] INFO: Scrape type for UD53703: 0
2026-01-28 20:02:28 [auto1.it] INFO: Found listing with ID: RR01200
2026-01-28 20:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RR01200%27 HTTP/1.1" 200 None
2026-01-28 20:02:28 [auto1.it] INFO: Scrape type for RR01200: 1
2026-01-28 20:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/1c/e21cfb98a73e65a314352c3a1ce5c145/pa/BM05081_2a8a9563b1f574aa55d7588677180781.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/1c/e21cfb98a73e65a314352c3a1ce5c145/pa/BM05081_a5b7ac33b48aeedb1c306ecdbf998d6a.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:02:28 [auto1.it] INFO: Found listing with ID: ZX31921
2026-01-28 20:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZX31921%27 HTTP/1.1" 200 None
2026-01-28 20:02:28 [auto1.it] INFO: Scrape type for ZX31921: 1
2026-01-28 20:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GK81526/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JW94842/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WZ33226> (referer: https://www.auto1.com/v1/car-details-view/WZ33226/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XR19887/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:02:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:02:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:02:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:02:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:02:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:02:28 [auto1.it] INFO: Found listing with ID: VV30676
2026-01-28 20:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VV30676%27 HTTP/1.1" 200 None
2026-01-28 20:02:28 [auto1.it] INFO: Scrape type for VV30676: 2
2026-01-28 20:02:28 [auto1.it] INFO: Found listing with ID: AP23964
2026-01-28 20:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AP23964%27 HTTP/1.1" 200 None
2026-01-28 20:02:28 [auto1.it] INFO: Scrape type for AP23964: 1
2026-01-28 20:02:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08c3c690>
2026-01-28 20:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8f04c0b-f98d-50df-a365-6ef5b27ef7fc/d8f04c0b-f98d-50df-a365-6ef5b27ef7fc_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F0b%252F2c0bb7ccc201057468358464a15bb096%252Fpa%252FKX95898_4ddbb3ed8ef36e3e8462039038e7d51a.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/0b/2c0bb7ccc201057468358464a15bb096/pa/KX95898_4ddbb3ed8ef36e3e8462039038e7d51a.jpg saved to cache
2026-01-28 20:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item d8f04c0b-f98d-50df-a365-6ef5b27ef7fc
2026-01-28 20:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/05/ed0515a90d6efed767e4defc5c867fde/pa/UH29837_f435e6f7f5c82f1b4e726fd24900adfa.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/05/ed0515a90d6efed767e4defc5c867fde/pa/UH29837_a6f12c77ee93b698a6a5157188439b11.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:02:29 [auto1.it] INFO: Found listing with ID: PM20896
2026-01-28 20:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PM20896%27 HTTP/1.1" 200 None
2026-01-28 20:02:29 [auto1.it] INFO: Scrape type for PM20896: 2
2026-01-28 20:02:29 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 22 - Data Location: 110 - value: b'SONY\x00'
2026-01-28 20:02:29 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 34 - Data Location: 116 - value: b'ILCE-7M3\x00'
2026-01-28 20:02:29 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 126 - value: b',\x01\x00\x00\x01\x00\x00\x00'
2026-01-28 20:02:29 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 134 - value: b',\x01\x00\x00\x01\x00\x00\x00'
2026-01-28 20:02:29 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-01-28 20:02:29 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 82 - Data Location: 142 - value: <table: 42 bytes>
2026-01-28 20:02:29 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 94 - Data Location: 184 - value: b'2026:01:28 11:03:13\x00'
2026-01-28 20:02:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\xcc\x00\x00\x00'
2026-01-28 20:02:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0bff3990>
2026-01-28 20:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_952ac053-e29b-5def-9dce-861a2bf03e69/952ac053-e29b-5def-9dce-861a2bf03e69_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F1c%252Fe21cfb98a73e65a314352c3a1ce5c145%252Fpa%252FBM05081_2a8a9563b1f574aa55d7588677180781.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/1c/e21cfb98a73e65a314352c3a1ce5c145/pa/BM05081_2a8a9563b1f574aa55d7588677180781.jpg saved to cache
2026-01-28 20:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 952ac053-e29b-5def-9dce-861a2bf03e69
2026-01-28 20:02:29 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 22 - Data Location: 110 - value: b'SONY\x00'
2026-01-28 20:02:29 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 34 - Data Location: 116 - value: b'ILCE-7M3\x00'
2026-01-28 20:02:29 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 126 - value: b',\x01\x00\x00\x01\x00\x00\x00'
2026-01-28 20:02:29 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 134 - value: b',\x01\x00\x00\x01\x00\x00\x00'
2026-01-28 20:02:29 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-01-28 20:02:29 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 82 - Data Location: 142 - value: <table: 42 bytes>
2026-01-28 20:02:29 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 94 - Data Location: 184 - value: b'2026:01:28 11:02:59\x00'
2026-01-28 20:02:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\xcc\x00\x00\x00'
2026-01-28 20:02:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09e33ad0>
2026-01-28 20:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_952ac053-e29b-5def-9dce-861a2bf03e69/952ac053-e29b-5def-9dce-861a2bf03e69_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F1c%252Fe21cfb98a73e65a314352c3a1ce5c145%252Fpa%252FBM05081_a5b7ac33b48aeedb1c306ecdbf998d6a.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/1c/e21cfb98a73e65a314352c3a1ce5c145/pa/BM05081_a5b7ac33b48aeedb1c306ecdbf998d6a.jpg saved to cache
2026-01-28 20:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 952ac053-e29b-5def-9dce-861a2bf03e69
2026-01-28 20:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/05/ed0515a90d6efed767e4defc5c867fde/pa/UH29837_afad117fa27d7e783505b1f779cfef70.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:02:29 [auto1.it] INFO: Found listing with ID: YR95481
2026-01-28 20:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YR95481%27 HTTP/1.1" 200 None
2026-01-28 20:02:29 [auto1.it] INFO: Scrape type for YR95481: 2
2026-01-28 20:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SF76565/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WK84125> (referer: https://www.auto1.com/v1/car-details-view/WK84125/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RV64842> (referer: https://www.auto1.com/v1/car-details-view/RV64842/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:02:29 [auto1.it] INFO: Parsing search results for channel: 24h
2026-01-28 20:02:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 25bcdb8f-fdc2-5c91-9ff6-b5c793e9d45c with identifier: WZ33226
2026-01-28 20:02:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25bcdb8f-fdc2-5c91-9ff6-b5c793e9d45c with scrape type 2
2026-01-28 20:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 25bcdb8f-fdc2-5c91-9ff6-b5c793e9d45c with scrape type 2
2026-01-28 20:02:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 25bcdb8f-fdc2-5c91-9ff6-b5c793e9d45c, identifier: WZ33226
2026-01-28 20:02:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09e74fd0>
2026-01-28 20:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_587e2dac-1d94-5964-96a9-a84650f493b1/587e2dac-1d94-5964-96a9-a84650f493b1_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F05%252Fed0515a90d6efed767e4defc5c867fde%252Fpa%252FUH29837_f435e6f7f5c82f1b4e726fd24900adfa.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/05/ed0515a90d6efed767e4defc5c867fde/pa/UH29837_f435e6f7f5c82f1b4e726fd24900adfa.jpg saved to cache
2026-01-28 20:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 587e2dac-1d94-5964-96a9-a84650f493b1
2026-01-28 20:02:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09fd9c10>
2026-01-28 20:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_587e2dac-1d94-5964-96a9-a84650f493b1/587e2dac-1d94-5964-96a9-a84650f493b1_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F05%252Fed0515a90d6efed767e4defc5c867fde%252Fpa%252FUH29837_a6f12c77ee93b698a6a5157188439b11.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/05/ed0515a90d6efed767e4defc5c867fde/pa/UH29837_a6f12c77ee93b698a6a5157188439b11.jpg saved to cache
2026-01-28 20:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 587e2dac-1d94-5964-96a9-a84650f493b1
2026-01-28 20:02:30 [auto1.it] INFO: Found listing with ID: VS47380
2026-01-28 20:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VS47380%27 HTTP/1.1" 200 None
2026-01-28 20:02:30 [auto1.it] INFO: Scrape type for VS47380: 1
2026-01-28 20:02:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:02:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:02:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:02:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 25bcdb8f-fdc2-5c91-9ff6-b5c793e9d45c with identifier: WZ33226
2026-01-28 20:02:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 25bcdb8f-fdc2-5c91-9ff6-b5c793e9d45c with identifier: WZ33226
2026-01-28 20:02:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 25bcdb8f-fdc2-5c91-9ff6-b5c793e9d45c with identifier: WZ33226 to the API
2026-01-28 20:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:02:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:02:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WZ33226>
{'auction_title': '',
 'c_o_2_emission_value': 169,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:29:59Z',
 'fuel_type': 'diesel',
 'id': '25bcdb8f-fdc2-5c91-9ff6-b5c793e9d45c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WZ33226',
 'listing': 'auction',
 'location': 'IT, Milazzo',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 62831,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-07-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI R-Line 4Motion',
 'transmission': 'automatic',
 'trim': 'R-Line 4Motion',
 'year': 2021}
2026-01-28 20:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WZ33226%27 HTTP/1.1" 200 None
2026-01-28 20:02:31 [auto1.it] INFO: Saving data for WZ33226: {'auction_closing_time': 1769704199.0, 'created_time': 1768853318.387259, 'last_price_update_time': 1769630551.401461}
2026-01-28 20:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WZ33226') HTTP/1.1" 204 0
2026-01-28 20:02:31 [auto1.it] INFO: Found listing with ID: BE15819
2026-01-28 20:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BE15819%27 HTTP/1.1" 200 None
2026-01-28 20:02:31 [auto1.it] INFO: Scrape type for BE15819: 1
2026-01-28 20:02:31 [auto1.it] INFO: Found listing with ID: YP57818
2026-01-28 20:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YP57818%27 HTTP/1.1" 200 None
2026-01-28 20:02:31 [auto1.it] INFO: Scrape type for YP57818: 2
2026-01-28 20:02:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08713d90>
2026-01-28 20:02:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_587e2dac-1d94-5964-96a9-a84650f493b1/587e2dac-1d94-5964-96a9-a84650f493b1_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F05%252Fed0515a90d6efed767e4defc5c867fde%252Fpa%252FUH29837_afad117fa27d7e783505b1f779cfef70.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/05/ed0515a90d6efed767e4defc5c867fde/pa/UH29837_afad117fa27d7e783505b1f779cfef70.jpg saved to cache
2026-01-28 20:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 587e2dac-1d94-5964-96a9-a84650f493b1
2026-01-28 20:02:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3be8869a-0230-533d-85a5-a59620dd4ad4 with identifier: WK84125
2026-01-28 20:02:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3be8869a-0230-533d-85a5-a59620dd4ad4 with scrape type 2
2026-01-28 20:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3be8869a-0230-533d-85a5-a59620dd4ad4 with scrape type 2
2026-01-28 20:02:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3be8869a-0230-533d-85a5-a59620dd4ad4, identifier: WK84125
2026-01-28 20:02:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa01df11-1642-584a-a511-ddcfb824e58b with identifier: RV64842
2026-01-28 20:02:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa01df11-1642-584a-a511-ddcfb824e58b with scrape type 2
2026-01-28 20:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fa01df11-1642-584a-a511-ddcfb824e58b with scrape type 2
2026-01-28 20:02:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: fa01df11-1642-584a-a511-ddcfb824e58b, identifier: RV64842
2026-01-28 20:02:32 [auto1.it] INFO: Found listing with ID: JG91765
2026-01-28 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JG91765%27 HTTP/1.1" 200 None
2026-01-28 20:02:32 [auto1.it] INFO: Scrape type for JG91765: 1
2026-01-28 20:02:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3be8869a-0230-533d-85a5-a59620dd4ad4 with identifier: WK84125
2026-01-28 20:02:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3be8869a-0230-533d-85a5-a59620dd4ad4 with identifier: WK84125
2026-01-28 20:02:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3be8869a-0230-533d-85a5-a59620dd4ad4 with identifier: WK84125 to the API
2026-01-28 20:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:02:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:02:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WK84125>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.5L',
 'engine_horse_power': 135,
 'expiration_date': '2026-01-29T16:41:04Z',
 'fuel_type': 'petrol',
 'id': '3be8869a-0230-533d-85a5-a59620dd4ad4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WK84125',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 49246,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-07-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI Countryman Cooper',
 'transmission': 'manual',
 'trim': '',
 'year': 2020}
2026-01-28 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WK84125%27 HTTP/1.1" 200 None
2026-01-28 20:02:32 [auto1.it] INFO: Saving data for WK84125: {'auction_closing_time': 1769704864.0, 'created_time': 1769544122.223493, 'last_price_update_time': 1769630552.365969}
2026-01-28 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WK84125') HTTP/1.1" 204 0
2026-01-28 20:02:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: fa01df11-1642-584a-a511-ddcfb824e58b with identifier: RV64842
2026-01-28 20:02:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: fa01df11-1642-584a-a511-ddcfb824e58b with identifier: RV64842
2026-01-28 20:02:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: fa01df11-1642-584a-a511-ddcfb824e58b with identifier: RV64842 to the API
2026-01-28 20:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:02:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:02:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RV64842>
{'auction_title': '',
 'c_o_2_emission_value': 157,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:05:39Z',
 'fuel_type': 'petrol',
 'id': 'fa01df11-1642-584a-a511-ddcfb824e58b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RV64842',
 'listing': 'auction',
 'location': 'IT, Ardea (RM)',
 'make': 'Audi',
 'model': 'Q3 Sportback',
 'odometer': 107742,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-01-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q3 Sportback 35 TFSI Mild-Hybrid ACT S line',
 'transmission': 'automatic',
 'trim': 'ACT S line',
 'year': 2022}
2026-01-28 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RV64842%27 HTTP/1.1" 200 None
2026-01-28 20:02:32 [auto1.it] INFO: Saving data for RV64842: {'auction_closing_time': 1769702739.0, 'created_time': 1769544048.403726, 'last_price_update_time': 1769630552.776126}
2026-01-28 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RV64842') HTTP/1.1" 204 0
2026-01-28 20:02:32 [auto1.it] INFO: Found listing with ID: HH59266
2026-01-28 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HH59266%27 HTTP/1.1" 200 None
2026-01-28 20:02:32 [auto1.it] INFO: Scrape type for HH59266: 2
2026-01-28 20:02:32 [auto1.it] INFO: Found listing with ID: GY55011
2026-01-28 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GY55011%27 HTTP/1.1" 200 None
2026-01-28 20:02:32 [auto1.it] INFO: Scrape type for GY55011: 0
2026-01-28 20:02:32 [auto1.it] INFO: Found listing with ID: ED39383
2026-01-28 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ED39383%27 HTTP/1.1" 200 None
2026-01-28 20:02:32 [auto1.it] INFO: Scrape type for ED39383: 1
2026-01-28 20:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YJ30752> (referer: https://www.auto1.com/v1/car-details-view/YJ30752/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BE54104> (referer: https://www.auto1.com/v1/car-details-view/BE54104/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NF51505> (referer: https://www.auto1.com/v1/car-details-view/NF51505/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SP33249/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SS94947> (referer: https://www.auto1.com/v1/car-details-view/SS94947/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:02:32 [auto1.it] INFO: Found listing with ID: PM77275
2026-01-28 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PM77275%27 HTTP/1.1" 200 None
2026-01-28 20:02:32 [auto1.it] INFO: Scrape type for PM77275: 2
2026-01-28 20:02:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:02:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:02:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:02:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:02:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:02:32 [auto1.it] INFO: Found listing with ID: BU98469
2026-01-28 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BU98469%27 HTTP/1.1" 200 None
2026-01-28 20:02:32 [auto1.it] INFO: Scrape type for BU98469: 1
2026-01-28 20:02:32 [auto1.it] INFO: Found listing with ID: TJ68491
2026-01-28 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TJ68491%27 HTTP/1.1" 200 None
2026-01-28 20:02:32 [auto1.it] INFO: Scrape type for TJ68491: 1
2026-01-28 20:02:32 [auto1.it] INFO: Found listing with ID: TE90440
2026-01-28 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TE90440%27 HTTP/1.1" 200 None
2026-01-28 20:02:33 [auto1.it] INFO: Scrape type for TE90440: 2
2026-01-28 20:02:33 [auto1.it] INFO: Found listing with ID: GZ60590
2026-01-28 20:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GZ60590%27 HTTP/1.1" 200 None
2026-01-28 20:02:33 [auto1.it] INFO: Scrape type for GZ60590: 1
2026-01-28 20:02:33 [auto1.it] INFO: Found listing with ID: VL02819
2026-01-28 20:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VL02819%27 HTTP/1.1" 200 None
2026-01-28 20:02:33 [auto1.it] INFO: Scrape type for VL02819: 2
2026-01-28 20:02:33 [auto1.it] INFO: Found listing with ID: CY86412
2026-01-28 20:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CY86412%27 HTTP/1.1" 200 None
2026-01-28 20:02:33 [auto1.it] INFO: Scrape type for CY86412: 1
2026-01-28 20:02:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ccf2c374-c86e-54c9-ad43-e4bfd6d4a486 with identifier: YJ30752
2026-01-28 20:02:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ccf2c374-c86e-54c9-ad43-e4bfd6d4a486 with scrape type 2
2026-01-28 20:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ccf2c374-c86e-54c9-ad43-e4bfd6d4a486 with scrape type 2
2026-01-28 20:02:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ccf2c374-c86e-54c9-ad43-e4bfd6d4a486, identifier: YJ30752
2026-01-28 20:02:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4be2cfc5-1f46-522c-a0da-349bd35d3f3d with identifier: BE54104
2026-01-28 20:02:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4be2cfc5-1f46-522c-a0da-349bd35d3f3d with scrape type 2
2026-01-28 20:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4be2cfc5-1f46-522c-a0da-349bd35d3f3d with scrape type 2
2026-01-28 20:02:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4be2cfc5-1f46-522c-a0da-349bd35d3f3d, identifier: BE54104
2026-01-28 20:02:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89117c2a-96d7-5d32-8b6c-c545367f13bd with identifier: NF51505
2026-01-28 20:02:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89117c2a-96d7-5d32-8b6c-c545367f13bd with scrape type 2
2026-01-28 20:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 89117c2a-96d7-5d32-8b6c-c545367f13bd with scrape type 2
2026-01-28 20:02:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 89117c2a-96d7-5d32-8b6c-c545367f13bd, identifier: NF51505
2026-01-28 20:02:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40291716-916d-53f4-b299-039a889d448a with identifier: SS94947
2026-01-28 20:02:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40291716-916d-53f4-b299-039a889d448a with scrape type 2
2026-01-28 20:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 40291716-916d-53f4-b299-039a889d448a with scrape type 2
2026-01-28 20:02:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 40291716-916d-53f4-b299-039a889d448a, identifier: SS94947
2026-01-28 20:02:33 [auto1.it] INFO: Found listing with ID: CC38555
2026-01-28 20:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CC38555%27 HTTP/1.1" 200 None
2026-01-28 20:02:33 [auto1.it] INFO: Scrape type for CC38555: 2
2026-01-28 20:02:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ccf2c374-c86e-54c9-ad43-e4bfd6d4a486 with identifier: YJ30752
2026-01-28 20:02:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ccf2c374-c86e-54c9-ad43-e4bfd6d4a486 with identifier: YJ30752
2026-01-28 20:02:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ccf2c374-c86e-54c9-ad43-e4bfd6d4a486 with identifier: YJ30752 to the API
2026-01-28 20:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:02:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:02:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YJ30752>
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:24:39Z',
 'fuel_type': 'diesel',
 'id': 'ccf2c374-c86e-54c9-ad43-e4bfd6d4a486',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YJ30752',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'Opel',
 'model': 'Grandland X',
 'odometer': 137603,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-11-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Grandland X 1.5 CDTI Business',
 'transmission': 'automatic',
 'trim': 'Business',
 'year': 2019}
2026-01-28 20:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YJ30752%27 HTTP/1.1" 200 None
2026-01-28 20:02:33 [auto1.it] INFO: Saving data for YJ30752: {'auction_closing_time': 1769703879.0, 'created_time': 1768816911.080959, 'last_price_update_time': 1769630553.991989}
2026-01-28 20:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YJ30752') HTTP/1.1" 204 0
2026-01-28 20:02:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4be2cfc5-1f46-522c-a0da-349bd35d3f3d with identifier: BE54104
2026-01-28 20:02:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4be2cfc5-1f46-522c-a0da-349bd35d3f3d with identifier: BE54104
2026-01-28 20:02:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4be2cfc5-1f46-522c-a0da-349bd35d3f3d with identifier: BE54104 to the API
2026-01-28 20:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:02:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:02:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BE54104>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 101,
 'expiration_date': '2026-01-29T16:26:29Z',
 'fuel_type': 'petrol',
 'id': '4be2cfc5-1f46-522c-a0da-349bd35d3f3d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BE54104',
 'listing': 'auction',
 'location': 'IT, Padova',
 'make': 'Jeep',
 'model': 'Avenger',
 'odometer': 7067,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-10-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jeep Avenger 1.2 T-GDI Summit',
 'transmission': 'manual',
 'trim': 'Summit',
 'year': 2024}
2026-01-28 20:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BE54104%27 HTTP/1.1" 200 None
2026-01-28 20:02:34 [auto1.it] INFO: Saving data for BE54104: {'auction_closing_time': 1769703989.0, 'created_time': 1768248587.620422, 'last_price_update_time': 1769630554.491385}
2026-01-28 20:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BE54104') HTTP/1.1" 204 0
2026-01-28 20:02:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 89117c2a-96d7-5d32-8b6c-c545367f13bd with identifier: NF51505
2026-01-28 20:02:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 89117c2a-96d7-5d32-8b6c-c545367f13bd with identifier: NF51505
2026-01-28 20:02:34 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 192275 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    192275
2026-01-28 20:02:34 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 89117c2a-96d7-5d32-8b6c-c545367f13bd spider: auto1.it
2026-01-28 20:02:34 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 89117c2a-96d7-5d32-8b6c-c545367f13bd due to rule: high_mileage_for_country.json, error: 192275 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    192275
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.6L',
 'engine_horse_power': 130,
 'expiration_date': '2026-01-29T16:27:38Z',
 'fuel_type': 'diesel',
 'id': '89117c2a-96d7-5d32-8b6c-c545367f13bd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NF51505',
 'listing': 'auction',
 'location': 'IT, Roma',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 192275,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-09-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Qashqai 1.6 dCi N-Connecta',
 'transmission': 'automatic',
 'trim': 'N-Connecta',
 'year': 2018}
2026-01-28 20:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NF51505%27 HTTP/1.1" 200 None
2026-01-28 20:02:34 [auto1.it] INFO: Saving data for NF51505: {'auction_closing_time': 1769704058.0, 'created_time': 1769544068.577813, 'last_price_update_time': 1769630554.726884}
2026-01-28 20:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NF51505') HTTP/1.1" 204 0
2026-01-28 20:02:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 40291716-916d-53f4-b299-039a889d448a with identifier: SS94947
2026-01-28 20:02:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 40291716-916d-53f4-b299-039a889d448a with identifier: SS94947
2026-01-28 20:02:34 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 152189 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    152189
2026-01-28 20:02:34 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 40291716-916d-53f4-b299-039a889d448a spider: auto1.it
2026-01-28 20:02:34 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 40291716-916d-53f4-b299-039a889d448a due to rule: high_mileage_for_country.json, error: 152189 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    152189
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 250,
 'expiration_date': '2026-01-29T16:59:21Z',
 'fuel_type': 'petrol',
 'id': '40291716-916d-53f4-b299-039a889d448a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SS94947',
 'listing': 'auction',
 'location': 'IT, Milano',
 'make': 'Jaguar',
 'model': 'F-Pace',
 'odometer': 152189,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-01-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jaguar F-Pace 25t R-Sport AWD',
 'transmission': 'automatic',
 'trim': 'R-Sport AWD',
 'year': 2020}
2026-01-28 20:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SS94947%27 HTTP/1.1" 200 None
2026-01-28 20:02:34 [auto1.it] INFO: Saving data for SS94947: {'auction_closing_time': 1769705961.0, 'created_time': 1769199455.366625, 'last_price_update_time': 1769630554.995875}
2026-01-28 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SS94947') HTTP/1.1" 204 0
2026-01-28 20:02:35 [auto1.it] INFO: Found listing with ID: AJ94497
2026-01-28 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AJ94497%27 HTTP/1.1" 200 None
2026-01-28 20:02:35 [auto1.it] INFO: Scrape type for AJ94497: 1
2026-01-28 20:02:35 [auto1.it] INFO: Found listing with ID: VM43481
2026-01-28 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VM43481%27 HTTP/1.1" 200 None
2026-01-28 20:02:35 [auto1.it] INFO: Scrape type for VM43481: 1
2026-01-28 20:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KF08387/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:02:35 [auto1.it] INFO: Found listing with ID: TK24342
2026-01-28 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TK24342%27 HTTP/1.1" 200 None
2026-01-28 20:02:35 [auto1.it] INFO: Scrape type for TK24342: 1
2026-01-28 20:02:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RR01200/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UD94632> (referer: https://www.auto1.com/v1/car-details-view/UD94632/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/0b/2c0bb7ccc201057468358464a15bb096/pa/KX95898_2f468249333264dcd954678733784ab1.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:02:35 [auto1.it] INFO: Found listing with ID: NP54569
2026-01-28 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NP54569%27 HTTP/1.1" 200 None
2026-01-28 20:02:35 [auto1.it] INFO: Scrape type for NP54569: 1
2026-01-28 20:02:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:02:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:02:35 [auto1.it] INFO: Found listing with ID: NJ76886
2026-01-28 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NJ76886%27 HTTP/1.1" 200 None
2026-01-28 20:02:35 [auto1.it] INFO: Scrape type for NJ76886: 1
2026-01-28 20:02:35 [auto1.it] INFO: Found listing with ID: PP05492
2026-01-28 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PP05492%27 HTTP/1.1" 200 None
2026-01-28 20:02:35 [auto1.it] INFO: Scrape type for PP05492: 2
2026-01-28 20:02:35 [auto1.it] INFO: Found listing with ID: UZ46554
2026-01-28 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UZ46554%27 HTTP/1.1" 200 None
2026-01-28 20:02:35 [auto1.it] INFO: Scrape type for UZ46554: 1
2026-01-28 20:02:35 [auto1.it] INFO: Found listing with ID: YG15382
2026-01-28 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YG15382%27 HTTP/1.1" 200 None
2026-01-28 20:02:35 [auto1.it] INFO: Scrape type for YG15382: 1
2026-01-28 20:02:35 [auto1.it] INFO: Found listing with ID: CK43710
2026-01-28 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CK43710%27 HTTP/1.1" 200 None
2026-01-28 20:02:35 [auto1.it] INFO: Scrape type for CK43710: 1
2026-01-28 20:02:35 [auto1.it] INFO: Found listing with ID: HU90428
2026-01-28 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HU90428%27 HTTP/1.1" 200 None
2026-01-28 20:02:35 [auto1.it] INFO: Scrape type for HU90428: 1
2026-01-28 20:02:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd3fe02e-68d3-59b0-95d9-2774a7386941 with identifier: UD94632
2026-01-28 20:02:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd3fe02e-68d3-59b0-95d9-2774a7386941 with scrape type 2
2026-01-28 20:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dd3fe02e-68d3-59b0-95d9-2774a7386941 with scrape type 2
2026-01-28 20:02:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: dd3fe02e-68d3-59b0-95d9-2774a7386941, identifier: UD94632
2026-01-28 20:02:35 [auto1.it] INFO: Found listing with ID: XA03649
2026-01-28 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XA03649%27 HTTP/1.1" 200 None
2026-01-28 20:02:35 [auto1.it] INFO: Scrape type for XA03649: 1
2026-01-28 20:02:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: dd3fe02e-68d3-59b0-95d9-2774a7386941 with identifier: UD94632
2026-01-28 20:02:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: dd3fe02e-68d3-59b0-95d9-2774a7386941 with identifier: UD94632
2026-01-28 20:02:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: dd3fe02e-68d3-59b0-95d9-2774a7386941 with identifier: UD94632 to the API
2026-01-28 20:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:02:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:02:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UD94632>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:10:43Z',
 'fuel_type': 'diesel',
 'id': 'dd3fe02e-68d3-59b0-95d9-2774a7386941',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UD94632',
 'listing': 'auction',
 'location': 'IT, Senago (MI)',
 'make': 'Seat',
 'model': 'Tarraco',
 'odometer': 81528,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-05-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Tarraco 2.0 TDI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2021}
2026-01-28 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UD94632%27 HTTP/1.1" 200 None
2026-01-28 20:02:35 [auto1.it] INFO: Saving data for UD94632: {'auction_closing_time': 1769703043.0, 'created_time': 1767040165.497323, 'last_price_update_time': 1769630555.78627}
2026-01-28 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UD94632') HTTP/1.1" 204 0
2026-01-28 20:02:35 [auto1.it] INFO: Found listing with ID: AC57291
2026-01-28 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AC57291%27 HTTP/1.1" 200 None
2026-01-28 20:02:35 [auto1.it] INFO: Scrape type for AC57291: 1
2026-01-28 20:02:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:02:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09d72b50>
2026-01-28 20:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8f04c0b-f98d-50df-a365-6ef5b27ef7fc/d8f04c0b-f98d-50df-a365-6ef5b27ef7fc_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F0b%252F2c0bb7ccc201057468358464a15bb096%252Fpa%252FKX95898_2f468249333264dcd954678733784ab1.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/0b/2c0bb7ccc201057468358464a15bb096/pa/KX95898_2f468249333264dcd954678733784ab1.jpg saved to cache
2026-01-28 20:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item d8f04c0b-f98d-50df-a365-6ef5b27ef7fc
2026-01-28 20:02:36 [auto1.it] INFO: Found listing with ID: XZ92879
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XZ92879%27 HTTP/1.1" 200 None
2026-01-28 20:02:36 [auto1.it] INFO: Scrape type for XZ92879: 1
2026-01-28 20:02:36 [auto1.it] INFO: Found listing with ID: VV31468
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VV31468%27 HTTP/1.1" 200 None
2026-01-28 20:02:36 [auto1.it] INFO: Scrape type for VV31468: 2
2026-01-28 20:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZX31921/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YR95481/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AP23964/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FS42168/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:02:36 [auto1.it] INFO: Found listing with ID: BD65212
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BD65212%27 HTTP/1.1" 200 None
2026-01-28 20:02:36 [auto1.it] INFO: Scrape type for BD65212: 1
2026-01-28 20:02:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:02:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:02:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:02:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VV30676/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:02:36 [auto1.it] INFO: Found listing with ID: UP17064
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UP17064%27 HTTP/1.1" 200 None
2026-01-28 20:02:36 [auto1.it] INFO: Scrape type for UP17064: 1
2026-01-28 20:02:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:02:36 [auto1.it] INFO: Found listing with ID: JN05485
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JN05485%27 HTTP/1.1" 200 None
2026-01-28 20:02:36 [auto1.it] INFO: Scrape type for JN05485: 1
2026-01-28 20:02:36 [auto1.it] INFO: Found listing with ID: YX37505
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YX37505%27 HTTP/1.1" 200 None
2026-01-28 20:02:36 [auto1.it] INFO: Scrape type for YX37505: 1
2026-01-28 20:02:36 [auto1.it] INFO: Found listing with ID: YE02110
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YE02110%27 HTTP/1.1" 200 None
2026-01-28 20:02:36 [auto1.it] INFO: Scrape type for YE02110: 1
2026-01-28 20:02:36 [auto1.it] INFO: Found listing with ID: NF03892
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NF03892%27 HTTP/1.1" 200 None
2026-01-28 20:02:36 [auto1.it] INFO: Scrape type for NF03892: 2
2026-01-28 20:02:36 [auto1.it] INFO: Found listing with ID: PW84021
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PW84021%27 HTTP/1.1" 200 None
2026-01-28 20:02:36 [auto1.it] INFO: Scrape type for PW84021: 1
2026-01-28 20:02:36 [auto1.it] INFO: Found listing with ID: UD73720
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UD73720%27 HTTP/1.1" 200 None
2026-01-28 20:02:36 [auto1.it] INFO: Scrape type for UD73720: 1
2026-01-28 20:02:36 [auto1.it] INFO: Found listing with ID: BM83226
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BM83226%27 HTTP/1.1" 200 None
2026-01-28 20:02:36 [auto1.it] INFO: Scrape type for BM83226: 2
2026-01-28 20:02:36 [auto1.it] INFO: Found listing with ID: CU51863
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CU51863%27 HTTP/1.1" 200 None
2026-01-28 20:02:36 [auto1.it] INFO: Scrape type for CU51863: 1
2026-01-28 20:02:36 [auto1.it] INFO: Found listing with ID: RH01953
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RH01953%27 HTTP/1.1" 200 None
2026-01-28 20:02:36 [auto1.it] INFO: Scrape type for RH01953: 1
2026-01-28 20:02:36 [auto1.it] INFO: Found listing with ID: JD87332
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JD87332%27 HTTP/1.1" 200 None
2026-01-28 20:02:36 [auto1.it] INFO: Scrape type for JD87332: 1
2026-01-28 20:02:36 [auto1.it] INFO: Found listing with ID: SR88948
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SR88948%27 HTTP/1.1" 200 None
2026-01-28 20:02:36 [auto1.it] INFO: Scrape type for SR88948: 1
2026-01-28 20:02:36 [auto1.it] INFO: Found listing with ID: MG90392
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MG90392%27 HTTP/1.1" 200 None
2026-01-28 20:02:36 [auto1.it] INFO: Scrape type for MG90392: 2
2026-01-28 20:02:36 [auto1.it] INFO: Found listing with ID: JY56965
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JY56965%27 HTTP/1.1" 200 None
2026-01-28 20:02:36 [auto1.it] INFO: Scrape type for JY56965: 1
2026-01-28 20:02:36 [auto1.it] INFO: Found listing with ID: YU19851
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YU19851%27 HTTP/1.1" 200 None
2026-01-28 20:02:36 [auto1.it] INFO: Scrape type for YU19851: 2
2026-01-28 20:02:36 [auto1.it] INFO: Found listing with ID: PD47677
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PD47677%27 HTTP/1.1" 200 None
2026-01-28 20:02:36 [auto1.it] INFO: Scrape type for PD47677: 2
2026-01-28 20:02:36 [auto1.it] INFO: Found listing with ID: HT79408
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HT79408%27 HTTP/1.1" 200 None
2026-01-28 20:02:36 [auto1.it] INFO: Scrape type for HT79408: 1
2026-01-28 20:02:36 [auto1.it] INFO: Found listing with ID: HH72494
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HH72494%27 HTTP/1.1" 200 None
2026-01-28 20:02:36 [auto1.it] INFO: Scrape type for HH72494: 1
2026-01-28 20:02:36 [auto1.it] INFO: Found listing with ID: DA53677
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DA53677%27 HTTP/1.1" 200 None
2026-01-28 20:02:36 [auto1.it] INFO: Scrape type for DA53677: 1
2026-01-28 20:02:36 [auto1.it] INFO: Found listing with ID: BC61751
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BC61751%27 HTTP/1.1" 200 None
2026-01-28 20:02:36 [auto1.it] INFO: Scrape type for BC61751: 2
2026-01-28 20:02:36 [auto1.it] INFO: Found listing with ID: XP18402
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XP18402%27 HTTP/1.1" 200 None
2026-01-28 20:02:36 [auto1.it] INFO: Scrape type for XP18402: 1
2026-01-28 20:02:36 [auto1.it] INFO: Found listing with ID: XX61742
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XX61742%27 HTTP/1.1" 200 None
2026-01-28 20:02:36 [auto1.it] INFO: Scrape type for XX61742: 1
2026-01-28 20:02:36 [auto1.it] INFO: Found listing with ID: XS04727
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XS04727%27 HTTP/1.1" 200 None
2026-01-28 20:02:36 [auto1.it] INFO: Scrape type for XS04727: 2
2026-01-28 20:02:36 [auto1.it] INFO: Found listing with ID: PK36389
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PK36389%27 HTTP/1.1" 200 None
2026-01-28 20:02:36 [auto1.it] INFO: Scrape type for PK36389: 1
2026-01-28 20:02:36 [auto1.it] INFO: Found listing with ID: PM33616
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PM33616%27 HTTP/1.1" 200 None
2026-01-28 20:02:36 [auto1.it] INFO: Scrape type for PM33616: 2
2026-01-28 20:02:36 [auto1.it] INFO: Found listing with ID: KK21064
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KK21064%27 HTTP/1.1" 200 None
2026-01-28 20:02:36 [auto1.it] INFO: Scrape type for KK21064: 2
2026-01-28 20:02:36 [auto1.it] INFO: Found listing with ID: RS56779
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RS56779%27 HTTP/1.1" 200 None
2026-01-28 20:02:36 [auto1.it] INFO: Scrape type for RS56779: 2
2026-01-28 20:02:36 [auto1.it] INFO: Found listing with ID: JV90142
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JV90142%27 HTTP/1.1" 200 None
2026-01-28 20:02:36 [auto1.it] INFO: Scrape type for JV90142: 2
2026-01-28 20:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PM20896/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:02:36 [auto1.it] INFO: Found listing with ID: TL16229
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TL16229%27 HTTP/1.1" 200 None
2026-01-28 20:02:36 [auto1.it] INFO: Scrape type for TL16229: 1
2026-01-28 20:02:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:02:36 [auto1.it] INFO: Found listing with ID: CK36923
2026-01-28 20:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CK36923%27 HTTP/1.1" 200 None
2026-01-28 20:02:37 [auto1.it] INFO: Scrape type for CK36923: 2
2026-01-28 20:02:37 [auto1.it] INFO: Found listing with ID: MJ69210
2026-01-28 20:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MJ69210%27 HTTP/1.1" 200 None
2026-01-28 20:02:37 [auto1.it] INFO: Scrape type for MJ69210: 2
2026-01-28 20:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ED39383/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:02:37 [auto1.it] INFO: Found listing with ID: ZT96568
2026-01-28 20:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZT96568%27 HTTP/1.1" 200 None
2026-01-28 20:02:37 [auto1.it] INFO: Scrape type for ZT96568: 2
2026-01-28 20:02:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:02:37 [auto1.it] INFO: Found listing with ID: YG51898
2026-01-28 20:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YG51898%27 HTTP/1.1" 200 None
2026-01-28 20:02:37 [auto1.it] INFO: Scrape type for YG51898: 2
2026-01-28 20:02:37 [auto1.it] INFO: Found listing with ID: KM02872
2026-01-28 20:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KM02872%27 HTTP/1.1" 200 None
2026-01-28 20:02:37 [auto1.it] INFO: Scrape type for KM02872: 2
2026-01-28 20:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HY00654> (referer: https://www.auto1.com/v1/car-details-view/HY00654/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:02:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:02:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ccccf40-b0da-5ae1-893a-84d50529871c with identifier: HY00654
2026-01-28 20:02:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ccccf40-b0da-5ae1-893a-84d50529871c with scrape type 2
2026-01-28 20:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4ccccf40-b0da-5ae1-893a-84d50529871c with scrape type 2
2026-01-28 20:02:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4ccccf40-b0da-5ae1-893a-84d50529871c, identifier: HY00654
2026-01-28 20:02:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4ccccf40-b0da-5ae1-893a-84d50529871c with identifier: HY00654
2026-01-28 20:02:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4ccccf40-b0da-5ae1-893a-84d50529871c with identifier: HY00654
2026-01-28 20:02:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4ccccf40-b0da-5ae1-893a-84d50529871c with identifier: HY00654 to the API
2026-01-28 20:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:02:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:02:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HY00654>
{'auction_title': '',
 'c_o_2_emission_value': 89,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.5L',
 'engine_horse_power': 105,
 'expiration_date': '2026-01-29T16:16:40Z',
 'fuel_type': 'diesel',
 'id': '4ccccf40-b0da-5ae1-893a-84d50529871c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HY00654',
 'listing': 'auction',
 'location': 'IT, Milazzo',
 'make': 'Mazda',
 'model': '2',
 'odometer': 134964,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-10-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mazda 2 1.5 Diesel Evolve',
 'transmission': 'manual',
 'trim': 'Evolve',
 'year': 2018}
2026-01-28 20:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HY00654%27 HTTP/1.1" 200 None
2026-01-28 20:02:37 [auto1.it] INFO: Saving data for HY00654: {'auction_closing_time': 1769703400.0, 'created_time': 1766606486.567514, 'last_price_update_time': 1769630557.981287}
2026-01-28 20:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HY00654') HTTP/1.1" 204 0
2026-01-28 20:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CC38555/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JG91765/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VM43481/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YP57818/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:02:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:02:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:02:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:02:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HH59266/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SF76565> (referer: https://www.auto1.com/v1/car-details-view/SF76565/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AJ94497/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:02:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:02:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:02:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:02:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15993e6b-6eda-5d0c-8b9a-931d6dd1bd13 with identifier: SF76565
2026-01-28 20:02:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15993e6b-6eda-5d0c-8b9a-931d6dd1bd13 with scrape type 1
2026-01-28 20:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 15993e6b-6eda-5d0c-8b9a-931d6dd1bd13
2026-01-28 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F7d%252Fe37d5e337e292bd66cd049148fbf9ef0%252Fpa%252FSF76565_1306c24da5c66d4b6d14e35f6d5c9342.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/7d/e37d5e337e292bd66cd049148fbf9ef0/pa/SF76565_1306c24da5c66d4b6d14e35f6d5c9342.jpg already downloaded
2026-01-28 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F7d%252Fe37d5e337e292bd66cd049148fbf9ef0%252Fpa%252FSF76565_c33b9ffd3775a94c0a1e9b80e4e91c7f.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/7d/e37d5e337e292bd66cd049148fbf9ef0/pa/SF76565_c33b9ffd3775a94c0a1e9b80e4e91c7f.jpg already downloaded
2026-01-28 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F7d%252Fe37d5e337e292bd66cd049148fbf9ef0%252Fpa%252FSF76565_99af3662804d36c58de159ce8140f1d5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/7d/e37d5e337e292bd66cd049148fbf9ef0/pa/SF76565_99af3662804d36c58de159ce8140f1d5.jpg already downloaded
2026-01-28 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F7d%252Fe37d5e337e292bd66cd049148fbf9ef0%252Fpa%252FSF76565_7125e8ecacf65fd7a265449127bfe9d0.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/7d/e37d5e337e292bd66cd049148fbf9ef0/pa/SF76565_7125e8ecacf65fd7a265449127bfe9d0.jpg already downloaded
2026-01-28 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F7d%252Fe37d5e337e292bd66cd049148fbf9ef0%252Fpa%252FSF76565_753e5d77dc1236139997a21bdf120826.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/7d/e37d5e337e292bd66cd049148fbf9ef0/pa/SF76565_753e5d77dc1236139997a21bdf120826.jpg already downloaded
2026-01-28 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F7d%252Fe37d5e337e292bd66cd049148fbf9ef0%252Fpa%252FSF76565_78374fd688d574573f95c93b69260adf.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/7d/e37d5e337e292bd66cd049148fbf9ef0/pa/SF76565_78374fd688d574573f95c93b69260adf.jpg already downloaded
2026-01-28 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F7d%252Fe37d5e337e292bd66cd049148fbf9ef0%252Fpa%252FSF76565_ff80bc22f0d8bc3453ee2d7b138ddf8a.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/7d/e37d5e337e292bd66cd049148fbf9ef0/pa/SF76565_ff80bc22f0d8bc3453ee2d7b138ddf8a.jpg already downloaded
2026-01-28 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F7d%252Fe37d5e337e292bd66cd049148fbf9ef0%252Fpa%252FSF76565_35825071f4c0e86e7a8d72373f2d1800.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/7d/e37d5e337e292bd66cd049148fbf9ef0/pa/SF76565_35825071f4c0e86e7a8d72373f2d1800.jpg already downloaded
2026-01-28 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F7d%252Fe37d5e337e292bd66cd049148fbf9ef0%252Fpa%252FSF76565_8146386b9ebd12e83cb0af595809022a.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/7d/e37d5e337e292bd66cd049148fbf9ef0/pa/SF76565_8146386b9ebd12e83cb0af595809022a.jpg already downloaded
2026-01-28 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F7d%252Fe37d5e337e292bd66cd049148fbf9ef0%252Fpa%252FSF76565_9c67bf783a6d4a61df2d2101ff34c829.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/7d/e37d5e337e292bd66cd049148fbf9ef0/pa/SF76565_9c67bf783a6d4a61df2d2101ff34c829.jpg already downloaded
2026-01-28 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F7d%252Fe37d5e337e292bd66cd049148fbf9ef0%252Fpa%252FSF76565_f82e48811b08a1940a2c81f7d4fb01ff.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/7d/e37d5e337e292bd66cd049148fbf9ef0/pa/SF76565_f82e48811b08a1940a2c81f7d4fb01ff.jpg already downloaded
2026-01-28 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F7d%252Fe37d5e337e292bd66cd049148fbf9ef0%252Fpa%252FSF76565_b6b797bf8c25bedd96f3b7ee423462fe.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/7d/e37d5e337e292bd66cd049148fbf9ef0/pa/SF76565_b6b797bf8c25bedd96f3b7ee423462fe.jpg already downloaded
2026-01-28 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F7d%252Fe37d5e337e292bd66cd049148fbf9ef0%252Fpa%252FSF76565_5b0c05b7a4ef2c2bcba8ada9dc67013b.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/7d/e37d5e337e292bd66cd049148fbf9ef0/pa/SF76565_5b0c05b7a4ef2c2bcba8ada9dc67013b.jpg already downloaded
2026-01-28 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F7d%252Fe37d5e337e292bd66cd049148fbf9ef0%252Fpa%252FSF76565_861b51cb23987931eded9fb35dfc65ee.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/7d/e37d5e337e292bd66cd049148fbf9ef0/pa/SF76565_861b51cb23987931eded9fb35dfc65ee.jpg already downloaded
2026-01-28 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F7d%252Fe37d5e337e292bd66cd049148fbf9ef0%252Fpa%252FSF76565_b8cc3de507ffb3e5d789b0f9417d3bf0.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/7d/e37d5e337e292bd66cd049148fbf9ef0/pa/SF76565_b8cc3de507ffb3e5d789b0f9417d3bf0.jpg already downloaded
2026-01-28 20:02:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 15993e6b-6eda-5d0c-8b9a-931d6dd1bd13, identifier: SF76565
2026-01-28 20:02:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 15993e6b-6eda-5d0c-8b9a-931d6dd1bd13 with identifier: SF76565
2026-01-28 20:02:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 15993e6b-6eda-5d0c-8b9a-931d6dd1bd13 with identifier: SF76565
2026-01-28 20:02:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 15993e6b-6eda-5d0c-8b9a-931d6dd1bd13 with identifier: SF76565 to the API
2026-01-28 20:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:02:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:02:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SF76565>
{'auction_title': '',
 'c_o_2_emission_value': 168,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '2.0L',
 'engine_horse_power': 252,
 'expiration_date': '2026-01-29T16:21:46Z',
 'fuel_type': 'petrol',
 'id': '15993e6b-6eda-5d0c-8b9a-931d6dd1bd13',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SF76565',
 'listing': 'auction',
 'location': 'IT, Senago (MI)',
 'make': 'Porsche',
 'model': 'Macan',
 'odometer': 89846,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imge3/7d/e37d5e337e292bd66cd049148fbf9ef0/pa/SF76565_1306c24da5c66d4b6d14e35f6d5c9342.jpg',
                'https://img-pa.auto1.com/imge3/7d/e37d5e337e292bd66cd049148fbf9ef0/pa/SF76565_c33b9ffd3775a94c0a1e9b80e4e91c7f.jpg',
                'https://img-pa.auto1.com/imge3/7d/e37d5e337e292bd66cd049148fbf9ef0/pa/SF76565_99af3662804d36c58de159ce8140f1d5.jpg',
                'https://img-pa.auto1.com/imge3/7d/e37d5e337e292bd66cd049148fbf9ef0/pa/SF76565_7125e8ecacf65fd7a265449127bfe9d0.jpg',
                'https://img-pa.auto1.com/imge3/7d/e37d5e337e292bd66cd049148fbf9ef0/pa/SF76565_753e5d77dc1236139997a21bdf120826.jpg',
                'https://img-pa.auto1.com/imge3/7d/e37d5e337e292bd66cd049148fbf9ef0/pa/SF76565_78374fd688d574573f95c93b69260adf.jpg',
                'https://img-pa.auto1.com/imge3/7d/e37d5e337e292bd66cd049148fbf9ef0/pa/SF76565_ff80bc22f0d8bc3453ee2d7b138ddf8a.jpg',
                'https://img-pa.auto1.com/imge3/7d/e37d5e337e292bd66cd049148fbf9ef0/pa/SF76565_35825071f4c0e86e7a8d72373f2d1800.jpg',
                'https://img-pa.auto1.com/imge3/7d/e37d5e337e292bd66cd049148fbf9ef0/pa/SF76565_8146386b9ebd12e83cb0af595809022a.jpg',
                'https://img-pa.auto1.com/imge3/7d/e37d5e337e292bd66cd049148fbf9ef0/pa/SF76565_9c67bf783a6d4a61df2d2101ff34c829.jpg',
                'https://img-pa.auto1.com/imge3/7d/e37d5e337e292bd66cd049148fbf9ef0/pa/SF76565_f82e48811b08a1940a2c81f7d4fb01ff.jpg',
                'https://img-pa.auto1.com/imge3/7d/e37d5e337e292bd66cd049148fbf9ef0/pa/SF76565_b6b797bf8c25bedd96f3b7ee423462fe.jpg',
                'https://img-pa.auto1.com/imge3/7d/e37d5e337e292bd66cd049148fbf9ef0/pa/SF76565_5b0c05b7a4ef2c2bcba8ada9dc67013b.jpg',
                'https://img-pa.auto1.com/imge3/7d/e37d5e337e292bd66cd049148fbf9ef0/pa/SF76565_861b51cb23987931eded9fb35dfc65ee.jpg',
                'https://img-pa.auto1.com/imge3/7d/e37d5e337e292bd66cd049148fbf9ef0/pa/SF76565_b8cc3de507ffb3e5d789b0f9417d3bf0.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15993e6b-6eda-5d0c-8b9a-931d6dd1bd13/15993e6b-6eda-5d0c-8b9a-931d6dd1bd13_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68270,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/7d/e37d5e337e292bd66cd049148fbf9ef0/pa/SF76565_1306c24da5c66d4b6d14e35f6d5c9342.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15993e6b-6eda-5d0c-8b9a-931d6dd1bd13/15993e6b-6eda-5d0c-8b9a-931d6dd1bd13_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64624,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/7d/e37d5e337e292bd66cd049148fbf9ef0/pa/SF76565_c33b9ffd3775a94c0a1e9b80e4e91c7f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15993e6b-6eda-5d0c-8b9a-931d6dd1bd13/15993e6b-6eda-5d0c-8b9a-931d6dd1bd13_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65944,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/7d/e37d5e337e292bd66cd049148fbf9ef0/pa/SF76565_99af3662804d36c58de159ce8140f1d5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15993e6b-6eda-5d0c-8b9a-931d6dd1bd13/15993e6b-6eda-5d0c-8b9a-931d6dd1bd13_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48329,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/7d/e37d5e337e292bd66cd049148fbf9ef0/pa/SF76565_7125e8ecacf65fd7a265449127bfe9d0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15993e6b-6eda-5d0c-8b9a-931d6dd1bd13/15993e6b-6eda-5d0c-8b9a-931d6dd1bd13_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55718,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/7d/e37d5e337e292bd66cd049148fbf9ef0/pa/SF76565_753e5d77dc1236139997a21bdf120826.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15993e6b-6eda-5d0c-8b9a-931d6dd1bd13/15993e6b-6eda-5d0c-8b9a-931d6dd1bd13_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2585661,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/7d/e37d5e337e292bd66cd049148fbf9ef0/pa/SF76565_78374fd688d574573f95c93b69260adf.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15993e6b-6eda-5d0c-8b9a-931d6dd1bd13/15993e6b-6eda-5d0c-8b9a-931d6dd1bd13_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2791474,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/7d/e37d5e337e292bd66cd049148fbf9ef0/pa/SF76565_ff80bc22f0d8bc3453ee2d7b138ddf8a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15993e6b-6eda-5d0c-8b9a-931d6dd1bd13/15993e6b-6eda-5d0c-8b9a-931d6dd1bd13_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77339,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/7d/e37d5e337e292bd66cd049148fbf9ef0/pa/SF76565_35825071f4c0e86e7a8d72373f2d1800.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15993e6b-6eda-5d0c-8b9a-931d6dd1bd13/15993e6b-6eda-5d0c-8b9a-931d6dd1bd13_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68344,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/7d/e37d5e337e292bd66cd049148fbf9ef0/pa/SF76565_8146386b9ebd12e83cb0af595809022a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15993e6b-6eda-5d0c-8b9a-931d6dd1bd13/15993e6b-6eda-5d0c-8b9a-931d6dd1bd13_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41782,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/7d/e37d5e337e292bd66cd049148fbf9ef0/pa/SF76565_9c67bf783a6d4a61df2d2101ff34c829.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15993e6b-6eda-5d0c-8b9a-931d6dd1bd13/15993e6b-6eda-5d0c-8b9a-931d6dd1bd13_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68189,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/7d/e37d5e337e292bd66cd049148fbf9ef0/pa/SF76565_f82e48811b08a1940a2c81f7d4fb01ff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15993e6b-6eda-5d0c-8b9a-931d6dd1bd13/15993e6b-6eda-5d0c-8b9a-931d6dd1bd13_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48654,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/7d/e37d5e337e292bd66cd049148fbf9ef0/pa/SF76565_b6b797bf8c25bedd96f3b7ee423462fe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15993e6b-6eda-5d0c-8b9a-931d6dd1bd13/15993e6b-6eda-5d0c-8b9a-931d6dd1bd13_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43931,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/7d/e37d5e337e292bd66cd049148fbf9ef0/pa/SF76565_5b0c05b7a4ef2c2bcba8ada9dc67013b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15993e6b-6eda-5d0c-8b9a-931d6dd1bd13/15993e6b-6eda-5d0c-8b9a-931d6dd1bd13_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42311,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/7d/e37d5e337e292bd66cd049148fbf9ef0/pa/SF76565_861b51cb23987931eded9fb35dfc65ee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15993e6b-6eda-5d0c-8b9a-931d6dd1bd13/15993e6b-6eda-5d0c-8b9a-931d6dd1bd13_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48678,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/7d/e37d5e337e292bd66cd049148fbf9ef0/pa/SF76565_b8cc3de507ffb3e5d789b0f9417d3bf0.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-05-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Porsche Macan 2.0',
 'transmission': 'automatic',
 'trim': '',
 'year': 2018}
2026-01-28 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SF76565%27 HTTP/1.1" 200 None
2026-01-28 20:02:39 [auto1.it] INFO: Saving data for SF76565: {'created_time': 1769630559.365383, 'last_price_update_time': 1769630559.365395, 'auction_closing_time': 1769703706.0}
2026-01-28 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SF76565') HTTP/1.1" 204 0
2026-01-28 20:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SP33249> (referer: https://www.auto1.com/v1/car-details-view/SP33249/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:02:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:02:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 077c23c7-7ac9-5751-8c7d-5f463a5e00f6 with identifier: SP33249
2026-01-28 20:02:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 077c23c7-7ac9-5751-8c7d-5f463a5e00f6 with scrape type 2
2026-01-28 20:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 077c23c7-7ac9-5751-8c7d-5f463a5e00f6 with scrape type 2
2026-01-28 20:02:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 077c23c7-7ac9-5751-8c7d-5f463a5e00f6, identifier: SP33249
2026-01-28 20:02:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 077c23c7-7ac9-5751-8c7d-5f463a5e00f6 with identifier: SP33249
2026-01-28 20:02:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 077c23c7-7ac9-5751-8c7d-5f463a5e00f6 with identifier: SP33249
2026-01-28 20:02:39 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'ford' containing 'ford' and model 'transit connect' containing 'transit'
2026-01-28 20:02:39 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 077c23c7-7ac9-5751-8c7d-5f463a5e00f6 spider: auto1.it
2026-01-28 20:02:39 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 077c23c7-7ac9-5751-8c7d-5f463a5e00f6 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'ford' containing 'ford' and model 'transit connect' containing 'transit'
{'auction_title': '',
 'c_o_2_emission_value': 151,
 'category': None,
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6D',
 'engine': '1.5L',
 'engine_horse_power': 120,
 'expiration_date': '2026-01-29T16:58:01Z',
 'fuel_type': 'diesel',
 'id': '077c23c7-7ac9-5751-8c7d-5f463a5e00f6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SP33249',
 'listing': 'auction',
 'location': 'IT, Senago (MI)',
 'make': 'Ford',
 'model': 'Transit Connect',
 'odometer': 115951,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-05-18',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Ford Transit Connect 1.5 EcoBlue TDCi Kasten Trend',
 'transmission': 'automatic',
 'trim': 'Kasten Trend',
 'year': 2022}
2026-01-28 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SP33249%27 HTTP/1.1" 200 None
2026-01-28 20:02:39 [auto1.it] INFO: Saving data for SP33249: {'auction_closing_time': 1769705881.0, 'created_time': 1768248689.70417, 'last_price_update_time': 1769630559.862593}
2026-01-28 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SP33249') HTTP/1.1" 204 0
2026-01-28 20:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XZ92879/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:02:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JV90142/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:02:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XA03649/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:02:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RR01200> (referer: https://www.auto1.com/v1/car-details-view/RR01200/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:02:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BD65212/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:02:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:02:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d7b14fb-b9cf-5147-ac0e-6de09fcca372 with identifier: RR01200
2026-01-28 20:02:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d7b14fb-b9cf-5147-ac0e-6de09fcca372 with scrape type 1
2026-01-28 20:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 0d7b14fb-b9cf-5147-ac0e-6de09fcca372
2026-01-28 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fb1%252F70b11a2b0b862a049c06661b3744d01e%252Fpa%252FRR01200_188ed4ee6350990a26824ce7c4078efb.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/b1/70b11a2b0b862a049c06661b3744d01e/pa/RR01200_188ed4ee6350990a26824ce7c4078efb.jpg not downloaded yet
2026-01-28 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fb1%252F70b11a2b0b862a049c06661b3744d01e%252Fpa%252FRR01200_7a698a2c67c75386d7a944e37332f359.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/b1/70b11a2b0b862a049c06661b3744d01e/pa/RR01200_7a698a2c67c75386d7a944e37332f359.jpg not downloaded yet
2026-01-28 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fb1%252F70b11a2b0b862a049c06661b3744d01e%252Fpa%252FRR01200_1c073352500317d05418fe2c4c1f003d.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/b1/70b11a2b0b862a049c06661b3744d01e/pa/RR01200_1c073352500317d05418fe2c4c1f003d.jpg not downloaded yet
2026-01-28 20:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MJ69210/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AC57291/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fb1%252F70b11a2b0b862a049c06661b3744d01e%252Fpa%252FRR01200_cef79024456bef9e6dcd30b9c5b5cf21.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/b1/70b11a2b0b862a049c06661b3744d01e/pa/RR01200_cef79024456bef9e6dcd30b9c5b5cf21.jpg not downloaded yet
2026-01-28 20:02:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:02:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fb1%252F70b11a2b0b862a049c06661b3744d01e%252Fpa%252FRR01200_571867db6e9067d51609113bd5c98916.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/b1/70b11a2b0b862a049c06661b3744d01e/pa/RR01200_571867db6e9067d51609113bd5c98916.jpg not downloaded yet
2026-01-28 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fb1%252F70b11a2b0b862a049c06661b3744d01e%252Fpa%252FRR01200_d24fcfc00dc04d73337d8a744025b68a.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/b1/70b11a2b0b862a049c06661b3744d01e/pa/RR01200_d24fcfc00dc04d73337d8a744025b68a.jpg not downloaded yet
2026-01-28 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fb1%252F70b11a2b0b862a049c06661b3744d01e%252Fpa%252FRR01200_78988b1c45d7bca7677950ef6f76d778.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/b1/70b11a2b0b862a049c06661b3744d01e/pa/RR01200_78988b1c45d7bca7677950ef6f76d778.jpg not downloaded yet
2026-01-28 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fb1%252F70b11a2b0b862a049c06661b3744d01e%252Fpa%252FRR01200_c916db38379303024398767c385a7aae.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/b1/70b11a2b0b862a049c06661b3744d01e/pa/RR01200_c916db38379303024398767c385a7aae.jpg not downloaded yet
2026-01-28 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fb1%252F70b11a2b0b862a049c06661b3744d01e%252Fpa%252FRR01200_9b6f589dd7059af54c3531a59be88625.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/b1/70b11a2b0b862a049c06661b3744d01e/pa/RR01200_9b6f589dd7059af54c3531a59be88625.jpg not downloaded yet
2026-01-28 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fb1%252F70b11a2b0b862a049c06661b3744d01e%252Fpa%252FRR01200_51e954736e5222b45e7323baeb810e7d.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/b1/70b11a2b0b862a049c06661b3744d01e/pa/RR01200_51e954736e5222b45e7323baeb810e7d.jpg not downloaded yet
2026-01-28 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fb1%252F70b11a2b0b862a049c06661b3744d01e%252Fpa%252FRR01200_5b23266ebe83bbd266edda7b2d6667bb.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/b1/70b11a2b0b862a049c06661b3744d01e/pa/RR01200_5b23266ebe83bbd266edda7b2d6667bb.jpg not downloaded yet
2026-01-28 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fb1%252F70b11a2b0b862a049c06661b3744d01e%252Fpa%252FRR01200_4fd2ab04a9cd6f6e6f8f4a047e7a8ab3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/b1/70b11a2b0b862a049c06661b3744d01e/pa/RR01200_4fd2ab04a9cd6f6e6f8f4a047e7a8ab3.jpg not downloaded yet
2026-01-28 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fb1%252F70b11a2b0b862a049c06661b3744d01e%252Fpa%252FRR01200_ed2a376be333bf0cfccb5a8ee1471503.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/b1/70b11a2b0b862a049c06661b3744d01e/pa/RR01200_ed2a376be333bf0cfccb5a8ee1471503.jpg not downloaded yet
2026-01-28 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fb1%252F70b11a2b0b862a049c06661b3744d01e%252Fpa%252FRR01200_8aae09835899509dc3f556657e1d59a1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/b1/70b11a2b0b862a049c06661b3744d01e/pa/RR01200_8aae09835899509dc3f556657e1d59a1.jpg not downloaded yet
2026-01-28 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fb1%252F70b11a2b0b862a049c06661b3744d01e%252Fpa%252FRR01200_8543bf7a1c67577d72785d49e778530a.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/b1/70b11a2b0b862a049c06661b3744d01e/pa/RR01200_8543bf7a1c67577d72785d49e778530a.jpg not downloaded yet
2026-01-28 20:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/b1/70b11a2b0b862a049c06661b3744d01e/pa/RR01200_1c073352500317d05418fe2c4c1f003d.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/b1/70b11a2b0b862a049c06661b3744d01e/pa/RR01200_8543bf7a1c67577d72785d49e778530a.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:02:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08c766d0>
2026-01-28 20:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d7b14fb-b9cf-5147-ac0e-6de09fcca372/0d7b14fb-b9cf-5147-ac0e-6de09fcca372_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fb1%252F70b11a2b0b862a049c06661b3744d01e%252Fpa%252FRR01200_1c073352500317d05418fe2c4c1f003d.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/b1/70b11a2b0b862a049c06661b3744d01e/pa/RR01200_1c073352500317d05418fe2c4c1f003d.jpg saved to cache
2026-01-28 20:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0d7b14fb-b9cf-5147-ac0e-6de09fcca372
2026-01-28 20:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/b1/70b11a2b0b862a049c06661b3744d01e/pa/RR01200_8aae09835899509dc3f556657e1d59a1.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KM02872/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ED39383> (referer: https://www.auto1.com/v1/car-details-view/ED39383/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:02:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:02:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:02:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09f44990>
2026-01-28 20:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d7b14fb-b9cf-5147-ac0e-6de09fcca372/0d7b14fb-b9cf-5147-ac0e-6de09fcca372_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fb1%252F70b11a2b0b862a049c06661b3744d01e%252Fpa%252FRR01200_8543bf7a1c67577d72785d49e778530a.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/b1/70b11a2b0b862a049c06661b3744d01e/pa/RR01200_8543bf7a1c67577d72785d49e778530a.jpg saved to cache
2026-01-28 20:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 0d7b14fb-b9cf-5147-ac0e-6de09fcca372
2026-01-28 20:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/b1/70b11a2b0b862a049c06661b3744d01e/pa/RR01200_ed2a376be333bf0cfccb5a8ee1471503.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZT96568/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YG51898/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CK36923/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PM20896> (referer: https://www.auto1.com/v1/car-details-view/PM20896/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RS56779/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:02:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09f44f90>
2026-01-28 20:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d7b14fb-b9cf-5147-ac0e-6de09fcca372/0d7b14fb-b9cf-5147-ac0e-6de09fcca372_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fb1%252F70b11a2b0b862a049c06661b3744d01e%252Fpa%252FRR01200_8aae09835899509dc3f556657e1d59a1.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/b1/70b11a2b0b862a049c06661b3744d01e/pa/RR01200_8aae09835899509dc3f556657e1d59a1.jpg saved to cache
2026-01-28 20:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 0d7b14fb-b9cf-5147-ac0e-6de09fcca372
2026-01-28 20:02:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e91390f-d960-55fa-a814-b4adfe996ef2 with identifier: ED39383
2026-01-28 20:02:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e91390f-d960-55fa-a814-b4adfe996ef2 with scrape type 1
2026-01-28 20:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 5e91390f-d960-55fa-a814-b4adfe996ef2
2026-01-28 20:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Ffd%252F38fd88ff893c0fefa3c06446d81828f1%252Fpa%252FED39383_543bf680f2f49e695c6fb0f3a440a87d.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/fd/38fd88ff893c0fefa3c06446d81828f1/pa/ED39383_543bf680f2f49e695c6fb0f3a440a87d.jpg not downloaded yet
2026-01-28 20:02:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:02:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:02:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:02:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:02:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/b1/70b11a2b0b862a049c06661b3744d01e/pa/RR01200_5b23266ebe83bbd266edda7b2d6667bb.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/b1/70b11a2b0b862a049c06661b3744d01e/pa/RR01200_4fd2ab04a9cd6f6e6f8f4a047e7a8ab3.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Ffd%252F38fd88ff893c0fefa3c06446d81828f1%252Fpa%252FED39383_f006e68ad3f078e735e7a4a588c4113c.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/fd/38fd88ff893c0fefa3c06446d81828f1/pa/ED39383_f006e68ad3f078e735e7a4a588c4113c.jpg not downloaded yet
2026-01-28 20:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TL16229/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:02:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b086c3110>
2026-01-28 20:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d7b14fb-b9cf-5147-ac0e-6de09fcca372/0d7b14fb-b9cf-5147-ac0e-6de09fcca372_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fb1%252F70b11a2b0b862a049c06661b3744d01e%252Fpa%252FRR01200_ed2a376be333bf0cfccb5a8ee1471503.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/b1/70b11a2b0b862a049c06661b3744d01e/pa/RR01200_ed2a376be333bf0cfccb5a8ee1471503.jpg saved to cache
2026-01-28 20:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 0d7b14fb-b9cf-5147-ac0e-6de09fcca372
2026-01-28 20:02:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 469aabaa-ad9b-54b4-9480-d6bf26c7d1dc with identifier: PM20896
2026-01-28 20:02:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 469aabaa-ad9b-54b4-9480-d6bf26c7d1dc with scrape type 2
2026-01-28 20:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 469aabaa-ad9b-54b4-9480-d6bf26c7d1dc with scrape type 2
2026-01-28 20:02:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 469aabaa-ad9b-54b4-9480-d6bf26c7d1dc, identifier: PM20896
2026-01-28 20:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/b1/70b11a2b0b862a049c06661b3744d01e/pa/RR01200_51e954736e5222b45e7323baeb810e7d.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Ffd%252F38fd88ff893c0fefa3c06446d81828f1%252Fpa%252FED39383_cbf208456d9f03ddd8533d9086356dd1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/fd/38fd88ff893c0fefa3c06446d81828f1/pa/ED39383_cbf208456d9f03ddd8533d9086356dd1.jpg not downloaded yet
2026-01-28 20:02:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:02:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 469aabaa-ad9b-54b4-9480-d6bf26c7d1dc with identifier: PM20896
2026-01-28 20:02:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 469aabaa-ad9b-54b4-9480-d6bf26c7d1dc with identifier: PM20896
2026-01-28 20:02:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 469aabaa-ad9b-54b4-9480-d6bf26c7d1dc with identifier: PM20896 to the API
2026-01-28 20:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:02:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:02:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PM20896>
{'auction_title': '',
 'c_o_2_emission_value': 176,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6D',
 'engine': '3.0L',
 'engine_horse_power': 333,
 'expiration_date': '2026-01-29T16:27:26Z',
 'fuel_type': 'petrol',
 'id': '469aabaa-ad9b-54b4-9480-d6bf26c7d1dc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PM20896',
 'listing': 'auction',
 'location': 'IT, Varedo (MB)',
 'make': 'BMW',
 'model': '5er',
 'odometer': 20431,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-09-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 5er 540i Mild-Hybrid xDrive M Sport',
 'transmission': 'automatic',
 'trim': 'xDrive M Sport',
 'year': 2021}
2026-01-28 20:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PM20896%27 HTTP/1.1" 200 None
2026-01-28 20:02:42 [auto1.it] INFO: Saving data for PM20896: {'auction_closing_time': 1769704046.0, 'created_time': 1768817253.56312, 'last_price_update_time': 1769630562.399231}
2026-01-28 20:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PM20896') HTTP/1.1" 204 0
2026-01-28 20:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/b1/70b11a2b0b862a049c06661b3744d01e/pa/RR01200_78988b1c45d7bca7677950ef6f76d778.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/b1/70b11a2b0b862a049c06661b3744d01e/pa/RR01200_c916db38379303024398767c385a7aae.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/b1/70b11a2b0b862a049c06661b3744d01e/pa/RR01200_9b6f589dd7059af54c3531a59be88625.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Ffd%252F38fd88ff893c0fefa3c06446d81828f1%252Fpa%252FED39383_ff71729d5bb76579fc929a5259d61cad.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/fd/38fd88ff893c0fefa3c06446d81828f1/pa/ED39383_ff71729d5bb76579fc929a5259d61cad.jpg not downloaded yet
2026-01-28 20:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AJ94497> (referer: https://www.auto1.com/v1/car-details-view/AJ94497/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/fd/38fd88ff893c0fefa3c06446d81828f1/pa/ED39383_543bf680f2f49e695c6fb0f3a440a87d.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:02:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HH59266> (referer: https://www.auto1.com/v1/car-details-view/HH59266/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:02:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08cf4990>
2026-01-28 20:02:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d7b14fb-b9cf-5147-ac0e-6de09fcca372/0d7b14fb-b9cf-5147-ac0e-6de09fcca372_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fb1%252F70b11a2b0b862a049c06661b3744d01e%252Fpa%252FRR01200_5b23266ebe83bbd266edda7b2d6667bb.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/b1/70b11a2b0b862a049c06661b3744d01e/pa/RR01200_5b23266ebe83bbd266edda7b2d6667bb.jpg saved to cache
2026-01-28 20:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 0d7b14fb-b9cf-5147-ac0e-6de09fcca372
2026-01-28 20:02:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09e60150>
2026-01-28 20:02:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d7b14fb-b9cf-5147-ac0e-6de09fcca372/0d7b14fb-b9cf-5147-ac0e-6de09fcca372_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fb1%252F70b11a2b0b862a049c06661b3744d01e%252Fpa%252FRR01200_4fd2ab04a9cd6f6e6f8f4a047e7a8ab3.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/b1/70b11a2b0b862a049c06661b3744d01e/pa/RR01200_4fd2ab04a9cd6f6e6f8f4a047e7a8ab3.jpg saved to cache
2026-01-28 20:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 0d7b14fb-b9cf-5147-ac0e-6de09fcca372
2026-01-28 20:02:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0a0dda10>
2026-01-28 20:02:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d7b14fb-b9cf-5147-ac0e-6de09fcca372/0d7b14fb-b9cf-5147-ac0e-6de09fcca372_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fb1%252F70b11a2b0b862a049c06661b3744d01e%252Fpa%252FRR01200_51e954736e5222b45e7323baeb810e7d.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/b1/70b11a2b0b862a049c06661b3744d01e/pa/RR01200_51e954736e5222b45e7323baeb810e7d.jpg saved to cache
2026-01-28 20:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0d7b14fb-b9cf-5147-ac0e-6de09fcca372
2026-01-28 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Ffd%252F38fd88ff893c0fefa3c06446d81828f1%252Fpa%252FED39383_66d2dbc9af6f0cfd4a0bee5a42a8bee2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/fd/38fd88ff893c0fefa3c06446d81828f1/pa/ED39383_66d2dbc9af6f0cfd4a0bee5a42a8bee2.jpg not downloaded yet
2026-01-28 20:02:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Ffd%252F38fd88ff893c0fefa3c06446d81828f1%252Fpa%252FED39383_b3bbb6b276b0b32b8bfee2972eca74ff.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/fd/38fd88ff893c0fefa3c06446d81828f1/pa/ED39383_b3bbb6b276b0b32b8bfee2972eca74ff.jpg not downloaded yet
2026-01-28 20:02:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08b07390>
2026-01-28 20:02:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d7b14fb-b9cf-5147-ac0e-6de09fcca372/0d7b14fb-b9cf-5147-ac0e-6de09fcca372_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fb1%252F70b11a2b0b862a049c06661b3744d01e%252Fpa%252FRR01200_78988b1c45d7bca7677950ef6f76d778.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/b1/70b11a2b0b862a049c06661b3744d01e/pa/RR01200_78988b1c45d7bca7677950ef6f76d778.jpg saved to cache
2026-01-28 20:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0d7b14fb-b9cf-5147-ac0e-6de09fcca372
2026-01-28 20:02:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b086c3b90>
2026-01-28 20:02:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d7b14fb-b9cf-5147-ac0e-6de09fcca372/0d7b14fb-b9cf-5147-ac0e-6de09fcca372_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fb1%252F70b11a2b0b862a049c06661b3744d01e%252Fpa%252FRR01200_c916db38379303024398767c385a7aae.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/b1/70b11a2b0b862a049c06661b3744d01e/pa/RR01200_c916db38379303024398767c385a7aae.jpg saved to cache
2026-01-28 20:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0d7b14fb-b9cf-5147-ac0e-6de09fcca372
2026-01-28 20:02:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b086c2390>
2026-01-28 20:02:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d7b14fb-b9cf-5147-ac0e-6de09fcca372/0d7b14fb-b9cf-5147-ac0e-6de09fcca372_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fb1%252F70b11a2b0b862a049c06661b3744d01e%252Fpa%252FRR01200_9b6f589dd7059af54c3531a59be88625.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/b1/70b11a2b0b862a049c06661b3744d01e/pa/RR01200_9b6f589dd7059af54c3531a59be88625.jpg saved to cache
2026-01-28 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0d7b14fb-b9cf-5147-ac0e-6de09fcca372
2026-01-28 20:02:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f902eea8-627c-51db-89c8-9495352ad881 with identifier: AJ94497
2026-01-28 20:02:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f902eea8-627c-51db-89c8-9495352ad881 with scrape type 1
2026-01-28 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 13 photos for item f902eea8-627c-51db-89c8-9495352ad881
2026-01-28 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F3c%252Fea3c5c207f517413e6d24154891f3b94%252Fpa%252FAJ94497_6bd4e8f1cf7ef18a7f62bb11c377c32b.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/3c/ea3c5c207f517413e6d24154891f3b94/pa/AJ94497_6bd4e8f1cf7ef18a7f62bb11c377c32b.jpg not downloaded yet
2026-01-28 20:02:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0a0434d0>
2026-01-28 20:02:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e91390f-d960-55fa-a814-b4adfe996ef2/5e91390f-d960-55fa-a814-b4adfe996ef2_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Ffd%252F38fd88ff893c0fefa3c06446d81828f1%252Fpa%252FED39383_543bf680f2f49e695c6fb0f3a440a87d.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/fd/38fd88ff893c0fefa3c06446d81828f1/pa/ED39383_543bf680f2f49e695c6fb0f3a440a87d.jpg saved to cache
2026-01-28 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5e91390f-d960-55fa-a814-b4adfe996ef2
2026-01-28 20:02:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6c8fba6d-0252-5783-ad18-ca6461a4f2b7 with identifier: HH59266
2026-01-28 20:02:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6c8fba6d-0252-5783-ad18-ca6461a4f2b7 with scrape type 2
2026-01-28 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6c8fba6d-0252-5783-ad18-ca6461a4f2b7 with scrape type 2
2026-01-28 20:02:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6c8fba6d-0252-5783-ad18-ca6461a4f2b7, identifier: HH59266
2026-01-28 20:02:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6c8fba6d-0252-5783-ad18-ca6461a4f2b7 with identifier: HH59266
2026-01-28 20:02:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6c8fba6d-0252-5783-ad18-ca6461a4f2b7 with identifier: HH59266
2026-01-28 20:02:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6c8fba6d-0252-5783-ad18-ca6461a4f2b7 with identifier: HH59266 to the API
2026-01-28 20:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:02:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:02:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HH59266>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.0L',
 'engine_horse_power': 91,
 'expiration_date': '2026-01-29T16:58:17Z',
 'fuel_type': 'petrol',
 'id': '6c8fba6d-0252-5783-ad18-ca6461a4f2b7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HH59266',
 'listing': 'auction',
 'location': 'IT, Roma',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 18380,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-12-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Dacia Sandero 1.0 TCe Stepway Expression',
 'transmission': 'manual',
 'trim': 'Stepway Expression',
 'year': 2022}
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HH59266%27 HTTP/1.1" 200 None
2026-01-28 20:02:45 [auto1.it] INFO: Saving data for HH59266: {'auction_closing_time': 1769705897.0, 'created_time': 1767866638.429772, 'last_price_update_time': 1769630565.108954}
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HH59266') HTTP/1.1" 204 0
2026-01-28 20:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/b1/70b11a2b0b862a049c06661b3744d01e/pa/RR01200_d24fcfc00dc04d73337d8a744025b68a.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/fd/38fd88ff893c0fefa3c06446d81828f1/pa/ED39383_ff71729d5bb76579fc929a5259d61cad.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/fd/38fd88ff893c0fefa3c06446d81828f1/pa/ED39383_cbf208456d9f03ddd8533d9086356dd1.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Ffd%252F38fd88ff893c0fefa3c06446d81828f1%252Fpa%252FED39383_cc10d7475d3fd3c392f3f84ffbedf787.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/fd/38fd88ff893c0fefa3c06446d81828f1/pa/ED39383_cc10d7475d3fd3c392f3f84ffbedf787.jpg not downloaded yet
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F3c%252Fea3c5c207f517413e6d24154891f3b94%252Fpa%252FAJ94497_a439d5d37a9e986485147045c360e67f.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/3c/ea3c5c207f517413e6d24154891f3b94/pa/AJ94497_a439d5d37a9e986485147045c360e67f.jpg not downloaded yet
2026-01-28 20:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/fd/38fd88ff893c0fefa3c06446d81828f1/pa/ED39383_f006e68ad3f078e735e7a4a588c4113c.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XZ92879> (referer: https://www.auto1.com/v1/car-details-view/XZ92879/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VM43481> (referer: https://www.auto1.com/v1/car-details-view/VM43481/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YP57818> (referer: https://www.auto1.com/v1/car-details-view/YP57818/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BD65212> (referer: https://www.auto1.com/v1/car-details-view/BD65212/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JG91765> (referer: https://www.auto1.com/v1/car-details-view/JG91765/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AC57291> (referer: https://www.auto1.com/v1/car-details-view/AC57291/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Ffd%252F38fd88ff893c0fefa3c06446d81828f1%252Fpa%252FED39383_f8a1ab4992ca03080dfe7e14e2981365.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/fd/38fd88ff893c0fefa3c06446d81828f1/pa/ED39383_f8a1ab4992ca03080dfe7e14e2981365.jpg not downloaded yet
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F3c%252Fea3c5c207f517413e6d24154891f3b94%252Fpa%252FAJ94497_ce1e7554161199c1126c163e36c9b646.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/3c/ea3c5c207f517413e6d24154891f3b94/pa/AJ94497_ce1e7554161199c1126c163e36c9b646.jpg not downloaded yet
2026-01-28 20:02:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:02:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:02:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:02:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:02:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Ffd%252F38fd88ff893c0fefa3c06446d81828f1%252Fpa%252FED39383_f3f061f8a24253337970fcac7e4ff804.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/fd/38fd88ff893c0fefa3c06446d81828f1/pa/ED39383_f3f061f8a24253337970fcac7e4ff804.jpg not downloaded yet
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F3c%252Fea3c5c207f517413e6d24154891f3b94%252Fpa%252FAJ94497_f0a726eaa1c588656ba0facd05218075.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/3c/ea3c5c207f517413e6d24154891f3b94/pa/AJ94497_f0a726eaa1c588656ba0facd05218075.jpg not downloaded yet
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Ffd%252F38fd88ff893c0fefa3c06446d81828f1%252Fpa%252FED39383_426c5c7abde334ebaf1dfd7a12870b91.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/fd/38fd88ff893c0fefa3c06446d81828f1/pa/ED39383_426c5c7abde334ebaf1dfd7a12870b91.jpg not downloaded yet
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F3c%252Fea3c5c207f517413e6d24154891f3b94%252Fpa%252FAJ94497_1e15c3fd192d865b3aafd420fac54e78.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/3c/ea3c5c207f517413e6d24154891f3b94/pa/AJ94497_1e15c3fd192d865b3aafd420fac54e78.jpg not downloaded yet
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Ffd%252F38fd88ff893c0fefa3c06446d81828f1%252Fpa%252FED39383_aafe6d4327e5c79cc624c23b7a6fd8b2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/fd/38fd88ff893c0fefa3c06446d81828f1/pa/ED39383_aafe6d4327e5c79cc624c23b7a6fd8b2.jpg not downloaded yet
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F3c%252Fea3c5c207f517413e6d24154891f3b94%252Fpa%252FAJ94497_8e1ec012aeac3d5dfe77df9b86c5f246.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/3c/ea3c5c207f517413e6d24154891f3b94/pa/AJ94497_8e1ec012aeac3d5dfe77df9b86c5f246.jpg not downloaded yet
2026-01-28 20:02:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09d97f50>
2026-01-28 20:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d7b14fb-b9cf-5147-ac0e-6de09fcca372/0d7b14fb-b9cf-5147-ac0e-6de09fcca372_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fb1%252F70b11a2b0b862a049c06661b3744d01e%252Fpa%252FRR01200_d24fcfc00dc04d73337d8a744025b68a.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/b1/70b11a2b0b862a049c06661b3744d01e/pa/RR01200_d24fcfc00dc04d73337d8a744025b68a.jpg saved to cache
2026-01-28 20:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0d7b14fb-b9cf-5147-ac0e-6de09fcca372
2026-01-28 20:02:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b088f6150>
2026-01-28 20:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e91390f-d960-55fa-a814-b4adfe996ef2/5e91390f-d960-55fa-a814-b4adfe996ef2_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Ffd%252F38fd88ff893c0fefa3c06446d81828f1%252Fpa%252FED39383_ff71729d5bb76579fc929a5259d61cad.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/fd/38fd88ff893c0fefa3c06446d81828f1/pa/ED39383_ff71729d5bb76579fc929a5259d61cad.jpg saved to cache
2026-01-28 20:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5e91390f-d960-55fa-a814-b4adfe996ef2
2026-01-28 20:02:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b088f7310>
2026-01-28 20:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e91390f-d960-55fa-a814-b4adfe996ef2/5e91390f-d960-55fa-a814-b4adfe996ef2_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Ffd%252F38fd88ff893c0fefa3c06446d81828f1%252Fpa%252FED39383_cbf208456d9f03ddd8533d9086356dd1.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/fd/38fd88ff893c0fefa3c06446d81828f1/pa/ED39383_cbf208456d9f03ddd8533d9086356dd1.jpg saved to cache
2026-01-28 20:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5e91390f-d960-55fa-a814-b4adfe996ef2
2026-01-28 20:02:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/b1/70b11a2b0b862a049c06661b3744d01e/pa/RR01200_571867db6e9067d51609113bd5c98916.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:02:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/b1/70b11a2b0b862a049c06661b3744d01e/pa/RR01200_cef79024456bef9e6dcd30b9c5b5cf21.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:02:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/b1/70b11a2b0b862a049c06661b3744d01e/pa/RR01200_7a698a2c67c75386d7a944e37332f359.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:02:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/fd/38fd88ff893c0fefa3c06446d81828f1/pa/ED39383_cc10d7475d3fd3c392f3f84ffbedf787.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Ffd%252F38fd88ff893c0fefa3c06446d81828f1%252Fpa%252FED39383_4a26861448411c1f480d2803dfcf84a8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/fd/38fd88ff893c0fefa3c06446d81828f1/pa/ED39383_4a26861448411c1f480d2803dfcf84a8.jpg not downloaded yet
2026-01-28 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F3c%252Fea3c5c207f517413e6d24154891f3b94%252Fpa%252FAJ94497_875d1ce4246fd13edf76567d78228669.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/3c/ea3c5c207f517413e6d24154891f3b94/pa/AJ94497_875d1ce4246fd13edf76567d78228669.jpg not downloaded yet
2026-01-28 20:02:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09eb4b50>
2026-01-28 20:02:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e91390f-d960-55fa-a814-b4adfe996ef2/5e91390f-d960-55fa-a814-b4adfe996ef2_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Ffd%252F38fd88ff893c0fefa3c06446d81828f1%252Fpa%252FED39383_f006e68ad3f078e735e7a4a588c4113c.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/fd/38fd88ff893c0fefa3c06446d81828f1/pa/ED39383_f006e68ad3f078e735e7a4a588c4113c.jpg saved to cache
2026-01-28 20:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5e91390f-d960-55fa-a814-b4adfe996ef2
2026-01-28 20:02:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0b8f56d5-5dc2-56aa-a900-55a8006fc8f1 with identifier: XZ92879
2026-01-28 20:02:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0b8f56d5-5dc2-56aa-a900-55a8006fc8f1 with scrape type 1
2026-01-28 20:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 13 photos for item 0b8f56d5-5dc2-56aa-a900-55a8006fc8f1
2026-01-28 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F31%252F4d311aa725e73a36b661a7c8a681b60a%252Fpa%252FXZ92879_8c72d9e7279c6fd44441432d4318fe87.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/31/4d311aa725e73a36b661a7c8a681b60a/pa/XZ92879_8c72d9e7279c6fd44441432d4318fe87.jpg not downloaded yet
2026-01-28 20:02:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 49e888e6-e08b-55b6-b9f8-fdb6743794c4 with identifier: VM43481
2026-01-28 20:02:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49e888e6-e08b-55b6-b9f8-fdb6743794c4 with scrape type 1
2026-01-28 20:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 49e888e6-e08b-55b6-b9f8-fdb6743794c4
2026-01-28 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F20%252Ff72010615952f8b7c2d6f5563f39ebd3%252Fpa%252FVM43481_72b7d3f5fa5e1ec4cab5c822ef3c293b.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/20/f72010615952f8b7c2d6f5563f39ebd3/pa/VM43481_72b7d3f5fa5e1ec4cab5c822ef3c293b.jpg not downloaded yet
2026-01-28 20:02:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b430618-12a2-5ef9-b8cf-158756d3a6f4 with identifier: YP57818
2026-01-28 20:02:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b430618-12a2-5ef9-b8cf-158756d3a6f4 with scrape type 2
2026-01-28 20:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6b430618-12a2-5ef9-b8cf-158756d3a6f4 with scrape type 2
2026-01-28 20:02:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6b430618-12a2-5ef9-b8cf-158756d3a6f4, identifier: YP57818
2026-01-28 20:02:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c8c1f790-5be4-59cd-856c-415a495ca919 with identifier: BD65212
2026-01-28 20:02:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8c1f790-5be4-59cd-856c-415a495ca919 with scrape type 1
2026-01-28 20:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item c8c1f790-5be4-59cd-856c-415a495ca919
2026-01-28 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Fd8%252F7ed85488bc581cacf8f0ee8e30d77685%252Fpa%252FBD65212_986e04cfa44d05e16bea8f29440e5dbc.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/d8/7ed85488bc581cacf8f0ee8e30d77685/pa/BD65212_986e04cfa44d05e16bea8f29440e5dbc.jpg already downloaded
2026-01-28 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Fd8%252F7ed85488bc581cacf8f0ee8e30d77685%252Fpa%252FBD65212_732a37a6aa2c9946dd5b35b1a2917c73.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/d8/7ed85488bc581cacf8f0ee8e30d77685/pa/BD65212_732a37a6aa2c9946dd5b35b1a2917c73.jpg already downloaded
2026-01-28 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Fd8%252F7ed85488bc581cacf8f0ee8e30d77685%252Fpa%252FBD65212_8a0b08908fc3fb40d7633db2ff7fd4f7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/d8/7ed85488bc581cacf8f0ee8e30d77685/pa/BD65212_8a0b08908fc3fb40d7633db2ff7fd4f7.jpg already downloaded
2026-01-28 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Fd8%252F7ed85488bc581cacf8f0ee8e30d77685%252Fpa%252FBD65212_f431d776523d4b65411b532baef7f70e.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/d8/7ed85488bc581cacf8f0ee8e30d77685/pa/BD65212_f431d776523d4b65411b532baef7f70e.jpg already downloaded
2026-01-28 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Fd8%252F7ed85488bc581cacf8f0ee8e30d77685%252Fpa%252FBD65212_949e5fece680b3d01a26026b7ca667d2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/d8/7ed85488bc581cacf8f0ee8e30d77685/pa/BD65212_949e5fece680b3d01a26026b7ca667d2.jpg already downloaded
2026-01-28 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Fd8%252F7ed85488bc581cacf8f0ee8e30d77685%252Fpa%252FBD65212_25988777f3336d44c26cfe8288f008a6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/d8/7ed85488bc581cacf8f0ee8e30d77685/pa/BD65212_25988777f3336d44c26cfe8288f008a6.jpg already downloaded
2026-01-28 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Fd8%252F7ed85488bc581cacf8f0ee8e30d77685%252Fpa%252FBD65212_864238d9e28d15dd9ba5024de940837f.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/d8/7ed85488bc581cacf8f0ee8e30d77685/pa/BD65212_864238d9e28d15dd9ba5024de940837f.jpg already downloaded
2026-01-28 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Fd8%252F7ed85488bc581cacf8f0ee8e30d77685%252Fpa%252FBD65212_8f5c1b89beeeccad4261f907ba78cf39.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/d8/7ed85488bc581cacf8f0ee8e30d77685/pa/BD65212_8f5c1b89beeeccad4261f907ba78cf39.jpg already downloaded
2026-01-28 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Fd8%252F7ed85488bc581cacf8f0ee8e30d77685%252Fpa%252FBD65212_b2ab667e88506cb405b0723e8f8f759b.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/d8/7ed85488bc581cacf8f0ee8e30d77685/pa/BD65212_b2ab667e88506cb405b0723e8f8f759b.jpg already downloaded
2026-01-28 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Fd8%252F7ed85488bc581cacf8f0ee8e30d77685%252Fpa%252FBD65212_db5117dbdea7400f84e7eca26025ad9e.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/d8/7ed85488bc581cacf8f0ee8e30d77685/pa/BD65212_db5117dbdea7400f84e7eca26025ad9e.jpg already downloaded
2026-01-28 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Fd8%252F7ed85488bc581cacf8f0ee8e30d77685%252Fpa%252FBD65212_2364b7acdcb3abbfabc5b5dfa7865cde.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/d8/7ed85488bc581cacf8f0ee8e30d77685/pa/BD65212_2364b7acdcb3abbfabc5b5dfa7865cde.jpg already downloaded
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Fd8%252F7ed85488bc581cacf8f0ee8e30d77685%252Fpa%252FBD65212_3c9204d191d7970e8052b71675ec2728.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/d8/7ed85488bc581cacf8f0ee8e30d77685/pa/BD65212_3c9204d191d7970e8052b71675ec2728.jpg already downloaded
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Fd8%252F7ed85488bc581cacf8f0ee8e30d77685%252Fpa%252FBD65212_f9559313655c707a4083bf0be7caed73.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/d8/7ed85488bc581cacf8f0ee8e30d77685/pa/BD65212_f9559313655c707a4083bf0be7caed73.jpg already downloaded
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Fd8%252F7ed85488bc581cacf8f0ee8e30d77685%252Fpa%252FBD65212_67940bd016948c13be00f3100128ae6e.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/d8/7ed85488bc581cacf8f0ee8e30d77685/pa/BD65212_67940bd016948c13be00f3100128ae6e.jpg already downloaded
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252Fd8%252F7ed85488bc581cacf8f0ee8e30d77685%252Fpa%252FBD65212_61bee343e632c762547ad75fdeab4975.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/d8/7ed85488bc581cacf8f0ee8e30d77685/pa/BD65212_61bee343e632c762547ad75fdeab4975.jpg already downloaded
2026-01-28 20:02:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c8c1f790-5be4-59cd-856c-415a495ca919, identifier: BD65212
2026-01-28 20:02:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 424c2fd1-f4e2-5a1c-acf7-7bb3a1fd6151 with identifier: JG91765
2026-01-28 20:02:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 424c2fd1-f4e2-5a1c-acf7-7bb3a1fd6151 with scrape type 1
2026-01-28 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 13 photos for item 424c2fd1-f4e2-5a1c-acf7-7bb3a1fd6151
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F66%252Fe566e21a6b255f63478fe2f214026935%252Fpa%252FJG91765_915102c90ea3bd68ca8b292ebb7c49fa.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/66/e566e21a6b255f63478fe2f214026935/pa/JG91765_915102c90ea3bd68ca8b292ebb7c49fa.jpg already downloaded
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F66%252Fe566e21a6b255f63478fe2f214026935%252Fpa%252FJG91765_8230fd3eea6ad38a234a61a37baafda1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/66/e566e21a6b255f63478fe2f214026935/pa/JG91765_8230fd3eea6ad38a234a61a37baafda1.jpg already downloaded
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F66%252Fe566e21a6b255f63478fe2f214026935%252Fpa%252FJG91765_01b13363bdc8cbef50f520c1f3178ed9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/66/e566e21a6b255f63478fe2f214026935/pa/JG91765_01b13363bdc8cbef50f520c1f3178ed9.jpg already downloaded
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F66%252Fe566e21a6b255f63478fe2f214026935%252Fpa%252FJG91765_3012f89e3084b99f6c3dc35de880194e.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/66/e566e21a6b255f63478fe2f214026935/pa/JG91765_3012f89e3084b99f6c3dc35de880194e.jpg already downloaded
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F66%252Fe566e21a6b255f63478fe2f214026935%252Fpa%252FJG91765_b743dd0c4745b09462f34989aa2dabe9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/66/e566e21a6b255f63478fe2f214026935/pa/JG91765_b743dd0c4745b09462f34989aa2dabe9.jpg already downloaded
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F66%252Fe566e21a6b255f63478fe2f214026935%252Fpa%252FJG91765_36171dc72550c6965090d4eece050deb.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/66/e566e21a6b255f63478fe2f214026935/pa/JG91765_36171dc72550c6965090d4eece050deb.jpg already downloaded
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F66%252Fe566e21a6b255f63478fe2f214026935%252Fpa%252FJG91765_8c9f18e23689f5a3ab36d4d851c3e871.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/66/e566e21a6b255f63478fe2f214026935/pa/JG91765_8c9f18e23689f5a3ab36d4d851c3e871.jpg already downloaded
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F66%252Fe566e21a6b255f63478fe2f214026935%252Fpa%252FJG91765_9a124d9a551f64989e7a21ba9205fbff.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/66/e566e21a6b255f63478fe2f214026935/pa/JG91765_9a124d9a551f64989e7a21ba9205fbff.jpg already downloaded
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F66%252Fe566e21a6b255f63478fe2f214026935%252Fpa%252FJG91765_eab0863a9aedef0e069a0d129979eb3c.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/66/e566e21a6b255f63478fe2f214026935/pa/JG91765_eab0863a9aedef0e069a0d129979eb3c.jpg already downloaded
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F66%252Fe566e21a6b255f63478fe2f214026935%252Fpa%252FJG91765_681f668e18a2a66f3923f294a5928d09.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/66/e566e21a6b255f63478fe2f214026935/pa/JG91765_681f668e18a2a66f3923f294a5928d09.jpg already downloaded
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F66%252Fe566e21a6b255f63478fe2f214026935%252Fpa%252FJG91765_da74cdc6d658142225b257230d1915cb.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/66/e566e21a6b255f63478fe2f214026935/pa/JG91765_da74cdc6d658142225b257230d1915cb.jpg already downloaded
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F66%252Fe566e21a6b255f63478fe2f214026935%252Fpa%252FJG91765_8e714b275086bf93c945b30671704a9e.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/66/e566e21a6b255f63478fe2f214026935/pa/JG91765_8e714b275086bf93c945b30671704a9e.jpg already downloaded
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F66%252Fe566e21a6b255f63478fe2f214026935%252Fpa%252FJG91765_7d5ffcdcd5df71ec87a078cb1b0e87bb.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/66/e566e21a6b255f63478fe2f214026935/pa/JG91765_7d5ffcdcd5df71ec87a078cb1b0e87bb.jpg already downloaded
2026-01-28 20:02:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 424c2fd1-f4e2-5a1c-acf7-7bb3a1fd6151, identifier: JG91765
2026-01-28 20:02:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 32036054-ff2f-5f01-9b00-edf64a69cfa2 with identifier: AC57291
2026-01-28 20:02:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32036054-ff2f-5f01-9b00-edf64a69cfa2 with scrape type 1
2026-01-28 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 32036054-ff2f-5f01-9b00-edf64a69cfa2
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F89%252Ffd89c4e8032f562bcbc4e894776f8b3a%252Fpa%252FAC57291_b1ad4405999dc59fc1e8fded58a454d9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/89/fd89c4e8032f562bcbc4e894776f8b3a/pa/AC57291_b1ad4405999dc59fc1e8fded58a454d9.jpg not downloaded yet
2026-01-28 20:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/fd/38fd88ff893c0fefa3c06446d81828f1/pa/ED39383_b3bbb6b276b0b32b8bfee2972eca74ff.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/fd/38fd88ff893c0fefa3c06446d81828f1/pa/ED39383_66d2dbc9af6f0cfd4a0bee5a42a8bee2.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MJ69210> (referer: https://www.auto1.com/v1/car-details-view/MJ69210/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:02:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6b430618-12a2-5ef9-b8cf-158756d3a6f4 with identifier: YP57818
2026-01-28 20:02:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6b430618-12a2-5ef9-b8cf-158756d3a6f4 with identifier: YP57818
2026-01-28 20:02:47 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'maserati levante 3.0 v6 diesel gransport', 'price': 0, 'currency': 'eur', 'make': 'maserati', 'model': 'levante', 'transmission': 'automatic', 'odometer': 127947, 'odometer_reading_unit': 'km', 'registration_date': '2018-10-11', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/yp57818', 'expiration_date': '2026-01-29t16:03:17z', 'origin_country_code': 'it', 'trim': 'gransport', 'year': 2018, 'fuel_type': 'diesel', 'listing': 'auction', 'engine_horse_power': 250, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '3.0l', 'location': 'it, bentivoglio (bo)', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6c', 'c_o_2_emission_value': 213, 'id': '6b430618-12a2-5ef9-b8cf-158756d3a6f4', 'current_year_diff': 8, 'age_in_months': 87, 'make_model': 'maserati levante', 'sanitized_make': 'maserati', 'odometer_in_km': 127947}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 87,
     'auction_title': '',
     'c_o_2_emission_value': 213,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 8,
     'doors_number': 5,
     'emission_standard': 'euro 6c',
     'engine': '3.0l',
     'engine_horse_power': 250,
     'expiration_date': '2026-01-29t16:03:17z',
     'fuel_type': 'diesel',
     'id': '6b430618-12a2-5ef9-b8cf-158756d3a6f4',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/yp57818',
     'listing': 'auction',
     'location': 'it, bentivoglio (bo)',
     'make': 'maserati',
     'make_model': 'maserati levante',
     'model': 'levante',
     'odometer': 127947,
     'odometer_in_km': 127947,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'it',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2018-10-11',
     'sanitized_make': 'maserati',
     'seats_number': 5,
     'seller_name': None,
     'title': 'maserati levante 3.0 v6 diesel gransport',
     'transmission': 'automatic',
     'trim': 'gransport',
     'year': 2018}
2026-01-28 20:02:47 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_NOT_ALLOWED failed for item: 6b430618-12a2-5ef9-b8cf-158756d3a6f4 spider: auto1.it
2026-01-28 20:02:48 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 6b430618-12a2-5ef9-b8cf-158756d3a6f4 due to rule: makes_not_allowed.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'maserati levante 3.0 v6 diesel gransport', 'price': 0, 'currency': 'eur', 'make': 'maserati', 'model': 'levante', 'transmission': 'automatic', 'odometer': 127947, 'odometer_reading_unit': 'km', 'registration_date': '2018-10-11', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/yp57818', 'expiration_date': '2026-01-29t16:03:17z', 'origin_country_code': 'it', 'trim': 'gransport', 'year': 2018, 'fuel_type': 'diesel', 'listing': 'auction', 'engine_horse_power': 250, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '3.0l', 'location': 'it, bentivoglio (bo)', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6c', 'c_o_2_emission_value': 213, 'id': '6b430618-12a2-5ef9-b8cf-158756d3a6f4', 'current_year_diff': 8, 'age_in_months': 87, 'make_model': 'maserati levante', 'sanitized_make': 'maserati', 'odometer_in_km': 127947}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 87,
     'auction_title': '',
     'c_o_2_emission_value': 213,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 8,
     'doors_number': 5,
     'emission_standard': 'euro 6c',
     'engine': '3.0l',
     'engine_horse_power': 250,
     'expiration_date': '2026-01-29t16:03:17z',
     'fuel_type': 'diesel',
     'id': '6b430618-12a2-5ef9-b8cf-158756d3a6f4',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/yp57818',
     'listing': 'auction',
     'location': 'it, bentivoglio (bo)',
     'make': 'maserati',
     'make_model': 'maserati levante',
     'model': 'levante',
     'odometer': 127947,
     'odometer_in_km': 127947,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'it',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2018-10-11',
     'sanitized_make': 'maserati',
     'seats_number': 5,
     'seller_name': None,
     'title': 'maserati levante 3.0 v6 diesel gransport',
     'transmission': 'automatic',
     'trim': 'gransport',
     'year': 2018}
{'auction_title': '',
 'c_o_2_emission_value': 213,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6C',
 'engine': '3.0L',
 'engine_horse_power': 250,
 'expiration_date': '2026-01-29T16:03:17Z',
 'fuel_type': 'diesel',
 'id': '6b430618-12a2-5ef9-b8cf-158756d3a6f4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YP57818',
 'listing': 'auction',
 'location': 'IT, Bentivoglio (BO)',
 'make': 'Maserati',
 'model': 'Levante',
 'odometer': 127947,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-10-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Maserati Levante 3.0 V6 Diesel GranSport',
 'transmission': 'automatic',
 'trim': 'GranSport',
 'year': 2018}
2026-01-28 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YP57818%27 HTTP/1.1" 200 None
2026-01-28 20:02:48 [auto1.it] INFO: Saving data for YP57818: {'auction_closing_time': 1769702597.0, 'created_time': 1767693771.965379, 'last_price_update_time': 1769630568.096393}
2026-01-28 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YP57818') HTTP/1.1" 204 0
2026-01-28 20:02:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c8c1f790-5be4-59cd-856c-415a495ca919 with identifier: BD65212
2026-01-28 20:02:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c8c1f790-5be4-59cd-856c-415a495ca919 with identifier: BD65212
2026-01-28 20:02:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c8c1f790-5be4-59cd-856c-415a495ca919 with identifier: BD65212 to the API
2026-01-28 20:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:02:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:02:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BD65212>
{'auction_title': '',
 'c_o_2_emission_value': 166,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '2.0L',
 'engine_horse_power': 185,
 'expiration_date': '2026-01-29T16:54:17Z',
 'fuel_type': 'petrol',
 'id': 'c8c1f790-5be4-59cd-856c-415a495ca919',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BD65212',
 'listing': 'auction',
 'location': 'IT, Castelnuovo del Garda (VR)',
 'make': 'BMW',
 'model': 'X4',
 'odometer': 93028,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img7e/d8/7ed85488bc581cacf8f0ee8e30d77685/pa/BD65212_986e04cfa44d05e16bea8f29440e5dbc.jpg',
                'https://img-pa.auto1.com/img7e/d8/7ed85488bc581cacf8f0ee8e30d77685/pa/BD65212_732a37a6aa2c9946dd5b35b1a2917c73.jpg',
                'https://img-pa.auto1.com/img7e/d8/7ed85488bc581cacf8f0ee8e30d77685/pa/BD65212_8a0b08908fc3fb40d7633db2ff7fd4f7.jpg',
                'https://img-pa.auto1.com/img7e/d8/7ed85488bc581cacf8f0ee8e30d77685/pa/BD65212_f431d776523d4b65411b532baef7f70e.jpg',
                'https://img-pa.auto1.com/img7e/d8/7ed85488bc581cacf8f0ee8e30d77685/pa/BD65212_949e5fece680b3d01a26026b7ca667d2.jpg',
                'https://img-pa.auto1.com/img7e/d8/7ed85488bc581cacf8f0ee8e30d77685/pa/BD65212_25988777f3336d44c26cfe8288f008a6.jpg',
                'https://img-pa.auto1.com/img7e/d8/7ed85488bc581cacf8f0ee8e30d77685/pa/BD65212_864238d9e28d15dd9ba5024de940837f.jpg',
                'https://img-pa.auto1.com/img7e/d8/7ed85488bc581cacf8f0ee8e30d77685/pa/BD65212_8f5c1b89beeeccad4261f907ba78cf39.jpg',
                'https://img-pa.auto1.com/img7e/d8/7ed85488bc581cacf8f0ee8e30d77685/pa/BD65212_b2ab667e88506cb405b0723e8f8f759b.jpg',
                'https://img-pa.auto1.com/img7e/d8/7ed85488bc581cacf8f0ee8e30d77685/pa/BD65212_db5117dbdea7400f84e7eca26025ad9e.jpg',
                'https://img-pa.auto1.com/img7e/d8/7ed85488bc581cacf8f0ee8e30d77685/pa/BD65212_2364b7acdcb3abbfabc5b5dfa7865cde.jpg',
                'https://img-pa.auto1.com/img7e/d8/7ed85488bc581cacf8f0ee8e30d77685/pa/BD65212_3c9204d191d7970e8052b71675ec2728.jpg',
                'https://img-pa.auto1.com/img7e/d8/7ed85488bc581cacf8f0ee8e30d77685/pa/BD65212_f9559313655c707a4083bf0be7caed73.jpg',
                'https://img-pa.auto1.com/img7e/d8/7ed85488bc581cacf8f0ee8e30d77685/pa/BD65212_67940bd016948c13be00f3100128ae6e.jpg',
                'https://img-pa.auto1.com/img7e/d8/7ed85488bc581cacf8f0ee8e30d77685/pa/BD65212_61bee343e632c762547ad75fdeab4975.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8c1f790-5be4-59cd-856c-415a495ca919/c8c1f790-5be4-59cd-856c-415a495ca919_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2673036,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/d8/7ed85488bc581cacf8f0ee8e30d77685/pa/BD65212_986e04cfa44d05e16bea8f29440e5dbc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8c1f790-5be4-59cd-856c-415a495ca919/c8c1f790-5be4-59cd-856c-415a495ca919_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2722039,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/d8/7ed85488bc581cacf8f0ee8e30d77685/pa/BD65212_732a37a6aa2c9946dd5b35b1a2917c73.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8c1f790-5be4-59cd-856c-415a495ca919/c8c1f790-5be4-59cd-856c-415a495ca919_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2443113,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/d8/7ed85488bc581cacf8f0ee8e30d77685/pa/BD65212_8a0b08908fc3fb40d7633db2ff7fd4f7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8c1f790-5be4-59cd-856c-415a495ca919/c8c1f790-5be4-59cd-856c-415a495ca919_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2486435,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/d8/7ed85488bc581cacf8f0ee8e30d77685/pa/BD65212_f431d776523d4b65411b532baef7f70e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8c1f790-5be4-59cd-856c-415a495ca919/c8c1f790-5be4-59cd-856c-415a495ca919_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58753,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/d8/7ed85488bc581cacf8f0ee8e30d77685/pa/BD65212_949e5fece680b3d01a26026b7ca667d2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8c1f790-5be4-59cd-856c-415a495ca919/c8c1f790-5be4-59cd-856c-415a495ca919_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66920,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/d8/7ed85488bc581cacf8f0ee8e30d77685/pa/BD65212_25988777f3336d44c26cfe8288f008a6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8c1f790-5be4-59cd-856c-415a495ca919/c8c1f790-5be4-59cd-856c-415a495ca919_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54433,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/d8/7ed85488bc581cacf8f0ee8e30d77685/pa/BD65212_864238d9e28d15dd9ba5024de940837f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8c1f790-5be4-59cd-856c-415a495ca919/c8c1f790-5be4-59cd-856c-415a495ca919_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69762,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/d8/7ed85488bc581cacf8f0ee8e30d77685/pa/BD65212_8f5c1b89beeeccad4261f907ba78cf39.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8c1f790-5be4-59cd-856c-415a495ca919/c8c1f790-5be4-59cd-856c-415a495ca919_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2330809,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/d8/7ed85488bc581cacf8f0ee8e30d77685/pa/BD65212_b2ab667e88506cb405b0723e8f8f759b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8c1f790-5be4-59cd-856c-415a495ca919/c8c1f790-5be4-59cd-856c-415a495ca919_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63017,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/d8/7ed85488bc581cacf8f0ee8e30d77685/pa/BD65212_db5117dbdea7400f84e7eca26025ad9e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8c1f790-5be4-59cd-856c-415a495ca919/c8c1f790-5be4-59cd-856c-415a495ca919_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2683284,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/d8/7ed85488bc581cacf8f0ee8e30d77685/pa/BD65212_2364b7acdcb3abbfabc5b5dfa7865cde.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8c1f790-5be4-59cd-856c-415a495ca919/c8c1f790-5be4-59cd-856c-415a495ca919_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2616884,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/d8/7ed85488bc581cacf8f0ee8e30d77685/pa/BD65212_3c9204d191d7970e8052b71675ec2728.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8c1f790-5be4-59cd-856c-415a495ca919/c8c1f790-5be4-59cd-856c-415a495ca919_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2736538,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/d8/7ed85488bc581cacf8f0ee8e30d77685/pa/BD65212_f9559313655c707a4083bf0be7caed73.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8c1f790-5be4-59cd-856c-415a495ca919/c8c1f790-5be4-59cd-856c-415a495ca919_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2424737,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/d8/7ed85488bc581cacf8f0ee8e30d77685/pa/BD65212_67940bd016948c13be00f3100128ae6e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8c1f790-5be4-59cd-856c-415a495ca919/c8c1f790-5be4-59cd-856c-415a495ca919_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54022,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/d8/7ed85488bc581cacf8f0ee8e30d77685/pa/BD65212_61bee343e632c762547ad75fdeab4975.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-04-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X4 xDrive 20i Mild-Hybrid M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2019}
2026-01-28 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BD65212%27 HTTP/1.1" 200 None
2026-01-28 20:02:48 [auto1.it] INFO: Saving data for BD65212: {'created_time': 1769630568.490739, 'last_price_update_time': 1769630568.490751, 'auction_closing_time': 1769705657.0}
2026-01-28 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BD65212') HTTP/1.1" 204 0
2026-01-28 20:02:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 424c2fd1-f4e2-5a1c-acf7-7bb3a1fd6151 with identifier: JG91765
2026-01-28 20:02:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 424c2fd1-f4e2-5a1c-acf7-7bb3a1fd6151 with identifier: JG91765
2026-01-28 20:02:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 424c2fd1-f4e2-5a1c-acf7-7bb3a1fd6151 with identifier: JG91765 to the API
2026-01-28 20:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:02:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:02:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JG91765>
{'auction_title': '',
 'c_o_2_emission_value': 171,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 204,
 'expiration_date': '2026-01-29T16:26:43Z',
 'fuel_type': 'diesel',
 'id': '424c2fd1-f4e2-5a1c-acf7-7bb3a1fd6151',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JG91765',
 'listing': 'auction',
 'location': 'IT',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 95096,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 13,
 'photo_urls': ['https://img-pa.auto1.com/imge5/66/e566e21a6b255f63478fe2f214026935/pa/JG91765_915102c90ea3bd68ca8b292ebb7c49fa.jpg',
                'https://img-pa.auto1.com/imge5/66/e566e21a6b255f63478fe2f214026935/pa/JG91765_8230fd3eea6ad38a234a61a37baafda1.jpg',
                'https://img-pa.auto1.com/imge5/66/e566e21a6b255f63478fe2f214026935/pa/JG91765_01b13363bdc8cbef50f520c1f3178ed9.jpg',
                'https://img-pa.auto1.com/imge5/66/e566e21a6b255f63478fe2f214026935/pa/JG91765_3012f89e3084b99f6c3dc35de880194e.jpg',
                'https://img-pa.auto1.com/imge5/66/e566e21a6b255f63478fe2f214026935/pa/JG91765_b743dd0c4745b09462f34989aa2dabe9.jpg',
                'https://img-pa.auto1.com/imge5/66/e566e21a6b255f63478fe2f214026935/pa/JG91765_36171dc72550c6965090d4eece050deb.jpg',
                'https://img-pa.auto1.com/imge5/66/e566e21a6b255f63478fe2f214026935/pa/JG91765_8c9f18e23689f5a3ab36d4d851c3e871.jpg',
                'https://img-pa.auto1.com/imge5/66/e566e21a6b255f63478fe2f214026935/pa/JG91765_9a124d9a551f64989e7a21ba9205fbff.jpg',
                'https://img-pa.auto1.com/imge5/66/e566e21a6b255f63478fe2f214026935/pa/JG91765_eab0863a9aedef0e069a0d129979eb3c.jpg',
                'https://img-pa.auto1.com/imge5/66/e566e21a6b255f63478fe2f214026935/pa/JG91765_681f668e18a2a66f3923f294a5928d09.jpg',
                'https://img-pa.auto1.com/imge5/66/e566e21a6b255f63478fe2f214026935/pa/JG91765_da74cdc6d658142225b257230d1915cb.jpg',
                'https://img-pa.auto1.com/imge5/66/e566e21a6b255f63478fe2f214026935/pa/JG91765_8e714b275086bf93c945b30671704a9e.jpg',
                'https://img-pa.auto1.com/imge5/66/e566e21a6b255f63478fe2f214026935/pa/JG91765_7d5ffcdcd5df71ec87a078cb1b0e87bb.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_424c2fd1-f4e2-5a1c-acf7-7bb3a1fd6151/424c2fd1-f4e2-5a1c-acf7-7bb3a1fd6151_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3002290,
             'Height': 3456,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/66/e566e21a6b255f63478fe2f214026935/pa/JG91765_915102c90ea3bd68ca8b292ebb7c49fa.jpg',
             'Width': 3846},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_424c2fd1-f4e2-5a1c-acf7-7bb3a1fd6151/424c2fd1-f4e2-5a1c-acf7-7bb3a1fd6151_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60157,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/66/e566e21a6b255f63478fe2f214026935/pa/JG91765_8230fd3eea6ad38a234a61a37baafda1.jpg',
             'Width': 668},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_424c2fd1-f4e2-5a1c-acf7-7bb3a1fd6151/424c2fd1-f4e2-5a1c-acf7-7bb3a1fd6151_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2114317,
             'Height': 3456,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/66/e566e21a6b255f63478fe2f214026935/pa/JG91765_01b13363bdc8cbef50f520c1f3178ed9.jpg',
             'Width': 3902},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_424c2fd1-f4e2-5a1c-acf7-7bb3a1fd6151/424c2fd1-f4e2-5a1c-acf7-7bb3a1fd6151_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3518276,
             'Height': 3024,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/66/e566e21a6b255f63478fe2f214026935/pa/JG91765_3012f89e3084b99f6c3dc35de880194e.jpg',
             'Width': 4032},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_424c2fd1-f4e2-5a1c-acf7-7bb3a1fd6151/424c2fd1-f4e2-5a1c-acf7-7bb3a1fd6151_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2881215,
             'Height': 3456,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/66/e566e21a6b255f63478fe2f214026935/pa/JG91765_b743dd0c4745b09462f34989aa2dabe9.jpg',
             'Width': 4608},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_424c2fd1-f4e2-5a1c-acf7-7bb3a1fd6151/424c2fd1-f4e2-5a1c-acf7-7bb3a1fd6151_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3328431,
             'Height': 3456,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/66/e566e21a6b255f63478fe2f214026935/pa/JG91765_36171dc72550c6965090d4eece050deb.jpg',
             'Width': 4608},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_424c2fd1-f4e2-5a1c-acf7-7bb3a1fd6151/424c2fd1-f4e2-5a1c-acf7-7bb3a1fd6151_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2934738,
             'Height': 3024,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/66/e566e21a6b255f63478fe2f214026935/pa/JG91765_8c9f18e23689f5a3ab36d4d851c3e871.jpg',
             'Width': 4032},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_424c2fd1-f4e2-5a1c-acf7-7bb3a1fd6151/424c2fd1-f4e2-5a1c-acf7-7bb3a1fd6151_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3214928,
             'Height': 3024,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/66/e566e21a6b255f63478fe2f214026935/pa/JG91765_9a124d9a551f64989e7a21ba9205fbff.jpg',
             'Width': 4032},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_424c2fd1-f4e2-5a1c-acf7-7bb3a1fd6151/424c2fd1-f4e2-5a1c-acf7-7bb3a1fd6151_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3087456,
             'Height': 3024,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/66/e566e21a6b255f63478fe2f214026935/pa/JG91765_eab0863a9aedef0e069a0d129979eb3c.jpg',
             'Width': 4032},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_424c2fd1-f4e2-5a1c-acf7-7bb3a1fd6151/424c2fd1-f4e2-5a1c-acf7-7bb3a1fd6151_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73080,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/66/e566e21a6b255f63478fe2f214026935/pa/JG91765_681f668e18a2a66f3923f294a5928d09.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_424c2fd1-f4e2-5a1c-acf7-7bb3a1fd6151/424c2fd1-f4e2-5a1c-acf7-7bb3a1fd6151_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3205472,
             'Height': 3024,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/66/e566e21a6b255f63478fe2f214026935/pa/JG91765_da74cdc6d658142225b257230d1915cb.jpg',
             'Width': 4032},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_424c2fd1-f4e2-5a1c-acf7-7bb3a1fd6151/424c2fd1-f4e2-5a1c-acf7-7bb3a1fd6151_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3341305,
             'Height': 3024,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/66/e566e21a6b255f63478fe2f214026935/pa/JG91765_8e714b275086bf93c945b30671704a9e.jpg',
             'Width': 4032},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_424c2fd1-f4e2-5a1c-acf7-7bb3a1fd6151/424c2fd1-f4e2-5a1c-acf7-7bb3a1fd6151_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3451974,
             'Height': 3024,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/66/e566e21a6b255f63478fe2f214026935/pa/JG91765_7d5ffcdcd5df71ec87a078cb1b0e87bb.jpg',
             'Width': 4032}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-12-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q5 40 TDI Mild-Hybrid quattro advanced',
 'transmission': 'automatic',
 'trim': 'quattro advanced',
 'year': 2020}
2026-01-28 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JG91765%27 HTTP/1.1" 200 None
2026-01-28 20:02:48 [auto1.it] INFO: Saving data for JG91765: {'created_time': 1769630568.855264, 'last_price_update_time': 1769630568.855275, 'auction_closing_time': 1769704003.0}
2026-01-28 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JG91765') HTTP/1.1" 204 0
2026-01-28 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Ffd%252F38fd88ff893c0fefa3c06446d81828f1%252Fpa%252FED39383_7da02b384c9dd312289601029a6d0f2f.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/fd/38fd88ff893c0fefa3c06446d81828f1/pa/ED39383_7da02b384c9dd312289601029a6d0f2f.jpg not downloaded yet
2026-01-28 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F3c%252Fea3c5c207f517413e6d24154891f3b94%252Fpa%252FAJ94497_31b5af403c4bc12c4d6d12ab5862a827.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/3c/ea3c5c207f517413e6d24154891f3b94/pa/AJ94497_31b5af403c4bc12c4d6d12ab5862a827.jpg not downloaded yet
2026-01-28 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F31%252F4d311aa725e73a36b661a7c8a681b60a%252Fpa%252FXZ92879_38a98400dfc4359259cb3cd2c9a243c0.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/31/4d311aa725e73a36b661a7c8a681b60a/pa/XZ92879_38a98400dfc4359259cb3cd2c9a243c0.jpg not downloaded yet
2026-01-28 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F20%252Ff72010615952f8b7c2d6f5563f39ebd3%252Fpa%252FVM43481_a576fe8c773ee825629d727097d50b50.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/20/f72010615952f8b7c2d6f5563f39ebd3/pa/VM43481_a576fe8c773ee825629d727097d50b50.jpg not downloaded yet
2026-01-28 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F89%252Ffd89c4e8032f562bcbc4e894776f8b3a%252Fpa%252FAC57291_8a26d5acf5e14c860cb40cd650b0fe6e.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/89/fd89c4e8032f562bcbc4e894776f8b3a/pa/AC57291_8a26d5acf5e14c860cb40cd650b0fe6e.jpg not downloaded yet
2026-01-28 20:02:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09ee10d0>
2026-01-28 20:02:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d7b14fb-b9cf-5147-ac0e-6de09fcca372/0d7b14fb-b9cf-5147-ac0e-6de09fcca372_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fb1%252F70b11a2b0b862a049c06661b3744d01e%252Fpa%252FRR01200_571867db6e9067d51609113bd5c98916.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/b1/70b11a2b0b862a049c06661b3744d01e/pa/RR01200_571867db6e9067d51609113bd5c98916.jpg saved to cache
2026-01-28 20:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0d7b14fb-b9cf-5147-ac0e-6de09fcca372
2026-01-28 20:02:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b086d9b90>
2026-01-28 20:02:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d7b14fb-b9cf-5147-ac0e-6de09fcca372/0d7b14fb-b9cf-5147-ac0e-6de09fcca372_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fb1%252F70b11a2b0b862a049c06661b3744d01e%252Fpa%252FRR01200_cef79024456bef9e6dcd30b9c5b5cf21.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/b1/70b11a2b0b862a049c06661b3744d01e/pa/RR01200_cef79024456bef9e6dcd30b9c5b5cf21.jpg saved to cache
2026-01-28 20:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0d7b14fb-b9cf-5147-ac0e-6de09fcca372
2026-01-28 20:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KM02872> (referer: https://www.auto1.com/v1/car-details-view/KM02872/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:02:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08bc8a90>
2026-01-28 20:02:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d7b14fb-b9cf-5147-ac0e-6de09fcca372/0d7b14fb-b9cf-5147-ac0e-6de09fcca372_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fb1%252F70b11a2b0b862a049c06661b3744d01e%252Fpa%252FRR01200_7a698a2c67c75386d7a944e37332f359.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/b1/70b11a2b0b862a049c06661b3744d01e/pa/RR01200_7a698a2c67c75386d7a944e37332f359.jpg saved to cache
2026-01-28 20:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0d7b14fb-b9cf-5147-ac0e-6de09fcca372
2026-01-28 20:02:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08bdf890>
2026-01-28 20:02:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e91390f-d960-55fa-a814-b4adfe996ef2/5e91390f-d960-55fa-a814-b4adfe996ef2_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Ffd%252F38fd88ff893c0fefa3c06446d81828f1%252Fpa%252FED39383_cc10d7475d3fd3c392f3f84ffbedf787.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/fd/38fd88ff893c0fefa3c06446d81828f1/pa/ED39383_cc10d7475d3fd3c392f3f84ffbedf787.jpg saved to cache
2026-01-28 20:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5e91390f-d960-55fa-a814-b4adfe996ef2
2026-01-28 20:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/b1/70b11a2b0b862a049c06661b3744d01e/pa/RR01200_188ed4ee6350990a26824ce7c4078efb.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Ffd%252F38fd88ff893c0fefa3c06446d81828f1%252Fpa%252FED39383_10313e9105ed1124473efb8dbfa11bbf.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/fd/38fd88ff893c0fefa3c06446d81828f1/pa/ED39383_10313e9105ed1124473efb8dbfa11bbf.jpg not downloaded yet
2026-01-28 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F3c%252Fea3c5c207f517413e6d24154891f3b94%252Fpa%252FAJ94497_29bd90d5a06f24deae915ba5f026157e.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/3c/ea3c5c207f517413e6d24154891f3b94/pa/AJ94497_29bd90d5a06f24deae915ba5f026157e.jpg not downloaded yet
2026-01-28 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F31%252F4d311aa725e73a36b661a7c8a681b60a%252Fpa%252FXZ92879_7cf70465b273d25300d0e75ff8d24c98.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/31/4d311aa725e73a36b661a7c8a681b60a/pa/XZ92879_7cf70465b273d25300d0e75ff8d24c98.jpg not downloaded yet
2026-01-28 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F20%252Ff72010615952f8b7c2d6f5563f39ebd3%252Fpa%252FVM43481_50b1b39aad0f0887c78e4f8a5a848f73.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/20/f72010615952f8b7c2d6f5563f39ebd3/pa/VM43481_50b1b39aad0f0887c78e4f8a5a848f73.jpg not downloaded yet
2026-01-28 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F89%252Ffd89c4e8032f562bcbc4e894776f8b3a%252Fpa%252FAC57291_3e7073e6f9daeb9e4cf5fc928a3cf41a.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/89/fd89c4e8032f562bcbc4e894776f8b3a/pa/AC57291_3e7073e6f9daeb9e4cf5fc928a3cf41a.jpg not downloaded yet
2026-01-28 20:02:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09db8690>
2026-01-28 20:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e91390f-d960-55fa-a814-b4adfe996ef2/5e91390f-d960-55fa-a814-b4adfe996ef2_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Ffd%252F38fd88ff893c0fefa3c06446d81828f1%252Fpa%252FED39383_b3bbb6b276b0b32b8bfee2972eca74ff.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/fd/38fd88ff893c0fefa3c06446d81828f1/pa/ED39383_b3bbb6b276b0b32b8bfee2972eca74ff.jpg saved to cache
2026-01-28 20:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5e91390f-d960-55fa-a814-b4adfe996ef2
2026-01-28 20:02:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08760950>
2026-01-28 20:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e91390f-d960-55fa-a814-b4adfe996ef2/5e91390f-d960-55fa-a814-b4adfe996ef2_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Ffd%252F38fd88ff893c0fefa3c06446d81828f1%252Fpa%252FED39383_66d2dbc9af6f0cfd4a0bee5a42a8bee2.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/fd/38fd88ff893c0fefa3c06446d81828f1/pa/ED39383_66d2dbc9af6f0cfd4a0bee5a42a8bee2.jpg saved to cache
2026-01-28 20:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5e91390f-d960-55fa-a814-b4adfe996ef2
2026-01-28 20:02:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94786459-dab5-5c7e-aec7-c60afccc3ec0 with identifier: MJ69210
2026-01-28 20:02:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94786459-dab5-5c7e-aec7-c60afccc3ec0 with scrape type 2
2026-01-28 20:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 94786459-dab5-5c7e-aec7-c60afccc3ec0 with scrape type 2
2026-01-28 20:02:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 94786459-dab5-5c7e-aec7-c60afccc3ec0, identifier: MJ69210
2026-01-28 20:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/fd/38fd88ff893c0fefa3c06446d81828f1/pa/ED39383_aafe6d4327e5c79cc624c23b7a6fd8b2.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/fd/38fd88ff893c0fefa3c06446d81828f1/pa/ED39383_426c5c7abde334ebaf1dfd7a12870b91.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:02:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 94786459-dab5-5c7e-aec7-c60afccc3ec0 with identifier: MJ69210
2026-01-28 20:02:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 94786459-dab5-5c7e-aec7-c60afccc3ec0 with identifier: MJ69210
2026-01-28 20:02:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 94786459-dab5-5c7e-aec7-c60afccc3ec0 with identifier: MJ69210 to the API
2026-01-28 20:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:02:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:02:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MJ69210>
{'auction_title': '',
 'c_o_2_emission_value': 40,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 367,
 'expiration_date': '2026-01-29T16:53:22Z',
 'fuel_type': 'hybrid',
 'id': '94786459-dab5-5c7e-aec7-c60afccc3ec0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MJ69210',
 'listing': 'auction',
 'location': 'IT, Castelnuovo del Garda (VR)',
 'make': 'Audi',
 'model': 'Q5 Sportback',
 'odometer': 103468,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-08-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q5 Sportback 55 TFSIe quattro S line',
 'transmission': 'automatic',
 'trim': 'quattro S line',
 'year': 2022}
2026-01-28 20:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MJ69210%27 HTTP/1.1" 200 None
2026-01-28 20:02:51 [auto1.it] INFO: Saving data for MJ69210: {'auction_closing_time': 1769705602.0, 'created_time': 1764792295.659571, 'last_price_update_time': 1769630571.327938}
2026-01-28 20:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MJ69210') HTTP/1.1" 204 0
2026-01-28 20:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Ffd%252F38fd88ff893c0fefa3c06446d81828f1%252Fpa%252FED39383_c8e8d871213c2ff8d24fb23d27a16879.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/fd/38fd88ff893c0fefa3c06446d81828f1/pa/ED39383_c8e8d871213c2ff8d24fb23d27a16879.jpg not downloaded yet
2026-01-28 20:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F3c%252Fea3c5c207f517413e6d24154891f3b94%252Fpa%252FAJ94497_badd68e81580f6c4d930b45eeb1e2632.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/3c/ea3c5c207f517413e6d24154891f3b94/pa/AJ94497_badd68e81580f6c4d930b45eeb1e2632.jpg not downloaded yet
2026-01-28 20:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F31%252F4d311aa725e73a36b661a7c8a681b60a%252Fpa%252FXZ92879_34fa87d944348d50ca401ff34886cbc4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/31/4d311aa725e73a36b661a7c8a681b60a/pa/XZ92879_34fa87d944348d50ca401ff34886cbc4.jpg not downloaded yet
2026-01-28 20:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F20%252Ff72010615952f8b7c2d6f5563f39ebd3%252Fpa%252FVM43481_88092aaf1779db58f8c93a487c385f4a.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/20/f72010615952f8b7c2d6f5563f39ebd3/pa/VM43481_88092aaf1779db58f8c93a487c385f4a.jpg not downloaded yet
2026-01-28 20:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F89%252Ffd89c4e8032f562bcbc4e894776f8b3a%252Fpa%252FAC57291_e039aa6b3b1a209bc1c513817f8249da.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/89/fd89c4e8032f562bcbc4e894776f8b3a/pa/AC57291_e039aa6b3b1a209bc1c513817f8249da.jpg not downloaded yet
2026-01-28 20:02:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 099e54e2-eb4c-566e-adce-49c80fcf33fb with identifier: KM02872
2026-01-28 20:02:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 099e54e2-eb4c-566e-adce-49c80fcf33fb with scrape type 2
2026-01-28 20:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 099e54e2-eb4c-566e-adce-49c80fcf33fb with scrape type 2
2026-01-28 20:02:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 099e54e2-eb4c-566e-adce-49c80fcf33fb, identifier: KM02872
2026-01-28 20:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/3c/ea3c5c207f517413e6d24154891f3b94/pa/AJ94497_f0a726eaa1c588656ba0facd05218075.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:02:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 099e54e2-eb4c-566e-adce-49c80fcf33fb with identifier: KM02872
2026-01-28 20:02:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 099e54e2-eb4c-566e-adce-49c80fcf33fb with identifier: KM02872
2026-01-28 20:02:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 099e54e2-eb4c-566e-adce-49c80fcf33fb with identifier: KM02872 to the API
2026-01-28 20:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:02:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:02:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KM02872>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-01-29T16:04:35Z',
 'fuel_type': 'diesel',
 'id': '099e54e2-eb4c-566e-adce-49c80fcf33fb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KM02872',
 'listing': 'auction',
 'location': 'IT, Roma',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 46321,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-09-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q5 2.0 TDI quattro Sport',
 'transmission': 'automatic',
 'trim': 'quattro Sport',
 'year': 2018}
2026-01-28 20:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KM02872%27 HTTP/1.1" 200 None
2026-01-28 20:02:51 [auto1.it] INFO: Saving data for KM02872: {'auction_closing_time': 1769702675.0, 'created_time': 1769199423.877016, 'last_price_update_time': 1769630571.941408}
2026-01-28 20:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KM02872') HTTP/1.1" 204 0
2026-01-28 20:02:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b086fad90>
2026-01-28 20:02:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d7b14fb-b9cf-5147-ac0e-6de09fcca372/0d7b14fb-b9cf-5147-ac0e-6de09fcca372_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fb1%252F70b11a2b0b862a049c06661b3744d01e%252Fpa%252FRR01200_188ed4ee6350990a26824ce7c4078efb.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/b1/70b11a2b0b862a049c06661b3744d01e/pa/RR01200_188ed4ee6350990a26824ce7c4078efb.jpg saved to cache
2026-01-28 20:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0d7b14fb-b9cf-5147-ac0e-6de09fcca372
2026-01-28 20:02:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0d7b14fb-b9cf-5147-ac0e-6de09fcca372, skipping ID generation
2026-01-28 20:02:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d7b14fb-b9cf-5147-ac0e-6de09fcca372 with scrape type 1
2026-01-28 20:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 0d7b14fb-b9cf-5147-ac0e-6de09fcca372 from tracking dictionaries
2026-01-28 20:02:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0d7b14fb-b9cf-5147-ac0e-6de09fcca372 sending to next pipeline
2026-01-28 20:02:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0d7b14fb-b9cf-5147-ac0e-6de09fcca372, identifier: RR01200
2026-01-28 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F3c%252Fea3c5c207f517413e6d24154891f3b94%252Fpa%252FAJ94497_9651aa2bb02e3ddaf82d997ccd225e56.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/3c/ea3c5c207f517413e6d24154891f3b94/pa/AJ94497_9651aa2bb02e3ddaf82d997ccd225e56.jpg not downloaded yet
2026-01-28 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F31%252F4d311aa725e73a36b661a7c8a681b60a%252Fpa%252FXZ92879_0213cd2b02076c9ec8e7002d7a2c3c7c.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/31/4d311aa725e73a36b661a7c8a681b60a/pa/XZ92879_0213cd2b02076c9ec8e7002d7a2c3c7c.jpg not downloaded yet
2026-01-28 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F20%252Ff72010615952f8b7c2d6f5563f39ebd3%252Fpa%252FVM43481_ff842e5d201872d13cb309303bf85754.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/20/f72010615952f8b7c2d6f5563f39ebd3/pa/VM43481_ff842e5d201872d13cb309303bf85754.jpg not downloaded yet
2026-01-28 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F89%252Ffd89c4e8032f562bcbc4e894776f8b3a%252Fpa%252FAC57291_49471482409dd29f5ea691db731d15a3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/89/fd89c4e8032f562bcbc4e894776f8b3a/pa/AC57291_49471482409dd29f5ea691db731d15a3.jpg not downloaded yet
2026-01-28 20:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TL16229> (referer: https://www.auto1.com/v1/car-details-view/TL16229/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZT96568> (referer: https://www.auto1.com/v1/car-details-view/ZT96568/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RS56779> (referer: https://www.auto1.com/v1/car-details-view/RS56779/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CK36923> (referer: https://www.auto1.com/v1/car-details-view/CK36923/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YG51898> (referer: https://www.auto1.com/v1/car-details-view/YG51898/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:02:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0d7b14fb-b9cf-5147-ac0e-6de09fcca372 with identifier: RR01200
2026-01-28 20:02:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0d7b14fb-b9cf-5147-ac0e-6de09fcca372 with identifier: RR01200
2026-01-28 20:02:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0d7b14fb-b9cf-5147-ac0e-6de09fcca372 with identifier: RR01200 to the API
2026-01-28 20:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:02:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:02:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img70/b1/70b11a2b0b862a049c06661b3744d01e/pa/RR01200_188ed4ee6350990a26824ce7c4078efb.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 151,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:20:19Z',
 'fuel_type': 'diesel',
 'id': '0d7b14fb-b9cf-5147-ac0e-6de09fcca372',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RR01200',
 'listing': 'auction',
 'location': 'IT, Pavia',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 35837,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d7b14fb-b9cf-5147-ac0e-6de09fcca372/0d7b14fb-b9cf-5147-ac0e-6de09fcca372_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66550,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/b1/70b11a2b0b862a049c06661b3744d01e/pa/RR01200_188ed4ee6350990a26824ce7c4078efb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d7b14fb-b9cf-5147-ac0e-6de09fcca372/0d7b14fb-b9cf-5147-ac0e-6de09fcca372_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66944,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/b1/70b11a2b0b862a049c06661b3744d01e/pa/RR01200_7a698a2c67c75386d7a944e37332f359.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d7b14fb-b9cf-5147-ac0e-6de09fcca372/0d7b14fb-b9cf-5147-ac0e-6de09fcca372_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59703,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/b1/70b11a2b0b862a049c06661b3744d01e/pa/RR01200_1c073352500317d05418fe2c4c1f003d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d7b14fb-b9cf-5147-ac0e-6de09fcca372/0d7b14fb-b9cf-5147-ac0e-6de09fcca372_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53965,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/b1/70b11a2b0b862a049c06661b3744d01e/pa/RR01200_cef79024456bef9e6dcd30b9c5b5cf21.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d7b14fb-b9cf-5147-ac0e-6de09fcca372/0d7b14fb-b9cf-5147-ac0e-6de09fcca372_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56357,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/b1/70b11a2b0b862a049c06661b3744d01e/pa/RR01200_571867db6e9067d51609113bd5c98916.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d7b14fb-b9cf-5147-ac0e-6de09fcca372/0d7b14fb-b9cf-5147-ac0e-6de09fcca372_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64667,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/b1/70b11a2b0b862a049c06661b3744d01e/pa/RR01200_d24fcfc00dc04d73337d8a744025b68a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d7b14fb-b9cf-5147-ac0e-6de09fcca372/0d7b14fb-b9cf-5147-ac0e-6de09fcca372_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56105,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/b1/70b11a2b0b862a049c06661b3744d01e/pa/RR01200_78988b1c45d7bca7677950ef6f76d778.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d7b14fb-b9cf-5147-ac0e-6de09fcca372/0d7b14fb-b9cf-5147-ac0e-6de09fcca372_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57456,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/b1/70b11a2b0b862a049c06661b3744d01e/pa/RR01200_c916db38379303024398767c385a7aae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d7b14fb-b9cf-5147-ac0e-6de09fcca372/0d7b14fb-b9cf-5147-ac0e-6de09fcca372_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70791,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/b1/70b11a2b0b862a049c06661b3744d01e/pa/RR01200_9b6f589dd7059af54c3531a59be88625.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d7b14fb-b9cf-5147-ac0e-6de09fcca372/0d7b14fb-b9cf-5147-ac0e-6de09fcca372_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55324,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/b1/70b11a2b0b862a049c06661b3744d01e/pa/RR01200_51e954736e5222b45e7323baeb810e7d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d7b14fb-b9cf-5147-ac0e-6de09fcca372/0d7b14fb-b9cf-5147-ac0e-6de09fcca372_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60318,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/b1/70b11a2b0b862a049c06661b3744d01e/pa/RR01200_5b23266ebe83bbd266edda7b2d6667bb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d7b14fb-b9cf-5147-ac0e-6de09fcca372/0d7b14fb-b9cf-5147-ac0e-6de09fcca372_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50586,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/b1/70b11a2b0b862a049c06661b3744d01e/pa/RR01200_4fd2ab04a9cd6f6e6f8f4a047e7a8ab3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d7b14fb-b9cf-5147-ac0e-6de09fcca372/0d7b14fb-b9cf-5147-ac0e-6de09fcca372_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56947,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/b1/70b11a2b0b862a049c06661b3744d01e/pa/RR01200_ed2a376be333bf0cfccb5a8ee1471503.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d7b14fb-b9cf-5147-ac0e-6de09fcca372/0d7b14fb-b9cf-5147-ac0e-6de09fcca372_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58169,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/b1/70b11a2b0b862a049c06661b3744d01e/pa/RR01200_8aae09835899509dc3f556657e1d59a1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d7b14fb-b9cf-5147-ac0e-6de09fcca372/0d7b14fb-b9cf-5147-ac0e-6de09fcca372_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68708,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/b1/70b11a2b0b862a049c06661b3744d01e/pa/RR01200_8543bf7a1c67577d72785d49e778530a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-01-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI R-Line',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2024}
2026-01-28 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RR01200%27 HTTP/1.1" 200 None
2026-01-28 20:02:52 [auto1.it] INFO: Saving data for RR01200: {'created_time': 1769630572.879288, 'last_price_update_time': 1769630572.879302, 'auction_closing_time': 1769703619.0}
2026-01-28 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RR01200') HTTP/1.1" 204 0
2026-01-28 20:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/89/fd89c4e8032f562bcbc4e894776f8b3a/pa/AC57291_b1ad4405999dc59fc1e8fded58a454d9.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/89/fd89c4e8032f562bcbc4e894776f8b3a/pa/AC57291_8a26d5acf5e14c860cb40cd650b0fe6e.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:02:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08bb3410>
2026-01-28 20:02:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e91390f-d960-55fa-a814-b4adfe996ef2/5e91390f-d960-55fa-a814-b4adfe996ef2_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Ffd%252F38fd88ff893c0fefa3c06446d81828f1%252Fpa%252FED39383_aafe6d4327e5c79cc624c23b7a6fd8b2.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/fd/38fd88ff893c0fefa3c06446d81828f1/pa/ED39383_aafe6d4327e5c79cc624c23b7a6fd8b2.jpg saved to cache
2026-01-28 20:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 5e91390f-d960-55fa-a814-b4adfe996ef2
2026-01-28 20:02:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08bb2890>
2026-01-28 20:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e91390f-d960-55fa-a814-b4adfe996ef2/5e91390f-d960-55fa-a814-b4adfe996ef2_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Ffd%252F38fd88ff893c0fefa3c06446d81828f1%252Fpa%252FED39383_426c5c7abde334ebaf1dfd7a12870b91.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/fd/38fd88ff893c0fefa3c06446d81828f1/pa/ED39383_426c5c7abde334ebaf1dfd7a12870b91.jpg saved to cache
2026-01-28 20:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5e91390f-d960-55fa-a814-b4adfe996ef2
2026-01-28 20:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F3c%252Fea3c5c207f517413e6d24154891f3b94%252Fpa%252FAJ94497_7eca6cf0b3e9507b5020b9147a2f5504.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/3c/ea3c5c207f517413e6d24154891f3b94/pa/AJ94497_7eca6cf0b3e9507b5020b9147a2f5504.jpg not downloaded yet
2026-01-28 20:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F31%252F4d311aa725e73a36b661a7c8a681b60a%252Fpa%252FXZ92879_e4545135eff2061e8233294a2bd4d100.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/31/4d311aa725e73a36b661a7c8a681b60a/pa/XZ92879_e4545135eff2061e8233294a2bd4d100.jpg not downloaded yet
2026-01-28 20:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F20%252Ff72010615952f8b7c2d6f5563f39ebd3%252Fpa%252FVM43481_928889a14e933a03c98ad56f26577210.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/20/f72010615952f8b7c2d6f5563f39ebd3/pa/VM43481_928889a14e933a03c98ad56f26577210.jpg not downloaded yet
2026-01-28 20:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F89%252Ffd89c4e8032f562bcbc4e894776f8b3a%252Fpa%252FAC57291_bb62a8c9f2573214a3c0f93869c045aa.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/89/fd89c4e8032f562bcbc4e894776f8b3a/pa/AC57291_bb62a8c9f2573214a3c0f93869c045aa.jpg not downloaded yet
2026-01-28 20:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/20/f72010615952f8b7c2d6f5563f39ebd3/pa/VM43481_a576fe8c773ee825629d727097d50b50.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:02:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0a0e8dd0>
2026-01-28 20:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f902eea8-627c-51db-89c8-9495352ad881/f902eea8-627c-51db-89c8-9495352ad881_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F3c%252Fea3c5c207f517413e6d24154891f3b94%252Fpa%252FAJ94497_f0a726eaa1c588656ba0facd05218075.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/3c/ea3c5c207f517413e6d24154891f3b94/pa/AJ94497_f0a726eaa1c588656ba0facd05218075.jpg saved to cache
2026-01-28 20:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f902eea8-627c-51db-89c8-9495352ad881
2026-01-28 20:02:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d2e38e4-f567-5149-998f-815ba0cbdf45 with identifier: TL16229
2026-01-28 20:02:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d2e38e4-f567-5149-998f-815ba0cbdf45 with scrape type 1
2026-01-28 20:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 8d2e38e4-f567-5149-998f-815ba0cbdf45
2026-01-28 20:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Fa1%252Fbba17735831d0c60f6cc98219f2f1a44%252Fpa%252FTL16229_349676914b001ae8db4cb09eea222073.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/a1/bba17735831d0c60f6cc98219f2f1a44/pa/TL16229_349676914b001ae8db4cb09eea222073.jpg not downloaded yet
2026-01-28 20:02:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14642d95-9e5b-56d5-b0e8-6b1cf591084c with identifier: ZT96568
2026-01-28 20:02:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14642d95-9e5b-56d5-b0e8-6b1cf591084c with scrape type 2
2026-01-28 20:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 14642d95-9e5b-56d5-b0e8-6b1cf591084c with scrape type 2
2026-01-28 20:02:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 14642d95-9e5b-56d5-b0e8-6b1cf591084c, identifier: ZT96568
2026-01-28 20:02:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 71ab4925-b65d-5779-8ef5-c034e5f68c1d with identifier: RS56779
2026-01-28 20:02:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71ab4925-b65d-5779-8ef5-c034e5f68c1d with scrape type 2
2026-01-28 20:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 71ab4925-b65d-5779-8ef5-c034e5f68c1d with scrape type 2
2026-01-28 20:02:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 71ab4925-b65d-5779-8ef5-c034e5f68c1d, identifier: RS56779
2026-01-28 20:02:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd7cf052-f32d-5a7a-9222-fac3c4728fdb with identifier: CK36923
2026-01-28 20:02:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd7cf052-f32d-5a7a-9222-fac3c4728fdb with scrape type 2
2026-01-28 20:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fd7cf052-f32d-5a7a-9222-fac3c4728fdb with scrape type 2
2026-01-28 20:02:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: fd7cf052-f32d-5a7a-9222-fac3c4728fdb, identifier: CK36923
2026-01-28 20:02:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d9f2f86-59fa-5973-a2e0-ae7528d878a3 with identifier: YG51898
2026-01-28 20:02:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d9f2f86-59fa-5973-a2e0-ae7528d878a3 with scrape type 2
2026-01-28 20:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9d9f2f86-59fa-5973-a2e0-ae7528d878a3 with scrape type 2
2026-01-28 20:02:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9d9f2f86-59fa-5973-a2e0-ae7528d878a3, identifier: YG51898
2026-01-28 20:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/3c/ea3c5c207f517413e6d24154891f3b94/pa/AJ94497_6bd4e8f1cf7ef18a7f62bb11c377c32b.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F3c%252Fea3c5c207f517413e6d24154891f3b94%252Fpa%252FAJ94497_51d4102d4875b8230b27ae69d0143f40.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/3c/ea3c5c207f517413e6d24154891f3b94/pa/AJ94497_51d4102d4875b8230b27ae69d0143f40.jpg not downloaded yet
2026-01-28 20:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F31%252F4d311aa725e73a36b661a7c8a681b60a%252Fpa%252FXZ92879_bfa3a0aee16ebbde70882d6d02fa8b25.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/31/4d311aa725e73a36b661a7c8a681b60a/pa/XZ92879_bfa3a0aee16ebbde70882d6d02fa8b25.jpg not downloaded yet
2026-01-28 20:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F20%252Ff72010615952f8b7c2d6f5563f39ebd3%252Fpa%252FVM43481_1d4e5fa6a18a7f9d91ad3b1abda90655.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/20/f72010615952f8b7c2d6f5563f39ebd3/pa/VM43481_1d4e5fa6a18a7f9d91ad3b1abda90655.jpg not downloaded yet
2026-01-28 20:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F89%252Ffd89c4e8032f562bcbc4e894776f8b3a%252Fpa%252FAC57291_391983a576c7038c19f113304ab83295.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/89/fd89c4e8032f562bcbc4e894776f8b3a/pa/AC57291_391983a576c7038c19f113304ab83295.jpg not downloaded yet
2026-01-28 20:02:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 14642d95-9e5b-56d5-b0e8-6b1cf591084c with identifier: ZT96568
2026-01-28 20:02:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 14642d95-9e5b-56d5-b0e8-6b1cf591084c with identifier: ZT96568
2026-01-28 20:02:54 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 150778 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    150778
2026-01-28 20:02:54 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 14642d95-9e5b-56d5-b0e8-6b1cf591084c spider: auto1.it
2026-01-28 20:02:54 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 14642d95-9e5b-56d5-b0e8-6b1cf591084c due to rule: high_mileage_for_country.json, error: 150778 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    150778
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.5L',
 'engine_horse_power': 115,
 'expiration_date': '2026-01-29T16:07:22Z',
 'fuel_type': 'diesel',
 'id': '14642d95-9e5b-56d5-b0e8-6b1cf591084c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZT96568',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 150778,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-07-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 d Sport Extra Edition',
 'transmission': 'automatic',
 'trim': 'Sport Extra Edition',
 'year': 2019}
2026-01-28 20:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZT96568%27 HTTP/1.1" 200 None
2026-01-28 20:02:54 [auto1.it] INFO: Saving data for ZT96568: {'auction_closing_time': 1769702842.0, 'created_time': 1768557993.271722, 'last_price_update_time': 1769630574.674788}
2026-01-28 20:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZT96568') HTTP/1.1" 204 0
2026-01-28 20:02:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 71ab4925-b65d-5779-8ef5-c034e5f68c1d with identifier: RS56779
2026-01-28 20:02:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 71ab4925-b65d-5779-8ef5-c034e5f68c1d with identifier: RS56779
2026-01-28 20:02:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 71ab4925-b65d-5779-8ef5-c034e5f68c1d with identifier: RS56779 to the API
2026-01-28 20:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:02:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:02:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RS56779>
{'auction_title': '',
 'c_o_2_emission_value': 168,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.9L',
 'engine_horse_power': 194,
 'expiration_date': '2026-01-29T16:33:09Z',
 'fuel_type': 'diesel',
 'id': '71ab4925-b65d-5779-8ef5-c034e5f68c1d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RS56779',
 'listing': 'auction',
 'location': 'IT, Milazzo',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 40639,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-10-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 220 d 4Matic Executive',
 'transmission': 'automatic',
 'trim': '4Matic Executive',
 'year': 2022}
2026-01-28 20:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RS56779%27 HTTP/1.1" 200 None
2026-01-28 20:02:55 [auto1.it] INFO: Saving data for RS56779: {'auction_closing_time': 1769704389.0, 'created_time': 1766088028.610112, 'last_price_update_time': 1769630575.675481}
2026-01-28 20:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RS56779') HTTP/1.1" 204 0
2026-01-28 20:02:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: fd7cf052-f32d-5a7a-9222-fac3c4728fdb with identifier: CK36923
2026-01-28 20:02:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: fd7cf052-f32d-5a7a-9222-fac3c4728fdb with identifier: CK36923
2026-01-28 20:02:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: fd7cf052-f32d-5a7a-9222-fac3c4728fdb with identifier: CK36923 to the API
2026-01-28 20:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:02:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:02:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CK36923>
{'auction_title': '',
 'c_o_2_emission_value': 172,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '2.0L',
 'engine_horse_power': 380,
 'expiration_date': '2026-01-29T16:11:30Z',
 'fuel_type': 'petrol',
 'id': 'fd7cf052-f32d-5a7a-9222-fac3c4728fdb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CK36923',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 47024,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-06-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 45 AMG 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2018}
2026-01-28 20:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CK36923%27 HTTP/1.1" 200 None
2026-01-28 20:02:56 [auto1.it] INFO: Saving data for CK36923: {'auction_closing_time': 1769703090.0, 'created_time': 1767039009.462762, 'last_price_update_time': 1769630576.058953}
2026-01-28 20:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CK36923') HTTP/1.1" 204 0
2026-01-28 20:02:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9d9f2f86-59fa-5973-a2e0-ae7528d878a3 with identifier: YG51898
2026-01-28 20:02:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9d9f2f86-59fa-5973-a2e0-ae7528d878a3 with identifier: YG51898
2026-01-28 20:02:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 9d9f2f86-59fa-5973-a2e0-ae7528d878a3 with identifier: YG51898 to the API
2026-01-28 20:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:02:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:02:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YG51898>
{'auction_title': '',
 'c_o_2_emission_value': 38,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 252,
 'expiration_date': '2026-01-29T16:19:57Z',
 'fuel_type': 'hybrid',
 'id': '9d9f2f86-59fa-5973-a2e0-ae7528d878a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YG51898',
 'listing': 'auction',
 'location': 'IT, Milano',
 'make': 'BMW',
 'model': '3er',
 'odometer': 40444,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-08-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3er 330e M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2022}
2026-01-28 20:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YG51898%27 HTTP/1.1" 200 None
2026-01-28 20:02:56 [auto1.it] INFO: Saving data for YG51898: {'auction_closing_time': 1769703597.0, 'created_time': 1767643346.774516, 'last_price_update_time': 1769630576.469896}
2026-01-28 20:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YG51898') HTTP/1.1" 204 0
2026-01-28 20:02:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08c8c1d0>
2026-01-28 20:02:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32036054-ff2f-5f01-9b00-edf64a69cfa2/32036054-ff2f-5f01-9b00-edf64a69cfa2_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F89%252Ffd89c4e8032f562bcbc4e894776f8b3a%252Fpa%252FAC57291_b1ad4405999dc59fc1e8fded58a454d9.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/89/fd89c4e8032f562bcbc4e894776f8b3a/pa/AC57291_b1ad4405999dc59fc1e8fded58a454d9.jpg saved to cache
2026-01-28 20:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 32036054-ff2f-5f01-9b00-edf64a69cfa2
2026-01-28 20:02:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0a026290>
2026-01-28 20:02:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32036054-ff2f-5f01-9b00-edf64a69cfa2/32036054-ff2f-5f01-9b00-edf64a69cfa2_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F89%252Ffd89c4e8032f562bcbc4e894776f8b3a%252Fpa%252FAC57291_8a26d5acf5e14c860cb40cd650b0fe6e.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/89/fd89c4e8032f562bcbc4e894776f8b3a/pa/AC57291_8a26d5acf5e14c860cb40cd650b0fe6e.jpg saved to cache
2026-01-28 20:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 32036054-ff2f-5f01-9b00-edf64a69cfa2
2026-01-28 20:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Fa1%252Fbba17735831d0c60f6cc98219f2f1a44%252Fpa%252FTL16229_ca7db81476d4ac18ca630519b94cfda0.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/a1/bba17735831d0c60f6cc98219f2f1a44/pa/TL16229_ca7db81476d4ac18ca630519b94cfda0.jpg not downloaded yet
2026-01-28 20:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/3c/ea3c5c207f517413e6d24154891f3b94/pa/AJ94497_31b5af403c4bc12c4d6d12ab5862a827.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F31%252F4d311aa725e73a36b661a7c8a681b60a%252Fpa%252FXZ92879_e95cb3283a9c43302a0e5a7662045481.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/31/4d311aa725e73a36b661a7c8a681b60a/pa/XZ92879_e95cb3283a9c43302a0e5a7662045481.jpg not downloaded yet
2026-01-28 20:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F20%252Ff72010615952f8b7c2d6f5563f39ebd3%252Fpa%252FVM43481_7bc5d81ca7bf7e138ec22fd0c716b3c2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/20/f72010615952f8b7c2d6f5563f39ebd3/pa/VM43481_7bc5d81ca7bf7e138ec22fd0c716b3c2.jpg not downloaded yet
2026-01-28 20:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F89%252Ffd89c4e8032f562bcbc4e894776f8b3a%252Fpa%252FAC57291_898688e22be389524ff54b9a970c77a5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/89/fd89c4e8032f562bcbc4e894776f8b3a/pa/AC57291_898688e22be389524ff54b9a970c77a5.jpg not downloaded yet
2026-01-28 20:02:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08c19910>
2026-01-28 20:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49e888e6-e08b-55b6-b9f8-fdb6743794c4/49e888e6-e08b-55b6-b9f8-fdb6743794c4_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F20%252Ff72010615952f8b7c2d6f5563f39ebd3%252Fpa%252FVM43481_a576fe8c773ee825629d727097d50b50.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/20/f72010615952f8b7c2d6f5563f39ebd3/pa/VM43481_a576fe8c773ee825629d727097d50b50.jpg saved to cache
2026-01-28 20:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 49e888e6-e08b-55b6-b9f8-fdb6743794c4
2026-01-28 20:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/3c/ea3c5c207f517413e6d24154891f3b94/pa/AJ94497_a439d5d37a9e986485147045c360e67f.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/89/fd89c4e8032f562bcbc4e894776f8b3a/pa/AC57291_3e7073e6f9daeb9e4cf5fc928a3cf41a.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Fa1%252Fbba17735831d0c60f6cc98219f2f1a44%252Fpa%252FTL16229_fdb74faf5e7da442927a82ba1a1b4d53.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/a1/bba17735831d0c60f6cc98219f2f1a44/pa/TL16229_fdb74faf5e7da442927a82ba1a1b4d53.jpg not downloaded yet
2026-01-28 20:02:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08c4edd0>
2026-01-28 20:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f902eea8-627c-51db-89c8-9495352ad881/f902eea8-627c-51db-89c8-9495352ad881_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F3c%252Fea3c5c207f517413e6d24154891f3b94%252Fpa%252FAJ94497_6bd4e8f1cf7ef18a7f62bb11c377c32b.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/3c/ea3c5c207f517413e6d24154891f3b94/pa/AJ94497_6bd4e8f1cf7ef18a7f62bb11c377c32b.jpg saved to cache
2026-01-28 20:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f902eea8-627c-51db-89c8-9495352ad881
2026-01-28 20:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F31%252F4d311aa725e73a36b661a7c8a681b60a%252Fpa%252FXZ92879_65dd4633622f2317c0af09138f0c931e.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/31/4d311aa725e73a36b661a7c8a681b60a/pa/XZ92879_65dd4633622f2317c0af09138f0c931e.jpg not downloaded yet
2026-01-28 20:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F20%252Ff72010615952f8b7c2d6f5563f39ebd3%252Fpa%252FVM43481_b8d1f025eda8a1304e1ac6658db756a8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/20/f72010615952f8b7c2d6f5563f39ebd3/pa/VM43481_b8d1f025eda8a1304e1ac6658db756a8.jpg not downloaded yet
2026-01-28 20:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F89%252Ffd89c4e8032f562bcbc4e894776f8b3a%252Fpa%252FAC57291_7866e0ad780ba684a40d3af4d9508cd1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/89/fd89c4e8032f562bcbc4e894776f8b3a/pa/AC57291_7866e0ad780ba684a40d3af4d9508cd1.jpg not downloaded yet
2026-01-28 20:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/20/f72010615952f8b7c2d6f5563f39ebd3/pa/VM43481_88092aaf1779db58f8c93a487c385f4a.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Fa1%252Fbba17735831d0c60f6cc98219f2f1a44%252Fpa%252FTL16229_cc3ce3e676d4df0a35aff4409103accb.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/a1/bba17735831d0c60f6cc98219f2f1a44/pa/TL16229_cc3ce3e676d4df0a35aff4409103accb.jpg not downloaded yet
2026-01-28 20:02:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09d71350>
2026-01-28 20:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f902eea8-627c-51db-89c8-9495352ad881/f902eea8-627c-51db-89c8-9495352ad881_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F3c%252Fea3c5c207f517413e6d24154891f3b94%252Fpa%252FAJ94497_31b5af403c4bc12c4d6d12ab5862a827.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/3c/ea3c5c207f517413e6d24154891f3b94/pa/AJ94497_31b5af403c4bc12c4d6d12ab5862a827.jpg saved to cache
2026-01-28 20:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f902eea8-627c-51db-89c8-9495352ad881
2026-01-28 20:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F31%252F4d311aa725e73a36b661a7c8a681b60a%252Fpa%252FXZ92879_d318b0ac25c08372c37ca645ebdab375.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/31/4d311aa725e73a36b661a7c8a681b60a/pa/XZ92879_d318b0ac25c08372c37ca645ebdab375.jpg not downloaded yet
2026-01-28 20:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F20%252Ff72010615952f8b7c2d6f5563f39ebd3%252Fpa%252FVM43481_b368de6f705d2148004cdd29cc9e1a40.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/20/f72010615952f8b7c2d6f5563f39ebd3/pa/VM43481_b368de6f705d2148004cdd29cc9e1a40.jpg not downloaded yet
2026-01-28 20:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F89%252Ffd89c4e8032f562bcbc4e894776f8b3a%252Fpa%252FAC57291_712fd4e7e5ead1ebe4395f060fcb1204.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/89/fd89c4e8032f562bcbc4e894776f8b3a/pa/AC57291_712fd4e7e5ead1ebe4395f060fcb1204.jpg not downloaded yet
2026-01-28 20:02:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0894b350>
2026-01-28 20:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f902eea8-627c-51db-89c8-9495352ad881/f902eea8-627c-51db-89c8-9495352ad881_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F3c%252Fea3c5c207f517413e6d24154891f3b94%252Fpa%252FAJ94497_a439d5d37a9e986485147045c360e67f.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/3c/ea3c5c207f517413e6d24154891f3b94/pa/AJ94497_a439d5d37a9e986485147045c360e67f.jpg saved to cache
2026-01-28 20:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f902eea8-627c-51db-89c8-9495352ad881
2026-01-28 20:02:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09d72390>
2026-01-28 20:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32036054-ff2f-5f01-9b00-edf64a69cfa2/32036054-ff2f-5f01-9b00-edf64a69cfa2_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F89%252Ffd89c4e8032f562bcbc4e894776f8b3a%252Fpa%252FAC57291_3e7073e6f9daeb9e4cf5fc928a3cf41a.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/89/fd89c4e8032f562bcbc4e894776f8b3a/pa/AC57291_3e7073e6f9daeb9e4cf5fc928a3cf41a.jpg saved to cache
2026-01-28 20:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 32036054-ff2f-5f01-9b00-edf64a69cfa2
2026-01-28 20:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/3c/ea3c5c207f517413e6d24154891f3b94/pa/AJ94497_8e1ec012aeac3d5dfe77df9b86c5f246.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/3c/ea3c5c207f517413e6d24154891f3b94/pa/AJ94497_badd68e81580f6c4d930b45eeb1e2632.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Fa1%252Fbba17735831d0c60f6cc98219f2f1a44%252Fpa%252FTL16229_7cd71fc87cb970dee6956e8ecf885f71.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/a1/bba17735831d0c60f6cc98219f2f1a44/pa/TL16229_7cd71fc87cb970dee6956e8ecf885f71.jpg not downloaded yet
2026-01-28 20:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/3c/ea3c5c207f517413e6d24154891f3b94/pa/AJ94497_1e15c3fd192d865b3aafd420fac54e78.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/fd/38fd88ff893c0fefa3c06446d81828f1/pa/ED39383_c8e8d871213c2ff8d24fb23d27a16879.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F31%252F4d311aa725e73a36b661a7c8a681b60a%252Fpa%252FXZ92879_bb8bfb267e16179bfe11f2976204b1ea.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/31/4d311aa725e73a36b661a7c8a681b60a/pa/XZ92879_bb8bfb267e16179bfe11f2976204b1ea.jpg not downloaded yet
2026-01-28 20:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F20%252Ff72010615952f8b7c2d6f5563f39ebd3%252Fpa%252FVM43481_092f5e9be9ff45588c730d374d8be41d.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/20/f72010615952f8b7c2d6f5563f39ebd3/pa/VM43481_092f5e9be9ff45588c730d374d8be41d.jpg not downloaded yet
2026-01-28 20:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F89%252Ffd89c4e8032f562bcbc4e894776f8b3a%252Fpa%252FAC57291_59ecd1712d08fdbd6c23f28bfc3c653b.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/89/fd89c4e8032f562bcbc4e894776f8b3a/pa/AC57291_59ecd1712d08fdbd6c23f28bfc3c653b.jpg not downloaded yet
2026-01-28 20:02:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09fd3b10>
2026-01-28 20:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49e888e6-e08b-55b6-b9f8-fdb6743794c4/49e888e6-e08b-55b6-b9f8-fdb6743794c4_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F20%252Ff72010615952f8b7c2d6f5563f39ebd3%252Fpa%252FVM43481_88092aaf1779db58f8c93a487c385f4a.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/20/f72010615952f8b7c2d6f5563f39ebd3/pa/VM43481_88092aaf1779db58f8c93a487c385f4a.jpg saved to cache
2026-01-28 20:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 49e888e6-e08b-55b6-b9f8-fdb6743794c4
2026-01-28 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Fa1%252Fbba17735831d0c60f6cc98219f2f1a44%252Fpa%252FTL16229_3f6111e1b5592800d54e2871896b1bf5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/a1/bba17735831d0c60f6cc98219f2f1a44/pa/TL16229_3f6111e1b5592800d54e2871896b1bf5.jpg not downloaded yet
2026-01-28 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F31%252F4d311aa725e73a36b661a7c8a681b60a%252Fpa%252FXZ92879_dcc058b7ecde18288f51e0bae6a07de7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/31/4d311aa725e73a36b661a7c8a681b60a/pa/XZ92879_dcc058b7ecde18288f51e0bae6a07de7.jpg not downloaded yet
2026-01-28 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F20%252Ff72010615952f8b7c2d6f5563f39ebd3%252Fpa%252FVM43481_415e7a51e958fa9004972c73e1f6adf6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/20/f72010615952f8b7c2d6f5563f39ebd3/pa/VM43481_415e7a51e958fa9004972c73e1f6adf6.jpg not downloaded yet
2026-01-28 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F89%252Ffd89c4e8032f562bcbc4e894776f8b3a%252Fpa%252FAC57291_468770fc39fcb78ffb8f0763c4bcaa6f.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/89/fd89c4e8032f562bcbc4e894776f8b3a/pa/AC57291_468770fc39fcb78ffb8f0763c4bcaa6f.jpg not downloaded yet
2026-01-28 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Fa1%252Fbba17735831d0c60f6cc98219f2f1a44%252Fpa%252FTL16229_739dae3163e7ae577d159629930894ec.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/a1/bba17735831d0c60f6cc98219f2f1a44/pa/TL16229_739dae3163e7ae577d159629930894ec.jpg not downloaded yet
2026-01-28 20:02:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09e5cb10>
2026-01-28 20:02:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f902eea8-627c-51db-89c8-9495352ad881/f902eea8-627c-51db-89c8-9495352ad881_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F3c%252Fea3c5c207f517413e6d24154891f3b94%252Fpa%252FAJ94497_8e1ec012aeac3d5dfe77df9b86c5f246.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/3c/ea3c5c207f517413e6d24154891f3b94/pa/AJ94497_8e1ec012aeac3d5dfe77df9b86c5f246.jpg saved to cache
2026-01-28 20:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f902eea8-627c-51db-89c8-9495352ad881
2026-01-28 20:02:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b086eeb90>
2026-01-28 20:02:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f902eea8-627c-51db-89c8-9495352ad881/f902eea8-627c-51db-89c8-9495352ad881_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F3c%252Fea3c5c207f517413e6d24154891f3b94%252Fpa%252FAJ94497_badd68e81580f6c4d930b45eeb1e2632.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/3c/ea3c5c207f517413e6d24154891f3b94/pa/AJ94497_badd68e81580f6c4d930b45eeb1e2632.jpg saved to cache
2026-01-28 20:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f902eea8-627c-51db-89c8-9495352ad881
2026-01-28 20:03:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09e5e1d0>
2026-01-28 20:03:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f902eea8-627c-51db-89c8-9495352ad881/f902eea8-627c-51db-89c8-9495352ad881_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F3c%252Fea3c5c207f517413e6d24154891f3b94%252Fpa%252FAJ94497_1e15c3fd192d865b3aafd420fac54e78.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/3c/ea3c5c207f517413e6d24154891f3b94/pa/AJ94497_1e15c3fd192d865b3aafd420fac54e78.jpg saved to cache
2026-01-28 20:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f902eea8-627c-51db-89c8-9495352ad881
2026-01-28 20:03:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b086f8790>
2026-01-28 20:03:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e91390f-d960-55fa-a814-b4adfe996ef2/5e91390f-d960-55fa-a814-b4adfe996ef2_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Ffd%252F38fd88ff893c0fefa3c06446d81828f1%252Fpa%252FED39383_c8e8d871213c2ff8d24fb23d27a16879.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/fd/38fd88ff893c0fefa3c06446d81828f1/pa/ED39383_c8e8d871213c2ff8d24fb23d27a16879.jpg saved to cache
2026-01-28 20:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 5e91390f-d960-55fa-a814-b4adfe996ef2
2026-01-28 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F31%252F4d311aa725e73a36b661a7c8a681b60a%252Fpa%252FXZ92879_de8a4cf66799dab2fc8db907c8362af9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/31/4d311aa725e73a36b661a7c8a681b60a/pa/XZ92879_de8a4cf66799dab2fc8db907c8362af9.jpg not downloaded yet
2026-01-28 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F20%252Ff72010615952f8b7c2d6f5563f39ebd3%252Fpa%252FVM43481_c39cb0bd1dcec2e3aaf18f8fb88c829d.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/20/f72010615952f8b7c2d6f5563f39ebd3/pa/VM43481_c39cb0bd1dcec2e3aaf18f8fb88c829d.jpg not downloaded yet
2026-01-28 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F89%252Ffd89c4e8032f562bcbc4e894776f8b3a%252Fpa%252FAC57291_85dc0c73eed05c4c12adf5d6f8b18abe.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/89/fd89c4e8032f562bcbc4e894776f8b3a/pa/AC57291_85dc0c73eed05c4c12adf5d6f8b18abe.jpg not downloaded yet
2026-01-28 20:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/89/fd89c4e8032f562bcbc4e894776f8b3a/pa/AC57291_bb62a8c9f2573214a3c0f93869c045aa.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/89/fd89c4e8032f562bcbc4e894776f8b3a/pa/AC57291_49471482409dd29f5ea691db731d15a3.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/31/4d311aa725e73a36b661a7c8a681b60a/pa/XZ92879_7cf70465b273d25300d0e75ff8d24c98.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Fa1%252Fbba17735831d0c60f6cc98219f2f1a44%252Fpa%252FTL16229_7409edacc49652a97b1b129a2203be84.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/a1/bba17735831d0c60f6cc98219f2f1a44/pa/TL16229_7409edacc49652a97b1b129a2203be84.jpg not downloaded yet
2026-01-28 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F20%252Ff72010615952f8b7c2d6f5563f39ebd3%252Fpa%252FVM43481_0f11ab19224651daf5764f1af0df2228.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/20/f72010615952f8b7c2d6f5563f39ebd3/pa/VM43481_0f11ab19224651daf5764f1af0df2228.jpg not downloaded yet
2026-01-28 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F89%252Ffd89c4e8032f562bcbc4e894776f8b3a%252Fpa%252FAC57291_5ec95d3ab39dbbaa29b10bc6b7a118ae.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/89/fd89c4e8032f562bcbc4e894776f8b3a/pa/AC57291_5ec95d3ab39dbbaa29b10bc6b7a118ae.jpg not downloaded yet
2026-01-28 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Fa1%252Fbba17735831d0c60f6cc98219f2f1a44%252Fpa%252FTL16229_bce85c5b26c0548d9df892951764d43c.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/a1/bba17735831d0c60f6cc98219f2f1a44/pa/TL16229_bce85c5b26c0548d9df892951764d43c.jpg not downloaded yet
2026-01-28 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F20%252Ff72010615952f8b7c2d6f5563f39ebd3%252Fpa%252FVM43481_9dd26768b742d87fac53baeda1257da3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/20/f72010615952f8b7c2d6f5563f39ebd3/pa/VM43481_9dd26768b742d87fac53baeda1257da3.jpg not downloaded yet
2026-01-28 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F89%252Ffd89c4e8032f562bcbc4e894776f8b3a%252Fpa%252FAC57291_3547eb1f83184fda07852e8244953081.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/89/fd89c4e8032f562bcbc4e894776f8b3a/pa/AC57291_3547eb1f83184fda07852e8244953081.jpg not downloaded yet
2026-01-28 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Fa1%252Fbba17735831d0c60f6cc98219f2f1a44%252Fpa%252FTL16229_7985f4e67907a546c4827fad748bdf00.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/a1/bba17735831d0c60f6cc98219f2f1a44/pa/TL16229_7985f4e67907a546c4827fad748bdf00.jpg not downloaded yet
2026-01-28 20:03:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/a1/bba17735831d0c60f6cc98219f2f1a44/pa/TL16229_ca7db81476d4ac18ca630519b94cfda0.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Fa1%252Fbba17735831d0c60f6cc98219f2f1a44%252Fpa%252FTL16229_d16780c76feabcda6d94e4ca397cd3b0.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/a1/bba17735831d0c60f6cc98219f2f1a44/pa/TL16229_d16780c76feabcda6d94e4ca397cd3b0.jpg not downloaded yet
2026-01-28 20:03:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08c2ea10>
2026-01-28 20:03:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32036054-ff2f-5f01-9b00-edf64a69cfa2/32036054-ff2f-5f01-9b00-edf64a69cfa2_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F89%252Ffd89c4e8032f562bcbc4e894776f8b3a%252Fpa%252FAC57291_bb62a8c9f2573214a3c0f93869c045aa.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/89/fd89c4e8032f562bcbc4e894776f8b3a/pa/AC57291_bb62a8c9f2573214a3c0f93869c045aa.jpg saved to cache
2026-01-28 20:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 32036054-ff2f-5f01-9b00-edf64a69cfa2
2026-01-28 20:03:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09e59f90>
2026-01-28 20:03:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32036054-ff2f-5f01-9b00-edf64a69cfa2/32036054-ff2f-5f01-9b00-edf64a69cfa2_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F89%252Ffd89c4e8032f562bcbc4e894776f8b3a%252Fpa%252FAC57291_49471482409dd29f5ea691db731d15a3.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/89/fd89c4e8032f562bcbc4e894776f8b3a/pa/AC57291_49471482409dd29f5ea691db731d15a3.jpg saved to cache
2026-01-28 20:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 32036054-ff2f-5f01-9b00-edf64a69cfa2
2026-01-28 20:03:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0a031790>
2026-01-28 20:03:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b8f56d5-5dc2-56aa-a900-55a8006fc8f1/0b8f56d5-5dc2-56aa-a900-55a8006fc8f1_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F31%252F4d311aa725e73a36b661a7c8a681b60a%252Fpa%252FXZ92879_7cf70465b273d25300d0e75ff8d24c98.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/31/4d311aa725e73a36b661a7c8a681b60a/pa/XZ92879_7cf70465b273d25300d0e75ff8d24c98.jpg saved to cache
2026-01-28 20:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0b8f56d5-5dc2-56aa-a900-55a8006fc8f1
2026-01-28 20:03:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/89/fd89c4e8032f562bcbc4e894776f8b3a/pa/AC57291_391983a576c7038c19f113304ab83295.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/20/f72010615952f8b7c2d6f5563f39ebd3/pa/VM43481_1d4e5fa6a18a7f9d91ad3b1abda90655.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Fa1%252Fbba17735831d0c60f6cc98219f2f1a44%252Fpa%252FTL16229_4da722ecd76f93e1ded9d4a83afa715a.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/a1/bba17735831d0c60f6cc98219f2f1a44/pa/TL16229_4da722ecd76f93e1ded9d4a83afa715a.jpg not downloaded yet
2026-01-28 20:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Fa1%252Fbba17735831d0c60f6cc98219f2f1a44%252Fpa%252FTL16229_3063e66de4576426629d6500e0f30735.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/a1/bba17735831d0c60f6cc98219f2f1a44/pa/TL16229_3063e66de4576426629d6500e0f30735.jpg not downloaded yet
2026-01-28 20:03:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b086cd690>
2026-01-28 20:03:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d2e38e4-f567-5149-998f-815ba0cbdf45/8d2e38e4-f567-5149-998f-815ba0cbdf45_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Fa1%252Fbba17735831d0c60f6cc98219f2f1a44%252Fpa%252FTL16229_ca7db81476d4ac18ca630519b94cfda0.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/a1/bba17735831d0c60f6cc98219f2f1a44/pa/TL16229_ca7db81476d4ac18ca630519b94cfda0.jpg saved to cache
2026-01-28 20:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8d2e38e4-f567-5149-998f-815ba0cbdf45
2026-01-28 20:03:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/a1/bba17735831d0c60f6cc98219f2f1a44/pa/TL16229_fdb74faf5e7da442927a82ba1a1b4d53.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Fa1%252Fbba17735831d0c60f6cc98219f2f1a44%252Fpa%252FTL16229_694e14cfbea4fa4e22d82ec69b12cdca.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/a1/bba17735831d0c60f6cc98219f2f1a44/pa/TL16229_694e14cfbea4fa4e22d82ec69b12cdca.jpg not downloaded yet
2026-01-28 20:03:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/20/f72010615952f8b7c2d6f5563f39ebd3/pa/VM43481_b368de6f705d2148004cdd29cc9e1a40.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/89/fd89c4e8032f562bcbc4e894776f8b3a/pa/AC57291_712fd4e7e5ead1ebe4395f060fcb1204.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Fa1%252Fbba17735831d0c60f6cc98219f2f1a44%252Fpa%252FTL16229_347b732ca8b846425b9d697e2f450bd1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/a1/bba17735831d0c60f6cc98219f2f1a44/pa/TL16229_347b732ca8b846425b9d697e2f450bd1.jpg not downloaded yet
2026-01-28 20:03:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08ccfcd0>
2026-01-28 20:03:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32036054-ff2f-5f01-9b00-edf64a69cfa2/32036054-ff2f-5f01-9b00-edf64a69cfa2_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F89%252Ffd89c4e8032f562bcbc4e894776f8b3a%252Fpa%252FAC57291_391983a576c7038c19f113304ab83295.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/89/fd89c4e8032f562bcbc4e894776f8b3a/pa/AC57291_391983a576c7038c19f113304ab83295.jpg saved to cache
2026-01-28 20:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 32036054-ff2f-5f01-9b00-edf64a69cfa2
2026-01-28 20:03:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0a02ec50>
2026-01-28 20:03:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49e888e6-e08b-55b6-b9f8-fdb6743794c4/49e888e6-e08b-55b6-b9f8-fdb6743794c4_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F20%252Ff72010615952f8b7c2d6f5563f39ebd3%252Fpa%252FVM43481_1d4e5fa6a18a7f9d91ad3b1abda90655.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/20/f72010615952f8b7c2d6f5563f39ebd3/pa/VM43481_1d4e5fa6a18a7f9d91ad3b1abda90655.jpg saved to cache
2026-01-28 20:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 49e888e6-e08b-55b6-b9f8-fdb6743794c4
2026-01-28 20:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/a1/bba17735831d0c60f6cc98219f2f1a44/pa/TL16229_cc3ce3e676d4df0a35aff4409103accb.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/89/fd89c4e8032f562bcbc4e894776f8b3a/pa/AC57291_85dc0c73eed05c4c12adf5d6f8b18abe.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b086c1690>
2026-01-28 20:03:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d2e38e4-f567-5149-998f-815ba0cbdf45/8d2e38e4-f567-5149-998f-815ba0cbdf45_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Fa1%252Fbba17735831d0c60f6cc98219f2f1a44%252Fpa%252FTL16229_fdb74faf5e7da442927a82ba1a1b4d53.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/a1/bba17735831d0c60f6cc98219f2f1a44/pa/TL16229_fdb74faf5e7da442927a82ba1a1b4d53.jpg saved to cache
2026-01-28 20:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8d2e38e4-f567-5149-998f-815ba0cbdf45
2026-01-28 20:03:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08c77d90>
2026-01-28 20:03:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49e888e6-e08b-55b6-b9f8-fdb6743794c4/49e888e6-e08b-55b6-b9f8-fdb6743794c4_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F20%252Ff72010615952f8b7c2d6f5563f39ebd3%252Fpa%252FVM43481_b368de6f705d2148004cdd29cc9e1a40.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/20/f72010615952f8b7c2d6f5563f39ebd3/pa/VM43481_b368de6f705d2148004cdd29cc9e1a40.jpg saved to cache
2026-01-28 20:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 49e888e6-e08b-55b6-b9f8-fdb6743794c4
2026-01-28 20:03:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09d09050>
2026-01-28 20:03:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32036054-ff2f-5f01-9b00-edf64a69cfa2/32036054-ff2f-5f01-9b00-edf64a69cfa2_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F89%252Ffd89c4e8032f562bcbc4e894776f8b3a%252Fpa%252FAC57291_712fd4e7e5ead1ebe4395f060fcb1204.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/89/fd89c4e8032f562bcbc4e894776f8b3a/pa/AC57291_712fd4e7e5ead1ebe4395f060fcb1204.jpg saved to cache
2026-01-28 20:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 32036054-ff2f-5f01-9b00-edf64a69cfa2
2026-01-28 20:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/fd/38fd88ff893c0fefa3c06446d81828f1/pa/ED39383_f3f061f8a24253337970fcac7e4ff804.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/31/4d311aa725e73a36b661a7c8a681b60a/pa/XZ92879_de8a4cf66799dab2fc8db907c8362af9.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/20/f72010615952f8b7c2d6f5563f39ebd3/pa/VM43481_c39cb0bd1dcec2e3aaf18f8fb88c829d.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/31/4d311aa725e73a36b661a7c8a681b60a/pa/XZ92879_34fa87d944348d50ca401ff34886cbc4.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09ed66d0>
2026-01-28 20:03:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d2e38e4-f567-5149-998f-815ba0cbdf45/8d2e38e4-f567-5149-998f-815ba0cbdf45_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Fa1%252Fbba17735831d0c60f6cc98219f2f1a44%252Fpa%252FTL16229_cc3ce3e676d4df0a35aff4409103accb.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/a1/bba17735831d0c60f6cc98219f2f1a44/pa/TL16229_cc3ce3e676d4df0a35aff4409103accb.jpg saved to cache
2026-01-28 20:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8d2e38e4-f567-5149-998f-815ba0cbdf45
2026-01-28 20:03:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0a0cf610>
2026-01-28 20:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32036054-ff2f-5f01-9b00-edf64a69cfa2/32036054-ff2f-5f01-9b00-edf64a69cfa2_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F89%252Ffd89c4e8032f562bcbc4e894776f8b3a%252Fpa%252FAC57291_85dc0c73eed05c4c12adf5d6f8b18abe.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/89/fd89c4e8032f562bcbc4e894776f8b3a/pa/AC57291_85dc0c73eed05c4c12adf5d6f8b18abe.jpg saved to cache
2026-01-28 20:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 32036054-ff2f-5f01-9b00-edf64a69cfa2
2026-01-28 20:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/31/4d311aa725e73a36b661a7c8a681b60a/pa/XZ92879_38a98400dfc4359259cb3cd2c9a243c0.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/89/fd89c4e8032f562bcbc4e894776f8b3a/pa/AC57291_e039aa6b3b1a209bc1c513817f8249da.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/a1/bba17735831d0c60f6cc98219f2f1a44/pa/TL16229_7985f4e67907a546c4827fad748bdf00.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/89/fd89c4e8032f562bcbc4e894776f8b3a/pa/AC57291_3547eb1f83184fda07852e8244953081.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/a1/bba17735831d0c60f6cc98219f2f1a44/pa/TL16229_d16780c76feabcda6d94e4ca397cd3b0.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:03:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09e90e90>
2026-01-28 20:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e91390f-d960-55fa-a814-b4adfe996ef2/5e91390f-d960-55fa-a814-b4adfe996ef2_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Ffd%252F38fd88ff893c0fefa3c06446d81828f1%252Fpa%252FED39383_f3f061f8a24253337970fcac7e4ff804.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/fd/38fd88ff893c0fefa3c06446d81828f1/pa/ED39383_f3f061f8a24253337970fcac7e4ff804.jpg saved to cache
2026-01-28 20:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5e91390f-d960-55fa-a814-b4adfe996ef2
2026-01-28 20:03:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0899d290>
2026-01-28 20:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b8f56d5-5dc2-56aa-a900-55a8006fc8f1/0b8f56d5-5dc2-56aa-a900-55a8006fc8f1_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F31%252F4d311aa725e73a36b661a7c8a681b60a%252Fpa%252FXZ92879_de8a4cf66799dab2fc8db907c8362af9.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/31/4d311aa725e73a36b661a7c8a681b60a/pa/XZ92879_de8a4cf66799dab2fc8db907c8362af9.jpg saved to cache
2026-01-28 20:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 0b8f56d5-5dc2-56aa-a900-55a8006fc8f1
2026-01-28 20:03:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09d8e310>
2026-01-28 20:03:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49e888e6-e08b-55b6-b9f8-fdb6743794c4/49e888e6-e08b-55b6-b9f8-fdb6743794c4_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F20%252Ff72010615952f8b7c2d6f5563f39ebd3%252Fpa%252FVM43481_c39cb0bd1dcec2e3aaf18f8fb88c829d.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/20/f72010615952f8b7c2d6f5563f39ebd3/pa/VM43481_c39cb0bd1dcec2e3aaf18f8fb88c829d.jpg saved to cache
2026-01-28 20:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 49e888e6-e08b-55b6-b9f8-fdb6743794c4
2026-01-28 20:03:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09e71590>
2026-01-28 20:03:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b8f56d5-5dc2-56aa-a900-55a8006fc8f1/0b8f56d5-5dc2-56aa-a900-55a8006fc8f1_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F31%252F4d311aa725e73a36b661a7c8a681b60a%252Fpa%252FXZ92879_34fa87d944348d50ca401ff34886cbc4.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/31/4d311aa725e73a36b661a7c8a681b60a/pa/XZ92879_34fa87d944348d50ca401ff34886cbc4.jpg saved to cache
2026-01-28 20:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0b8f56d5-5dc2-56aa-a900-55a8006fc8f1
2026-01-28 20:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/a1/bba17735831d0c60f6cc98219f2f1a44/pa/TL16229_3063e66de4576426629d6500e0f30735.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/a1/bba17735831d0c60f6cc98219f2f1a44/pa/TL16229_347b732ca8b846425b9d697e2f450bd1.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/a1/bba17735831d0c60f6cc98219f2f1a44/pa/TL16229_4da722ecd76f93e1ded9d4a83afa715a.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/a1/bba17735831d0c60f6cc98219f2f1a44/pa/TL16229_694e14cfbea4fa4e22d82ec69b12cdca.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/20/f72010615952f8b7c2d6f5563f39ebd3/pa/VM43481_9dd26768b742d87fac53baeda1257da3.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/a1/bba17735831d0c60f6cc98219f2f1a44/pa/TL16229_bce85c5b26c0548d9df892951764d43c.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/20/f72010615952f8b7c2d6f5563f39ebd3/pa/VM43481_50b1b39aad0f0887c78e4f8a5a848f73.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09dde910>
2026-01-28 20:03:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b8f56d5-5dc2-56aa-a900-55a8006fc8f1/0b8f56d5-5dc2-56aa-a900-55a8006fc8f1_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F31%252F4d311aa725e73a36b661a7c8a681b60a%252Fpa%252FXZ92879_38a98400dfc4359259cb3cd2c9a243c0.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/31/4d311aa725e73a36b661a7c8a681b60a/pa/XZ92879_38a98400dfc4359259cb3cd2c9a243c0.jpg saved to cache
2026-01-28 20:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0b8f56d5-5dc2-56aa-a900-55a8006fc8f1
2026-01-28 20:03:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:03:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08b02310>
2026-01-28 20:03:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32036054-ff2f-5f01-9b00-edf64a69cfa2/32036054-ff2f-5f01-9b00-edf64a69cfa2_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F89%252Ffd89c4e8032f562bcbc4e894776f8b3a%252Fpa%252FAC57291_e039aa6b3b1a209bc1c513817f8249da.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/89/fd89c4e8032f562bcbc4e894776f8b3a/pa/AC57291_e039aa6b3b1a209bc1c513817f8249da.jpg saved to cache
2026-01-28 20:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 32036054-ff2f-5f01-9b00-edf64a69cfa2
2026-01-28 20:03:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09d994d0>
2026-01-28 20:03:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d2e38e4-f567-5149-998f-815ba0cbdf45/8d2e38e4-f567-5149-998f-815ba0cbdf45_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Fa1%252Fbba17735831d0c60f6cc98219f2f1a44%252Fpa%252FTL16229_7985f4e67907a546c4827fad748bdf00.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/a1/bba17735831d0c60f6cc98219f2f1a44/pa/TL16229_7985f4e67907a546c4827fad748bdf00.jpg saved to cache
2026-01-28 20:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8d2e38e4-f567-5149-998f-815ba0cbdf45
2026-01-28 20:03:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0870f510>
2026-01-28 20:03:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32036054-ff2f-5f01-9b00-edf64a69cfa2/32036054-ff2f-5f01-9b00-edf64a69cfa2_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F89%252Ffd89c4e8032f562bcbc4e894776f8b3a%252Fpa%252FAC57291_3547eb1f83184fda07852e8244953081.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/89/fd89c4e8032f562bcbc4e894776f8b3a/pa/AC57291_3547eb1f83184fda07852e8244953081.jpg saved to cache
2026-01-28 20:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 32036054-ff2f-5f01-9b00-edf64a69cfa2
2026-01-28 20:03:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08b01e50>
2026-01-28 20:03:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d2e38e4-f567-5149-998f-815ba0cbdf45/8d2e38e4-f567-5149-998f-815ba0cbdf45_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Fa1%252Fbba17735831d0c60f6cc98219f2f1a44%252Fpa%252FTL16229_d16780c76feabcda6d94e4ca397cd3b0.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/a1/bba17735831d0c60f6cc98219f2f1a44/pa/TL16229_d16780c76feabcda6d94e4ca397cd3b0.jpg saved to cache
2026-01-28 20:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 8d2e38e4-f567-5149-998f-815ba0cbdf45
2026-01-28 20:03:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/89/fd89c4e8032f562bcbc4e894776f8b3a/pa/AC57291_5ec95d3ab39dbbaa29b10bc6b7a118ae.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/a1/bba17735831d0c60f6cc98219f2f1a44/pa/TL16229_7409edacc49652a97b1b129a2203be84.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0ea8c990>
2026-01-28 20:03:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d2e38e4-f567-5149-998f-815ba0cbdf45/8d2e38e4-f567-5149-998f-815ba0cbdf45_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Fa1%252Fbba17735831d0c60f6cc98219f2f1a44%252Fpa%252FTL16229_3063e66de4576426629d6500e0f30735.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/a1/bba17735831d0c60f6cc98219f2f1a44/pa/TL16229_3063e66de4576426629d6500e0f30735.jpg saved to cache
2026-01-28 20:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 8d2e38e4-f567-5149-998f-815ba0cbdf45
2026-01-28 20:03:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08c125d0>
2026-01-28 20:03:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d2e38e4-f567-5149-998f-815ba0cbdf45/8d2e38e4-f567-5149-998f-815ba0cbdf45_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Fa1%252Fbba17735831d0c60f6cc98219f2f1a44%252Fpa%252FTL16229_347b732ca8b846425b9d697e2f450bd1.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/a1/bba17735831d0c60f6cc98219f2f1a44/pa/TL16229_347b732ca8b846425b9d697e2f450bd1.jpg saved to cache
2026-01-28 20:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 8d2e38e4-f567-5149-998f-815ba0cbdf45
2026-01-28 20:03:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0872e450>
2026-01-28 20:03:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d2e38e4-f567-5149-998f-815ba0cbdf45/8d2e38e4-f567-5149-998f-815ba0cbdf45_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Fa1%252Fbba17735831d0c60f6cc98219f2f1a44%252Fpa%252FTL16229_4da722ecd76f93e1ded9d4a83afa715a.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/a1/bba17735831d0c60f6cc98219f2f1a44/pa/TL16229_4da722ecd76f93e1ded9d4a83afa715a.jpg saved to cache
2026-01-28 20:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 8d2e38e4-f567-5149-998f-815ba0cbdf45
2026-01-28 20:03:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0872f510>
2026-01-28 20:03:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d2e38e4-f567-5149-998f-815ba0cbdf45/8d2e38e4-f567-5149-998f-815ba0cbdf45_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Fa1%252Fbba17735831d0c60f6cc98219f2f1a44%252Fpa%252FTL16229_694e14cfbea4fa4e22d82ec69b12cdca.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/a1/bba17735831d0c60f6cc98219f2f1a44/pa/TL16229_694e14cfbea4fa4e22d82ec69b12cdca.jpg saved to cache
2026-01-28 20:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 8d2e38e4-f567-5149-998f-815ba0cbdf45
2026-01-28 20:03:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08c117d0>
2026-01-28 20:03:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49e888e6-e08b-55b6-b9f8-fdb6743794c4/49e888e6-e08b-55b6-b9f8-fdb6743794c4_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F20%252Ff72010615952f8b7c2d6f5563f39ebd3%252Fpa%252FVM43481_9dd26768b742d87fac53baeda1257da3.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/20/f72010615952f8b7c2d6f5563f39ebd3/pa/VM43481_9dd26768b742d87fac53baeda1257da3.jpg saved to cache
2026-01-28 20:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 49e888e6-e08b-55b6-b9f8-fdb6743794c4
2026-01-28 20:03:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09d838d0>
2026-01-28 20:03:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d2e38e4-f567-5149-998f-815ba0cbdf45/8d2e38e4-f567-5149-998f-815ba0cbdf45_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Fa1%252Fbba17735831d0c60f6cc98219f2f1a44%252Fpa%252FTL16229_bce85c5b26c0548d9df892951764d43c.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/a1/bba17735831d0c60f6cc98219f2f1a44/pa/TL16229_bce85c5b26c0548d9df892951764d43c.jpg saved to cache
2026-01-28 20:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8d2e38e4-f567-5149-998f-815ba0cbdf45
2026-01-28 20:03:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:03:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09fbd1d0>
2026-01-28 20:03:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49e888e6-e08b-55b6-b9f8-fdb6743794c4/49e888e6-e08b-55b6-b9f8-fdb6743794c4_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F20%252Ff72010615952f8b7c2d6f5563f39ebd3%252Fpa%252FVM43481_50b1b39aad0f0887c78e4f8a5a848f73.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/20/f72010615952f8b7c2d6f5563f39ebd3/pa/VM43481_50b1b39aad0f0887c78e4f8a5a848f73.jpg saved to cache
2026-01-28 20:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 49e888e6-e08b-55b6-b9f8-fdb6743794c4
2026-01-28 20:03:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/a1/bba17735831d0c60f6cc98219f2f1a44/pa/TL16229_3f6111e1b5592800d54e2871896b1bf5.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/a1/bba17735831d0c60f6cc98219f2f1a44/pa/TL16229_739dae3163e7ae577d159629930894ec.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/89/fd89c4e8032f562bcbc4e894776f8b3a/pa/AC57291_59ecd1712d08fdbd6c23f28bfc3c653b.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/20/f72010615952f8b7c2d6f5563f39ebd3/pa/VM43481_415e7a51e958fa9004972c73e1f6adf6.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/89/fd89c4e8032f562bcbc4e894776f8b3a/pa/AC57291_468770fc39fcb78ffb8f0763c4bcaa6f.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08931750>
2026-01-28 20:03:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32036054-ff2f-5f01-9b00-edf64a69cfa2/32036054-ff2f-5f01-9b00-edf64a69cfa2_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F89%252Ffd89c4e8032f562bcbc4e894776f8b3a%252Fpa%252FAC57291_5ec95d3ab39dbbaa29b10bc6b7a118ae.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/89/fd89c4e8032f562bcbc4e894776f8b3a/pa/AC57291_5ec95d3ab39dbbaa29b10bc6b7a118ae.jpg saved to cache
2026-01-28 20:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 32036054-ff2f-5f01-9b00-edf64a69cfa2
2026-01-28 20:03:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09f2bdd0>
2026-01-28 20:03:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d2e38e4-f567-5149-998f-815ba0cbdf45/8d2e38e4-f567-5149-998f-815ba0cbdf45_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Fa1%252Fbba17735831d0c60f6cc98219f2f1a44%252Fpa%252FTL16229_7409edacc49652a97b1b129a2203be84.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/a1/bba17735831d0c60f6cc98219f2f1a44/pa/TL16229_7409edacc49652a97b1b129a2203be84.jpg saved to cache
2026-01-28 20:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8d2e38e4-f567-5149-998f-815ba0cbdf45
2026-01-28 20:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/a1/bba17735831d0c60f6cc98219f2f1a44/pa/TL16229_7cd71fc87cb970dee6956e8ecf885f71.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/89/fd89c4e8032f562bcbc4e894776f8b3a/pa/AC57291_7866e0ad780ba684a40d3af4d9508cd1.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09d0c990>
2026-01-28 20:03:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d2e38e4-f567-5149-998f-815ba0cbdf45/8d2e38e4-f567-5149-998f-815ba0cbdf45_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Fa1%252Fbba17735831d0c60f6cc98219f2f1a44%252Fpa%252FTL16229_3f6111e1b5592800d54e2871896b1bf5.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/a1/bba17735831d0c60f6cc98219f2f1a44/pa/TL16229_3f6111e1b5592800d54e2871896b1bf5.jpg saved to cache
2026-01-28 20:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8d2e38e4-f567-5149-998f-815ba0cbdf45
2026-01-28 20:03:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b086cc950>
2026-01-28 20:03:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d2e38e4-f567-5149-998f-815ba0cbdf45/8d2e38e4-f567-5149-998f-815ba0cbdf45_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Fa1%252Fbba17735831d0c60f6cc98219f2f1a44%252Fpa%252FTL16229_739dae3163e7ae577d159629930894ec.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/a1/bba17735831d0c60f6cc98219f2f1a44/pa/TL16229_739dae3163e7ae577d159629930894ec.jpg saved to cache
2026-01-28 20:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8d2e38e4-f567-5149-998f-815ba0cbdf45
2026-01-28 20:03:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09d43dd0>
2026-01-28 20:03:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32036054-ff2f-5f01-9b00-edf64a69cfa2/32036054-ff2f-5f01-9b00-edf64a69cfa2_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F89%252Ffd89c4e8032f562bcbc4e894776f8b3a%252Fpa%252FAC57291_59ecd1712d08fdbd6c23f28bfc3c653b.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/89/fd89c4e8032f562bcbc4e894776f8b3a/pa/AC57291_59ecd1712d08fdbd6c23f28bfc3c653b.jpg saved to cache
2026-01-28 20:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 32036054-ff2f-5f01-9b00-edf64a69cfa2
2026-01-28 20:03:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09fdea50>
2026-01-28 20:03:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49e888e6-e08b-55b6-b9f8-fdb6743794c4/49e888e6-e08b-55b6-b9f8-fdb6743794c4_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F20%252Ff72010615952f8b7c2d6f5563f39ebd3%252Fpa%252FVM43481_415e7a51e958fa9004972c73e1f6adf6.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/20/f72010615952f8b7c2d6f5563f39ebd3/pa/VM43481_415e7a51e958fa9004972c73e1f6adf6.jpg saved to cache
2026-01-28 20:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 49e888e6-e08b-55b6-b9f8-fdb6743794c4
2026-01-28 20:03:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09e2bf10>
2026-01-28 20:03:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32036054-ff2f-5f01-9b00-edf64a69cfa2/32036054-ff2f-5f01-9b00-edf64a69cfa2_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F89%252Ffd89c4e8032f562bcbc4e894776f8b3a%252Fpa%252FAC57291_468770fc39fcb78ffb8f0763c4bcaa6f.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/89/fd89c4e8032f562bcbc4e894776f8b3a/pa/AC57291_468770fc39fcb78ffb8f0763c4bcaa6f.jpg saved to cache
2026-01-28 20:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 32036054-ff2f-5f01-9b00-edf64a69cfa2
2026-01-28 20:03:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/20/f72010615952f8b7c2d6f5563f39ebd3/pa/VM43481_b8d1f025eda8a1304e1ac6658db756a8.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0a066f50>
2026-01-28 20:03:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d2e38e4-f567-5149-998f-815ba0cbdf45/8d2e38e4-f567-5149-998f-815ba0cbdf45_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Fa1%252Fbba17735831d0c60f6cc98219f2f1a44%252Fpa%252FTL16229_7cd71fc87cb970dee6956e8ecf885f71.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/a1/bba17735831d0c60f6cc98219f2f1a44/pa/TL16229_7cd71fc87cb970dee6956e8ecf885f71.jpg saved to cache
2026-01-28 20:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8d2e38e4-f567-5149-998f-815ba0cbdf45
2026-01-28 20:03:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09d46ed0>
2026-01-28 20:03:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32036054-ff2f-5f01-9b00-edf64a69cfa2/32036054-ff2f-5f01-9b00-edf64a69cfa2_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F89%252Ffd89c4e8032f562bcbc4e894776f8b3a%252Fpa%252FAC57291_7866e0ad780ba684a40d3af4d9508cd1.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/89/fd89c4e8032f562bcbc4e894776f8b3a/pa/AC57291_7866e0ad780ba684a40d3af4d9508cd1.jpg saved to cache
2026-01-28 20:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 32036054-ff2f-5f01-9b00-edf64a69cfa2
2026-01-28 20:03:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/20/f72010615952f8b7c2d6f5563f39ebd3/pa/VM43481_7bc5d81ca7bf7e138ec22fd0c716b3c2.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/89/fd89c4e8032f562bcbc4e894776f8b3a/pa/AC57291_898688e22be389524ff54b9a970c77a5.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0ea8c990>
2026-01-28 20:03:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49e888e6-e08b-55b6-b9f8-fdb6743794c4/49e888e6-e08b-55b6-b9f8-fdb6743794c4_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F20%252Ff72010615952f8b7c2d6f5563f39ebd3%252Fpa%252FVM43481_b8d1f025eda8a1304e1ac6658db756a8.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/20/f72010615952f8b7c2d6f5563f39ebd3/pa/VM43481_b8d1f025eda8a1304e1ac6658db756a8.jpg saved to cache
2026-01-28 20:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 49e888e6-e08b-55b6-b9f8-fdb6743794c4
2026-01-28 20:03:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/31/4d311aa725e73a36b661a7c8a681b60a/pa/XZ92879_e95cb3283a9c43302a0e5a7662045481.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08cd2550>
2026-01-28 20:03:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49e888e6-e08b-55b6-b9f8-fdb6743794c4/49e888e6-e08b-55b6-b9f8-fdb6743794c4_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F20%252Ff72010615952f8b7c2d6f5563f39ebd3%252Fpa%252FVM43481_7bc5d81ca7bf7e138ec22fd0c716b3c2.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/20/f72010615952f8b7c2d6f5563f39ebd3/pa/VM43481_7bc5d81ca7bf7e138ec22fd0c716b3c2.jpg saved to cache
2026-01-28 20:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 49e888e6-e08b-55b6-b9f8-fdb6743794c4
2026-01-28 20:03:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09ddd050>
2026-01-28 20:03:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32036054-ff2f-5f01-9b00-edf64a69cfa2/32036054-ff2f-5f01-9b00-edf64a69cfa2_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F89%252Ffd89c4e8032f562bcbc4e894776f8b3a%252Fpa%252FAC57291_898688e22be389524ff54b9a970c77a5.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/89/fd89c4e8032f562bcbc4e894776f8b3a/pa/AC57291_898688e22be389524ff54b9a970c77a5.jpg saved to cache
2026-01-28 20:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 32036054-ff2f-5f01-9b00-edf64a69cfa2
2026-01-28 20:03:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 32036054-ff2f-5f01-9b00-edf64a69cfa2, skipping ID generation
2026-01-28 20:03:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32036054-ff2f-5f01-9b00-edf64a69cfa2 with scrape type 1
2026-01-28 20:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 32036054-ff2f-5f01-9b00-edf64a69cfa2 from tracking dictionaries
2026-01-28 20:03:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 32036054-ff2f-5f01-9b00-edf64a69cfa2 sending to next pipeline
2026-01-28 20:03:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 32036054-ff2f-5f01-9b00-edf64a69cfa2, identifier: AC57291
2026-01-28 20:03:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 32036054-ff2f-5f01-9b00-edf64a69cfa2 with identifier: AC57291
2026-01-28 20:03:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 32036054-ff2f-5f01-9b00-edf64a69cfa2 with identifier: AC57291
2026-01-28 20:03:14 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 164365 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    164365
2026-01-28 20:03:14 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 32036054-ff2f-5f01-9b00-edf64a69cfa2 spider: auto1.it
2026-01-28 20:03:14 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 32036054-ff2f-5f01-9b00-edf64a69cfa2 due to rule: high_mileage_for_country.json, error: 164365 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    164365
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.4L',
 'engine_horse_power': 140,
 'expiration_date': '2026-01-29T16:10:03Z',
 'fuel_type': 'petrol',
 'id': '32036054-ff2f-5f01-9b00-edf64a69cfa2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AC57291',
 'listing': 'auction',
 'location': 'IT, Varese',
 'make': 'Jeep',
 'model': 'Compass',
 'odometer': 164365,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32036054-ff2f-5f01-9b00-edf64a69cfa2/32036054-ff2f-5f01-9b00-edf64a69cfa2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75169,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/89/fd89c4e8032f562bcbc4e894776f8b3a/pa/AC57291_b1ad4405999dc59fc1e8fded58a454d9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32036054-ff2f-5f01-9b00-edf64a69cfa2/32036054-ff2f-5f01-9b00-edf64a69cfa2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71746,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/89/fd89c4e8032f562bcbc4e894776f8b3a/pa/AC57291_8a26d5acf5e14c860cb40cd650b0fe6e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32036054-ff2f-5f01-9b00-edf64a69cfa2/32036054-ff2f-5f01-9b00-edf64a69cfa2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68158,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/89/fd89c4e8032f562bcbc4e894776f8b3a/pa/AC57291_3e7073e6f9daeb9e4cf5fc928a3cf41a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32036054-ff2f-5f01-9b00-edf64a69cfa2/32036054-ff2f-5f01-9b00-edf64a69cfa2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2415820,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/89/fd89c4e8032f562bcbc4e894776f8b3a/pa/AC57291_e039aa6b3b1a209bc1c513817f8249da.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32036054-ff2f-5f01-9b00-edf64a69cfa2/32036054-ff2f-5f01-9b00-edf64a69cfa2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69916,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/89/fd89c4e8032f562bcbc4e894776f8b3a/pa/AC57291_49471482409dd29f5ea691db731d15a3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32036054-ff2f-5f01-9b00-edf64a69cfa2/32036054-ff2f-5f01-9b00-edf64a69cfa2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69163,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/89/fd89c4e8032f562bcbc4e894776f8b3a/pa/AC57291_bb62a8c9f2573214a3c0f93869c045aa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32036054-ff2f-5f01-9b00-edf64a69cfa2/32036054-ff2f-5f01-9b00-edf64a69cfa2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54880,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/89/fd89c4e8032f562bcbc4e894776f8b3a/pa/AC57291_391983a576c7038c19f113304ab83295.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32036054-ff2f-5f01-9b00-edf64a69cfa2/32036054-ff2f-5f01-9b00-edf64a69cfa2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76055,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/89/fd89c4e8032f562bcbc4e894776f8b3a/pa/AC57291_898688e22be389524ff54b9a970c77a5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32036054-ff2f-5f01-9b00-edf64a69cfa2/32036054-ff2f-5f01-9b00-edf64a69cfa2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71622,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/89/fd89c4e8032f562bcbc4e894776f8b3a/pa/AC57291_7866e0ad780ba684a40d3af4d9508cd1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32036054-ff2f-5f01-9b00-edf64a69cfa2/32036054-ff2f-5f01-9b00-edf64a69cfa2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65793,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/89/fd89c4e8032f562bcbc4e894776f8b3a/pa/AC57291_712fd4e7e5ead1ebe4395f060fcb1204.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32036054-ff2f-5f01-9b00-edf64a69cfa2/32036054-ff2f-5f01-9b00-edf64a69cfa2_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58126,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/89/fd89c4e8032f562bcbc4e894776f8b3a/pa/AC57291_59ecd1712d08fdbd6c23f28bfc3c653b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32036054-ff2f-5f01-9b00-edf64a69cfa2/32036054-ff2f-5f01-9b00-edf64a69cfa2_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65973,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/89/fd89c4e8032f562bcbc4e894776f8b3a/pa/AC57291_468770fc39fcb78ffb8f0763c4bcaa6f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32036054-ff2f-5f01-9b00-edf64a69cfa2/32036054-ff2f-5f01-9b00-edf64a69cfa2_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60719,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/89/fd89c4e8032f562bcbc4e894776f8b3a/pa/AC57291_85dc0c73eed05c4c12adf5d6f8b18abe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32036054-ff2f-5f01-9b00-edf64a69cfa2/32036054-ff2f-5f01-9b00-edf64a69cfa2_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46805,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/89/fd89c4e8032f562bcbc4e894776f8b3a/pa/AC57291_5ec95d3ab39dbbaa29b10bc6b7a118ae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32036054-ff2f-5f01-9b00-edf64a69cfa2/32036054-ff2f-5f01-9b00-edf64a69cfa2_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62528,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/89/fd89c4e8032f562bcbc4e894776f8b3a/pa/AC57291_3547eb1f83184fda07852e8244953081.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-01-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jeep Compass 1.4 M-Air Limited FWD',
 'transmission': 'manual',
 'trim': 'Limited FWD',
 'year': 2020}
2026-01-28 20:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AC57291%27 HTTP/1.1" 200 None
2026-01-28 20:03:14 [auto1.it] INFO: Saving data for AC57291: {'created_time': 1769630594.25374, 'last_price_update_time': 1769630594.253752, 'auction_closing_time': 1769703003.0}
2026-01-28 20:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AC57291') HTTP/1.1" 204 0
2026-01-28 20:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/31/4d311aa725e73a36b661a7c8a681b60a/pa/XZ92879_bfa3a0aee16ebbde70882d6d02fa8b25.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/3c/ea3c5c207f517413e6d24154891f3b94/pa/AJ94497_51d4102d4875b8230b27ae69d0143f40.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0a02e910>
2026-01-28 20:03:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b8f56d5-5dc2-56aa-a900-55a8006fc8f1/0b8f56d5-5dc2-56aa-a900-55a8006fc8f1_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F31%252F4d311aa725e73a36b661a7c8a681b60a%252Fpa%252FXZ92879_e95cb3283a9c43302a0e5a7662045481.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/31/4d311aa725e73a36b661a7c8a681b60a/pa/XZ92879_e95cb3283a9c43302a0e5a7662045481.jpg saved to cache
2026-01-28 20:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0b8f56d5-5dc2-56aa-a900-55a8006fc8f1
2026-01-28 20:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/a1/bba17735831d0c60f6cc98219f2f1a44/pa/TL16229_349676914b001ae8db4cb09eea222073.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0a01c710>
2026-01-28 20:03:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b8f56d5-5dc2-56aa-a900-55a8006fc8f1/0b8f56d5-5dc2-56aa-a900-55a8006fc8f1_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F31%252F4d311aa725e73a36b661a7c8a681b60a%252Fpa%252FXZ92879_bfa3a0aee16ebbde70882d6d02fa8b25.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/31/4d311aa725e73a36b661a7c8a681b60a/pa/XZ92879_bfa3a0aee16ebbde70882d6d02fa8b25.jpg saved to cache
2026-01-28 20:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0b8f56d5-5dc2-56aa-a900-55a8006fc8f1
2026-01-28 20:03:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09d6c610>
2026-01-28 20:03:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f902eea8-627c-51db-89c8-9495352ad881/f902eea8-627c-51db-89c8-9495352ad881_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F3c%252Fea3c5c207f517413e6d24154891f3b94%252Fpa%252FAJ94497_51d4102d4875b8230b27ae69d0143f40.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/3c/ea3c5c207f517413e6d24154891f3b94/pa/AJ94497_51d4102d4875b8230b27ae69d0143f40.jpg saved to cache
2026-01-28 20:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item f902eea8-627c-51db-89c8-9495352ad881
2026-01-28 20:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/20/f72010615952f8b7c2d6f5563f39ebd3/pa/VM43481_0f11ab19224651daf5764f1af0df2228.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/31/4d311aa725e73a36b661a7c8a681b60a/pa/XZ92879_d318b0ac25c08372c37ca645ebdab375.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/31/4d311aa725e73a36b661a7c8a681b60a/pa/XZ92879_dcc058b7ecde18288f51e0bae6a07de7.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/20/f72010615952f8b7c2d6f5563f39ebd3/pa/VM43481_928889a14e933a03c98ad56f26577210.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0899d450>
2026-01-28 20:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d2e38e4-f567-5149-998f-815ba0cbdf45/8d2e38e4-f567-5149-998f-815ba0cbdf45_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Fa1%252Fbba17735831d0c60f6cc98219f2f1a44%252Fpa%252FTL16229_349676914b001ae8db4cb09eea222073.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/a1/bba17735831d0c60f6cc98219f2f1a44/pa/TL16229_349676914b001ae8db4cb09eea222073.jpg saved to cache
2026-01-28 20:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8d2e38e4-f567-5149-998f-815ba0cbdf45
2026-01-28 20:03:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8d2e38e4-f567-5149-998f-815ba0cbdf45, skipping ID generation
2026-01-28 20:03:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d2e38e4-f567-5149-998f-815ba0cbdf45 with scrape type 1
2026-01-28 20:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 8d2e38e4-f567-5149-998f-815ba0cbdf45 from tracking dictionaries
2026-01-28 20:03:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8d2e38e4-f567-5149-998f-815ba0cbdf45 sending to next pipeline
2026-01-28 20:03:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8d2e38e4-f567-5149-998f-815ba0cbdf45, identifier: TL16229
2026-01-28 20:03:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8d2e38e4-f567-5149-998f-815ba0cbdf45 with identifier: TL16229
2026-01-28 20:03:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8d2e38e4-f567-5149-998f-815ba0cbdf45 with identifier: TL16229
2026-01-28 20:03:15 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 174171 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    174171
2026-01-28 20:03:15 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 8d2e38e4-f567-5149-998f-815ba0cbdf45 spider: auto1.it
2026-01-28 20:03:15 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 8d2e38e4-f567-5149-998f-815ba0cbdf45 due to rule: high_mileage_for_country.json, error: 174171 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    174171
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:44:05Z',
 'fuel_type': 'diesel',
 'id': '8d2e38e4-f567-5149-998f-815ba0cbdf45',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TL16229',
 'listing': 'auction',
 'location': 'IT, Mariano Comense',
 'make': 'Skoda',
 'model': 'Karoq',
 'odometer': 174171,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d2e38e4-f567-5149-998f-815ba0cbdf45/8d2e38e4-f567-5149-998f-815ba0cbdf45_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61056,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/a1/bba17735831d0c60f6cc98219f2f1a44/pa/TL16229_349676914b001ae8db4cb09eea222073.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d2e38e4-f567-5149-998f-815ba0cbdf45/8d2e38e4-f567-5149-998f-815ba0cbdf45_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56003,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/a1/bba17735831d0c60f6cc98219f2f1a44/pa/TL16229_ca7db81476d4ac18ca630519b94cfda0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d2e38e4-f567-5149-998f-815ba0cbdf45/8d2e38e4-f567-5149-998f-815ba0cbdf45_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59309,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/a1/bba17735831d0c60f6cc98219f2f1a44/pa/TL16229_fdb74faf5e7da442927a82ba1a1b4d53.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d2e38e4-f567-5149-998f-815ba0cbdf45/8d2e38e4-f567-5149-998f-815ba0cbdf45_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45248,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/a1/bba17735831d0c60f6cc98219f2f1a44/pa/TL16229_cc3ce3e676d4df0a35aff4409103accb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d2e38e4-f567-5149-998f-815ba0cbdf45/8d2e38e4-f567-5149-998f-815ba0cbdf45_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54000,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/a1/bba17735831d0c60f6cc98219f2f1a44/pa/TL16229_7cd71fc87cb970dee6956e8ecf885f71.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d2e38e4-f567-5149-998f-815ba0cbdf45/8d2e38e4-f567-5149-998f-815ba0cbdf45_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59511,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/a1/bba17735831d0c60f6cc98219f2f1a44/pa/TL16229_3f6111e1b5592800d54e2871896b1bf5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d2e38e4-f567-5149-998f-815ba0cbdf45/8d2e38e4-f567-5149-998f-815ba0cbdf45_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45253,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/a1/bba17735831d0c60f6cc98219f2f1a44/pa/TL16229_739dae3163e7ae577d159629930894ec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d2e38e4-f567-5149-998f-815ba0cbdf45/8d2e38e4-f567-5149-998f-815ba0cbdf45_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64484,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/a1/bba17735831d0c60f6cc98219f2f1a44/pa/TL16229_7409edacc49652a97b1b129a2203be84.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d2e38e4-f567-5149-998f-815ba0cbdf45/8d2e38e4-f567-5149-998f-815ba0cbdf45_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61551,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/a1/bba17735831d0c60f6cc98219f2f1a44/pa/TL16229_bce85c5b26c0548d9df892951764d43c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d2e38e4-f567-5149-998f-815ba0cbdf45/8d2e38e4-f567-5149-998f-815ba0cbdf45_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60477,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/a1/bba17735831d0c60f6cc98219f2f1a44/pa/TL16229_7985f4e67907a546c4827fad748bdf00.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d2e38e4-f567-5149-998f-815ba0cbdf45/8d2e38e4-f567-5149-998f-815ba0cbdf45_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51035,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/a1/bba17735831d0c60f6cc98219f2f1a44/pa/TL16229_d16780c76feabcda6d94e4ca397cd3b0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d2e38e4-f567-5149-998f-815ba0cbdf45/8d2e38e4-f567-5149-998f-815ba0cbdf45_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47729,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/a1/bba17735831d0c60f6cc98219f2f1a44/pa/TL16229_4da722ecd76f93e1ded9d4a83afa715a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d2e38e4-f567-5149-998f-815ba0cbdf45/8d2e38e4-f567-5149-998f-815ba0cbdf45_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56925,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/a1/bba17735831d0c60f6cc98219f2f1a44/pa/TL16229_3063e66de4576426629d6500e0f30735.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d2e38e4-f567-5149-998f-815ba0cbdf45/8d2e38e4-f567-5149-998f-815ba0cbdf45_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46573,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/a1/bba17735831d0c60f6cc98219f2f1a44/pa/TL16229_694e14cfbea4fa4e22d82ec69b12cdca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d2e38e4-f567-5149-998f-815ba0cbdf45/8d2e38e4-f567-5149-998f-815ba0cbdf45_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62249,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/a1/bba17735831d0c60f6cc98219f2f1a44/pa/TL16229_347b732ca8b846425b9d697e2f450bd1.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-04-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Karoq 2.0 TDI Style 4x4',
 'transmission': 'automatic',
 'trim': 'Style 4x4',
 'year': 2018}
2026-01-28 20:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TL16229%27 HTTP/1.1" 200 None
2026-01-28 20:03:15 [auto1.it] INFO: Saving data for TL16229: {'created_time': 1769630595.808042, 'last_price_update_time': 1769630595.808053, 'auction_closing_time': 1769705045.0}
2026-01-28 20:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TL16229') HTTP/1.1" 204 0
2026-01-28 20:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/3c/ea3c5c207f517413e6d24154891f3b94/pa/AJ94497_9651aa2bb02e3ddaf82d997ccd225e56.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/31/4d311aa725e73a36b661a7c8a681b60a/pa/XZ92879_e4545135eff2061e8233294a2bd4d100.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:03:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08c180d0>
2026-01-28 20:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49e888e6-e08b-55b6-b9f8-fdb6743794c4/49e888e6-e08b-55b6-b9f8-fdb6743794c4_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F20%252Ff72010615952f8b7c2d6f5563f39ebd3%252Fpa%252FVM43481_0f11ab19224651daf5764f1af0df2228.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/20/f72010615952f8b7c2d6f5563f39ebd3/pa/VM43481_0f11ab19224651daf5764f1af0df2228.jpg saved to cache
2026-01-28 20:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 49e888e6-e08b-55b6-b9f8-fdb6743794c4
2026-01-28 20:03:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0a031090>
2026-01-28 20:03:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b8f56d5-5dc2-56aa-a900-55a8006fc8f1/0b8f56d5-5dc2-56aa-a900-55a8006fc8f1_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F31%252F4d311aa725e73a36b661a7c8a681b60a%252Fpa%252FXZ92879_d318b0ac25c08372c37ca645ebdab375.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/31/4d311aa725e73a36b661a7c8a681b60a/pa/XZ92879_d318b0ac25c08372c37ca645ebdab375.jpg saved to cache
2026-01-28 20:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0b8f56d5-5dc2-56aa-a900-55a8006fc8f1
2026-01-28 20:03:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b089a0190>
2026-01-28 20:03:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b8f56d5-5dc2-56aa-a900-55a8006fc8f1/0b8f56d5-5dc2-56aa-a900-55a8006fc8f1_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F31%252F4d311aa725e73a36b661a7c8a681b60a%252Fpa%252FXZ92879_dcc058b7ecde18288f51e0bae6a07de7.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/31/4d311aa725e73a36b661a7c8a681b60a/pa/XZ92879_dcc058b7ecde18288f51e0bae6a07de7.jpg saved to cache
2026-01-28 20:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 0b8f56d5-5dc2-56aa-a900-55a8006fc8f1
2026-01-28 20:03:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0872a490>
2026-01-28 20:03:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:03:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49e888e6-e08b-55b6-b9f8-fdb6743794c4/49e888e6-e08b-55b6-b9f8-fdb6743794c4_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F20%252Ff72010615952f8b7c2d6f5563f39ebd3%252Fpa%252FVM43481_928889a14e933a03c98ad56f26577210.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/20/f72010615952f8b7c2d6f5563f39ebd3/pa/VM43481_928889a14e933a03c98ad56f26577210.jpg saved to cache
2026-01-28 20:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 49e888e6-e08b-55b6-b9f8-fdb6743794c4
2026-01-28 20:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/20/f72010615952f8b7c2d6f5563f39ebd3/pa/VM43481_092f5e9be9ff45588c730d374d8be41d.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:03:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:03:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09d72050>
2026-01-28 20:03:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f902eea8-627c-51db-89c8-9495352ad881/f902eea8-627c-51db-89c8-9495352ad881_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F3c%252Fea3c5c207f517413e6d24154891f3b94%252Fpa%252FAJ94497_9651aa2bb02e3ddaf82d997ccd225e56.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/3c/ea3c5c207f517413e6d24154891f3b94/pa/AJ94497_9651aa2bb02e3ddaf82d997ccd225e56.jpg saved to cache
2026-01-28 20:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item f902eea8-627c-51db-89c8-9495352ad881
2026-01-28 20:03:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0a040290>
2026-01-28 20:03:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:03:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b8f56d5-5dc2-56aa-a900-55a8006fc8f1/0b8f56d5-5dc2-56aa-a900-55a8006fc8f1_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F31%252F4d311aa725e73a36b661a7c8a681b60a%252Fpa%252FXZ92879_e4545135eff2061e8233294a2bd4d100.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/31/4d311aa725e73a36b661a7c8a681b60a/pa/XZ92879_e4545135eff2061e8233294a2bd4d100.jpg saved to cache
2026-01-28 20:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0b8f56d5-5dc2-56aa-a900-55a8006fc8f1
2026-01-28 20:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/fd/38fd88ff893c0fefa3c06446d81828f1/pa/ED39383_10313e9105ed1124473efb8dbfa11bbf.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/3c/ea3c5c207f517413e6d24154891f3b94/pa/AJ94497_29bd90d5a06f24deae915ba5f026157e.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/3c/ea3c5c207f517413e6d24154891f3b94/pa/AJ94497_7eca6cf0b3e9507b5020b9147a2f5504.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:03:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b089a1590>
2026-01-28 20:03:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:03:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49e888e6-e08b-55b6-b9f8-fdb6743794c4/49e888e6-e08b-55b6-b9f8-fdb6743794c4_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F20%252Ff72010615952f8b7c2d6f5563f39ebd3%252Fpa%252FVM43481_092f5e9be9ff45588c730d374d8be41d.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/20/f72010615952f8b7c2d6f5563f39ebd3/pa/VM43481_092f5e9be9ff45588c730d374d8be41d.jpg saved to cache
2026-01-28 20:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 49e888e6-e08b-55b6-b9f8-fdb6743794c4
2026-01-28 20:03:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:03:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:03:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/fd/38fd88ff893c0fefa3c06446d81828f1/pa/ED39383_7da02b384c9dd312289601029a6d0f2f.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:03:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/31/4d311aa725e73a36b661a7c8a681b60a/pa/XZ92879_65dd4633622f2317c0af09138f0c931e.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/20/f72010615952f8b7c2d6f5563f39ebd3/pa/VM43481_72b7d3f5fa5e1ec4cab5c822ef3c293b.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:03:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:03:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08931550>
2026-01-28 20:03:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e91390f-d960-55fa-a814-b4adfe996ef2/5e91390f-d960-55fa-a814-b4adfe996ef2_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Ffd%252F38fd88ff893c0fefa3c06446d81828f1%252Fpa%252FED39383_10313e9105ed1124473efb8dbfa11bbf.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/fd/38fd88ff893c0fefa3c06446d81828f1/pa/ED39383_10313e9105ed1124473efb8dbfa11bbf.jpg saved to cache
2026-01-28 20:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 5e91390f-d960-55fa-a814-b4adfe996ef2
2026-01-28 20:03:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0a0dc8d0>
2026-01-28 20:03:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f902eea8-627c-51db-89c8-9495352ad881/f902eea8-627c-51db-89c8-9495352ad881_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F3c%252Fea3c5c207f517413e6d24154891f3b94%252Fpa%252FAJ94497_29bd90d5a06f24deae915ba5f026157e.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/3c/ea3c5c207f517413e6d24154891f3b94/pa/AJ94497_29bd90d5a06f24deae915ba5f026157e.jpg saved to cache
2026-01-28 20:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f902eea8-627c-51db-89c8-9495352ad881
2026-01-28 20:03:18 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 22 - Data Location: 110 - value: b'SONY\x00'
2026-01-28 20:03:18 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 34 - Data Location: 116 - value: b'ILCE-7M3\x00'
2026-01-28 20:03:18 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 126 - value: b',\x01\x00\x00\x01\x00\x00\x00'
2026-01-28 20:03:18 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 134 - value: b',\x01\x00\x00\x01\x00\x00\x00'
2026-01-28 20:03:18 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-01-28 20:03:18 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 82 - Data Location: 142 - value: <table: 42 bytes>
2026-01-28 20:03:18 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 94 - Data Location: 184 - value: b'2026:01:28 10:30:25\x00'
2026-01-28 20:03:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\xcc\x00\x00\x00'
2026-01-28 20:03:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09d78390>
2026-01-28 20:03:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f902eea8-627c-51db-89c8-9495352ad881/f902eea8-627c-51db-89c8-9495352ad881_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F3c%252Fea3c5c207f517413e6d24154891f3b94%252Fpa%252FAJ94497_7eca6cf0b3e9507b5020b9147a2f5504.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/3c/ea3c5c207f517413e6d24154891f3b94/pa/AJ94497_7eca6cf0b3e9507b5020b9147a2f5504.jpg saved to cache
2026-01-28 20:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item f902eea8-627c-51db-89c8-9495352ad881
2026-01-28 20:03:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/31/4d311aa725e73a36b661a7c8a681b60a/pa/XZ92879_8c72d9e7279c6fd44441432d4318fe87.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/fd/38fd88ff893c0fefa3c06446d81828f1/pa/ED39383_4a26861448411c1f480d2803dfcf84a8.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b086edb10>
2026-01-28 20:03:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:03:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e91390f-d960-55fa-a814-b4adfe996ef2/5e91390f-d960-55fa-a814-b4adfe996ef2_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Ffd%252F38fd88ff893c0fefa3c06446d81828f1%252Fpa%252FED39383_7da02b384c9dd312289601029a6d0f2f.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/fd/38fd88ff893c0fefa3c06446d81828f1/pa/ED39383_7da02b384c9dd312289601029a6d0f2f.jpg saved to cache
2026-01-28 20:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 5e91390f-d960-55fa-a814-b4adfe996ef2
2026-01-28 20:03:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0a030410>
2026-01-28 20:03:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b8f56d5-5dc2-56aa-a900-55a8006fc8f1/0b8f56d5-5dc2-56aa-a900-55a8006fc8f1_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F31%252F4d311aa725e73a36b661a7c8a681b60a%252Fpa%252FXZ92879_65dd4633622f2317c0af09138f0c931e.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/31/4d311aa725e73a36b661a7c8a681b60a/pa/XZ92879_65dd4633622f2317c0af09138f0c931e.jpg saved to cache
2026-01-28 20:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0b8f56d5-5dc2-56aa-a900-55a8006fc8f1
2026-01-28 20:03:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b086eef90>
2026-01-28 20:03:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49e888e6-e08b-55b6-b9f8-fdb6743794c4/49e888e6-e08b-55b6-b9f8-fdb6743794c4_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F20%252Ff72010615952f8b7c2d6f5563f39ebd3%252Fpa%252FVM43481_72b7d3f5fa5e1ec4cab5c822ef3c293b.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/20/f72010615952f8b7c2d6f5563f39ebd3/pa/VM43481_72b7d3f5fa5e1ec4cab5c822ef3c293b.jpg saved to cache
2026-01-28 20:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 49e888e6-e08b-55b6-b9f8-fdb6743794c4
2026-01-28 20:03:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/fd/38fd88ff893c0fefa3c06446d81828f1/pa/ED39383_f8a1ab4992ca03080dfe7e14e2981365.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09fd2890>
2026-01-28 20:03:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b8f56d5-5dc2-56aa-a900-55a8006fc8f1/0b8f56d5-5dc2-56aa-a900-55a8006fc8f1_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F31%252F4d311aa725e73a36b661a7c8a681b60a%252Fpa%252FXZ92879_8c72d9e7279c6fd44441432d4318fe87.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/31/4d311aa725e73a36b661a7c8a681b60a/pa/XZ92879_8c72d9e7279c6fd44441432d4318fe87.jpg saved to cache
2026-01-28 20:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0b8f56d5-5dc2-56aa-a900-55a8006fc8f1
2026-01-28 20:03:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09d78a10>
2026-01-28 20:03:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e91390f-d960-55fa-a814-b4adfe996ef2/5e91390f-d960-55fa-a814-b4adfe996ef2_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Ffd%252F38fd88ff893c0fefa3c06446d81828f1%252Fpa%252FED39383_4a26861448411c1f480d2803dfcf84a8.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/fd/38fd88ff893c0fefa3c06446d81828f1/pa/ED39383_4a26861448411c1f480d2803dfcf84a8.jpg saved to cache
2026-01-28 20:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 5e91390f-d960-55fa-a814-b4adfe996ef2
2026-01-28 20:03:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/31/4d311aa725e73a36b661a7c8a681b60a/pa/XZ92879_bb8bfb267e16179bfe11f2976204b1ea.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08cd0450>
2026-01-28 20:03:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e91390f-d960-55fa-a814-b4adfe996ef2/5e91390f-d960-55fa-a814-b4adfe996ef2_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg38%252Ffd%252F38fd88ff893c0fefa3c06446d81828f1%252Fpa%252FED39383_f8a1ab4992ca03080dfe7e14e2981365.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/fd/38fd88ff893c0fefa3c06446d81828f1/pa/ED39383_f8a1ab4992ca03080dfe7e14e2981365.jpg saved to cache
2026-01-28 20:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5e91390f-d960-55fa-a814-b4adfe996ef2
2026-01-28 20:03:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5e91390f-d960-55fa-a814-b4adfe996ef2, skipping ID generation
2026-01-28 20:03:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e91390f-d960-55fa-a814-b4adfe996ef2 with scrape type 1
2026-01-28 20:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 5e91390f-d960-55fa-a814-b4adfe996ef2 from tracking dictionaries
2026-01-28 20:03:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5e91390f-d960-55fa-a814-b4adfe996ef2 sending to next pipeline
2026-01-28 20:03:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5e91390f-d960-55fa-a814-b4adfe996ef2, identifier: ED39383
2026-01-28 20:03:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5e91390f-d960-55fa-a814-b4adfe996ef2 with identifier: ED39383
2026-01-28 20:03:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5e91390f-d960-55fa-a814-b4adfe996ef2 with identifier: ED39383
2026-01-28 20:03:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5e91390f-d960-55fa-a814-b4adfe996ef2 with identifier: ED39383 to the API
2026-01-28 20:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:03:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:03:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img38/fd/38fd88ff893c0fefa3c06446d81828f1/pa/ED39383_f8a1ab4992ca03080dfe7e14e2981365.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.0L',
 'engine_horse_power': 111,
 'expiration_date': '2026-01-29T16:30:46Z',
 'fuel_type': 'petrol',
 'id': '5e91390f-d960-55fa-a814-b4adfe996ef2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ED39383',
 'listing': 'auction',
 'location': 'IT, Napoli',
 'make': 'MG',
 'model': 'ZS',
 'odometer': 45443,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e91390f-d960-55fa-a814-b4adfe996ef2/5e91390f-d960-55fa-a814-b4adfe996ef2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75266,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/fd/38fd88ff893c0fefa3c06446d81828f1/pa/ED39383_543bf680f2f49e695c6fb0f3a440a87d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e91390f-d960-55fa-a814-b4adfe996ef2/5e91390f-d960-55fa-a814-b4adfe996ef2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75211,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/fd/38fd88ff893c0fefa3c06446d81828f1/pa/ED39383_f006e68ad3f078e735e7a4a588c4113c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e91390f-d960-55fa-a814-b4adfe996ef2/5e91390f-d960-55fa-a814-b4adfe996ef2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74260,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/fd/38fd88ff893c0fefa3c06446d81828f1/pa/ED39383_cbf208456d9f03ddd8533d9086356dd1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e91390f-d960-55fa-a814-b4adfe996ef2/5e91390f-d960-55fa-a814-b4adfe996ef2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62915,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/fd/38fd88ff893c0fefa3c06446d81828f1/pa/ED39383_ff71729d5bb76579fc929a5259d61cad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e91390f-d960-55fa-a814-b4adfe996ef2/5e91390f-d960-55fa-a814-b4adfe996ef2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72129,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/fd/38fd88ff893c0fefa3c06446d81828f1/pa/ED39383_66d2dbc9af6f0cfd4a0bee5a42a8bee2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e91390f-d960-55fa-a814-b4adfe996ef2/5e91390f-d960-55fa-a814-b4adfe996ef2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73088,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/fd/38fd88ff893c0fefa3c06446d81828f1/pa/ED39383_b3bbb6b276b0b32b8bfee2972eca74ff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e91390f-d960-55fa-a814-b4adfe996ef2/5e91390f-d960-55fa-a814-b4adfe996ef2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63313,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/fd/38fd88ff893c0fefa3c06446d81828f1/pa/ED39383_cc10d7475d3fd3c392f3f84ffbedf787.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e91390f-d960-55fa-a814-b4adfe996ef2/5e91390f-d960-55fa-a814-b4adfe996ef2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74379,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/fd/38fd88ff893c0fefa3c06446d81828f1/pa/ED39383_f8a1ab4992ca03080dfe7e14e2981365.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e91390f-d960-55fa-a814-b4adfe996ef2/5e91390f-d960-55fa-a814-b4adfe996ef2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2685652,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img38/fd/38fd88ff893c0fefa3c06446d81828f1/pa/ED39383_f3f061f8a24253337970fcac7e4ff804.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e91390f-d960-55fa-a814-b4adfe996ef2/5e91390f-d960-55fa-a814-b4adfe996ef2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67728,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/fd/38fd88ff893c0fefa3c06446d81828f1/pa/ED39383_426c5c7abde334ebaf1dfd7a12870b91.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e91390f-d960-55fa-a814-b4adfe996ef2/5e91390f-d960-55fa-a814-b4adfe996ef2_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65373,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/fd/38fd88ff893c0fefa3c06446d81828f1/pa/ED39383_aafe6d4327e5c79cc624c23b7a6fd8b2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e91390f-d960-55fa-a814-b4adfe996ef2/5e91390f-d960-55fa-a814-b4adfe996ef2_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66282,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/fd/38fd88ff893c0fefa3c06446d81828f1/pa/ED39383_4a26861448411c1f480d2803dfcf84a8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e91390f-d960-55fa-a814-b4adfe996ef2/5e91390f-d960-55fa-a814-b4adfe996ef2_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55729,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/fd/38fd88ff893c0fefa3c06446d81828f1/pa/ED39383_7da02b384c9dd312289601029a6d0f2f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e91390f-d960-55fa-a814-b4adfe996ef2/5e91390f-d960-55fa-a814-b4adfe996ef2_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60796,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/fd/38fd88ff893c0fefa3c06446d81828f1/pa/ED39383_10313e9105ed1124473efb8dbfa11bbf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e91390f-d960-55fa-a814-b4adfe996ef2/5e91390f-d960-55fa-a814-b4adfe996ef2_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57758,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img38/fd/38fd88ff893c0fefa3c06446d81828f1/pa/ED39383_c8e8d871213c2ff8d24fb23d27a16879.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-03-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MG ZS 1.0 T-GDI Luxury',
 'transmission': 'manual',
 'trim': 'Luxury',
 'year': 2022}
2026-01-28 20:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ED39383%27 HTTP/1.1" 200 None
2026-01-28 20:03:21 [auto1.it] INFO: Saving data for ED39383: {'created_time': 1769630601.694331, 'last_price_update_time': 1769630601.694344, 'auction_closing_time': 1769704246.0}
2026-01-28 20:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ED39383') HTTP/1.1" 204 0
2026-01-28 20:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/3c/ea3c5c207f517413e6d24154891f3b94/pa/AJ94497_875d1ce4246fd13edf76567d78228669.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PK36389/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KK21064/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PM33616/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JV90142> (referer: https://www.auto1.com/v1/car-details-view/JV90142/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CC38555> (referer: https://www.auto1.com/v1/car-details-view/CC38555/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XX61742/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XS04727/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XA03649> (referer: https://www.auto1.com/v1/car-details-view/XA03649/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:03:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:03:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:03:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:03:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:03:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:03:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:03:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:03:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:03:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08712cd0>
2026-01-28 20:03:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b8f56d5-5dc2-56aa-a900-55a8006fc8f1/0b8f56d5-5dc2-56aa-a900-55a8006fc8f1_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F31%252F4d311aa725e73a36b661a7c8a681b60a%252Fpa%252FXZ92879_bb8bfb267e16179bfe11f2976204b1ea.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/31/4d311aa725e73a36b661a7c8a681b60a/pa/XZ92879_bb8bfb267e16179bfe11f2976204b1ea.jpg saved to cache
2026-01-28 20:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 0b8f56d5-5dc2-56aa-a900-55a8006fc8f1
2026-01-28 20:03:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0872a950>
2026-01-28 20:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f902eea8-627c-51db-89c8-9495352ad881/f902eea8-627c-51db-89c8-9495352ad881_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F3c%252Fea3c5c207f517413e6d24154891f3b94%252Fpa%252FAJ94497_875d1ce4246fd13edf76567d78228669.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/3c/ea3c5c207f517413e6d24154891f3b94/pa/AJ94497_875d1ce4246fd13edf76567d78228669.jpg saved to cache
2026-01-28 20:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f902eea8-627c-51db-89c8-9495352ad881
2026-01-28 20:03:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 35741478-6c74-5103-900b-960875a76099 with identifier: JV90142
2026-01-28 20:03:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 35741478-6c74-5103-900b-960875a76099 with scrape type 2
2026-01-28 20:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 35741478-6c74-5103-900b-960875a76099 with scrape type 2
2026-01-28 20:03:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 35741478-6c74-5103-900b-960875a76099, identifier: JV90142
2026-01-28 20:03:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 98e5eb42-32d1-5781-a60c-2e8aad53c869 with identifier: CC38555
2026-01-28 20:03:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98e5eb42-32d1-5781-a60c-2e8aad53c869 with scrape type 2
2026-01-28 20:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 98e5eb42-32d1-5781-a60c-2e8aad53c869 with scrape type 2
2026-01-28 20:03:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 98e5eb42-32d1-5781-a60c-2e8aad53c869, identifier: CC38555
2026-01-28 20:03:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 697b49cf-5fb3-549c-8273-0f9f018d36a6 with identifier: XA03649
2026-01-28 20:03:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 697b49cf-5fb3-549c-8273-0f9f018d36a6 with scrape type 1
2026-01-28 20:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 697b49cf-5fb3-549c-8273-0f9f018d36a6
2026-01-28 20:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252Fb0%252Fb7b02e96c39b384924bc3a112ccefa59%252Fpa%252FXA03649_fa7cc1e0a4da47458db42338eab51fa9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/b0/b7b02e96c39b384924bc3a112ccefa59/pa/XA03649_fa7cc1e0a4da47458db42338eab51fa9.jpg not downloaded yet
2026-01-28 20:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/20/f72010615952f8b7c2d6f5563f39ebd3/pa/VM43481_ff842e5d201872d13cb309303bf85754.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/3c/ea3c5c207f517413e6d24154891f3b94/pa/AJ94497_ce1e7554161199c1126c163e36c9b646.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 35741478-6c74-5103-900b-960875a76099 with identifier: JV90142
2026-01-28 20:03:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 35741478-6c74-5103-900b-960875a76099 with identifier: JV90142
2026-01-28 20:03:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 35741478-6c74-5103-900b-960875a76099 with identifier: JV90142 to the API
2026-01-28 20:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:03:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:03:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JV90142>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '0.9L',
 'engine_horse_power': 85,
 'expiration_date': '2026-01-29T16:00:19Z',
 'fuel_type': 'petrol',
 'id': '35741478-6c74-5103-900b-960875a76099',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JV90142',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'Fiat',
 'model': '500C',
 'odometer': 95113,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-04-29',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat 500C 0.9 Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2019}
2026-01-28 20:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JV90142%27 HTTP/1.1" 200 None
2026-01-28 20:03:23 [auto1.it] INFO: Saving data for JV90142: {'auction_closing_time': 1769702419.0, 'created_time': 1768817340.81987, 'last_price_update_time': 1769630603.732549}
2026-01-28 20:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JV90142') HTTP/1.1" 204 0
2026-01-28 20:03:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 98e5eb42-32d1-5781-a60c-2e8aad53c869 with identifier: CC38555
2026-01-28 20:03:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 98e5eb42-32d1-5781-a60c-2e8aad53c869 with identifier: CC38555
2026-01-28 20:03:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 98e5eb42-32d1-5781-a60c-2e8aad53c869 with identifier: CC38555 to the API
2026-01-28 20:03:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:03:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:03:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CC38555>
{'auction_title': '',
 'c_o_2_emission_value': 176,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 204,
 'expiration_date': '2026-01-29T16:41:00Z',
 'fuel_type': 'diesel',
 'id': '98e5eb42-32d1-5781-a60c-2e8aad53c869',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CC38555',
 'listing': 'auction',
 'location': 'IT',
 'make': 'Audi',
 'model': 'Q5 Sportback',
 'odometer': 60263,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2025-01-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q5 Sportback 40 TDI Mild-Hybrid quattro S line',
 'transmission': 'automatic',
 'trim': 'quattro S line',
 'year': 2025}
2026-01-28 20:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CC38555%27 HTTP/1.1" 200 None
2026-01-28 20:03:24 [auto1.it] INFO: Saving data for CC38555: {'auction_closing_time': 1769704860.0, 'created_time': 1769458017.78858, 'last_price_update_time': 1769630604.072478}
2026-01-28 20:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CC38555') HTTP/1.1" 204 0
2026-01-28 20:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252Fb0%252Fb7b02e96c39b384924bc3a112ccefa59%252Fpa%252FXA03649_7dfcec7dfc8453cffca2a78346e28f61.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/b0/b7b02e96c39b384924bc3a112ccefa59/pa/XA03649_7dfcec7dfc8453cffca2a78346e28f61.jpg not downloaded yet
2026-01-28 20:03:24 [scrapy.extensions.logstats] INFO: Crawled 215 pages (at 75 pages/min), scraped 59 items (at 21 items/min)
2026-01-28 20:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/31/4d311aa725e73a36b661a7c8a681b60a/pa/XZ92879_0213cd2b02076c9ec8e7002d7a2c3c7c.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252Fb0%252Fb7b02e96c39b384924bc3a112ccefa59%252Fpa%252FXA03649_1370c01c2f746c0a236fb44513fe5a74.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/b0/b7b02e96c39b384924bc3a112ccefa59/pa/XA03649_1370c01c2f746c0a236fb44513fe5a74.jpg not downloaded yet
2026-01-28 20:03:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:03:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09eb5f90>
2026-01-28 20:03:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49e888e6-e08b-55b6-b9f8-fdb6743794c4/49e888e6-e08b-55b6-b9f8-fdb6743794c4_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F20%252Ff72010615952f8b7c2d6f5563f39ebd3%252Fpa%252FVM43481_ff842e5d201872d13cb309303bf85754.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/20/f72010615952f8b7c2d6f5563f39ebd3/pa/VM43481_ff842e5d201872d13cb309303bf85754.jpg saved to cache
2026-01-28 20:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 49e888e6-e08b-55b6-b9f8-fdb6743794c4
2026-01-28 20:03:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 49e888e6-e08b-55b6-b9f8-fdb6743794c4, skipping ID generation
2026-01-28 20:03:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49e888e6-e08b-55b6-b9f8-fdb6743794c4 with scrape type 1
2026-01-28 20:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 49e888e6-e08b-55b6-b9f8-fdb6743794c4 from tracking dictionaries
2026-01-28 20:03:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 49e888e6-e08b-55b6-b9f8-fdb6743794c4 sending to next pipeline
2026-01-28 20:03:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 49e888e6-e08b-55b6-b9f8-fdb6743794c4, identifier: VM43481
2026-01-28 20:03:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08b56d10>
2026-01-28 20:03:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f902eea8-627c-51db-89c8-9495352ad881/f902eea8-627c-51db-89c8-9495352ad881_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F3c%252Fea3c5c207f517413e6d24154891f3b94%252Fpa%252FAJ94497_ce1e7554161199c1126c163e36c9b646.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/3c/ea3c5c207f517413e6d24154891f3b94/pa/AJ94497_ce1e7554161199c1126c163e36c9b646.jpg saved to cache
2026-01-28 20:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f902eea8-627c-51db-89c8-9495352ad881
2026-01-28 20:03:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f902eea8-627c-51db-89c8-9495352ad881, skipping ID generation
2026-01-28 20:03:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f902eea8-627c-51db-89c8-9495352ad881 with scrape type 1
2026-01-28 20:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Removing item f902eea8-627c-51db-89c8-9495352ad881 from tracking dictionaries
2026-01-28 20:03:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f902eea8-627c-51db-89c8-9495352ad881 sending to next pipeline
2026-01-28 20:03:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f902eea8-627c-51db-89c8-9495352ad881, identifier: AJ94497
2026-01-28 20:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252Fb0%252Fb7b02e96c39b384924bc3a112ccefa59%252Fpa%252FXA03649_4371229e52ee59563fb84f4a8e5c2e0d.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/b0/b7b02e96c39b384924bc3a112ccefa59/pa/XA03649_4371229e52ee59563fb84f4a8e5c2e0d.jpg not downloaded yet
2026-01-28 20:03:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 49e888e6-e08b-55b6-b9f8-fdb6743794c4 with identifier: VM43481
2026-01-28 20:03:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 49e888e6-e08b-55b6-b9f8-fdb6743794c4 with identifier: VM43481
2026-01-28 20:03:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 49e888e6-e08b-55b6-b9f8-fdb6743794c4 with identifier: VM43481 to the API
2026-01-28 20:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:03:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:03:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf7/20/f72010615952f8b7c2d6f5563f39ebd3/pa/VM43481_ff842e5d201872d13cb309303bf85754.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 39,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.5L',
 'engine_horse_power': 220,
 'expiration_date': '2026-01-29T16:55:23Z',
 'fuel_type': 'hybrid',
 'id': '49e888e6-e08b-55b6-b9f8-fdb6743794c4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VM43481',
 'listing': 'auction',
 'location': 'IT, Roma RM',
 'make': 'BMW',
 'model': 'X2',
 'odometer': 44141,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49e888e6-e08b-55b6-b9f8-fdb6743794c4/49e888e6-e08b-55b6-b9f8-fdb6743794c4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69317,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/20/f72010615952f8b7c2d6f5563f39ebd3/pa/VM43481_72b7d3f5fa5e1ec4cab5c822ef3c293b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49e888e6-e08b-55b6-b9f8-fdb6743794c4/49e888e6-e08b-55b6-b9f8-fdb6743794c4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70695,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/20/f72010615952f8b7c2d6f5563f39ebd3/pa/VM43481_a576fe8c773ee825629d727097d50b50.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49e888e6-e08b-55b6-b9f8-fdb6743794c4/49e888e6-e08b-55b6-b9f8-fdb6743794c4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2366456,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/20/f72010615952f8b7c2d6f5563f39ebd3/pa/VM43481_50b1b39aad0f0887c78e4f8a5a848f73.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49e888e6-e08b-55b6-b9f8-fdb6743794c4/49e888e6-e08b-55b6-b9f8-fdb6743794c4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55117,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/20/f72010615952f8b7c2d6f5563f39ebd3/pa/VM43481_88092aaf1779db58f8c93a487c385f4a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49e888e6-e08b-55b6-b9f8-fdb6743794c4/49e888e6-e08b-55b6-b9f8-fdb6743794c4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2410288,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/20/f72010615952f8b7c2d6f5563f39ebd3/pa/VM43481_ff842e5d201872d13cb309303bf85754.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49e888e6-e08b-55b6-b9f8-fdb6743794c4/49e888e6-e08b-55b6-b9f8-fdb6743794c4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84727,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/20/f72010615952f8b7c2d6f5563f39ebd3/pa/VM43481_928889a14e933a03c98ad56f26577210.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49e888e6-e08b-55b6-b9f8-fdb6743794c4/49e888e6-e08b-55b6-b9f8-fdb6743794c4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48974,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/20/f72010615952f8b7c2d6f5563f39ebd3/pa/VM43481_1d4e5fa6a18a7f9d91ad3b1abda90655.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49e888e6-e08b-55b6-b9f8-fdb6743794c4/49e888e6-e08b-55b6-b9f8-fdb6743794c4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61071,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/20/f72010615952f8b7c2d6f5563f39ebd3/pa/VM43481_7bc5d81ca7bf7e138ec22fd0c716b3c2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49e888e6-e08b-55b6-b9f8-fdb6743794c4/49e888e6-e08b-55b6-b9f8-fdb6743794c4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64830,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/20/f72010615952f8b7c2d6f5563f39ebd3/pa/VM43481_b8d1f025eda8a1304e1ac6658db756a8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49e888e6-e08b-55b6-b9f8-fdb6743794c4/49e888e6-e08b-55b6-b9f8-fdb6743794c4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58005,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/20/f72010615952f8b7c2d6f5563f39ebd3/pa/VM43481_b368de6f705d2148004cdd29cc9e1a40.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49e888e6-e08b-55b6-b9f8-fdb6743794c4/49e888e6-e08b-55b6-b9f8-fdb6743794c4_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2272970,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/20/f72010615952f8b7c2d6f5563f39ebd3/pa/VM43481_092f5e9be9ff45588c730d374d8be41d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49e888e6-e08b-55b6-b9f8-fdb6743794c4/49e888e6-e08b-55b6-b9f8-fdb6743794c4_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56480,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/20/f72010615952f8b7c2d6f5563f39ebd3/pa/VM43481_415e7a51e958fa9004972c73e1f6adf6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49e888e6-e08b-55b6-b9f8-fdb6743794c4/49e888e6-e08b-55b6-b9f8-fdb6743794c4_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62095,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/20/f72010615952f8b7c2d6f5563f39ebd3/pa/VM43481_c39cb0bd1dcec2e3aaf18f8fb88c829d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49e888e6-e08b-55b6-b9f8-fdb6743794c4/49e888e6-e08b-55b6-b9f8-fdb6743794c4_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2180349,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/20/f72010615952f8b7c2d6f5563f39ebd3/pa/VM43481_0f11ab19224651daf5764f1af0df2228.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49e888e6-e08b-55b6-b9f8-fdb6743794c4/49e888e6-e08b-55b6-b9f8-fdb6743794c4_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63316,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/20/f72010615952f8b7c2d6f5563f39ebd3/pa/VM43481_9dd26768b742d87fac53baeda1257da3.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-09-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X2 xDrive 25e Advantage',
 'transmission': 'automatic',
 'trim': 'Advantage',
 'year': 2022}
2026-01-28 20:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VM43481%27 HTTP/1.1" 200 None
2026-01-28 20:03:25 [auto1.it] INFO: Saving data for VM43481: {'created_time': 1769630605.499851, 'last_price_update_time': 1769630605.499864, 'auction_closing_time': 1769705723.0}
2026-01-28 20:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VM43481') HTTP/1.1" 204 0
2026-01-28 20:03:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f902eea8-627c-51db-89c8-9495352ad881 with identifier: AJ94497
2026-01-28 20:03:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f902eea8-627c-51db-89c8-9495352ad881 with identifier: AJ94497
2026-01-28 20:03:25 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 184634 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    184634
2026-01-28 20:03:25 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: f902eea8-627c-51db-89c8-9495352ad881 spider: auto1.it
2026-01-28 20:03:25 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: f902eea8-627c-51db-89c8-9495352ad881 due to rule: high_mileage_for_country.json, error: 184634 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    184634
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 115,
 'expiration_date': '2026-01-29T16:15:39Z',
 'fuel_type': 'diesel',
 'id': 'f902eea8-627c-51db-89c8-9495352ad881',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AJ94497',
 'listing': 'auction',
 'location': 'IT',
 'make': 'Audi',
 'model': 'Q2',
 'odometer': 184634,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f902eea8-627c-51db-89c8-9495352ad881/f902eea8-627c-51db-89c8-9495352ad881_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1111582,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/3c/ea3c5c207f517413e6d24154891f3b94/pa/AJ94497_6bd4e8f1cf7ef18a7f62bb11c377c32b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f902eea8-627c-51db-89c8-9495352ad881/f902eea8-627c-51db-89c8-9495352ad881_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1111582,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/3c/ea3c5c207f517413e6d24154891f3b94/pa/AJ94497_a439d5d37a9e986485147045c360e67f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f902eea8-627c-51db-89c8-9495352ad881/f902eea8-627c-51db-89c8-9495352ad881_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1067113,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/3c/ea3c5c207f517413e6d24154891f3b94/pa/AJ94497_ce1e7554161199c1126c163e36c9b646.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f902eea8-627c-51db-89c8-9495352ad881/f902eea8-627c-51db-89c8-9495352ad881_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 134347,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/3c/ea3c5c207f517413e6d24154891f3b94/pa/AJ94497_f0a726eaa1c588656ba0facd05218075.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f902eea8-627c-51db-89c8-9495352ad881/f902eea8-627c-51db-89c8-9495352ad881_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1103281,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/3c/ea3c5c207f517413e6d24154891f3b94/pa/AJ94497_1e15c3fd192d865b3aafd420fac54e78.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f902eea8-627c-51db-89c8-9495352ad881/f902eea8-627c-51db-89c8-9495352ad881_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1024817,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/3c/ea3c5c207f517413e6d24154891f3b94/pa/AJ94497_8e1ec012aeac3d5dfe77df9b86c5f246.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f902eea8-627c-51db-89c8-9495352ad881/f902eea8-627c-51db-89c8-9495352ad881_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1024071,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/3c/ea3c5c207f517413e6d24154891f3b94/pa/AJ94497_875d1ce4246fd13edf76567d78228669.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f902eea8-627c-51db-89c8-9495352ad881/f902eea8-627c-51db-89c8-9495352ad881_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 162667,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/3c/ea3c5c207f517413e6d24154891f3b94/pa/AJ94497_31b5af403c4bc12c4d6d12ab5862a827.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f902eea8-627c-51db-89c8-9495352ad881/f902eea8-627c-51db-89c8-9495352ad881_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 134552,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/3c/ea3c5c207f517413e6d24154891f3b94/pa/AJ94497_29bd90d5a06f24deae915ba5f026157e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f902eea8-627c-51db-89c8-9495352ad881/f902eea8-627c-51db-89c8-9495352ad881_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 119047,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/3c/ea3c5c207f517413e6d24154891f3b94/pa/AJ94497_badd68e81580f6c4d930b45eeb1e2632.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f902eea8-627c-51db-89c8-9495352ad881/f902eea8-627c-51db-89c8-9495352ad881_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 124386,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/3c/ea3c5c207f517413e6d24154891f3b94/pa/AJ94497_9651aa2bb02e3ddaf82d997ccd225e56.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f902eea8-627c-51db-89c8-9495352ad881/f902eea8-627c-51db-89c8-9495352ad881_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 672492,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/3c/ea3c5c207f517413e6d24154891f3b94/pa/AJ94497_7eca6cf0b3e9507b5020b9147a2f5504.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f902eea8-627c-51db-89c8-9495352ad881/f902eea8-627c-51db-89c8-9495352ad881_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 129275,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/3c/ea3c5c207f517413e6d24154891f3b94/pa/AJ94497_51d4102d4875b8230b27ae69d0143f40.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-05-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q2 1.6 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2018}
2026-01-28 20:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AJ94497%27 HTTP/1.1" 200 None
2026-01-28 20:03:25 [auto1.it] INFO: Saving data for AJ94497: {'created_time': 1769630605.858532, 'last_price_update_time': 1769630605.858544, 'auction_closing_time': 1769703339.0}
2026-01-28 20:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AJ94497') HTTP/1.1" 204 0
2026-01-28 20:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252Fb0%252Fb7b02e96c39b384924bc3a112ccefa59%252Fpa%252FXA03649_e2abe59c7c12cfff409aef46f360f0b7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/b0/b7b02e96c39b384924bc3a112ccefa59/pa/XA03649_e2abe59c7c12cfff409aef46f360f0b7.jpg not downloaded yet
2026-01-28 20:03:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BC61751/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:03:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HH72494/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:03:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YU19851/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:03:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HT79408/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:03:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DA53677/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:03:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XP18402/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:03:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JY56965/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:03:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PD47677/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:03:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:03:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:03:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:03:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:03:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:03:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:03:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:03:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08c42dd0>
2026-01-28 20:03:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b8f56d5-5dc2-56aa-a900-55a8006fc8f1/0b8f56d5-5dc2-56aa-a900-55a8006fc8f1_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F31%252F4d311aa725e73a36b661a7c8a681b60a%252Fpa%252FXZ92879_0213cd2b02076c9ec8e7002d7a2c3c7c.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/31/4d311aa725e73a36b661a7c8a681b60a/pa/XZ92879_0213cd2b02076c9ec8e7002d7a2c3c7c.jpg saved to cache
2026-01-28 20:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0b8f56d5-5dc2-56aa-a900-55a8006fc8f1
2026-01-28 20:03:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0b8f56d5-5dc2-56aa-a900-55a8006fc8f1, skipping ID generation
2026-01-28 20:03:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0b8f56d5-5dc2-56aa-a900-55a8006fc8f1 with scrape type 1
2026-01-28 20:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 0b8f56d5-5dc2-56aa-a900-55a8006fc8f1 from tracking dictionaries
2026-01-28 20:03:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0b8f56d5-5dc2-56aa-a900-55a8006fc8f1 sending to next pipeline
2026-01-28 20:03:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0b8f56d5-5dc2-56aa-a900-55a8006fc8f1, identifier: XZ92879
2026-01-28 20:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252Fb0%252Fb7b02e96c39b384924bc3a112ccefa59%252Fpa%252FXA03649_ed3fd0e90813ea245401dbe0846ba69e.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/b0/b7b02e96c39b384924bc3a112ccefa59/pa/XA03649_ed3fd0e90813ea245401dbe0846ba69e.jpg not downloaded yet
2026-01-28 20:03:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0b8f56d5-5dc2-56aa-a900-55a8006fc8f1 with identifier: XZ92879
2026-01-28 20:03:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0b8f56d5-5dc2-56aa-a900-55a8006fc8f1 with identifier: XZ92879
2026-01-28 20:03:26 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 150776 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    150776
2026-01-28 20:03:26 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 0b8f56d5-5dc2-56aa-a900-55a8006fc8f1 spider: auto1.it
2026-01-28 20:03:26 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 0b8f56d5-5dc2-56aa-a900-55a8006fc8f1 due to rule: high_mileage_for_country.json, error: 150776 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    150776
{'auction_title': '',
 'c_o_2_emission_value': 183,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 179,
 'expiration_date': '2026-01-29T16:39:11Z',
 'fuel_type': 'diesel',
 'id': '0b8f56d5-5dc2-56aa-a900-55a8006fc8f1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XZ92879',
 'listing': 'auction',
 'location': 'IT',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 150776,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b8f56d5-5dc2-56aa-a900-55a8006fc8f1/0b8f56d5-5dc2-56aa-a900-55a8006fc8f1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48249,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/31/4d311aa725e73a36b661a7c8a681b60a/pa/XZ92879_8c72d9e7279c6fd44441432d4318fe87.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b8f56d5-5dc2-56aa-a900-55a8006fc8f1/0b8f56d5-5dc2-56aa-a900-55a8006fc8f1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2626589,
             'Height': 4032,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/31/4d311aa725e73a36b661a7c8a681b60a/pa/XZ92879_38a98400dfc4359259cb3cd2c9a243c0.jpg',
             'Width': 3024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b8f56d5-5dc2-56aa-a900-55a8006fc8f1/0b8f56d5-5dc2-56aa-a900-55a8006fc8f1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84246,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/31/4d311aa725e73a36b661a7c8a681b60a/pa/XZ92879_7cf70465b273d25300d0e75ff8d24c98.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b8f56d5-5dc2-56aa-a900-55a8006fc8f1/0b8f56d5-5dc2-56aa-a900-55a8006fc8f1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2035188,
             'Height': 4032,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/31/4d311aa725e73a36b661a7c8a681b60a/pa/XZ92879_34fa87d944348d50ca401ff34886cbc4.jpg',
             'Width': 3024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b8f56d5-5dc2-56aa-a900-55a8006fc8f1/0b8f56d5-5dc2-56aa-a900-55a8006fc8f1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2582756,
             'Height': 4032,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/31/4d311aa725e73a36b661a7c8a681b60a/pa/XZ92879_0213cd2b02076c9ec8e7002d7a2c3c7c.jpg',
             'Width': 3024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b8f56d5-5dc2-56aa-a900-55a8006fc8f1/0b8f56d5-5dc2-56aa-a900-55a8006fc8f1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75179,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/31/4d311aa725e73a36b661a7c8a681b60a/pa/XZ92879_e4545135eff2061e8233294a2bd4d100.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b8f56d5-5dc2-56aa-a900-55a8006fc8f1/0b8f56d5-5dc2-56aa-a900-55a8006fc8f1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48212,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/31/4d311aa725e73a36b661a7c8a681b60a/pa/XZ92879_bfa3a0aee16ebbde70882d6d02fa8b25.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b8f56d5-5dc2-56aa-a900-55a8006fc8f1/0b8f56d5-5dc2-56aa-a900-55a8006fc8f1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77359,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/31/4d311aa725e73a36b661a7c8a681b60a/pa/XZ92879_e95cb3283a9c43302a0e5a7662045481.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b8f56d5-5dc2-56aa-a900-55a8006fc8f1/0b8f56d5-5dc2-56aa-a900-55a8006fc8f1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2587507,
             'Height': 4032,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/31/4d311aa725e73a36b661a7c8a681b60a/pa/XZ92879_65dd4633622f2317c0af09138f0c931e.jpg',
             'Width': 3024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b8f56d5-5dc2-56aa-a900-55a8006fc8f1/0b8f56d5-5dc2-56aa-a900-55a8006fc8f1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3533504,
             'Height': 4032,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/31/4d311aa725e73a36b661a7c8a681b60a/pa/XZ92879_d318b0ac25c08372c37ca645ebdab375.jpg',
             'Width': 3024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b8f56d5-5dc2-56aa-a900-55a8006fc8f1/0b8f56d5-5dc2-56aa-a900-55a8006fc8f1_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3672087,
             'Height': 3024,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/31/4d311aa725e73a36b661a7c8a681b60a/pa/XZ92879_bb8bfb267e16179bfe11f2976204b1ea.jpg',
             'Width': 4032},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b8f56d5-5dc2-56aa-a900-55a8006fc8f1/0b8f56d5-5dc2-56aa-a900-55a8006fc8f1_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1979893,
             'Height': 3024,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/31/4d311aa725e73a36b661a7c8a681b60a/pa/XZ92879_dcc058b7ecde18288f51e0bae6a07de7.jpg',
             'Width': 4032},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b8f56d5-5dc2-56aa-a900-55a8006fc8f1/0b8f56d5-5dc2-56aa-a900-55a8006fc8f1_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32028,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/31/4d311aa725e73a36b661a7c8a681b60a/pa/XZ92879_de8a4cf66799dab2fc8db907c8362af9.jpg',
             'Width': 450}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-02-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Evoque D180 Mild-Hybrid',
 'transmission': 'automatic',
 'trim': '',
 'year': 2020}
2026-01-28 20:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XZ92879%27 HTTP/1.1" 200 None
2026-01-28 20:03:26 [auto1.it] INFO: Saving data for XZ92879: {'created_time': 1769630606.600009, 'last_price_update_time': 1769630606.600019, 'auction_closing_time': 1769704751.0}
2026-01-28 20:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XZ92879') HTTP/1.1" 204 0
2026-01-28 20:03:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252Fb0%252Fb7b02e96c39b384924bc3a112ccefa59%252Fpa%252FXA03649_28f5afba35415327ccf8417b533350eb.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/b0/b7b02e96c39b384924bc3a112ccefa59/pa/XA03649_28f5afba35415327ccf8417b533350eb.jpg not downloaded yet
2026-01-28 20:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252Fb0%252Fb7b02e96c39b384924bc3a112ccefa59%252Fpa%252FXA03649_9ffc276f10aba3175daa1d42b46b0747.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/b0/b7b02e96c39b384924bc3a112ccefa59/pa/XA03649_9ffc276f10aba3175daa1d42b46b0747.jpg not downloaded yet
2026-01-28 20:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252Fb0%252Fb7b02e96c39b384924bc3a112ccefa59%252Fpa%252FXA03649_ba59089503a83c2b7b3ccf3a6b272809.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/b0/b7b02e96c39b384924bc3a112ccefa59/pa/XA03649_ba59089503a83c2b7b3ccf3a6b272809.jpg not downloaded yet
2026-01-28 20:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252Fb0%252Fb7b02e96c39b384924bc3a112ccefa59%252Fpa%252FXA03649_488603456a39ac5949e78e063b17fa15.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/b0/b7b02e96c39b384924bc3a112ccefa59/pa/XA03649_488603456a39ac5949e78e063b17fa15.jpg not downloaded yet
2026-01-28 20:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252Fb0%252Fb7b02e96c39b384924bc3a112ccefa59%252Fpa%252FXA03649_c09244ecb4d5d91c1f5b1e57926f3d6b.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/b0/b7b02e96c39b384924bc3a112ccefa59/pa/XA03649_c09244ecb4d5d91c1f5b1e57926f3d6b.jpg not downloaded yet
2026-01-28 20:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252Fb0%252Fb7b02e96c39b384924bc3a112ccefa59%252Fpa%252FXA03649_1579007b7431221b8d962d78d2259cc3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/b0/b7b02e96c39b384924bc3a112ccefa59/pa/XA03649_1579007b7431221b8d962d78d2259cc3.jpg not downloaded yet
2026-01-28 20:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252Fb0%252Fb7b02e96c39b384924bc3a112ccefa59%252Fpa%252FXA03649_858a92446090fd6e6d41fd51857126dc.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/b0/b7b02e96c39b384924bc3a112ccefa59/pa/XA03649_858a92446090fd6e6d41fd51857126dc.jpg not downloaded yet
2026-01-28 20:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252Fb0%252Fb7b02e96c39b384924bc3a112ccefa59%252Fpa%252FXA03649_8236e8ec8c8e5d43cb83b119782d5517.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/b0/b7b02e96c39b384924bc3a112ccefa59/pa/XA03649_8236e8ec8c8e5d43cb83b119782d5517.jpg not downloaded yet
2026-01-28 20:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252Fb0%252Fb7b02e96c39b384924bc3a112ccefa59%252Fpa%252FXA03649_e3b1d647392644f3ad79b915154fc1d1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/b0/b7b02e96c39b384924bc3a112ccefa59/pa/XA03649_e3b1d647392644f3ad79b915154fc1d1.jpg not downloaded yet
2026-01-28 20:03:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/b0/b7b02e96c39b384924bc3a112ccefa59/pa/XA03649_1370c01c2f746c0a236fb44513fe5a74.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/b0/b7b02e96c39b384924bc3a112ccefa59/pa/XA03649_e2abe59c7c12cfff409aef46f360f0b7.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/b0/b7b02e96c39b384924bc3a112ccefa59/pa/XA03649_7dfcec7dfc8453cffca2a78346e28f61.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/b0/b7b02e96c39b384924bc3a112ccefa59/pa/XA03649_e3b1d647392644f3ad79b915154fc1d1.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/b0/b7b02e96c39b384924bc3a112ccefa59/pa/XA03649_4371229e52ee59563fb84f4a8e5c2e0d.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08cf4990>
2026-01-28 20:03:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_697b49cf-5fb3-549c-8273-0f9f018d36a6/697b49cf-5fb3-549c-8273-0f9f018d36a6_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252Fb0%252Fb7b02e96c39b384924bc3a112ccefa59%252Fpa%252FXA03649_1370c01c2f746c0a236fb44513fe5a74.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/b0/b7b02e96c39b384924bc3a112ccefa59/pa/XA03649_1370c01c2f746c0a236fb44513fe5a74.jpg saved to cache
2026-01-28 20:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 697b49cf-5fb3-549c-8273-0f9f018d36a6
2026-01-28 20:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/b0/b7b02e96c39b384924bc3a112ccefa59/pa/XA03649_858a92446090fd6e6d41fd51857126dc.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/b0/b7b02e96c39b384924bc3a112ccefa59/pa/XA03649_1579007b7431221b8d962d78d2259cc3.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0a0a5a10>
2026-01-28 20:03:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_697b49cf-5fb3-549c-8273-0f9f018d36a6/697b49cf-5fb3-549c-8273-0f9f018d36a6_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252Fb0%252Fb7b02e96c39b384924bc3a112ccefa59%252Fpa%252FXA03649_e2abe59c7c12cfff409aef46f360f0b7.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/b0/b7b02e96c39b384924bc3a112ccefa59/pa/XA03649_e2abe59c7c12cfff409aef46f360f0b7.jpg saved to cache
2026-01-28 20:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 697b49cf-5fb3-549c-8273-0f9f018d36a6
2026-01-28 20:03:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:03:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b086e0490>
2026-01-28 20:03:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_697b49cf-5fb3-549c-8273-0f9f018d36a6/697b49cf-5fb3-549c-8273-0f9f018d36a6_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252Fb0%252Fb7b02e96c39b384924bc3a112ccefa59%252Fpa%252FXA03649_7dfcec7dfc8453cffca2a78346e28f61.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/b0/b7b02e96c39b384924bc3a112ccefa59/pa/XA03649_7dfcec7dfc8453cffca2a78346e28f61.jpg saved to cache
2026-01-28 20:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 697b49cf-5fb3-549c-8273-0f9f018d36a6
2026-01-28 20:03:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09ddced0>
2026-01-28 20:03:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_697b49cf-5fb3-549c-8273-0f9f018d36a6/697b49cf-5fb3-549c-8273-0f9f018d36a6_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252Fb0%252Fb7b02e96c39b384924bc3a112ccefa59%252Fpa%252FXA03649_e3b1d647392644f3ad79b915154fc1d1.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/b0/b7b02e96c39b384924bc3a112ccefa59/pa/XA03649_e3b1d647392644f3ad79b915154fc1d1.jpg saved to cache
2026-01-28 20:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 697b49cf-5fb3-549c-8273-0f9f018d36a6
2026-01-28 20:03:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:03:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0be06250>
2026-01-28 20:03:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_697b49cf-5fb3-549c-8273-0f9f018d36a6/697b49cf-5fb3-549c-8273-0f9f018d36a6_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252Fb0%252Fb7b02e96c39b384924bc3a112ccefa59%252Fpa%252FXA03649_4371229e52ee59563fb84f4a8e5c2e0d.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/b0/b7b02e96c39b384924bc3a112ccefa59/pa/XA03649_4371229e52ee59563fb84f4a8e5c2e0d.jpg saved to cache
2026-01-28 20:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 697b49cf-5fb3-549c-8273-0f9f018d36a6
2026-01-28 20:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SR88948/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CU51863/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JD87332/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RH01953/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MG90392/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VV30676> (referer: https://www.auto1.com/v1/car-details-view/VV30676/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XS04727> (referer: https://www.auto1.com/v1/car-details-view/XS04727/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FS42168> (referer: https://www.auto1.com/v1/car-details-view/FS42168/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:03:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:03:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:03:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:03:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:03:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:03:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:03:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:03:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:03:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0a0dfbd0>
2026-01-28 20:03:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_697b49cf-5fb3-549c-8273-0f9f018d36a6/697b49cf-5fb3-549c-8273-0f9f018d36a6_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252Fb0%252Fb7b02e96c39b384924bc3a112ccefa59%252Fpa%252FXA03649_858a92446090fd6e6d41fd51857126dc.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/b0/b7b02e96c39b384924bc3a112ccefa59/pa/XA03649_858a92446090fd6e6d41fd51857126dc.jpg saved to cache
2026-01-28 20:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 697b49cf-5fb3-549c-8273-0f9f018d36a6
2026-01-28 20:03:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0bee7150>
2026-01-28 20:03:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:03:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_697b49cf-5fb3-549c-8273-0f9f018d36a6/697b49cf-5fb3-549c-8273-0f9f018d36a6_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252Fb0%252Fb7b02e96c39b384924bc3a112ccefa59%252Fpa%252FXA03649_1579007b7431221b8d962d78d2259cc3.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/b0/b7b02e96c39b384924bc3a112ccefa59/pa/XA03649_1579007b7431221b8d962d78d2259cc3.jpg saved to cache
2026-01-28 20:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 697b49cf-5fb3-549c-8273-0f9f018d36a6
2026-01-28 20:03:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9cc4ea46-5409-5b61-b6a5-9901462bc08a with identifier: VV30676
2026-01-28 20:03:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9cc4ea46-5409-5b61-b6a5-9901462bc08a with scrape type 2
2026-01-28 20:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9cc4ea46-5409-5b61-b6a5-9901462bc08a with scrape type 2
2026-01-28 20:03:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9cc4ea46-5409-5b61-b6a5-9901462bc08a, identifier: VV30676
2026-01-28 20:03:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 232936ab-6f9e-5438-a553-fb776e146587 with identifier: XS04727
2026-01-28 20:03:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 232936ab-6f9e-5438-a553-fb776e146587 with scrape type 2
2026-01-28 20:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 232936ab-6f9e-5438-a553-fb776e146587 with scrape type 2
2026-01-28 20:03:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 232936ab-6f9e-5438-a553-fb776e146587, identifier: XS04727
2026-01-28 20:03:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6fad9e88-16f6-5d88-a76b-d0004b53f11d with identifier: FS42168
2026-01-28 20:03:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6fad9e88-16f6-5d88-a76b-d0004b53f11d with scrape type 2
2026-01-28 20:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6fad9e88-16f6-5d88-a76b-d0004b53f11d with scrape type 2
2026-01-28 20:03:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6fad9e88-16f6-5d88-a76b-d0004b53f11d, identifier: FS42168
2026-01-28 20:03:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9cc4ea46-5409-5b61-b6a5-9901462bc08a with identifier: VV30676
2026-01-28 20:03:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9cc4ea46-5409-5b61-b6a5-9901462bc08a with identifier: VV30676
2026-01-28 20:03:30 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 178275 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    178275
2026-01-28 20:03:30 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 9cc4ea46-5409-5b61-b6a5-9901462bc08a spider: auto1.it
2026-01-28 20:03:30 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 9cc4ea46-5409-5b61-b6a5-9901462bc08a due to rule: high_mileage_for_country.json, error: 178275 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    178275
{'auction_title': '',
 'c_o_2_emission_value': 146,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-01-29T16:29:39Z',
 'fuel_type': 'diesel',
 'id': '9cc4ea46-5409-5b61-b6a5-9901462bc08a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VV30676',
 'listing': 'auction',
 'location': 'IT, Milazzo',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 178275,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-04-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q5 40 TDI quattro Sport',
 'transmission': 'automatic',
 'trim': 'quattro Sport',
 'year': 2019}
2026-01-28 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VV30676%27 HTTP/1.1" 200 None
2026-01-28 20:03:30 [auto1.it] INFO: Saving data for VV30676: {'auction_closing_time': 1769704179.0, 'created_time': 1768471448.480636, 'last_price_update_time': 1769630610.843343}
2026-01-28 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VV30676') HTTP/1.1" 204 0
2026-01-28 20:03:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 232936ab-6f9e-5438-a553-fb776e146587 with identifier: XS04727
2026-01-28 20:03:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 232936ab-6f9e-5438-a553-fb776e146587 with identifier: XS04727
2026-01-28 20:03:30 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'ford' containing 'ford' and model 'tourneo custom' containing 'tourneo'
2026-01-28 20:03:30 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 232936ab-6f9e-5438-a553-fb776e146587 spider: auto1.it
2026-01-28 20:03:31 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 232936ab-6f9e-5438-a553-fb776e146587 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'ford' containing 'ford' and model 'tourneo custom' containing 'tourneo'
{'auction_title': '',
 'c_o_2_emission_value': 232,
 'category': None,
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 170,
 'expiration_date': '2026-01-29T16:31:46Z',
 'fuel_type': 'diesel',
 'id': '232936ab-6f9e-5438-a553-fb776e146587',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XS04727',
 'listing': 'auction',
 'location': 'IT, Padova',
 'make': 'Ford',
 'model': 'Tourneo Custom',
 'odometer': 51158,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-04-17',
 'seats_number': 8,
 'seller_name': None,
 'title': 'Ford Tourneo Custom 2.0 TDCi L1 Titanium X',
 'transmission': 'automatic',
 'trim': 'L1 Titanium X',
 'year': 2023}
2026-01-28 20:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XS04727%27 HTTP/1.1" 200 None
2026-01-28 20:03:31 [auto1.it] INFO: Saving data for XS04727: {'auction_closing_time': 1769704306.0, 'created_time': 1768299464.31779, 'last_price_update_time': 1769630611.387739}
2026-01-28 20:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XS04727') HTTP/1.1" 204 0
2026-01-28 20:03:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6fad9e88-16f6-5d88-a76b-d0004b53f11d with identifier: FS42168
2026-01-28 20:03:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6fad9e88-16f6-5d88-a76b-d0004b53f11d with identifier: FS42168
2026-01-28 20:03:31 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'fiat' containing 'fiat' and model 'ducato' containing 'ducato'
2026-01-28 20:03:31 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 6fad9e88-16f6-5d88-a76b-d0004b53f11d spider: auto1.it
2026-01-28 20:03:31 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 6fad9e88-16f6-5d88-a76b-d0004b53f11d due to rule: makes_models_not_allowed.json, error: Rejected due to make 'fiat' containing 'fiat' and model 'ducato' containing 'ducato'
{'auction_title': '',
 'c_o_2_emission_value': 207,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '2.3L',
 'engine_horse_power': 160,
 'expiration_date': '2026-01-29T16:22:49Z',
 'fuel_type': 'diesel',
 'id': '6fad9e88-16f6-5d88-a76b-d0004b53f11d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FS42168',
 'listing': 'auction',
 'location': 'IT, Benevento',
 'make': 'Fiat',
 'model': 'Ducato',
 'odometer': 30218,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-11-18',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Fiat Ducato 2.3 Multijet L1H1 RS: 3000 mm',
 'transmission': 'manual',
 'trim': 'L1H1 RS: 3000 mm',
 'year': 2020}
2026-01-28 20:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FS42168%27 HTTP/1.1" 200 None
2026-01-28 20:03:31 [auto1.it] INFO: Saving data for FS42168: {'auction_closing_time': 1769703769.0, 'created_time': 1769458134.552399, 'last_price_update_time': 1769630611.639677}
2026-01-28 20:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FS42168') HTTP/1.1" 204 0
2026-01-28 20:03:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/b0/b7b02e96c39b384924bc3a112ccefa59/pa/XA03649_9ffc276f10aba3175daa1d42b46b0747.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/b0/b7b02e96c39b384924bc3a112ccefa59/pa/XA03649_c09244ecb4d5d91c1f5b1e57926f3d6b.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/b0/b7b02e96c39b384924bc3a112ccefa59/pa/XA03649_fa7cc1e0a4da47458db42338eab51fa9.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/b0/b7b02e96c39b384924bc3a112ccefa59/pa/XA03649_8236e8ec8c8e5d43cb83b119782d5517.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/b0/b7b02e96c39b384924bc3a112ccefa59/pa/XA03649_488603456a39ac5949e78e063b17fa15.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08c38c10>
2026-01-28 20:03:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:03:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_697b49cf-5fb3-549c-8273-0f9f018d36a6/697b49cf-5fb3-549c-8273-0f9f018d36a6_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252Fb0%252Fb7b02e96c39b384924bc3a112ccefa59%252Fpa%252FXA03649_9ffc276f10aba3175daa1d42b46b0747.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/b0/b7b02e96c39b384924bc3a112ccefa59/pa/XA03649_9ffc276f10aba3175daa1d42b46b0747.jpg saved to cache
2026-01-28 20:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 697b49cf-5fb3-549c-8273-0f9f018d36a6
2026-01-28 20:03:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09db9d50>
2026-01-28 20:03:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_697b49cf-5fb3-549c-8273-0f9f018d36a6/697b49cf-5fb3-549c-8273-0f9f018d36a6_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252Fb0%252Fb7b02e96c39b384924bc3a112ccefa59%252Fpa%252FXA03649_c09244ecb4d5d91c1f5b1e57926f3d6b.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/b0/b7b02e96c39b384924bc3a112ccefa59/pa/XA03649_c09244ecb4d5d91c1f5b1e57926f3d6b.jpg saved to cache
2026-01-28 20:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 697b49cf-5fb3-549c-8273-0f9f018d36a6
2026-01-28 20:03:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:03:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0a092d90>
2026-01-28 20:03:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_697b49cf-5fb3-549c-8273-0f9f018d36a6/697b49cf-5fb3-549c-8273-0f9f018d36a6_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252Fb0%252Fb7b02e96c39b384924bc3a112ccefa59%252Fpa%252FXA03649_fa7cc1e0a4da47458db42338eab51fa9.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/b0/b7b02e96c39b384924bc3a112ccefa59/pa/XA03649_fa7cc1e0a4da47458db42338eab51fa9.jpg saved to cache
2026-01-28 20:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 697b49cf-5fb3-549c-8273-0f9f018d36a6
2026-01-28 20:03:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:03:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0eaa4510>
2026-01-28 20:03:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_697b49cf-5fb3-549c-8273-0f9f018d36a6/697b49cf-5fb3-549c-8273-0f9f018d36a6_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252Fb0%252Fb7b02e96c39b384924bc3a112ccefa59%252Fpa%252FXA03649_8236e8ec8c8e5d43cb83b119782d5517.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/b0/b7b02e96c39b384924bc3a112ccefa59/pa/XA03649_8236e8ec8c8e5d43cb83b119782d5517.jpg saved to cache
2026-01-28 20:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 697b49cf-5fb3-549c-8273-0f9f018d36a6
2026-01-28 20:03:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:03:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09f0d610>
2026-01-28 20:03:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_697b49cf-5fb3-549c-8273-0f9f018d36a6/697b49cf-5fb3-549c-8273-0f9f018d36a6_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252Fb0%252Fb7b02e96c39b384924bc3a112ccefa59%252Fpa%252FXA03649_488603456a39ac5949e78e063b17fa15.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/b0/b7b02e96c39b384924bc3a112ccefa59/pa/XA03649_488603456a39ac5949e78e063b17fa15.jpg saved to cache
2026-01-28 20:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 697b49cf-5fb3-549c-8273-0f9f018d36a6
2026-01-28 20:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/b0/b7b02e96c39b384924bc3a112ccefa59/pa/XA03649_ba59089503a83c2b7b3ccf3a6b272809.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:03:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09d9fc50>
2026-01-28 20:03:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_697b49cf-5fb3-549c-8273-0f9f018d36a6/697b49cf-5fb3-549c-8273-0f9f018d36a6_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252Fb0%252Fb7b02e96c39b384924bc3a112ccefa59%252Fpa%252FXA03649_ba59089503a83c2b7b3ccf3a6b272809.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/b0/b7b02e96c39b384924bc3a112ccefa59/pa/XA03649_ba59089503a83c2b7b3ccf3a6b272809.jpg saved to cache
2026-01-28 20:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 697b49cf-5fb3-549c-8273-0f9f018d36a6
2026-01-28 20:03:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JY56965> (referer: https://www.auto1.com/v1/car-details-view/JY56965/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:03:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:03:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XP18402> (referer: https://www.auto1.com/v1/car-details-view/XP18402/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:03:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KK21064> (referer: https://www.auto1.com/v1/car-details-view/KK21064/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:03:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DA53677> (referer: https://www.auto1.com/v1/car-details-view/DA53677/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:03:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:03:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:03:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:03:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XX61742> (referer: https://www.auto1.com/v1/car-details-view/XX61742/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:03:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PM33616> (referer: https://www.auto1.com/v1/car-details-view/PM33616/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:03:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:03:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:03:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0218895-008c-5901-8d81-495dcbc7bbb2 with identifier: JY56965
2026-01-28 20:03:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0218895-008c-5901-8d81-495dcbc7bbb2 with scrape type 1
2026-01-28 20:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item c0218895-008c-5901-8d81-495dcbc7bbb2
2026-01-28 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Fa4%252F57a41f04407b77fc18110f7a3d1df06f%252Fpa%252FJY56965_00609c4172c1ab768c60d62f132c08b9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/a4/57a41f04407b77fc18110f7a3d1df06f/pa/JY56965_00609c4172c1ab768c60d62f132c08b9.jpg not downloaded yet
2026-01-28 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Fa4%252F57a41f04407b77fc18110f7a3d1df06f%252Fpa%252FJY56965_050f804855e288a819f8d590d8aff6d2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/a4/57a41f04407b77fc18110f7a3d1df06f/pa/JY56965_050f804855e288a819f8d590d8aff6d2.jpg not downloaded yet
2026-01-28 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Fa4%252F57a41f04407b77fc18110f7a3d1df06f%252Fpa%252FJY56965_c6c3698aab43303ed80423bc01f2a436.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/a4/57a41f04407b77fc18110f7a3d1df06f/pa/JY56965_c6c3698aab43303ed80423bc01f2a436.jpg not downloaded yet
2026-01-28 20:03:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa8f0b27-091b-5c48-a778-9f0012ab28b2 with identifier: XP18402
2026-01-28 20:03:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa8f0b27-091b-5c48-a778-9f0012ab28b2 with scrape type 1
2026-01-28 20:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item fa8f0b27-091b-5c48-a778-9f0012ab28b2
2026-01-28 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252Fe4%252F2de443a529edfde728e09f1928d64710%252Fpa%252FXP18402_2c15ce9b267c2bc6a3a0cd139e588cfe.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/e4/2de443a529edfde728e09f1928d64710/pa/XP18402_2c15ce9b267c2bc6a3a0cd139e588cfe.jpg not downloaded yet
2026-01-28 20:03:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 35e35a72-decf-5cdd-b63b-c0248a0d08a6 with identifier: KK21064
2026-01-28 20:03:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 35e35a72-decf-5cdd-b63b-c0248a0d08a6 with scrape type 2
2026-01-28 20:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 35e35a72-decf-5cdd-b63b-c0248a0d08a6 with scrape type 2
2026-01-28 20:03:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 35e35a72-decf-5cdd-b63b-c0248a0d08a6, identifier: KK21064
2026-01-28 20:03:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 894533ef-f191-5942-9c9e-b41dd4e310bd with identifier: DA53677
2026-01-28 20:03:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 894533ef-f191-5942-9c9e-b41dd4e310bd with scrape type 1
2026-01-28 20:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 894533ef-f191-5942-9c9e-b41dd4e310bd
2026-01-28 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F43%252Fbe439af2949fe96ad794d0bc2332d7dd%252Fpa%252FDA53677_970b1a90910aadb994c71ba9423b4f92.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/43/be439af2949fe96ad794d0bc2332d7dd/pa/DA53677_970b1a90910aadb994c71ba9423b4f92.jpg already downloaded
2026-01-28 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F43%252Fbe439af2949fe96ad794d0bc2332d7dd%252Fpa%252FDA53677_2a3116a0df8aa3efdc57a2367951ee80.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/43/be439af2949fe96ad794d0bc2332d7dd/pa/DA53677_2a3116a0df8aa3efdc57a2367951ee80.jpg already downloaded
2026-01-28 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F43%252Fbe439af2949fe96ad794d0bc2332d7dd%252Fpa%252FDA53677_dbe4de31732c33b4960a101d20fd0a9d.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/43/be439af2949fe96ad794d0bc2332d7dd/pa/DA53677_dbe4de31732c33b4960a101d20fd0a9d.jpg already downloaded
2026-01-28 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F43%252Fbe439af2949fe96ad794d0bc2332d7dd%252Fpa%252FDA53677_60662b2c66ce0e98a20e5e9344519fc7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/43/be439af2949fe96ad794d0bc2332d7dd/pa/DA53677_60662b2c66ce0e98a20e5e9344519fc7.jpg already downloaded
2026-01-28 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F43%252Fbe439af2949fe96ad794d0bc2332d7dd%252Fpa%252FDA53677_9e77424ea0b2f1301f18464dba33fd99.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/43/be439af2949fe96ad794d0bc2332d7dd/pa/DA53677_9e77424ea0b2f1301f18464dba33fd99.jpg already downloaded
2026-01-28 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F43%252Fbe439af2949fe96ad794d0bc2332d7dd%252Fpa%252FDA53677_a31c310fca72544600c7397810b9ffdb.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/43/be439af2949fe96ad794d0bc2332d7dd/pa/DA53677_a31c310fca72544600c7397810b9ffdb.jpg already downloaded
2026-01-28 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F43%252Fbe439af2949fe96ad794d0bc2332d7dd%252Fpa%252FDA53677_7be38eed2ecb98617ec7ac71222118ed.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/43/be439af2949fe96ad794d0bc2332d7dd/pa/DA53677_7be38eed2ecb98617ec7ac71222118ed.jpg already downloaded
2026-01-28 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F43%252Fbe439af2949fe96ad794d0bc2332d7dd%252Fpa%252FDA53677_3f28dbb5ec4232cb04634b540fe44f3e.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/43/be439af2949fe96ad794d0bc2332d7dd/pa/DA53677_3f28dbb5ec4232cb04634b540fe44f3e.jpg already downloaded
2026-01-28 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F43%252Fbe439af2949fe96ad794d0bc2332d7dd%252Fpa%252FDA53677_94ca2ac84dbc07711f06dd9938f2bfe1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/43/be439af2949fe96ad794d0bc2332d7dd/pa/DA53677_94ca2ac84dbc07711f06dd9938f2bfe1.jpg already downloaded
2026-01-28 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F43%252Fbe439af2949fe96ad794d0bc2332d7dd%252Fpa%252FDA53677_ad4b9b6a950ec3a5498bf5e902b51003.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/43/be439af2949fe96ad794d0bc2332d7dd/pa/DA53677_ad4b9b6a950ec3a5498bf5e902b51003.jpg already downloaded
2026-01-28 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F43%252Fbe439af2949fe96ad794d0bc2332d7dd%252Fpa%252FDA53677_70d1e278c2df5420eaf77380713d3135.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/43/be439af2949fe96ad794d0bc2332d7dd/pa/DA53677_70d1e278c2df5420eaf77380713d3135.jpg already downloaded
2026-01-28 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F43%252Fbe439af2949fe96ad794d0bc2332d7dd%252Fpa%252FDA53677_94d8f7159eb2f7287ab6937d4d61d716.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/43/be439af2949fe96ad794d0bc2332d7dd/pa/DA53677_94d8f7159eb2f7287ab6937d4d61d716.jpg already downloaded
2026-01-28 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F43%252Fbe439af2949fe96ad794d0bc2332d7dd%252Fpa%252FDA53677_d53a43de01271108e8fd509d6f9db727.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/43/be439af2949fe96ad794d0bc2332d7dd/pa/DA53677_d53a43de01271108e8fd509d6f9db727.jpg already downloaded
2026-01-28 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F43%252Fbe439af2949fe96ad794d0bc2332d7dd%252Fpa%252FDA53677_4cd334c862c6fd8b13908e6516dfedf4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/43/be439af2949fe96ad794d0bc2332d7dd/pa/DA53677_4cd334c862c6fd8b13908e6516dfedf4.jpg already downloaded
2026-01-28 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F43%252Fbe439af2949fe96ad794d0bc2332d7dd%252Fpa%252FDA53677_729a28088a74facad36c96588eae0ab9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/43/be439af2949fe96ad794d0bc2332d7dd/pa/DA53677_729a28088a74facad36c96588eae0ab9.jpg already downloaded
2026-01-28 20:03:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 894533ef-f191-5942-9c9e-b41dd4e310bd, identifier: DA53677
2026-01-28 20:03:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4d9f98b-ae16-55ce-83a2-f5c7c8a02d91 with identifier: XX61742
2026-01-28 20:03:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4d9f98b-ae16-55ce-83a2-f5c7c8a02d91 with scrape type 1
2026-01-28 20:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item a4d9f98b-ae16-55ce-83a2-f5c7c8a02d91
2026-01-28 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F9b%252F5e9bd9af10ddf07ad6df01859299cca1%252Fpa%252FXX61742_c8fb31742eedcd4f07abea42a8352e4d.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/9b/5e9bd9af10ddf07ad6df01859299cca1/pa/XX61742_c8fb31742eedcd4f07abea42a8352e4d.jpg not downloaded yet
2026-01-28 20:03:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4d78f6b-0f04-5fb0-9f01-0252067d94a7 with identifier: PM33616
2026-01-28 20:03:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4d78f6b-0f04-5fb0-9f01-0252067d94a7 with scrape type 2
2026-01-28 20:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a4d78f6b-0f04-5fb0-9f01-0252067d94a7 with scrape type 2
2026-01-28 20:03:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a4d78f6b-0f04-5fb0-9f01-0252067d94a7, identifier: PM33616
2026-01-28 20:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Fa4%252F57a41f04407b77fc18110f7a3d1df06f%252Fpa%252FJY56965_372381d539c1b0995dd4388a6739c767.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/a4/57a41f04407b77fc18110f7a3d1df06f/pa/JY56965_372381d539c1b0995dd4388a6739c767.jpg not downloaded yet
2026-01-28 20:03:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 35e35a72-decf-5cdd-b63b-c0248a0d08a6 with identifier: KK21064
2026-01-28 20:03:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 35e35a72-decf-5cdd-b63b-c0248a0d08a6 with identifier: KK21064
2026-01-28 20:03:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 35e35a72-decf-5cdd-b63b-c0248a0d08a6 with identifier: KK21064 to the API
2026-01-28 20:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:03:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:03:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KK21064>
{'auction_title': '',
 'c_o_2_emission_value': 153,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.9L',
 'engine_horse_power': 190,
 'expiration_date': '2026-01-29T16:26:30Z',
 'fuel_type': 'diesel',
 'id': '35e35a72-decf-5cdd-b63b-c0248a0d08a6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KK21064',
 'listing': 'auction',
 'location': 'IT, Varedo (MB)',
 'make': 'Mercedes-Benz',
 'model': 'GLB-Klasse',
 'odometer': 85226,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-05-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLB-Klasse GLB 220 d 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2022}
2026-01-28 20:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KK21064%27 HTTP/1.1" 200 None
2026-01-28 20:03:35 [auto1.it] INFO: Saving data for KK21064: {'auction_closing_time': 1769703990.0, 'created_time': 1768817043.289325, 'last_price_update_time': 1769630615.935723}
2026-01-28 20:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KK21064') HTTP/1.1" 204 0
2026-01-28 20:03:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 894533ef-f191-5942-9c9e-b41dd4e310bd with identifier: DA53677
2026-01-28 20:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-28 20:03:36 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=red HTTP/1.1" 200 None
2026-01-28 20:03:36 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-28 20:03:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 894533ef-f191-5942-9c9e-b41dd4e310bd with identifier: DA53677
2026-01-28 20:03:36 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 161552 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    161552
2026-01-28 20:03:36 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 894533ef-f191-5942-9c9e-b41dd4e310bd spider: auto1.it
2026-01-28 20:03:36 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 894533ef-f191-5942-9c9e-b41dd4e310bd due to rule: high_mileage_for_country.json, error: 161552 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    161552
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2026-01-29T16:35:33Z',
 'fuel_type': 'diesel',
 'id': '894533ef-f191-5942-9c9e-b41dd4e310bd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DA53677',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'Jeep',
 'model': 'Renegade',
 'odometer': 161552,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgbe/43/be439af2949fe96ad794d0bc2332d7dd/pa/DA53677_970b1a90910aadb994c71ba9423b4f92.jpg',
                'https://img-pa.auto1.com/imgbe/43/be439af2949fe96ad794d0bc2332d7dd/pa/DA53677_2a3116a0df8aa3efdc57a2367951ee80.jpg',
                'https://img-pa.auto1.com/imgbe/43/be439af2949fe96ad794d0bc2332d7dd/pa/DA53677_dbe4de31732c33b4960a101d20fd0a9d.jpg',
                'https://img-pa.auto1.com/imgbe/43/be439af2949fe96ad794d0bc2332d7dd/pa/DA53677_60662b2c66ce0e98a20e5e9344519fc7.jpg',
                'https://img-pa.auto1.com/imgbe/43/be439af2949fe96ad794d0bc2332d7dd/pa/DA53677_9e77424ea0b2f1301f18464dba33fd99.jpg',
                'https://img-pa.auto1.com/imgbe/43/be439af2949fe96ad794d0bc2332d7dd/pa/DA53677_a31c310fca72544600c7397810b9ffdb.jpg',
                'https://img-pa.auto1.com/imgbe/43/be439af2949fe96ad794d0bc2332d7dd/pa/DA53677_7be38eed2ecb98617ec7ac71222118ed.jpg',
                'https://img-pa.auto1.com/imgbe/43/be439af2949fe96ad794d0bc2332d7dd/pa/DA53677_3f28dbb5ec4232cb04634b540fe44f3e.jpg',
                'https://img-pa.auto1.com/imgbe/43/be439af2949fe96ad794d0bc2332d7dd/pa/DA53677_94ca2ac84dbc07711f06dd9938f2bfe1.jpg',
                'https://img-pa.auto1.com/imgbe/43/be439af2949fe96ad794d0bc2332d7dd/pa/DA53677_ad4b9b6a950ec3a5498bf5e902b51003.jpg',
                'https://img-pa.auto1.com/imgbe/43/be439af2949fe96ad794d0bc2332d7dd/pa/DA53677_70d1e278c2df5420eaf77380713d3135.jpg',
                'https://img-pa.auto1.com/imgbe/43/be439af2949fe96ad794d0bc2332d7dd/pa/DA53677_94d8f7159eb2f7287ab6937d4d61d716.jpg',
                'https://img-pa.auto1.com/imgbe/43/be439af2949fe96ad794d0bc2332d7dd/pa/DA53677_d53a43de01271108e8fd509d6f9db727.jpg',
                'https://img-pa.auto1.com/imgbe/43/be439af2949fe96ad794d0bc2332d7dd/pa/DA53677_4cd334c862c6fd8b13908e6516dfedf4.jpg',
                'https://img-pa.auto1.com/imgbe/43/be439af2949fe96ad794d0bc2332d7dd/pa/DA53677_729a28088a74facad36c96588eae0ab9.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_894533ef-f191-5942-9c9e-b41dd4e310bd/894533ef-f191-5942-9c9e-b41dd4e310bd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3148634,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/43/be439af2949fe96ad794d0bc2332d7dd/pa/DA53677_970b1a90910aadb994c71ba9423b4f92.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_894533ef-f191-5942-9c9e-b41dd4e310bd/894533ef-f191-5942-9c9e-b41dd4e310bd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3229190,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/43/be439af2949fe96ad794d0bc2332d7dd/pa/DA53677_2a3116a0df8aa3efdc57a2367951ee80.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_894533ef-f191-5942-9c9e-b41dd4e310bd/894533ef-f191-5942-9c9e-b41dd4e310bd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3017127,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/43/be439af2949fe96ad794d0bc2332d7dd/pa/DA53677_dbe4de31732c33b4960a101d20fd0a9d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_894533ef-f191-5942-9c9e-b41dd4e310bd/894533ef-f191-5942-9c9e-b41dd4e310bd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55793,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/43/be439af2949fe96ad794d0bc2332d7dd/pa/DA53677_60662b2c66ce0e98a20e5e9344519fc7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_894533ef-f191-5942-9c9e-b41dd4e310bd/894533ef-f191-5942-9c9e-b41dd4e310bd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64786,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/43/be439af2949fe96ad794d0bc2332d7dd/pa/DA53677_9e77424ea0b2f1301f18464dba33fd99.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_894533ef-f191-5942-9c9e-b41dd4e310bd/894533ef-f191-5942-9c9e-b41dd4e310bd_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74834,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/43/be439af2949fe96ad794d0bc2332d7dd/pa/DA53677_a31c310fca72544600c7397810b9ffdb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_894533ef-f191-5942-9c9e-b41dd4e310bd/894533ef-f191-5942-9c9e-b41dd4e310bd_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71891,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/43/be439af2949fe96ad794d0bc2332d7dd/pa/DA53677_7be38eed2ecb98617ec7ac71222118ed.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_894533ef-f191-5942-9c9e-b41dd4e310bd/894533ef-f191-5942-9c9e-b41dd4e310bd_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75735,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/43/be439af2949fe96ad794d0bc2332d7dd/pa/DA53677_3f28dbb5ec4232cb04634b540fe44f3e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_894533ef-f191-5942-9c9e-b41dd4e310bd/894533ef-f191-5942-9c9e-b41dd4e310bd_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3131015,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/43/be439af2949fe96ad794d0bc2332d7dd/pa/DA53677_94ca2ac84dbc07711f06dd9938f2bfe1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_894533ef-f191-5942-9c9e-b41dd4e310bd/894533ef-f191-5942-9c9e-b41dd4e310bd_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2764695,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/43/be439af2949fe96ad794d0bc2332d7dd/pa/DA53677_ad4b9b6a950ec3a5498bf5e902b51003.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_894533ef-f191-5942-9c9e-b41dd4e310bd/894533ef-f191-5942-9c9e-b41dd4e310bd_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65830,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/43/be439af2949fe96ad794d0bc2332d7dd/pa/DA53677_70d1e278c2df5420eaf77380713d3135.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_894533ef-f191-5942-9c9e-b41dd4e310bd/894533ef-f191-5942-9c9e-b41dd4e310bd_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2893589,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/43/be439af2949fe96ad794d0bc2332d7dd/pa/DA53677_94d8f7159eb2f7287ab6937d4d61d716.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_894533ef-f191-5942-9c9e-b41dd4e310bd/894533ef-f191-5942-9c9e-b41dd4e310bd_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63107,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/43/be439af2949fe96ad794d0bc2332d7dd/pa/DA53677_d53a43de01271108e8fd509d6f9db727.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_894533ef-f191-5942-9c9e-b41dd4e310bd/894533ef-f191-5942-9c9e-b41dd4e310bd_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2744941,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/43/be439af2949fe96ad794d0bc2332d7dd/pa/DA53677_4cd334c862c6fd8b13908e6516dfedf4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_894533ef-f191-5942-9c9e-b41dd4e310bd/894533ef-f191-5942-9c9e-b41dd4e310bd_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78250,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/43/be439af2949fe96ad794d0bc2332d7dd/pa/DA53677_729a28088a74facad36c96588eae0ab9.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-09-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jeep Renegade 1.6 M-Jet Limited FWD',
 'transmission': 'manual',
 'trim': 'Limited FWD',
 'year': 2018}
2026-01-28 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DA53677%27 HTTP/1.1" 200 None
2026-01-28 20:03:36 [auto1.it] INFO: Saving data for DA53677: {'created_time': 1769630616.357407, 'last_price_update_time': 1769630616.357418, 'auction_closing_time': 1769704533.0}
2026-01-28 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DA53677') HTTP/1.1" 204 0
2026-01-28 20:03:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a4d78f6b-0f04-5fb0-9f01-0252067d94a7 with identifier: PM33616
2026-01-28 20:03:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a4d78f6b-0f04-5fb0-9f01-0252067d94a7 with identifier: PM33616
2026-01-28 20:03:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a4d78f6b-0f04-5fb0-9f01-0252067d94a7 with identifier: PM33616 to the API
2026-01-28 20:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:03:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:03:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PM33616>
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.6L',
 'engine_horse_power': 230,
 'expiration_date': '2026-01-29T16:28:25Z',
 'fuel_type': 'hybrid',
 'id': 'a4d78f6b-0f04-5fb0-9f01-0252067d94a7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PM33616',
 'listing': 'auction',
 'location': 'IT, Manoppello (PE)',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 40987,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-07-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 T-GDI Hybrid N Line 2WD',
 'transmission': 'automatic',
 'trim': 'N Line 2WD',
 'year': 2022}
2026-01-28 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PM33616%27 HTTP/1.1" 200 None
2026-01-28 20:03:36 [auto1.it] INFO: Saving data for PM33616: {'auction_closing_time': 1769704105.0, 'created_time': 1768817027.58487, 'last_price_update_time': 1769630616.700501}
2026-01-28 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PM33616') HTTP/1.1" 204 0
2026-01-28 20:03:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/b0/b7b02e96c39b384924bc3a112ccefa59/pa/XA03649_ed3fd0e90813ea245401dbe0846ba69e.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252Fe4%252F2de443a529edfde728e09f1928d64710%252Fpa%252FXP18402_b0d94e9cb8c384726631623c75fa6875.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/e4/2de443a529edfde728e09f1928d64710/pa/XP18402_b0d94e9cb8c384726631623c75fa6875.jpg not downloaded yet
2026-01-28 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F9b%252F5e9bd9af10ddf07ad6df01859299cca1%252Fpa%252FXX61742_56688d712bba6189f0d8a47aa52c9647.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/9b/5e9bd9af10ddf07ad6df01859299cca1/pa/XX61742_56688d712bba6189f0d8a47aa52c9647.jpg not downloaded yet
2026-01-28 20:03:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HT79408> (referer: https://www.auto1.com/v1/car-details-view/HT79408/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:03:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PD47677> (referer: https://www.auto1.com/v1/car-details-view/PD47677/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Fa4%252F57a41f04407b77fc18110f7a3d1df06f%252Fpa%252FJY56965_0a2f6bfad43d30a6544565cfc62defce.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/a4/57a41f04407b77fc18110f7a3d1df06f/pa/JY56965_0a2f6bfad43d30a6544565cfc62defce.jpg not downloaded yet
2026-01-28 20:03:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:03:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252Fe4%252F2de443a529edfde728e09f1928d64710%252Fpa%252FXP18402_e19bb9bfbb83f202924dacecbe71c713.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/e4/2de443a529edfde728e09f1928d64710/pa/XP18402_e19bb9bfbb83f202924dacecbe71c713.jpg not downloaded yet
2026-01-28 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F9b%252F5e9bd9af10ddf07ad6df01859299cca1%252Fpa%252FXX61742_fd47c3215c74c23acf2668aaa237e71b.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/9b/5e9bd9af10ddf07ad6df01859299cca1/pa/XX61742_fd47c3215c74c23acf2668aaa237e71b.jpg not downloaded yet
2026-01-28 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Fa4%252F57a41f04407b77fc18110f7a3d1df06f%252Fpa%252FJY56965_fcd23ad8bd38b970a416bc15f34734a1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/a4/57a41f04407b77fc18110f7a3d1df06f/pa/JY56965_fcd23ad8bd38b970a416bc15f34734a1.jpg not downloaded yet
2026-01-28 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252Fe4%252F2de443a529edfde728e09f1928d64710%252Fpa%252FXP18402_236365bb07935c4c80f6556a2350cb78.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/e4/2de443a529edfde728e09f1928d64710/pa/XP18402_236365bb07935c4c80f6556a2350cb78.jpg not downloaded yet
2026-01-28 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F9b%252F5e9bd9af10ddf07ad6df01859299cca1%252Fpa%252FXX61742_401647714336b4339515822649e9dc5c.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/9b/5e9bd9af10ddf07ad6df01859299cca1/pa/XX61742_401647714336b4339515822649e9dc5c.jpg not downloaded yet
2026-01-28 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Fa4%252F57a41f04407b77fc18110f7a3d1df06f%252Fpa%252FJY56965_cdb40600efed209cfb0d131938229766.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/a4/57a41f04407b77fc18110f7a3d1df06f/pa/JY56965_cdb40600efed209cfb0d131938229766.jpg not downloaded yet
2026-01-28 20:03:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/9b/5e9bd9af10ddf07ad6df01859299cca1/pa/XX61742_c8fb31742eedcd4f07abea42a8352e4d.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/e4/2de443a529edfde728e09f1928d64710/pa/XP18402_2c15ce9b267c2bc6a3a0cd139e588cfe.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252Fe4%252F2de443a529edfde728e09f1928d64710%252Fpa%252FXP18402_b4d89e4f58a20340e30c4835646acfaf.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/e4/2de443a529edfde728e09f1928d64710/pa/XP18402_b4d89e4f58a20340e30c4835646acfaf.jpg not downloaded yet
2026-01-28 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F9b%252F5e9bd9af10ddf07ad6df01859299cca1%252Fpa%252FXX61742_5ef9c9da55148f34bc0b39f65427b656.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/9b/5e9bd9af10ddf07ad6df01859299cca1/pa/XX61742_5ef9c9da55148f34bc0b39f65427b656.jpg not downloaded yet
2026-01-28 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Fa4%252F57a41f04407b77fc18110f7a3d1df06f%252Fpa%252FJY56965_438a4cf6d12dd904749875de19ac2d7a.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/a4/57a41f04407b77fc18110f7a3d1df06f/pa/JY56965_438a4cf6d12dd904749875de19ac2d7a.jpg not downloaded yet
2026-01-28 20:03:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08c46590>
2026-01-28 20:03:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:03:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_697b49cf-5fb3-549c-8273-0f9f018d36a6/697b49cf-5fb3-549c-8273-0f9f018d36a6_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252Fb0%252Fb7b02e96c39b384924bc3a112ccefa59%252Fpa%252FXA03649_ed3fd0e90813ea245401dbe0846ba69e.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/b0/b7b02e96c39b384924bc3a112ccefa59/pa/XA03649_ed3fd0e90813ea245401dbe0846ba69e.jpg saved to cache
2026-01-28 20:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 697b49cf-5fb3-549c-8273-0f9f018d36a6
2026-01-28 20:03:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 671898e1-449c-5ada-876d-5f1fc58104ac with identifier: HT79408
2026-01-28 20:03:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 671898e1-449c-5ada-876d-5f1fc58104ac with scrape type 1
2026-01-28 20:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 671898e1-449c-5ada-876d-5f1fc58104ac
2026-01-28 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252Fab%252Fb5ab56d0a20cdc021525f878ec10d5bc%252Fpa%252FHT79408_28d97836390fe218fa374b77a362afe9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/ab/b5ab56d0a20cdc021525f878ec10d5bc/pa/HT79408_28d97836390fe218fa374b77a362afe9.jpg already downloaded
2026-01-28 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252Fab%252Fb5ab56d0a20cdc021525f878ec10d5bc%252Fpa%252FHT79408_fb5a8321c769cf059bf2ec23fd73544f.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/ab/b5ab56d0a20cdc021525f878ec10d5bc/pa/HT79408_fb5a8321c769cf059bf2ec23fd73544f.jpg already downloaded
2026-01-28 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252Fab%252Fb5ab56d0a20cdc021525f878ec10d5bc%252Fpa%252FHT79408_9a736921399ac735dfb1cb41992195f1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/ab/b5ab56d0a20cdc021525f878ec10d5bc/pa/HT79408_9a736921399ac735dfb1cb41992195f1.jpg already downloaded
2026-01-28 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252Fab%252Fb5ab56d0a20cdc021525f878ec10d5bc%252Fpa%252FHT79408_24351e85ce1bc76ec797c05bfc68312e.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/ab/b5ab56d0a20cdc021525f878ec10d5bc/pa/HT79408_24351e85ce1bc76ec797c05bfc68312e.jpg already downloaded
2026-01-28 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252Fab%252Fb5ab56d0a20cdc021525f878ec10d5bc%252Fpa%252FHT79408_1c3c6384894cff7b423aaa1b2df59a2a.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/ab/b5ab56d0a20cdc021525f878ec10d5bc/pa/HT79408_1c3c6384894cff7b423aaa1b2df59a2a.jpg already downloaded
2026-01-28 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252Fab%252Fb5ab56d0a20cdc021525f878ec10d5bc%252Fpa%252FHT79408_4d78aa8c7bc83775efc03e924a894d4e.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/ab/b5ab56d0a20cdc021525f878ec10d5bc/pa/HT79408_4d78aa8c7bc83775efc03e924a894d4e.jpg already downloaded
2026-01-28 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252Fab%252Fb5ab56d0a20cdc021525f878ec10d5bc%252Fpa%252FHT79408_259fa425067e60969c49daae044f920b.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/ab/b5ab56d0a20cdc021525f878ec10d5bc/pa/HT79408_259fa425067e60969c49daae044f920b.jpg already downloaded
2026-01-28 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252Fab%252Fb5ab56d0a20cdc021525f878ec10d5bc%252Fpa%252FHT79408_ebe76c2891c63af76b286440060604e5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/ab/b5ab56d0a20cdc021525f878ec10d5bc/pa/HT79408_ebe76c2891c63af76b286440060604e5.jpg already downloaded
2026-01-28 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252Fab%252Fb5ab56d0a20cdc021525f878ec10d5bc%252Fpa%252FHT79408_1b36aff254cd706bf42757864a8fd286.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/ab/b5ab56d0a20cdc021525f878ec10d5bc/pa/HT79408_1b36aff254cd706bf42757864a8fd286.jpg already downloaded
2026-01-28 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252Fab%252Fb5ab56d0a20cdc021525f878ec10d5bc%252Fpa%252FHT79408_393a2bb407c5d17cbcfb9c6ce0e16dd5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/ab/b5ab56d0a20cdc021525f878ec10d5bc/pa/HT79408_393a2bb407c5d17cbcfb9c6ce0e16dd5.jpg already downloaded
2026-01-28 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252Fab%252Fb5ab56d0a20cdc021525f878ec10d5bc%252Fpa%252FHT79408_d2158d4ef03edc9a2efa8115195f7cec.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/ab/b5ab56d0a20cdc021525f878ec10d5bc/pa/HT79408_d2158d4ef03edc9a2efa8115195f7cec.jpg already downloaded
2026-01-28 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252Fab%252Fb5ab56d0a20cdc021525f878ec10d5bc%252Fpa%252FHT79408_242e49905c584ebb41739a4b8b8df770.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/ab/b5ab56d0a20cdc021525f878ec10d5bc/pa/HT79408_242e49905c584ebb41739a4b8b8df770.jpg already downloaded
2026-01-28 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252Fab%252Fb5ab56d0a20cdc021525f878ec10d5bc%252Fpa%252FHT79408_4642d04dc8505c5048e6503a3d67ae2f.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/ab/b5ab56d0a20cdc021525f878ec10d5bc/pa/HT79408_4642d04dc8505c5048e6503a3d67ae2f.jpg already downloaded
2026-01-28 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252Fab%252Fb5ab56d0a20cdc021525f878ec10d5bc%252Fpa%252FHT79408_d35828c2e031bb983866b0d650221832.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/ab/b5ab56d0a20cdc021525f878ec10d5bc/pa/HT79408_d35828c2e031bb983866b0d650221832.jpg already downloaded
2026-01-28 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252Fab%252Fb5ab56d0a20cdc021525f878ec10d5bc%252Fpa%252FHT79408_a43a19b48c43297e28f659d37e881e0d.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/ab/b5ab56d0a20cdc021525f878ec10d5bc/pa/HT79408_a43a19b48c43297e28f659d37e881e0d.jpg already downloaded
2026-01-28 20:03:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 671898e1-449c-5ada-876d-5f1fc58104ac, identifier: HT79408
2026-01-28 20:03:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f08ed03f-29e9-5e66-8f2f-0a9f1f55e79a with identifier: PD47677
2026-01-28 20:03:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f08ed03f-29e9-5e66-8f2f-0a9f1f55e79a with scrape type 2
2026-01-28 20:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f08ed03f-29e9-5e66-8f2f-0a9f1f55e79a with scrape type 2
2026-01-28 20:03:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f08ed03f-29e9-5e66-8f2f-0a9f1f55e79a, identifier: PD47677
2026-01-28 20:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/a4/57a41f04407b77fc18110f7a3d1df06f/pa/JY56965_372381d539c1b0995dd4388a6739c767.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252Fe4%252F2de443a529edfde728e09f1928d64710%252Fpa%252FXP18402_d39670086632f2690b93db51ba841997.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/e4/2de443a529edfde728e09f1928d64710/pa/XP18402_d39670086632f2690b93db51ba841997.jpg not downloaded yet
2026-01-28 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F9b%252F5e9bd9af10ddf07ad6df01859299cca1%252Fpa%252FXX61742_bd0c58dd4b24d7b399e4822ae2e0e5c0.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/9b/5e9bd9af10ddf07ad6df01859299cca1/pa/XX61742_bd0c58dd4b24d7b399e4822ae2e0e5c0.jpg not downloaded yet
2026-01-28 20:03:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 671898e1-449c-5ada-876d-5f1fc58104ac with identifier: HT79408
2026-01-28 20:03:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 671898e1-449c-5ada-876d-5f1fc58104ac with identifier: HT79408
2026-01-28 20:03:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 671898e1-449c-5ada-876d-5f1fc58104ac with identifier: HT79408 to the API
2026-01-28 20:03:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:03:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:03:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HT79408>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.0L',
 'engine_horse_power': 67,
 'expiration_date': '2026-01-29T16:27:38Z',
 'fuel_type': 'petrol',
 'id': '671898e1-449c-5ada-876d-5f1fc58104ac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HT79408',
 'listing': 'auction',
 'location': 'IT, Capannori (LU)',
 'make': 'Hyundai',
 'model': 'i10',
 'odometer': 22653,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgb5/ab/b5ab56d0a20cdc021525f878ec10d5bc/pa/HT79408_28d97836390fe218fa374b77a362afe9.jpg',
                'https://img-pa.auto1.com/imgb5/ab/b5ab56d0a20cdc021525f878ec10d5bc/pa/HT79408_fb5a8321c769cf059bf2ec23fd73544f.jpg',
                'https://img-pa.auto1.com/imgb5/ab/b5ab56d0a20cdc021525f878ec10d5bc/pa/HT79408_9a736921399ac735dfb1cb41992195f1.jpg',
                'https://img-pa.auto1.com/imgb5/ab/b5ab56d0a20cdc021525f878ec10d5bc/pa/HT79408_24351e85ce1bc76ec797c05bfc68312e.jpg',
                'https://img-pa.auto1.com/imgb5/ab/b5ab56d0a20cdc021525f878ec10d5bc/pa/HT79408_1c3c6384894cff7b423aaa1b2df59a2a.jpg',
                'https://img-pa.auto1.com/imgb5/ab/b5ab56d0a20cdc021525f878ec10d5bc/pa/HT79408_4d78aa8c7bc83775efc03e924a894d4e.jpg',
                'https://img-pa.auto1.com/imgb5/ab/b5ab56d0a20cdc021525f878ec10d5bc/pa/HT79408_259fa425067e60969c49daae044f920b.jpg',
                'https://img-pa.auto1.com/imgb5/ab/b5ab56d0a20cdc021525f878ec10d5bc/pa/HT79408_ebe76c2891c63af76b286440060604e5.jpg',
                'https://img-pa.auto1.com/imgb5/ab/b5ab56d0a20cdc021525f878ec10d5bc/pa/HT79408_1b36aff254cd706bf42757864a8fd286.jpg',
                'https://img-pa.auto1.com/imgb5/ab/b5ab56d0a20cdc021525f878ec10d5bc/pa/HT79408_393a2bb407c5d17cbcfb9c6ce0e16dd5.jpg',
                'https://img-pa.auto1.com/imgb5/ab/b5ab56d0a20cdc021525f878ec10d5bc/pa/HT79408_d2158d4ef03edc9a2efa8115195f7cec.jpg',
                'https://img-pa.auto1.com/imgb5/ab/b5ab56d0a20cdc021525f878ec10d5bc/pa/HT79408_242e49905c584ebb41739a4b8b8df770.jpg',
                'https://img-pa.auto1.com/imgb5/ab/b5ab56d0a20cdc021525f878ec10d5bc/pa/HT79408_4642d04dc8505c5048e6503a3d67ae2f.jpg',
                'https://img-pa.auto1.com/imgb5/ab/b5ab56d0a20cdc021525f878ec10d5bc/pa/HT79408_d35828c2e031bb983866b0d650221832.jpg',
                'https://img-pa.auto1.com/imgb5/ab/b5ab56d0a20cdc021525f878ec10d5bc/pa/HT79408_a43a19b48c43297e28f659d37e881e0d.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_671898e1-449c-5ada-876d-5f1fc58104ac/671898e1-449c-5ada-876d-5f1fc58104ac_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81541,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/ab/b5ab56d0a20cdc021525f878ec10d5bc/pa/HT79408_28d97836390fe218fa374b77a362afe9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_671898e1-449c-5ada-876d-5f1fc58104ac/671898e1-449c-5ada-876d-5f1fc58104ac_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3238633,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/ab/b5ab56d0a20cdc021525f878ec10d5bc/pa/HT79408_fb5a8321c769cf059bf2ec23fd73544f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_671898e1-449c-5ada-876d-5f1fc58104ac/671898e1-449c-5ada-876d-5f1fc58104ac_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3052343,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/ab/b5ab56d0a20cdc021525f878ec10d5bc/pa/HT79408_9a736921399ac735dfb1cb41992195f1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_671898e1-449c-5ada-876d-5f1fc58104ac/671898e1-449c-5ada-876d-5f1fc58104ac_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2634201,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/ab/b5ab56d0a20cdc021525f878ec10d5bc/pa/HT79408_24351e85ce1bc76ec797c05bfc68312e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_671898e1-449c-5ada-876d-5f1fc58104ac/671898e1-449c-5ada-876d-5f1fc58104ac_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70946,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/ab/b5ab56d0a20cdc021525f878ec10d5bc/pa/HT79408_1c3c6384894cff7b423aaa1b2df59a2a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_671898e1-449c-5ada-876d-5f1fc58104ac/671898e1-449c-5ada-876d-5f1fc58104ac_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88012,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/ab/b5ab56d0a20cdc021525f878ec10d5bc/pa/HT79408_4d78aa8c7bc83775efc03e924a894d4e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_671898e1-449c-5ada-876d-5f1fc58104ac/671898e1-449c-5ada-876d-5f1fc58104ac_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2716665,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/ab/b5ab56d0a20cdc021525f878ec10d5bc/pa/HT79408_259fa425067e60969c49daae044f920b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_671898e1-449c-5ada-876d-5f1fc58104ac/671898e1-449c-5ada-876d-5f1fc58104ac_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84840,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/ab/b5ab56d0a20cdc021525f878ec10d5bc/pa/HT79408_ebe76c2891c63af76b286440060604e5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_671898e1-449c-5ada-876d-5f1fc58104ac/671898e1-449c-5ada-876d-5f1fc58104ac_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3089607,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/ab/b5ab56d0a20cdc021525f878ec10d5bc/pa/HT79408_1b36aff254cd706bf42757864a8fd286.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_671898e1-449c-5ada-876d-5f1fc58104ac/671898e1-449c-5ada-876d-5f1fc58104ac_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83318,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/ab/b5ab56d0a20cdc021525f878ec10d5bc/pa/HT79408_393a2bb407c5d17cbcfb9c6ce0e16dd5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_671898e1-449c-5ada-876d-5f1fc58104ac/671898e1-449c-5ada-876d-5f1fc58104ac_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60033,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/ab/b5ab56d0a20cdc021525f878ec10d5bc/pa/HT79408_d2158d4ef03edc9a2efa8115195f7cec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_671898e1-449c-5ada-876d-5f1fc58104ac/671898e1-449c-5ada-876d-5f1fc58104ac_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53304,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/ab/b5ab56d0a20cdc021525f878ec10d5bc/pa/HT79408_242e49905c584ebb41739a4b8b8df770.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_671898e1-449c-5ada-876d-5f1fc58104ac/671898e1-449c-5ada-876d-5f1fc58104ac_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37664,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/ab/b5ab56d0a20cdc021525f878ec10d5bc/pa/HT79408_4642d04dc8505c5048e6503a3d67ae2f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_671898e1-449c-5ada-876d-5f1fc58104ac/671898e1-449c-5ada-876d-5f1fc58104ac_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47245,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/ab/b5ab56d0a20cdc021525f878ec10d5bc/pa/HT79408_d35828c2e031bb983866b0d650221832.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_671898e1-449c-5ada-876d-5f1fc58104ac/671898e1-449c-5ada-876d-5f1fc58104ac_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52834,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/ab/b5ab56d0a20cdc021525f878ec10d5bc/pa/HT79408_a43a19b48c43297e28f659d37e881e0d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-11-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai i10 1.0 Tech',
 'transmission': 'automatic',
 'trim': 'Tech',
 'year': 2022}
2026-01-28 20:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HT79408%27 HTTP/1.1" 200 None
2026-01-28 20:03:38 [auto1.it] INFO: Saving data for HT79408: {'created_time': 1769630618.257527, 'last_price_update_time': 1769630618.257537, 'auction_closing_time': 1769704058.0}
2026-01-28 20:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HT79408') HTTP/1.1" 204 0
2026-01-28 20:03:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f08ed03f-29e9-5e66-8f2f-0a9f1f55e79a with identifier: PD47677
2026-01-28 20:03:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f08ed03f-29e9-5e66-8f2f-0a9f1f55e79a with identifier: PD47677
2026-01-28 20:03:38 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 150284 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    150284
2026-01-28 20:03:38 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: f08ed03f-29e9-5e66-8f2f-0a9f1f55e79a spider: auto1.it
2026-01-28 20:03:38 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: f08ed03f-29e9-5e66-8f2f-0a9f1f55e79a due to rule: high_mileage_for_country.json, error: 150284 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    150284
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.6L',
 'engine_horse_power': 135,
 'expiration_date': '2026-01-29T16:06:53Z',
 'fuel_type': 'diesel',
 'id': 'f08ed03f-29e9-5e66-8f2f-0a9f1f55e79a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PD47677',
 'listing': 'auction',
 'location': 'IT, Bentivoglio (BO)',
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 150284,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-04-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai i30 1.6 CRDi N-Line',
 'transmission': 'manual',
 'trim': 'N-Line',
 'year': 2021}
2026-01-28 20:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PD47677%27 HTTP/1.1" 200 None
2026-01-28 20:03:38 [auto1.it] INFO: Saving data for PD47677: {'auction_closing_time': 1769702813.0, 'created_time': 1769457943.170116, 'last_price_update_time': 1769630618.501816}
2026-01-28 20:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PD47677') HTTP/1.1" 204 0
2026-01-28 20:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Fa4%252F57a41f04407b77fc18110f7a3d1df06f%252Fpa%252FJY56965_cee2a34e15751f469f06a7a7e4dbe3b8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/a4/57a41f04407b77fc18110f7a3d1df06f/pa/JY56965_cee2a34e15751f469f06a7a7e4dbe3b8.jpg not downloaded yet
2026-01-28 20:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252Fe4%252F2de443a529edfde728e09f1928d64710%252Fpa%252FXP18402_acb9276a682ba1cab636099711389da9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/e4/2de443a529edfde728e09f1928d64710/pa/XP18402_acb9276a682ba1cab636099711389da9.jpg not downloaded yet
2026-01-28 20:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F9b%252F5e9bd9af10ddf07ad6df01859299cca1%252Fpa%252FXX61742_70acfbb53262fb1288c0f0811ee2f1e6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/9b/5e9bd9af10ddf07ad6df01859299cca1/pa/XX61742_70acfbb53262fb1288c0f0811ee2f1e6.jpg not downloaded yet
2026-01-28 20:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CU51863> (referer: https://www.auto1.com/v1/car-details-view/CU51863/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JD87332> (referer: https://www.auto1.com/v1/car-details-view/JD87332/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YU19851> (referer: https://www.auto1.com/v1/car-details-view/YU19851/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HH72494> (referer: https://www.auto1.com/v1/car-details-view/HH72494/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RH01953> (referer: https://www.auto1.com/v1/car-details-view/RH01953/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MG90392> (referer: https://www.auto1.com/v1/car-details-view/MG90392/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:03:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09d94ed0>
2026-01-28 20:03:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4d9f98b-ae16-55ce-83a2-f5c7c8a02d91/a4d9f98b-ae16-55ce-83a2-f5c7c8a02d91_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F9b%252F5e9bd9af10ddf07ad6df01859299cca1%252Fpa%252FXX61742_c8fb31742eedcd4f07abea42a8352e4d.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/9b/5e9bd9af10ddf07ad6df01859299cca1/pa/XX61742_c8fb31742eedcd4f07abea42a8352e4d.jpg saved to cache
2026-01-28 20:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a4d9f98b-ae16-55ce-83a2-f5c7c8a02d91
2026-01-28 20:03:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b086cdf50>
2026-01-28 20:03:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:03:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa8f0b27-091b-5c48-a778-9f0012ab28b2/fa8f0b27-091b-5c48-a778-9f0012ab28b2_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252Fe4%252F2de443a529edfde728e09f1928d64710%252Fpa%252FXP18402_2c15ce9b267c2bc6a3a0cd139e588cfe.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/e4/2de443a529edfde728e09f1928d64710/pa/XP18402_2c15ce9b267c2bc6a3a0cd139e588cfe.jpg saved to cache
2026-01-28 20:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fa8f0b27-091b-5c48-a778-9f0012ab28b2
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Fa4%252F57a41f04407b77fc18110f7a3d1df06f%252Fpa%252FJY56965_07d976453195704ce8a6b57f26e06881.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/a4/57a41f04407b77fc18110f7a3d1df06f/pa/JY56965_07d976453195704ce8a6b57f26e06881.jpg not downloaded yet
2026-01-28 20:03:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:03:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:03:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:03:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/9b/5e9bd9af10ddf07ad6df01859299cca1/pa/XX61742_5ef9c9da55148f34bc0b39f65427b656.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/a4/57a41f04407b77fc18110f7a3d1df06f/pa/JY56965_cdb40600efed209cfb0d131938229766.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252Fe4%252F2de443a529edfde728e09f1928d64710%252Fpa%252FXP18402_d41f2e3da6e33d7ccfebc7b6026c6757.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/e4/2de443a529edfde728e09f1928d64710/pa/XP18402_d41f2e3da6e33d7ccfebc7b6026c6757.jpg not downloaded yet
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F9b%252F5e9bd9af10ddf07ad6df01859299cca1%252Fpa%252FXX61742_f9dd6a9b2cb7a2b3bcbc06a8557d9aed.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/9b/5e9bd9af10ddf07ad6df01859299cca1/pa/XX61742_f9dd6a9b2cb7a2b3bcbc06a8557d9aed.jpg not downloaded yet
2026-01-28 20:03:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08b0b450>
2026-01-28 20:03:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0218895-008c-5901-8d81-495dcbc7bbb2/c0218895-008c-5901-8d81-495dcbc7bbb2_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Fa4%252F57a41f04407b77fc18110f7a3d1df06f%252Fpa%252FJY56965_372381d539c1b0995dd4388a6739c767.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/a4/57a41f04407b77fc18110f7a3d1df06f/pa/JY56965_372381d539c1b0995dd4388a6739c767.jpg saved to cache
2026-01-28 20:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c0218895-008c-5901-8d81-495dcbc7bbb2
2026-01-28 20:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/9b/5e9bd9af10ddf07ad6df01859299cca1/pa/XX61742_401647714336b4339515822649e9dc5c.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Fa4%252F57a41f04407b77fc18110f7a3d1df06f%252Fpa%252FJY56965_4a3e82bb14c3148d53b702b0908a0583.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/a4/57a41f04407b77fc18110f7a3d1df06f/pa/JY56965_4a3e82bb14c3148d53b702b0908a0583.jpg not downloaded yet
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252Fe4%252F2de443a529edfde728e09f1928d64710%252Fpa%252FXP18402_be489d1b440dabb7fcd0a388254f6f51.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/e4/2de443a529edfde728e09f1928d64710/pa/XP18402_be489d1b440dabb7fcd0a388254f6f51.jpg not downloaded yet
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F9b%252F5e9bd9af10ddf07ad6df01859299cca1%252Fpa%252FXX61742_9865870780dac156c10b92c8517270bd.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/9b/5e9bd9af10ddf07ad6df01859299cca1/pa/XX61742_9865870780dac156c10b92c8517270bd.jpg not downloaded yet
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Fa4%252F57a41f04407b77fc18110f7a3d1df06f%252Fpa%252FJY56965_3d0d6d1ad33043bad1af430d3e7b2538.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/a4/57a41f04407b77fc18110f7a3d1df06f/pa/JY56965_3d0d6d1ad33043bad1af430d3e7b2538.jpg not downloaded yet
2026-01-28 20:03:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1fc23a0d-7e51-556c-aa83-233656974dd8 with identifier: CU51863
2026-01-28 20:03:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1fc23a0d-7e51-556c-aa83-233656974dd8 with scrape type 1
2026-01-28 20:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 1fc23a0d-7e51-556c-aa83-233656974dd8
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F8a%252F348a3e75b70a5c6a5a857ba46d5af98e%252Fpa%252FCU51863_b2978ff22737e27be155c68b71e1c51a.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/8a/348a3e75b70a5c6a5a857ba46d5af98e/pa/CU51863_b2978ff22737e27be155c68b71e1c51a.jpg not downloaded yet
2026-01-28 20:03:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f0ca04ca-1890-54cc-80be-2205a411ef7d with identifier: JD87332
2026-01-28 20:03:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f0ca04ca-1890-54cc-80be-2205a411ef7d with scrape type 1
2026-01-28 20:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item f0ca04ca-1890-54cc-80be-2205a411ef7d
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F5a%252F765a4222ce3836b6ffd97e3f1f7b8262%252Fpa%252FJD87332_0d2f7d1b698eb3f511c2edd0667f9c03.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/5a/765a4222ce3836b6ffd97e3f1f7b8262/pa/JD87332_0d2f7d1b698eb3f511c2edd0667f9c03.jpg not downloaded yet
2026-01-28 20:03:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 626097a6-eaf9-5ab1-811a-b0eb7721353b with identifier: YU19851
2026-01-28 20:03:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 626097a6-eaf9-5ab1-811a-b0eb7721353b with scrape type 2
2026-01-28 20:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 626097a6-eaf9-5ab1-811a-b0eb7721353b with scrape type 2
2026-01-28 20:03:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 626097a6-eaf9-5ab1-811a-b0eb7721353b, identifier: YU19851
2026-01-28 20:03:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aa2b949d-c89d-556d-b45e-7c1158796c0d with identifier: HH72494
2026-01-28 20:03:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa2b949d-c89d-556d-b45e-7c1158796c0d with scrape type 1
2026-01-28 20:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item aa2b949d-c89d-556d-b45e-7c1158796c0d
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252Fda%252F0adad667f1edaa1155ce2138d2074fbc%252Fpa%252FHH72494_06daa4979c28bc27a5707a76f8179c8e.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/da/0adad667f1edaa1155ce2138d2074fbc/pa/HH72494_06daa4979c28bc27a5707a76f8179c8e.jpg already downloaded
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252Fda%252F0adad667f1edaa1155ce2138d2074fbc%252Fpa%252FHH72494_c7db64437a8737e94f21aaf709c45b73.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/da/0adad667f1edaa1155ce2138d2074fbc/pa/HH72494_c7db64437a8737e94f21aaf709c45b73.jpg already downloaded
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252Fda%252F0adad667f1edaa1155ce2138d2074fbc%252Fpa%252FHH72494_d44b8cf3dd0a60a64f901b1a2104c94a.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/da/0adad667f1edaa1155ce2138d2074fbc/pa/HH72494_d44b8cf3dd0a60a64f901b1a2104c94a.jpg already downloaded
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252Fda%252F0adad667f1edaa1155ce2138d2074fbc%252Fpa%252FHH72494_42b7ab530c3954316b154250ee5cc2cf.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/da/0adad667f1edaa1155ce2138d2074fbc/pa/HH72494_42b7ab530c3954316b154250ee5cc2cf.jpg already downloaded
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252Fda%252F0adad667f1edaa1155ce2138d2074fbc%252Fpa%252FHH72494_b79635b56751051603d3a1fcd9addd2b.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/da/0adad667f1edaa1155ce2138d2074fbc/pa/HH72494_b79635b56751051603d3a1fcd9addd2b.jpg already downloaded
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252Fda%252F0adad667f1edaa1155ce2138d2074fbc%252Fpa%252FHH72494_5779aee7e668d05bb4394198fec85885.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/da/0adad667f1edaa1155ce2138d2074fbc/pa/HH72494_5779aee7e668d05bb4394198fec85885.jpg already downloaded
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252Fda%252F0adad667f1edaa1155ce2138d2074fbc%252Fpa%252FHH72494_8867e23637696c43a1d7779bdc25338f.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/da/0adad667f1edaa1155ce2138d2074fbc/pa/HH72494_8867e23637696c43a1d7779bdc25338f.jpg already downloaded
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252Fda%252F0adad667f1edaa1155ce2138d2074fbc%252Fpa%252FHH72494_5b4b4e9bebb4fa0b89060f2eb61bfdb1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/da/0adad667f1edaa1155ce2138d2074fbc/pa/HH72494_5b4b4e9bebb4fa0b89060f2eb61bfdb1.jpg already downloaded
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252Fda%252F0adad667f1edaa1155ce2138d2074fbc%252Fpa%252FHH72494_1aa7ce32f6bfe0aa5e77c89a56eb88fe.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/da/0adad667f1edaa1155ce2138d2074fbc/pa/HH72494_1aa7ce32f6bfe0aa5e77c89a56eb88fe.jpg already downloaded
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252Fda%252F0adad667f1edaa1155ce2138d2074fbc%252Fpa%252FHH72494_1587af5b559d56e1b48cb14695eacd72.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/da/0adad667f1edaa1155ce2138d2074fbc/pa/HH72494_1587af5b559d56e1b48cb14695eacd72.jpg already downloaded
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252Fda%252F0adad667f1edaa1155ce2138d2074fbc%252Fpa%252FHH72494_11989562e847617d3fbeacb4ed23d15a.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/da/0adad667f1edaa1155ce2138d2074fbc/pa/HH72494_11989562e847617d3fbeacb4ed23d15a.jpg already downloaded
2026-01-28 20:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252Fda%252F0adad667f1edaa1155ce2138d2074fbc%252Fpa%252FHH72494_8f3470d932f93a52b0450188b6318997.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/da/0adad667f1edaa1155ce2138d2074fbc/pa/HH72494_8f3470d932f93a52b0450188b6318997.jpg already downloaded
2026-01-28 20:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252Fda%252F0adad667f1edaa1155ce2138d2074fbc%252Fpa%252FHH72494_b97df0ce7cdfb82b9c47bdfd9703f860.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/da/0adad667f1edaa1155ce2138d2074fbc/pa/HH72494_b97df0ce7cdfb82b9c47bdfd9703f860.jpg already downloaded
2026-01-28 20:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252Fda%252F0adad667f1edaa1155ce2138d2074fbc%252Fpa%252FHH72494_7962ce5cea8b391b743ac7bf641042d2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/da/0adad667f1edaa1155ce2138d2074fbc/pa/HH72494_7962ce5cea8b391b743ac7bf641042d2.jpg already downloaded
2026-01-28 20:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252Fda%252F0adad667f1edaa1155ce2138d2074fbc%252Fpa%252FHH72494_e3fa40d5f0a24bf49e69b24152198837.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/da/0adad667f1edaa1155ce2138d2074fbc/pa/HH72494_e3fa40d5f0a24bf49e69b24152198837.jpg already downloaded
2026-01-28 20:03:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: aa2b949d-c89d-556d-b45e-7c1158796c0d, identifier: HH72494
2026-01-28 20:03:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa89909a-c9a0-5bc6-9dae-b2d6118c5124 with identifier: RH01953
2026-01-28 20:03:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa89909a-c9a0-5bc6-9dae-b2d6118c5124 with scrape type 1
2026-01-28 20:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item fa89909a-c9a0-5bc6-9dae-b2d6118c5124
2026-01-28 20:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Ff8%252Fd4f897137fb25efb00f4d92f62f39559%252Fpa%252FRH01953_5702798018508f53e4f02b93c5327536.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/f8/d4f897137fb25efb00f4d92f62f39559/pa/RH01953_5702798018508f53e4f02b93c5327536.jpg already downloaded
2026-01-28 20:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Ff8%252Fd4f897137fb25efb00f4d92f62f39559%252Fpa%252FRH01953_73eb94280bf41fc8ee5e7e72e25833ae.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/f8/d4f897137fb25efb00f4d92f62f39559/pa/RH01953_73eb94280bf41fc8ee5e7e72e25833ae.jpg already downloaded
2026-01-28 20:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Ff8%252Fd4f897137fb25efb00f4d92f62f39559%252Fpa%252FRH01953_665f2f6607c3a7a10281b27d3ee588f0.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/f8/d4f897137fb25efb00f4d92f62f39559/pa/RH01953_665f2f6607c3a7a10281b27d3ee588f0.jpg already downloaded
2026-01-28 20:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Ff8%252Fd4f897137fb25efb00f4d92f62f39559%252Fpa%252FRH01953_5fe5e0c012e343b9cef2ed0c935ad90a.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/f8/d4f897137fb25efb00f4d92f62f39559/pa/RH01953_5fe5e0c012e343b9cef2ed0c935ad90a.jpg already downloaded
2026-01-28 20:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Ff8%252Fd4f897137fb25efb00f4d92f62f39559%252Fpa%252FRH01953_f6bed861ee8d4e1be029d39c0a669dab.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/f8/d4f897137fb25efb00f4d92f62f39559/pa/RH01953_f6bed861ee8d4e1be029d39c0a669dab.jpg already downloaded
2026-01-28 20:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Ff8%252Fd4f897137fb25efb00f4d92f62f39559%252Fpa%252FRH01953_f960eeac284253b52574b0190d7a0d1f.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/f8/d4f897137fb25efb00f4d92f62f39559/pa/RH01953_f960eeac284253b52574b0190d7a0d1f.jpg already downloaded
2026-01-28 20:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Ff8%252Fd4f897137fb25efb00f4d92f62f39559%252Fpa%252FRH01953_d6440ef0adc2ed05bda407a1f49bdb71.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/f8/d4f897137fb25efb00f4d92f62f39559/pa/RH01953_d6440ef0adc2ed05bda407a1f49bdb71.jpg already downloaded
2026-01-28 20:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Ff8%252Fd4f897137fb25efb00f4d92f62f39559%252Fpa%252FRH01953_06568971a7cac088865fbf53b42b67f6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/f8/d4f897137fb25efb00f4d92f62f39559/pa/RH01953_06568971a7cac088865fbf53b42b67f6.jpg already downloaded
2026-01-28 20:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Ff8%252Fd4f897137fb25efb00f4d92f62f39559%252Fpa%252FRH01953_3e4eec8f74e251332a0f0f1a31efc260.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/f8/d4f897137fb25efb00f4d92f62f39559/pa/RH01953_3e4eec8f74e251332a0f0f1a31efc260.jpg already downloaded
2026-01-28 20:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Ff8%252Fd4f897137fb25efb00f4d92f62f39559%252Fpa%252FRH01953_8939f32e35a66128c9eccf568b02a66b.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/f8/d4f897137fb25efb00f4d92f62f39559/pa/RH01953_8939f32e35a66128c9eccf568b02a66b.jpg already downloaded
2026-01-28 20:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Ff8%252Fd4f897137fb25efb00f4d92f62f39559%252Fpa%252FRH01953_b66c284f4dd38ba2bf83c7c9f5effedb.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/f8/d4f897137fb25efb00f4d92f62f39559/pa/RH01953_b66c284f4dd38ba2bf83c7c9f5effedb.jpg already downloaded
2026-01-28 20:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Ff8%252Fd4f897137fb25efb00f4d92f62f39559%252Fpa%252FRH01953_f98c4deb71effb817fc4ca8e5b39a379.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/f8/d4f897137fb25efb00f4d92f62f39559/pa/RH01953_f98c4deb71effb817fc4ca8e5b39a379.jpg already downloaded
2026-01-28 20:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Ff8%252Fd4f897137fb25efb00f4d92f62f39559%252Fpa%252FRH01953_c0fdf5e1d93ba3f89166aa56f04d8f8f.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/f8/d4f897137fb25efb00f4d92f62f39559/pa/RH01953_c0fdf5e1d93ba3f89166aa56f04d8f8f.jpg already downloaded
2026-01-28 20:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Ff8%252Fd4f897137fb25efb00f4d92f62f39559%252Fpa%252FRH01953_6118af8099bed006f27ff341a5860d55.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/f8/d4f897137fb25efb00f4d92f62f39559/pa/RH01953_6118af8099bed006f27ff341a5860d55.jpg already downloaded
2026-01-28 20:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Ff8%252Fd4f897137fb25efb00f4d92f62f39559%252Fpa%252FRH01953_73191e7de5bbaee37150fe5d6ec4f601.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/f8/d4f897137fb25efb00f4d92f62f39559/pa/RH01953_73191e7de5bbaee37150fe5d6ec4f601.jpg already downloaded
2026-01-28 20:03:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: fa89909a-c9a0-5bc6-9dae-b2d6118c5124, identifier: RH01953
2026-01-28 20:03:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c418dc17-3c23-5591-9929-4e579f04a83d with identifier: MG90392
2026-01-28 20:03:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c418dc17-3c23-5591-9929-4e579f04a83d with scrape type 2
2026-01-28 20:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c418dc17-3c23-5591-9929-4e579f04a83d with scrape type 2
2026-01-28 20:03:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c418dc17-3c23-5591-9929-4e579f04a83d, identifier: MG90392
2026-01-28 20:03:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09dc5950>
2026-01-28 20:03:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:03:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4d9f98b-ae16-55ce-83a2-f5c7c8a02d91/a4d9f98b-ae16-55ce-83a2-f5c7c8a02d91_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F9b%252F5e9bd9af10ddf07ad6df01859299cca1%252Fpa%252FXX61742_5ef9c9da55148f34bc0b39f65427b656.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/9b/5e9bd9af10ddf07ad6df01859299cca1/pa/XX61742_5ef9c9da55148f34bc0b39f65427b656.jpg saved to cache
2026-01-28 20:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a4d9f98b-ae16-55ce-83a2-f5c7c8a02d91
2026-01-28 20:03:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b086a7150>
2026-01-28 20:03:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:03:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0218895-008c-5901-8d81-495dcbc7bbb2/c0218895-008c-5901-8d81-495dcbc7bbb2_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Fa4%252F57a41f04407b77fc18110f7a3d1df06f%252Fpa%252FJY56965_cdb40600efed209cfb0d131938229766.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/a4/57a41f04407b77fc18110f7a3d1df06f/pa/JY56965_cdb40600efed209cfb0d131938229766.jpg saved to cache
2026-01-28 20:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c0218895-008c-5901-8d81-495dcbc7bbb2
2026-01-28 20:03:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/e4/2de443a529edfde728e09f1928d64710/pa/XP18402_b4d89e4f58a20340e30c4835646acfaf.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/e4/2de443a529edfde728e09f1928d64710/pa/XP18402_d39670086632f2690b93db51ba841997.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252Fe4%252F2de443a529edfde728e09f1928d64710%252Fpa%252FXP18402_b1b3143445852d3e711aa5e1a18c661f.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/e4/2de443a529edfde728e09f1928d64710/pa/XP18402_b1b3143445852d3e711aa5e1a18c661f.jpg not downloaded yet
2026-01-28 20:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F9b%252F5e9bd9af10ddf07ad6df01859299cca1%252Fpa%252FXX61742_e550ec4f5ea0d15db4f52b1f472dfac9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/9b/5e9bd9af10ddf07ad6df01859299cca1/pa/XX61742_e550ec4f5ea0d15db4f52b1f472dfac9.jpg not downloaded yet
2026-01-28 20:03:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 626097a6-eaf9-5ab1-811a-b0eb7721353b with identifier: YU19851
2026-01-28 20:03:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 626097a6-eaf9-5ab1-811a-b0eb7721353b with identifier: YU19851
2026-01-28 20:03:41 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 175657 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    175657
2026-01-28 20:03:41 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 626097a6-eaf9-5ab1-811a-b0eb7721353b spider: auto1.it
2026-01-28 20:03:41 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 626097a6-eaf9-5ab1-811a-b0eb7721353b due to rule: high_mileage_for_country.json, error: 175657 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    175657
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '2.0L',
 'engine_horse_power': 241,
 'expiration_date': '2026-01-29T16:00:29Z',
 'fuel_type': 'diesel',
 'id': '626097a6-eaf9-5ab1-811a-b0eb7721353b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YU19851',
 'listing': 'auction',
 'location': 'IT, Bentivoglio (BO)',
 'make': 'Land Rover',
 'model': 'Discovery Sport',
 'odometer': 175657,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-10-14',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Land Rover Discovery Sport D240 R-Dynamic HSE AWD',
 'transmission': 'automatic',
 'trim': 'R-Dynamic HSE AWD',
 'year': 2020}
2026-01-28 20:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YU19851%27 HTTP/1.1" 200 None
2026-01-28 20:03:41 [auto1.it] INFO: Saving data for YU19851: {'auction_closing_time': 1769702429.0, 'created_time': 1769199359.396724, 'last_price_update_time': 1769630621.461756}
2026-01-28 20:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YU19851') HTTP/1.1" 204 0
2026-01-28 20:03:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: aa2b949d-c89d-556d-b45e-7c1158796c0d with identifier: HH72494
2026-01-28 20:03:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: aa2b949d-c89d-556d-b45e-7c1158796c0d with identifier: HH72494
2026-01-28 20:03:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: aa2b949d-c89d-556d-b45e-7c1158796c0d with identifier: HH72494 to the API
2026-01-28 20:03:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:03:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:03:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HH72494>
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.3L',
 'engine_horse_power': 140,
 'expiration_date': '2026-01-29T16:43:42Z',
 'fuel_type': 'petrol',
 'id': 'aa2b949d-c89d-556d-b45e-7c1158796c0d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HH72494',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 17348,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img0a/da/0adad667f1edaa1155ce2138d2074fbc/pa/HH72494_06daa4979c28bc27a5707a76f8179c8e.jpg',
                'https://img-pa.auto1.com/img0a/da/0adad667f1edaa1155ce2138d2074fbc/pa/HH72494_c7db64437a8737e94f21aaf709c45b73.jpg',
                'https://img-pa.auto1.com/img0a/da/0adad667f1edaa1155ce2138d2074fbc/pa/HH72494_d44b8cf3dd0a60a64f901b1a2104c94a.jpg',
                'https://img-pa.auto1.com/img0a/da/0adad667f1edaa1155ce2138d2074fbc/pa/HH72494_42b7ab530c3954316b154250ee5cc2cf.jpg',
                'https://img-pa.auto1.com/img0a/da/0adad667f1edaa1155ce2138d2074fbc/pa/HH72494_b79635b56751051603d3a1fcd9addd2b.jpg',
                'https://img-pa.auto1.com/img0a/da/0adad667f1edaa1155ce2138d2074fbc/pa/HH72494_5779aee7e668d05bb4394198fec85885.jpg',
                'https://img-pa.auto1.com/img0a/da/0adad667f1edaa1155ce2138d2074fbc/pa/HH72494_8867e23637696c43a1d7779bdc25338f.jpg',
                'https://img-pa.auto1.com/img0a/da/0adad667f1edaa1155ce2138d2074fbc/pa/HH72494_5b4b4e9bebb4fa0b89060f2eb61bfdb1.jpg',
                'https://img-pa.auto1.com/img0a/da/0adad667f1edaa1155ce2138d2074fbc/pa/HH72494_1aa7ce32f6bfe0aa5e77c89a56eb88fe.jpg',
                'https://img-pa.auto1.com/img0a/da/0adad667f1edaa1155ce2138d2074fbc/pa/HH72494_1587af5b559d56e1b48cb14695eacd72.jpg',
                'https://img-pa.auto1.com/img0a/da/0adad667f1edaa1155ce2138d2074fbc/pa/HH72494_11989562e847617d3fbeacb4ed23d15a.jpg',
                'https://img-pa.auto1.com/img0a/da/0adad667f1edaa1155ce2138d2074fbc/pa/HH72494_8f3470d932f93a52b0450188b6318997.jpg',
                'https://img-pa.auto1.com/img0a/da/0adad667f1edaa1155ce2138d2074fbc/pa/HH72494_b97df0ce7cdfb82b9c47bdfd9703f860.jpg',
                'https://img-pa.auto1.com/img0a/da/0adad667f1edaa1155ce2138d2074fbc/pa/HH72494_7962ce5cea8b391b743ac7bf641042d2.jpg',
                'https://img-pa.auto1.com/img0a/da/0adad667f1edaa1155ce2138d2074fbc/pa/HH72494_e3fa40d5f0a24bf49e69b24152198837.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa2b949d-c89d-556d-b45e-7c1158796c0d/aa2b949d-c89d-556d-b45e-7c1158796c0d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2424855,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/da/0adad667f1edaa1155ce2138d2074fbc/pa/HH72494_06daa4979c28bc27a5707a76f8179c8e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa2b949d-c89d-556d-b45e-7c1158796c0d/aa2b949d-c89d-556d-b45e-7c1158796c0d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2479333,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/da/0adad667f1edaa1155ce2138d2074fbc/pa/HH72494_c7db64437a8737e94f21aaf709c45b73.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa2b949d-c89d-556d-b45e-7c1158796c0d/aa2b949d-c89d-556d-b45e-7c1158796c0d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74117,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/da/0adad667f1edaa1155ce2138d2074fbc/pa/HH72494_d44b8cf3dd0a60a64f901b1a2104c94a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa2b949d-c89d-556d-b45e-7c1158796c0d/aa2b949d-c89d-556d-b45e-7c1158796c0d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2450513,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/da/0adad667f1edaa1155ce2138d2074fbc/pa/HH72494_42b7ab530c3954316b154250ee5cc2cf.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa2b949d-c89d-556d-b45e-7c1158796c0d/aa2b949d-c89d-556d-b45e-7c1158796c0d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2391468,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/da/0adad667f1edaa1155ce2138d2074fbc/pa/HH72494_b79635b56751051603d3a1fcd9addd2b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa2b949d-c89d-556d-b45e-7c1158796c0d/aa2b949d-c89d-556d-b45e-7c1158796c0d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2532501,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/da/0adad667f1edaa1155ce2138d2074fbc/pa/HH72494_5779aee7e668d05bb4394198fec85885.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa2b949d-c89d-556d-b45e-7c1158796c0d/aa2b949d-c89d-556d-b45e-7c1158796c0d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2456989,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/da/0adad667f1edaa1155ce2138d2074fbc/pa/HH72494_8867e23637696c43a1d7779bdc25338f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa2b949d-c89d-556d-b45e-7c1158796c0d/aa2b949d-c89d-556d-b45e-7c1158796c0d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2628497,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/da/0adad667f1edaa1155ce2138d2074fbc/pa/HH72494_5b4b4e9bebb4fa0b89060f2eb61bfdb1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa2b949d-c89d-556d-b45e-7c1158796c0d/aa2b949d-c89d-556d-b45e-7c1158796c0d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2453304,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/da/0adad667f1edaa1155ce2138d2074fbc/pa/HH72494_1aa7ce32f6bfe0aa5e77c89a56eb88fe.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa2b949d-c89d-556d-b45e-7c1158796c0d/aa2b949d-c89d-556d-b45e-7c1158796c0d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2521942,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/da/0adad667f1edaa1155ce2138d2074fbc/pa/HH72494_1587af5b559d56e1b48cb14695eacd72.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa2b949d-c89d-556d-b45e-7c1158796c0d/aa2b949d-c89d-556d-b45e-7c1158796c0d_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2819265,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/da/0adad667f1edaa1155ce2138d2074fbc/pa/HH72494_11989562e847617d3fbeacb4ed23d15a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa2b949d-c89d-556d-b45e-7c1158796c0d/aa2b949d-c89d-556d-b45e-7c1158796c0d_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2941718,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/da/0adad667f1edaa1155ce2138d2074fbc/pa/HH72494_8f3470d932f93a52b0450188b6318997.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa2b949d-c89d-556d-b45e-7c1158796c0d/aa2b949d-c89d-556d-b45e-7c1158796c0d_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73437,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/da/0adad667f1edaa1155ce2138d2074fbc/pa/HH72494_b97df0ce7cdfb82b9c47bdfd9703f860.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa2b949d-c89d-556d-b45e-7c1158796c0d/aa2b949d-c89d-556d-b45e-7c1158796c0d_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2746710,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/da/0adad667f1edaa1155ce2138d2074fbc/pa/HH72494_7962ce5cea8b391b743ac7bf641042d2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa2b949d-c89d-556d-b45e-7c1158796c0d/aa2b949d-c89d-556d-b45e-7c1158796c0d_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70105,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/da/0adad667f1edaa1155ce2138d2074fbc/pa/HH72494_e3fa40d5f0a24bf49e69b24152198837.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-06-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Qashqai 1.3 DIG-T Mild-Hybrid Tekna',
 'transmission': 'manual',
 'trim': 'Tekna',
 'year': 2024}
2026-01-28 20:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HH72494%27 HTTP/1.1" 200 None
2026-01-28 20:03:41 [auto1.it] INFO: Saving data for HH72494: {'created_time': 1769630621.820981, 'last_price_update_time': 1769630621.820994, 'auction_closing_time': 1769705022.0}
2026-01-28 20:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HH72494') HTTP/1.1" 204 0
2026-01-28 20:03:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: fa89909a-c9a0-5bc6-9dae-b2d6118c5124 with identifier: RH01953
2026-01-28 20:03:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: fa89909a-c9a0-5bc6-9dae-b2d6118c5124 with identifier: RH01953
2026-01-28 20:03:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: fa89909a-c9a0-5bc6-9dae-b2d6118c5124 with identifier: RH01953 to the API
2026-01-28 20:03:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:03:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RH01953>
{'auction_title': '',
 'c_o_2_emission_value': 213,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '3.0L',
 'engine_horse_power': 400,
 'expiration_date': '2026-01-29T16:02:43Z',
 'fuel_type': 'petrol',
 'id': 'fa89909a-c9a0-5bc6-9dae-b2d6118c5124',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RH01953',
 'listing': 'auction',
 'location': 'IT, Senago (MI)',
 'make': 'Land Rover',
 'model': 'Range Rover Sport',
 'odometer': 127564,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgd4/f8/d4f897137fb25efb00f4d92f62f39559/pa/RH01953_5702798018508f53e4f02b93c5327536.jpg',
                'https://img-pa.auto1.com/imgd4/f8/d4f897137fb25efb00f4d92f62f39559/pa/RH01953_73eb94280bf41fc8ee5e7e72e25833ae.jpg',
                'https://img-pa.auto1.com/imgd4/f8/d4f897137fb25efb00f4d92f62f39559/pa/RH01953_665f2f6607c3a7a10281b27d3ee588f0.jpg',
                'https://img-pa.auto1.com/imgd4/f8/d4f897137fb25efb00f4d92f62f39559/pa/RH01953_5fe5e0c012e343b9cef2ed0c935ad90a.jpg',
                'https://img-pa.auto1.com/imgd4/f8/d4f897137fb25efb00f4d92f62f39559/pa/RH01953_f6bed861ee8d4e1be029d39c0a669dab.jpg',
                'https://img-pa.auto1.com/imgd4/f8/d4f897137fb25efb00f4d92f62f39559/pa/RH01953_f960eeac284253b52574b0190d7a0d1f.jpg',
                'https://img-pa.auto1.com/imgd4/f8/d4f897137fb25efb00f4d92f62f39559/pa/RH01953_d6440ef0adc2ed05bda407a1f49bdb71.jpg',
                'https://img-pa.auto1.com/imgd4/f8/d4f897137fb25efb00f4d92f62f39559/pa/RH01953_06568971a7cac088865fbf53b42b67f6.jpg',
                'https://img-pa.auto1.com/imgd4/f8/d4f897137fb25efb00f4d92f62f39559/pa/RH01953_3e4eec8f74e251332a0f0f1a31efc260.jpg',
                'https://img-pa.auto1.com/imgd4/f8/d4f897137fb25efb00f4d92f62f39559/pa/RH01953_8939f32e35a66128c9eccf568b02a66b.jpg',
                'https://img-pa.auto1.com/imgd4/f8/d4f897137fb25efb00f4d92f62f39559/pa/RH01953_b66c284f4dd38ba2bf83c7c9f5effedb.jpg',
                'https://img-pa.auto1.com/imgd4/f8/d4f897137fb25efb00f4d92f62f39559/pa/RH01953_f98c4deb71effb817fc4ca8e5b39a379.jpg',
                'https://img-pa.auto1.com/imgd4/f8/d4f897137fb25efb00f4d92f62f39559/pa/RH01953_c0fdf5e1d93ba3f89166aa56f04d8f8f.jpg',
                'https://img-pa.auto1.com/imgd4/f8/d4f897137fb25efb00f4d92f62f39559/pa/RH01953_6118af8099bed006f27ff341a5860d55.jpg',
                'https://img-pa.auto1.com/imgd4/f8/d4f897137fb25efb00f4d92f62f39559/pa/RH01953_73191e7de5bbaee37150fe5d6ec4f601.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa89909a-c9a0-5bc6-9dae-b2d6118c5124/fa89909a-c9a0-5bc6-9dae-b2d6118c5124_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67531,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/f8/d4f897137fb25efb00f4d92f62f39559/pa/RH01953_5702798018508f53e4f02b93c5327536.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa89909a-c9a0-5bc6-9dae-b2d6118c5124/fa89909a-c9a0-5bc6-9dae-b2d6118c5124_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62782,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/f8/d4f897137fb25efb00f4d92f62f39559/pa/RH01953_73eb94280bf41fc8ee5e7e72e25833ae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa89909a-c9a0-5bc6-9dae-b2d6118c5124/fa89909a-c9a0-5bc6-9dae-b2d6118c5124_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62506,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/f8/d4f897137fb25efb00f4d92f62f39559/pa/RH01953_665f2f6607c3a7a10281b27d3ee588f0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa89909a-c9a0-5bc6-9dae-b2d6118c5124/fa89909a-c9a0-5bc6-9dae-b2d6118c5124_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59313,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/f8/d4f897137fb25efb00f4d92f62f39559/pa/RH01953_5fe5e0c012e343b9cef2ed0c935ad90a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa89909a-c9a0-5bc6-9dae-b2d6118c5124/fa89909a-c9a0-5bc6-9dae-b2d6118c5124_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59746,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/f8/d4f897137fb25efb00f4d92f62f39559/pa/RH01953_f6bed861ee8d4e1be029d39c0a669dab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa89909a-c9a0-5bc6-9dae-b2d6118c5124/fa89909a-c9a0-5bc6-9dae-b2d6118c5124_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60790,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/f8/d4f897137fb25efb00f4d92f62f39559/pa/RH01953_f960eeac284253b52574b0190d7a0d1f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa89909a-c9a0-5bc6-9dae-b2d6118c5124/fa89909a-c9a0-5bc6-9dae-b2d6118c5124_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44384,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/f8/d4f897137fb25efb00f4d92f62f39559/pa/RH01953_d6440ef0adc2ed05bda407a1f49bdb71.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa89909a-c9a0-5bc6-9dae-b2d6118c5124/fa89909a-c9a0-5bc6-9dae-b2d6118c5124_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61829,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/f8/d4f897137fb25efb00f4d92f62f39559/pa/RH01953_06568971a7cac088865fbf53b42b67f6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa89909a-c9a0-5bc6-9dae-b2d6118c5124/fa89909a-c9a0-5bc6-9dae-b2d6118c5124_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2445031,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/f8/d4f897137fb25efb00f4d92f62f39559/pa/RH01953_3e4eec8f74e251332a0f0f1a31efc260.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa89909a-c9a0-5bc6-9dae-b2d6118c5124/fa89909a-c9a0-5bc6-9dae-b2d6118c5124_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59680,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/f8/d4f897137fb25efb00f4d92f62f39559/pa/RH01953_8939f32e35a66128c9eccf568b02a66b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa89909a-c9a0-5bc6-9dae-b2d6118c5124/fa89909a-c9a0-5bc6-9dae-b2d6118c5124_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61294,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/f8/d4f897137fb25efb00f4d92f62f39559/pa/RH01953_b66c284f4dd38ba2bf83c7c9f5effedb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa89909a-c9a0-5bc6-9dae-b2d6118c5124/fa89909a-c9a0-5bc6-9dae-b2d6118c5124_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60927,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/f8/d4f897137fb25efb00f4d92f62f39559/pa/RH01953_f98c4deb71effb817fc4ca8e5b39a379.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa89909a-c9a0-5bc6-9dae-b2d6118c5124/fa89909a-c9a0-5bc6-9dae-b2d6118c5124_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50505,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/f8/d4f897137fb25efb00f4d92f62f39559/pa/RH01953_c0fdf5e1d93ba3f89166aa56f04d8f8f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa89909a-c9a0-5bc6-9dae-b2d6118c5124/fa89909a-c9a0-5bc6-9dae-b2d6118c5124_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50949,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/f8/d4f897137fb25efb00f4d92f62f39559/pa/RH01953_6118af8099bed006f27ff341a5860d55.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa89909a-c9a0-5bc6-9dae-b2d6118c5124/fa89909a-c9a0-5bc6-9dae-b2d6118c5124_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62755,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/f8/d4f897137fb25efb00f4d92f62f39559/pa/RH01953_73191e7de5bbaee37150fe5d6ec4f601.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-09-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Range Rover Sport P400 Mild-Hybrid HST',
 'transmission': 'automatic',
 'trim': 'HST',
 'year': 2019}
2026-01-28 20:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RH01953%27 HTTP/1.1" 200 None
2026-01-28 20:03:43 [auto1.it] INFO: Saving data for RH01953: {'created_time': 1769630623.036327, 'last_price_update_time': 1769630623.036379, 'auction_closing_time': 1769702563.0}
2026-01-28 20:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RH01953') HTTP/1.1" 204 0
2026-01-28 20:03:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c418dc17-3c23-5591-9929-4e579f04a83d with identifier: MG90392
2026-01-28 20:03:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c418dc17-3c23-5591-9929-4e579f04a83d with identifier: MG90392
2026-01-28 20:03:43 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'ford' containing 'ford' and model 'transit' containing 'transit'
2026-01-28 20:03:43 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: c418dc17-3c23-5591-9929-4e579f04a83d spider: auto1.it
2026-01-28 20:03:43 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: c418dc17-3c23-5591-9929-4e579f04a83d due to rule: makes_models_not_allowed.json, error: Rejected due to make 'ford' containing 'ford' and model 'transit' containing 'transit'
{'auction_title': '',
 'c_o_2_emission_value': 234,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '2.0L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:00:58Z',
 'fuel_type': 'diesel',
 'id': 'c418dc17-3c23-5591-9929-4e579f04a83d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MG90392',
 'listing': 'auction',
 'location': 'IT, Senago (MI)',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 149295,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-09-18',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Ford Transit 2.0 TDCi 310 L3 Trend',
 'transmission': 'manual',
 'trim': '310 L3 Trend',
 'year': 2022}
2026-01-28 20:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MG90392%27 HTTP/1.1" 200 None
2026-01-28 20:03:43 [auto1.it] INFO: Saving data for MG90392: {'auction_closing_time': 1769702458.0, 'created_time': 1766001842.654093, 'last_price_update_time': 1769630623.26664}
2026-01-28 20:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MG90392') HTTP/1.1" 204 0
2026-01-28 20:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/9b/5e9bd9af10ddf07ad6df01859299cca1/pa/XX61742_bd0c58dd4b24d7b399e4822ae2e0e5c0.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/e4/2de443a529edfde728e09f1928d64710/pa/XP18402_acb9276a682ba1cab636099711389da9.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Fa4%252F57a41f04407b77fc18110f7a3d1df06f%252Fpa%252FJY56965_411dadb1ece1152e6a47c28ff09aebb0.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/a4/57a41f04407b77fc18110f7a3d1df06f/pa/JY56965_411dadb1ece1152e6a47c28ff09aebb0.jpg not downloaded yet
2026-01-28 20:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F8a%252F348a3e75b70a5c6a5a857ba46d5af98e%252Fpa%252FCU51863_d6721547c3094646544f3fe96ed6c498.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/8a/348a3e75b70a5c6a5a857ba46d5af98e/pa/CU51863_d6721547c3094646544f3fe96ed6c498.jpg not downloaded yet
2026-01-28 20:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F5a%252F765a4222ce3836b6ffd97e3f1f7b8262%252Fpa%252FJD87332_886f2b90087af7e652496f05f6513cdb.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/5a/765a4222ce3836b6ffd97e3f1f7b8262/pa/JD87332_886f2b90087af7e652496f05f6513cdb.jpg not downloaded yet
2026-01-28 20:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/a4/57a41f04407b77fc18110f7a3d1df06f/pa/JY56965_438a4cf6d12dd904749875de19ac2d7a.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/9b/5e9bd9af10ddf07ad6df01859299cca1/pa/XX61742_70acfbb53262fb1288c0f0811ee2f1e6.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/a4/57a41f04407b77fc18110f7a3d1df06f/pa/JY56965_cee2a34e15751f469f06a7a7e4dbe3b8.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252Fe4%252F2de443a529edfde728e09f1928d64710%252Fpa%252FXP18402_ceea54df4bfef50267644325d21b828d.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/e4/2de443a529edfde728e09f1928d64710/pa/XP18402_ceea54df4bfef50267644325d21b828d.jpg not downloaded yet
2026-01-28 20:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F9b%252F5e9bd9af10ddf07ad6df01859299cca1%252Fpa%252FXX61742_c9fc1839b164bd1c0789da07d7653d33.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/9b/5e9bd9af10ddf07ad6df01859299cca1/pa/XX61742_c9fc1839b164bd1c0789da07d7653d33.jpg not downloaded yet
2026-01-28 20:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BC61751> (referer: https://www.auto1.com/v1/car-details-view/BC61751/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SR88948> (referer: https://www.auto1.com/v1/car-details-view/SR88948/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:03:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08b541d0>
2026-01-28 20:03:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:03:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4d9f98b-ae16-55ce-83a2-f5c7c8a02d91/a4d9f98b-ae16-55ce-83a2-f5c7c8a02d91_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F9b%252F5e9bd9af10ddf07ad6df01859299cca1%252Fpa%252FXX61742_401647714336b4339515822649e9dc5c.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/9b/5e9bd9af10ddf07ad6df01859299cca1/pa/XX61742_401647714336b4339515822649e9dc5c.jpg saved to cache
2026-01-28 20:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a4d9f98b-ae16-55ce-83a2-f5c7c8a02d91
2026-01-28 20:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/e4/2de443a529edfde728e09f1928d64710/pa/XP18402_236365bb07935c4c80f6556a2350cb78.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Fa4%252F57a41f04407b77fc18110f7a3d1df06f%252Fpa%252FJY56965_6e1396e3716eeaa8d639b7a932a38893.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/a4/57a41f04407b77fc18110f7a3d1df06f/pa/JY56965_6e1396e3716eeaa8d639b7a932a38893.jpg not downloaded yet
2026-01-28 20:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F8a%252F348a3e75b70a5c6a5a857ba46d5af98e%252Fpa%252FCU51863_bfb4e01f297635aa2dc1b6857f4146c1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/8a/348a3e75b70a5c6a5a857ba46d5af98e/pa/CU51863_bfb4e01f297635aa2dc1b6857f4146c1.jpg not downloaded yet
2026-01-28 20:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F5a%252F765a4222ce3836b6ffd97e3f1f7b8262%252Fpa%252FJD87332_3efa8f3484bc87f6700c9f37ba27ca2a.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/5a/765a4222ce3836b6ffd97e3f1f7b8262/pa/JD87332_3efa8f3484bc87f6700c9f37ba27ca2a.jpg not downloaded yet
2026-01-28 20:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/a4/57a41f04407b77fc18110f7a3d1df06f/pa/JY56965_07d976453195704ce8a6b57f26e06881.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252Fe4%252F2de443a529edfde728e09f1928d64710%252Fpa%252FXP18402_cc5781d90409e0f5672023e79e32c5cc.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/e4/2de443a529edfde728e09f1928d64710/pa/XP18402_cc5781d90409e0f5672023e79e32c5cc.jpg not downloaded yet
2026-01-28 20:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F9b%252F5e9bd9af10ddf07ad6df01859299cca1%252Fpa%252FXX61742_29c73269c418087a349f25da1a5d733d.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/9b/5e9bd9af10ddf07ad6df01859299cca1/pa/XX61742_29c73269c418087a349f25da1a5d733d.jpg not downloaded yet
2026-01-28 20:03:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08cbb3d0>
2026-01-28 20:03:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:03:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa8f0b27-091b-5c48-a778-9f0012ab28b2/fa8f0b27-091b-5c48-a778-9f0012ab28b2_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252Fe4%252F2de443a529edfde728e09f1928d64710%252Fpa%252FXP18402_b4d89e4f58a20340e30c4835646acfaf.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/e4/2de443a529edfde728e09f1928d64710/pa/XP18402_b4d89e4f58a20340e30c4835646acfaf.jpg saved to cache
2026-01-28 20:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fa8f0b27-091b-5c48-a778-9f0012ab28b2
2026-01-28 20:03:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08b66a90>
2026-01-28 20:03:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:03:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa8f0b27-091b-5c48-a778-9f0012ab28b2/fa8f0b27-091b-5c48-a778-9f0012ab28b2_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252Fe4%252F2de443a529edfde728e09f1928d64710%252Fpa%252FXP18402_d39670086632f2690b93db51ba841997.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/e4/2de443a529edfde728e09f1928d64710/pa/XP18402_d39670086632f2690b93db51ba841997.jpg saved to cache
2026-01-28 20:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fa8f0b27-091b-5c48-a778-9f0012ab28b2
2026-01-28 20:03:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/9b/5e9bd9af10ddf07ad6df01859299cca1/pa/XX61742_9865870780dac156c10b92c8517270bd.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Fa4%252F57a41f04407b77fc18110f7a3d1df06f%252Fpa%252FJY56965_a97f767950fb9ad23f155fd5cdd90801.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/a4/57a41f04407b77fc18110f7a3d1df06f/pa/JY56965_a97f767950fb9ad23f155fd5cdd90801.jpg not downloaded yet
2026-01-28 20:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F8a%252F348a3e75b70a5c6a5a857ba46d5af98e%252Fpa%252FCU51863_9541b8796987c85ab9409c0a1a1a94b3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/8a/348a3e75b70a5c6a5a857ba46d5af98e/pa/CU51863_9541b8796987c85ab9409c0a1a1a94b3.jpg not downloaded yet
2026-01-28 20:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F5a%252F765a4222ce3836b6ffd97e3f1f7b8262%252Fpa%252FJD87332_f6c4db9de265839aa03d9788a8e4ac6d.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/5a/765a4222ce3836b6ffd97e3f1f7b8262/pa/JD87332_f6c4db9de265839aa03d9788a8e4ac6d.jpg not downloaded yet
2026-01-28 20:03:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08b6dc50>
2026-01-28 20:03:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:03:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4d9f98b-ae16-55ce-83a2-f5c7c8a02d91/a4d9f98b-ae16-55ce-83a2-f5c7c8a02d91_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F9b%252F5e9bd9af10ddf07ad6df01859299cca1%252Fpa%252FXX61742_bd0c58dd4b24d7b399e4822ae2e0e5c0.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/9b/5e9bd9af10ddf07ad6df01859299cca1/pa/XX61742_bd0c58dd4b24d7b399e4822ae2e0e5c0.jpg saved to cache
2026-01-28 20:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a4d9f98b-ae16-55ce-83a2-f5c7c8a02d91
2026-01-28 20:03:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08b745d0>
2026-01-28 20:03:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:03:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa8f0b27-091b-5c48-a778-9f0012ab28b2/fa8f0b27-091b-5c48-a778-9f0012ab28b2_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252Fe4%252F2de443a529edfde728e09f1928d64710%252Fpa%252FXP18402_acb9276a682ba1cab636099711389da9.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/e4/2de443a529edfde728e09f1928d64710/pa/XP18402_acb9276a682ba1cab636099711389da9.jpg saved to cache
2026-01-28 20:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fa8f0b27-091b-5c48-a778-9f0012ab28b2
2026-01-28 20:03:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08b4fb50>
2026-01-28 20:03:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:03:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0218895-008c-5901-8d81-495dcbc7bbb2/c0218895-008c-5901-8d81-495dcbc7bbb2_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Fa4%252F57a41f04407b77fc18110f7a3d1df06f%252Fpa%252FJY56965_438a4cf6d12dd904749875de19ac2d7a.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/a4/57a41f04407b77fc18110f7a3d1df06f/pa/JY56965_438a4cf6d12dd904749875de19ac2d7a.jpg saved to cache
2026-01-28 20:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c0218895-008c-5901-8d81-495dcbc7bbb2
2026-01-28 20:03:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08b6ef50>
2026-01-28 20:03:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:03:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4d9f98b-ae16-55ce-83a2-f5c7c8a02d91/a4d9f98b-ae16-55ce-83a2-f5c7c8a02d91_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F9b%252F5e9bd9af10ddf07ad6df01859299cca1%252Fpa%252FXX61742_70acfbb53262fb1288c0f0811ee2f1e6.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/9b/5e9bd9af10ddf07ad6df01859299cca1/pa/XX61742_70acfbb53262fb1288c0f0811ee2f1e6.jpg saved to cache
2026-01-28 20:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a4d9f98b-ae16-55ce-83a2-f5c7c8a02d91
2026-01-28 20:03:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08b74390>
2026-01-28 20:03:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:03:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0218895-008c-5901-8d81-495dcbc7bbb2/c0218895-008c-5901-8d81-495dcbc7bbb2_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Fa4%252F57a41f04407b77fc18110f7a3d1df06f%252Fpa%252FJY56965_cee2a34e15751f469f06a7a7e4dbe3b8.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/a4/57a41f04407b77fc18110f7a3d1df06f/pa/JY56965_cee2a34e15751f469f06a7a7e4dbe3b8.jpg saved to cache
2026-01-28 20:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c0218895-008c-5901-8d81-495dcbc7bbb2
2026-01-28 20:03:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d539d2ac-85e8-5d2d-860d-67ba5245b881 with identifier: BC61751
2026-01-28 20:03:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d539d2ac-85e8-5d2d-860d-67ba5245b881 with scrape type 2
2026-01-28 20:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d539d2ac-85e8-5d2d-860d-67ba5245b881 with scrape type 2
2026-01-28 20:03:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d539d2ac-85e8-5d2d-860d-67ba5245b881, identifier: BC61751
2026-01-28 20:03:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e511f1b-7d74-5878-80ad-55a38cd3a30f with identifier: SR88948
2026-01-28 20:03:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e511f1b-7d74-5878-80ad-55a38cd3a30f with scrape type 1
2026-01-28 20:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 14 photos for item 4e511f1b-7d74-5878-80ad-55a38cd3a30f
2026-01-28 20:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F4f%252F2a4f612bbbd4f1ec36b60172f241997f%252Fpa%252FSR88948_4be2f3ee677d5fab525a4499c3c518e0.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/4f/2a4f612bbbd4f1ec36b60172f241997f/pa/SR88948_4be2f3ee677d5fab525a4499c3c518e0.jpg not downloaded yet
2026-01-28 20:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/8a/348a3e75b70a5c6a5a857ba46d5af98e/pa/CU51863_b2978ff22737e27be155c68b71e1c51a.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/e4/2de443a529edfde728e09f1928d64710/pa/XP18402_be489d1b440dabb7fcd0a388254f6f51.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/e4/2de443a529edfde728e09f1928d64710/pa/XP18402_b1b3143445852d3e711aa5e1a18c661f.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252Fe4%252F2de443a529edfde728e09f1928d64710%252Fpa%252FXP18402_f51058e9a8a454cd8659b29ee389edfd.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/e4/2de443a529edfde728e09f1928d64710/pa/XP18402_f51058e9a8a454cd8659b29ee389edfd.jpg not downloaded yet
2026-01-28 20:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F9b%252F5e9bd9af10ddf07ad6df01859299cca1%252Fpa%252FXX61742_11e21e770c31bbb819199e42b5f791e8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/9b/5e9bd9af10ddf07ad6df01859299cca1/pa/XX61742_11e21e770c31bbb819199e42b5f791e8.jpg not downloaded yet
2026-01-28 20:03:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d539d2ac-85e8-5d2d-860d-67ba5245b881 with identifier: BC61751
2026-01-28 20:03:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d539d2ac-85e8-5d2d-860d-67ba5245b881 with identifier: BC61751
2026-01-28 20:03:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d539d2ac-85e8-5d2d-860d-67ba5245b881 with identifier: BC61751 to the API
2026-01-28 20:03:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:03:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:03:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BC61751>
{'auction_title': '',
 'c_o_2_emission_value': 145,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:20:04Z',
 'fuel_type': 'diesel',
 'id': 'd539d2ac-85e8-5d2d-860d-67ba5245b881',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BC61751',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'Skoda',
 'model': 'Kodiaq',
 'odometer': 136311,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-06-27',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Skoda Kodiaq 2.0 TDI Ambition 4x4',
 'transmission': 'automatic',
 'trim': 'Ambition 4x4',
 'year': 2019}
2026-01-28 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BC61751%27 HTTP/1.1" 200 None
2026-01-28 20:03:48 [auto1.it] INFO: Saving data for BC61751: {'auction_closing_time': 1769703604.0, 'created_time': 1768853286.471512, 'last_price_update_time': 1769630628.084096}
2026-01-28 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BC61751') HTTP/1.1" 204 0
2026-01-28 20:03:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/a4/57a41f04407b77fc18110f7a3d1df06f/pa/JY56965_3d0d6d1ad33043bad1af430d3e7b2538.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/9b/5e9bd9af10ddf07ad6df01859299cca1/pa/XX61742_e550ec4f5ea0d15db4f52b1f472dfac9.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F8a%252F348a3e75b70a5c6a5a857ba46d5af98e%252Fpa%252FCU51863_b972ef4cf1aa404e0edb8d87ebbafacd.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/8a/348a3e75b70a5c6a5a857ba46d5af98e/pa/CU51863_b972ef4cf1aa404e0edb8d87ebbafacd.jpg not downloaded yet
2026-01-28 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F5a%252F765a4222ce3836b6ffd97e3f1f7b8262%252Fpa%252FJD87332_a99da0c3515d9bf4ad034182d84eb374.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/5a/765a4222ce3836b6ffd97e3f1f7b8262/pa/JD87332_a99da0c3515d9bf4ad034182d84eb374.jpg not downloaded yet
2026-01-28 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F4f%252F2a4f612bbbd4f1ec36b60172f241997f%252Fpa%252FSR88948_b8fa73bb64c9ef56d02a8fd8288d0896.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/4f/2a4f612bbbd4f1ec36b60172f241997f/pa/SR88948_b8fa73bb64c9ef56d02a8fd8288d0896.jpg not downloaded yet
2026-01-28 20:03:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YR95481> (referer: https://www.auto1.com/v1/car-details-view/YR95481/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:03:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZX31921> (referer: https://www.auto1.com/v1/car-details-view/ZX31921/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:03:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PK36389> (referer: https://www.auto1.com/v1/car-details-view/PK36389/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:03:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AP23964> (referer: https://www.auto1.com/v1/car-details-view/AP23964/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:03:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09d96f50>
2026-01-28 20:03:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa8f0b27-091b-5c48-a778-9f0012ab28b2/fa8f0b27-091b-5c48-a778-9f0012ab28b2_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252Fe4%252F2de443a529edfde728e09f1928d64710%252Fpa%252FXP18402_236365bb07935c4c80f6556a2350cb78.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/e4/2de443a529edfde728e09f1928d64710/pa/XP18402_236365bb07935c4c80f6556a2350cb78.jpg saved to cache
2026-01-28 20:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fa8f0b27-091b-5c48-a778-9f0012ab28b2
2026-01-28 20:03:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09e30ad0>
2026-01-28 20:03:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:03:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0218895-008c-5901-8d81-495dcbc7bbb2/c0218895-008c-5901-8d81-495dcbc7bbb2_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Fa4%252F57a41f04407b77fc18110f7a3d1df06f%252Fpa%252FJY56965_07d976453195704ce8a6b57f26e06881.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/a4/57a41f04407b77fc18110f7a3d1df06f/pa/JY56965_07d976453195704ce8a6b57f26e06881.jpg saved to cache
2026-01-28 20:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c0218895-008c-5901-8d81-495dcbc7bbb2
2026-01-28 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252Fe4%252F2de443a529edfde728e09f1928d64710%252Fpa%252FXP18402_37c4b6ca0707c1627abbbfefdf544ac1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/e4/2de443a529edfde728e09f1928d64710/pa/XP18402_37c4b6ca0707c1627abbbfefdf544ac1.jpg not downloaded yet
2026-01-28 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F9b%252F5e9bd9af10ddf07ad6df01859299cca1%252Fpa%252FXX61742_d631ad4c3e3620b6432a89e006bcdece.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/9b/5e9bd9af10ddf07ad6df01859299cca1/pa/XX61742_d631ad4c3e3620b6432a89e006bcdece.jpg not downloaded yet
2026-01-28 20:03:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08c3a110>
2026-01-28 20:03:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4d9f98b-ae16-55ce-83a2-f5c7c8a02d91/a4d9f98b-ae16-55ce-83a2-f5c7c8a02d91_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F9b%252F5e9bd9af10ddf07ad6df01859299cca1%252Fpa%252FXX61742_9865870780dac156c10b92c8517270bd.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/9b/5e9bd9af10ddf07ad6df01859299cca1/pa/XX61742_9865870780dac156c10b92c8517270bd.jpg saved to cache
2026-01-28 20:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a4d9f98b-ae16-55ce-83a2-f5c7c8a02d91
2026-01-28 20:03:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/8a/348a3e75b70a5c6a5a857ba46d5af98e/pa/CU51863_d6721547c3094646544f3fe96ed6c498.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F8a%252F348a3e75b70a5c6a5a857ba46d5af98e%252Fpa%252FCU51863_afda6904984750e5b79eec1e1aaf516c.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/8a/348a3e75b70a5c6a5a857ba46d5af98e/pa/CU51863_afda6904984750e5b79eec1e1aaf516c.jpg not downloaded yet
2026-01-28 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F5a%252F765a4222ce3836b6ffd97e3f1f7b8262%252Fpa%252FJD87332_6b0505192a8fd35aeff1ad539a0cbb9b.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/5a/765a4222ce3836b6ffd97e3f1f7b8262/pa/JD87332_6b0505192a8fd35aeff1ad539a0cbb9b.jpg not downloaded yet
2026-01-28 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F4f%252F2a4f612bbbd4f1ec36b60172f241997f%252Fpa%252FSR88948_fe5b61932c8befb2ec4d09cb6879197d.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/4f/2a4f612bbbd4f1ec36b60172f241997f/pa/SR88948_fe5b61932c8befb2ec4d09cb6879197d.jpg not downloaded yet
2026-01-28 20:03:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/a4/57a41f04407b77fc18110f7a3d1df06f/pa/JY56965_411dadb1ece1152e6a47c28ff09aebb0.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/9b/5e9bd9af10ddf07ad6df01859299cca1/pa/XX61742_c9fc1839b164bd1c0789da07d7653d33.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252Fe4%252F2de443a529edfde728e09f1928d64710%252Fpa%252FXP18402_5c29ad533554dccfd4b69dab7cda356f.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/e4/2de443a529edfde728e09f1928d64710/pa/XP18402_5c29ad533554dccfd4b69dab7cda356f.jpg not downloaded yet
2026-01-28 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F9b%252F5e9bd9af10ddf07ad6df01859299cca1%252Fpa%252FXX61742_58e8e1c7b598f153babe7851f3aafb10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/9b/5e9bd9af10ddf07ad6df01859299cca1/pa/XX61742_58e8e1c7b598f153babe7851f3aafb10.jpg not downloaded yet
2026-01-28 20:03:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09f37350>
2026-01-28 20:03:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:03:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fc23a0d-7e51-556c-aa83-233656974dd8/1fc23a0d-7e51-556c-aa83-233656974dd8_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F8a%252F348a3e75b70a5c6a5a857ba46d5af98e%252Fpa%252FCU51863_b2978ff22737e27be155c68b71e1c51a.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/8a/348a3e75b70a5c6a5a857ba46d5af98e/pa/CU51863_b2978ff22737e27be155c68b71e1c51a.jpg saved to cache
2026-01-28 20:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1fc23a0d-7e51-556c-aa83-233656974dd8
2026-01-28 20:03:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08b97f10>
2026-01-28 20:03:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa8f0b27-091b-5c48-a778-9f0012ab28b2/fa8f0b27-091b-5c48-a778-9f0012ab28b2_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252Fe4%252F2de443a529edfde728e09f1928d64710%252Fpa%252FXP18402_be489d1b440dabb7fcd0a388254f6f51.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/e4/2de443a529edfde728e09f1928d64710/pa/XP18402_be489d1b440dabb7fcd0a388254f6f51.jpg saved to cache
2026-01-28 20:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fa8f0b27-091b-5c48-a778-9f0012ab28b2
2026-01-28 20:03:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0a0ceed0>
2026-01-28 20:03:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:03:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa8f0b27-091b-5c48-a778-9f0012ab28b2/fa8f0b27-091b-5c48-a778-9f0012ab28b2_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252Fe4%252F2de443a529edfde728e09f1928d64710%252Fpa%252FXP18402_b1b3143445852d3e711aa5e1a18c661f.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/e4/2de443a529edfde728e09f1928d64710/pa/XP18402_b1b3143445852d3e711aa5e1a18c661f.jpg saved to cache
2026-01-28 20:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fa8f0b27-091b-5c48-a778-9f0012ab28b2
2026-01-28 20:03:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0a039f90>
2026-01-28 20:03:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0218895-008c-5901-8d81-495dcbc7bbb2/c0218895-008c-5901-8d81-495dcbc7bbb2_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Fa4%252F57a41f04407b77fc18110f7a3d1df06f%252Fpa%252FJY56965_3d0d6d1ad33043bad1af430d3e7b2538.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/a4/57a41f04407b77fc18110f7a3d1df06f/pa/JY56965_3d0d6d1ad33043bad1af430d3e7b2538.jpg saved to cache
2026-01-28 20:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item c0218895-008c-5901-8d81-495dcbc7bbb2
2026-01-28 20:03:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0a0678d0>
2026-01-28 20:03:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4d9f98b-ae16-55ce-83a2-f5c7c8a02d91/a4d9f98b-ae16-55ce-83a2-f5c7c8a02d91_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F9b%252F5e9bd9af10ddf07ad6df01859299cca1%252Fpa%252FXX61742_e550ec4f5ea0d15db4f52b1f472dfac9.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/9b/5e9bd9af10ddf07ad6df01859299cca1/pa/XX61742_e550ec4f5ea0d15db4f52b1f472dfac9.jpg saved to cache
2026-01-28 20:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a4d9f98b-ae16-55ce-83a2-f5c7c8a02d91
2026-01-28 20:03:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 69459ae1-63a7-5afa-b36b-0c4eb39acdae with identifier: YR95481
2026-01-28 20:03:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69459ae1-63a7-5afa-b36b-0c4eb39acdae with scrape type 2
2026-01-28 20:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 69459ae1-63a7-5afa-b36b-0c4eb39acdae with scrape type 2
2026-01-28 20:03:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 69459ae1-63a7-5afa-b36b-0c4eb39acdae, identifier: YR95481
2026-01-28 20:03:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a68fae47-969d-5ba4-b17d-2758a3bcdfdb with identifier: ZX31921
2026-01-28 20:03:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a68fae47-969d-5ba4-b17d-2758a3bcdfdb with scrape type 1
2026-01-28 20:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item a68fae47-969d-5ba4-b17d-2758a3bcdfdb
2026-01-28 20:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fce%252Fe7ce544553ed0429a1b886b86fc834cb%252Fpa%252FZX31921_4bfebe2c3f53b7c3a1e53e0546a28b5c.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/ce/e7ce544553ed0429a1b886b86fc834cb/pa/ZX31921_4bfebe2c3f53b7c3a1e53e0546a28b5c.jpg not downloaded yet
2026-01-28 20:03:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a287b3ca-f16d-5078-9162-132368cf1cbf with identifier: PK36389
2026-01-28 20:03:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a287b3ca-f16d-5078-9162-132368cf1cbf with scrape type 1
2026-01-28 20:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item a287b3ca-f16d-5078-9162-132368cf1cbf
2026-01-28 20:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F66%252Fe866a0d7aa28d0f3d11b71ff44fca61a%252Fpa%252FPK36389_3cf247f56a2879accaeb8c0c1f0ceb06.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/66/e866a0d7aa28d0f3d11b71ff44fca61a/pa/PK36389_3cf247f56a2879accaeb8c0c1f0ceb06.jpg not downloaded yet
2026-01-28 20:03:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6852bac-9c4b-5809-b41f-da869669d056 with identifier: AP23964
2026-01-28 20:03:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6852bac-9c4b-5809-b41f-da869669d056 with scrape type 1
2026-01-28 20:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item d6852bac-9c4b-5809-b41f-da869669d056
2026-01-28 20:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fcd%252Fe1cd9ac9315909533fe538013abcce2c%252Fpa%252FAP23964_7bf0ed8817a66a6bdd65410861800d2a.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_7bf0ed8817a66a6bdd65410861800d2a.jpg not downloaded yet
2026-01-28 20:03:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/9b/5e9bd9af10ddf07ad6df01859299cca1/pa/XX61742_29c73269c418087a349f25da1a5d733d.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F8a%252F348a3e75b70a5c6a5a857ba46d5af98e%252Fpa%252FCU51863_4ac400b7800d1e559491a501b847d583.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/8a/348a3e75b70a5c6a5a857ba46d5af98e/pa/CU51863_4ac400b7800d1e559491a501b847d583.jpg not downloaded yet
2026-01-28 20:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F5a%252F765a4222ce3836b6ffd97e3f1f7b8262%252Fpa%252FJD87332_638dbae7eccab166cabb66508b8fc166.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/5a/765a4222ce3836b6ffd97e3f1f7b8262/pa/JD87332_638dbae7eccab166cabb66508b8fc166.jpg not downloaded yet
2026-01-28 20:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F4f%252F2a4f612bbbd4f1ec36b60172f241997f%252Fpa%252FSR88948_42993d47f2209fb0fa6fb767e5cb1b0e.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/4f/2a4f612bbbd4f1ec36b60172f241997f/pa/SR88948_42993d47f2209fb0fa6fb767e5cb1b0e.jpg not downloaded yet
2026-01-28 20:03:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 69459ae1-63a7-5afa-b36b-0c4eb39acdae with identifier: YR95481
2026-01-28 20:03:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 69459ae1-63a7-5afa-b36b-0c4eb39acdae with identifier: YR95481
2026-01-28 20:03:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 69459ae1-63a7-5afa-b36b-0c4eb39acdae with identifier: YR95481 to the API
2026-01-28 20:03:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:03:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:03:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YR95481>
{'auction_title': '',
 'c_o_2_emission_value': 228,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6D',
 'engine': '2.2L',
 'engine_horse_power': 177,
 'expiration_date': '2026-01-29T16:43:43Z',
 'fuel_type': 'diesel',
 'id': '69459ae1-63a7-5afa-b36b-0c4eb39acdae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YR95481',
 'listing': 'auction',
 'location': 'IT, Settimo Torinese',
 'make': 'Hyundai',
 'model': 'Staria',
 'odometer': 33298,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-05-30',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Hyundai Staria 2.2 CRDi Signature 2WD',
 'transmission': 'automatic',
 'trim': 'Signature 2WD',
 'year': 2022}
2026-01-28 20:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YR95481%27 HTTP/1.1" 200 None
2026-01-28 20:03:51 [auto1.it] INFO: Saving data for YR95481: {'auction_closing_time': 1769705023.0, 'created_time': 1767039137.922972, 'last_price_update_time': 1769630631.21618}
2026-01-28 20:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YR95481') HTTP/1.1" 204 0
2026-01-28 20:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fce%252Fe7ce544553ed0429a1b886b86fc834cb%252Fpa%252FZX31921_5a42f150197b25bfa8ea146840be53db.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/ce/e7ce544553ed0429a1b886b86fc834cb/pa/ZX31921_5a42f150197b25bfa8ea146840be53db.jpg not downloaded yet
2026-01-28 20:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F66%252Fe866a0d7aa28d0f3d11b71ff44fca61a%252Fpa%252FPK36389_fe52c6a8cfd4d1b0f1b7b0a38ee1ebdc.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/66/e866a0d7aa28d0f3d11b71ff44fca61a/pa/PK36389_fe52c6a8cfd4d1b0f1b7b0a38ee1ebdc.jpg not downloaded yet
2026-01-28 20:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fcd%252Fe1cd9ac9315909533fe538013abcce2c%252Fpa%252FAP23964_35e16d4013f8467ea4298938c29860aa.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_35e16d4013f8467ea4298938c29860aa.jpg not downloaded yet
2026-01-28 20:03:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/e4/2de443a529edfde728e09f1928d64710/pa/XP18402_cc5781d90409e0f5672023e79e32c5cc.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/8a/348a3e75b70a5c6a5a857ba46d5af98e/pa/CU51863_bfb4e01f297635aa2dc1b6857f4146c1.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F8a%252F348a3e75b70a5c6a5a857ba46d5af98e%252Fpa%252FCU51863_94372cc153a0a9e8e5b4900ebdae3231.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/8a/348a3e75b70a5c6a5a857ba46d5af98e/pa/CU51863_94372cc153a0a9e8e5b4900ebdae3231.jpg not downloaded yet
2026-01-28 20:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F5a%252F765a4222ce3836b6ffd97e3f1f7b8262%252Fpa%252FJD87332_18d7e2d28916ff2fbfbd368bde3e2d22.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/5a/765a4222ce3836b6ffd97e3f1f7b8262/pa/JD87332_18d7e2d28916ff2fbfbd368bde3e2d22.jpg not downloaded yet
2026-01-28 20:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F4f%252F2a4f612bbbd4f1ec36b60172f241997f%252Fpa%252FSR88948_e7d288f5aeec2a4712d6e03c027058ce.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/4f/2a4f612bbbd4f1ec36b60172f241997f/pa/SR88948_e7d288f5aeec2a4712d6e03c027058ce.jpg not downloaded yet
2026-01-28 20:03:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08b38e50>
2026-01-28 20:03:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fc23a0d-7e51-556c-aa83-233656974dd8/1fc23a0d-7e51-556c-aa83-233656974dd8_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F8a%252F348a3e75b70a5c6a5a857ba46d5af98e%252Fpa%252FCU51863_d6721547c3094646544f3fe96ed6c498.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/8a/348a3e75b70a5c6a5a857ba46d5af98e/pa/CU51863_d6721547c3094646544f3fe96ed6c498.jpg saved to cache
2026-01-28 20:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1fc23a0d-7e51-556c-aa83-233656974dd8
2026-01-28 20:03:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0a0a2290>
2026-01-28 20:03:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0218895-008c-5901-8d81-495dcbc7bbb2/c0218895-008c-5901-8d81-495dcbc7bbb2_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Fa4%252F57a41f04407b77fc18110f7a3d1df06f%252Fpa%252FJY56965_411dadb1ece1152e6a47c28ff09aebb0.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/a4/57a41f04407b77fc18110f7a3d1df06f/pa/JY56965_411dadb1ece1152e6a47c28ff09aebb0.jpg saved to cache
2026-01-28 20:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item c0218895-008c-5901-8d81-495dcbc7bbb2
2026-01-28 20:03:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0a033d10>
2026-01-28 20:03:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4d9f98b-ae16-55ce-83a2-f5c7c8a02d91/a4d9f98b-ae16-55ce-83a2-f5c7c8a02d91_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F9b%252F5e9bd9af10ddf07ad6df01859299cca1%252Fpa%252FXX61742_c9fc1839b164bd1c0789da07d7653d33.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/9b/5e9bd9af10ddf07ad6df01859299cca1/pa/XX61742_c9fc1839b164bd1c0789da07d7653d33.jpg saved to cache
2026-01-28 20:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item a4d9f98b-ae16-55ce-83a2-f5c7c8a02d91
2026-01-28 20:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/4f/2a4f612bbbd4f1ec36b60172f241997f/pa/SR88948_4be2f3ee677d5fab525a4499c3c518e0.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fce%252Fe7ce544553ed0429a1b886b86fc834cb%252Fpa%252FZX31921_938c6ad73a886a120e3c46b8e45fc615.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/ce/e7ce544553ed0429a1b886b86fc834cb/pa/ZX31921_938c6ad73a886a120e3c46b8e45fc615.jpg not downloaded yet
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F66%252Fe866a0d7aa28d0f3d11b71ff44fca61a%252Fpa%252FPK36389_5accd11b719e0b432b4e42dcbd1ee263.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/66/e866a0d7aa28d0f3d11b71ff44fca61a/pa/PK36389_5accd11b719e0b432b4e42dcbd1ee263.jpg not downloaded yet
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fcd%252Fe1cd9ac9315909533fe538013abcce2c%252Fpa%252FAP23964_8ce46dfeed916921c4d6d36dca4dd68d.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_8ce46dfeed916921c4d6d36dca4dd68d.jpg not downloaded yet
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F8a%252F348a3e75b70a5c6a5a857ba46d5af98e%252Fpa%252FCU51863_a867b839db381aae1dbc59e39472fbaa.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/8a/348a3e75b70a5c6a5a857ba46d5af98e/pa/CU51863_a867b839db381aae1dbc59e39472fbaa.jpg not downloaded yet
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F5a%252F765a4222ce3836b6ffd97e3f1f7b8262%252Fpa%252FJD87332_1e8a35ffa8b57dce88e9a71ab1b73032.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/5a/765a4222ce3836b6ffd97e3f1f7b8262/pa/JD87332_1e8a35ffa8b57dce88e9a71ab1b73032.jpg not downloaded yet
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F4f%252F2a4f612bbbd4f1ec36b60172f241997f%252Fpa%252FSR88948_eba2e4797ae044cac4b3be123a40f727.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/4f/2a4f612bbbd4f1ec36b60172f241997f/pa/SR88948_eba2e4797ae044cac4b3be123a40f727.jpg not downloaded yet
2026-01-28 20:03:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09dfb510>
2026-01-28 20:03:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4d9f98b-ae16-55ce-83a2-f5c7c8a02d91/a4d9f98b-ae16-55ce-83a2-f5c7c8a02d91_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F9b%252F5e9bd9af10ddf07ad6df01859299cca1%252Fpa%252FXX61742_29c73269c418087a349f25da1a5d733d.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/9b/5e9bd9af10ddf07ad6df01859299cca1/pa/XX61742_29c73269c418087a349f25da1a5d733d.jpg saved to cache
2026-01-28 20:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item a4d9f98b-ae16-55ce-83a2-f5c7c8a02d91
2026-01-28 20:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/b0/b7b02e96c39b384924bc3a112ccefa59/pa/XA03649_28f5afba35415327ccf8417b533350eb.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fce%252Fe7ce544553ed0429a1b886b86fc834cb%252Fpa%252FZX31921_c1e40b6577af0e5b615de2199d48d73d.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/ce/e7ce544553ed0429a1b886b86fc834cb/pa/ZX31921_c1e40b6577af0e5b615de2199d48d73d.jpg not downloaded yet
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F66%252Fe866a0d7aa28d0f3d11b71ff44fca61a%252Fpa%252FPK36389_6bca44bc35ec2370bb953e800dde7024.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/66/e866a0d7aa28d0f3d11b71ff44fca61a/pa/PK36389_6bca44bc35ec2370bb953e800dde7024.jpg not downloaded yet
2026-01-28 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fcd%252Fe1cd9ac9315909533fe538013abcce2c%252Fpa%252FAP23964_35517d133c1cb1491101acbbd58b0594.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_35517d133c1cb1491101acbbd58b0594.jpg not downloaded yet
2026-01-28 20:03:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09d92a10>
2026-01-28 20:03:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:03:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa8f0b27-091b-5c48-a778-9f0012ab28b2/fa8f0b27-091b-5c48-a778-9f0012ab28b2_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252Fe4%252F2de443a529edfde728e09f1928d64710%252Fpa%252FXP18402_cc5781d90409e0f5672023e79e32c5cc.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/e4/2de443a529edfde728e09f1928d64710/pa/XP18402_cc5781d90409e0f5672023e79e32c5cc.jpg saved to cache
2026-01-28 20:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item fa8f0b27-091b-5c48-a778-9f0012ab28b2
2026-01-28 20:03:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09d6dc50>
2026-01-28 20:03:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fc23a0d-7e51-556c-aa83-233656974dd8/1fc23a0d-7e51-556c-aa83-233656974dd8_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F8a%252F348a3e75b70a5c6a5a857ba46d5af98e%252Fpa%252FCU51863_bfb4e01f297635aa2dc1b6857f4146c1.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/8a/348a3e75b70a5c6a5a857ba46d5af98e/pa/CU51863_bfb4e01f297635aa2dc1b6857f4146c1.jpg saved to cache
2026-01-28 20:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1fc23a0d-7e51-556c-aa83-233656974dd8
2026-01-28 20:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/e4/2de443a529edfde728e09f1928d64710/pa/XP18402_f51058e9a8a454cd8659b29ee389edfd.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/8a/348a3e75b70a5c6a5a857ba46d5af98e/pa/CU51863_9541b8796987c85ab9409c0a1a1a94b3.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F8a%252F348a3e75b70a5c6a5a857ba46d5af98e%252Fpa%252FCU51863_104f5776ed017d5c371ae82d68933df0.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/8a/348a3e75b70a5c6a5a857ba46d5af98e/pa/CU51863_104f5776ed017d5c371ae82d68933df0.jpg not downloaded yet
2026-01-28 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F5a%252F765a4222ce3836b6ffd97e3f1f7b8262%252Fpa%252FJD87332_f999195152883e30410333448b19e204.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/5a/765a4222ce3836b6ffd97e3f1f7b8262/pa/JD87332_f999195152883e30410333448b19e204.jpg not downloaded yet
2026-01-28 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F4f%252F2a4f612bbbd4f1ec36b60172f241997f%252Fpa%252FSR88948_ebb5fbeec228d1c6c026ff1902864dd4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/4f/2a4f612bbbd4f1ec36b60172f241997f/pa/SR88948_ebb5fbeec228d1c6c026ff1902864dd4.jpg not downloaded yet
2026-01-28 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fce%252Fe7ce544553ed0429a1b886b86fc834cb%252Fpa%252FZX31921_086b4f22effb09b271f75bc7b08add02.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/ce/e7ce544553ed0429a1b886b86fc834cb/pa/ZX31921_086b4f22effb09b271f75bc7b08add02.jpg not downloaded yet
2026-01-28 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F66%252Fe866a0d7aa28d0f3d11b71ff44fca61a%252Fpa%252FPK36389_bc81aa4b3f44d1ac4260297f3a5488f5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/66/e866a0d7aa28d0f3d11b71ff44fca61a/pa/PK36389_bc81aa4b3f44d1ac4260297f3a5488f5.jpg not downloaded yet
2026-01-28 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fcd%252Fe1cd9ac9315909533fe538013abcce2c%252Fpa%252FAP23964_c04ea2507cc79d492260128cb22826f7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_c04ea2507cc79d492260128cb22826f7.jpg not downloaded yet
2026-01-28 20:03:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09f46b90>
2026-01-28 20:03:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:03:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e511f1b-7d74-5878-80ad-55a38cd3a30f/4e511f1b-7d74-5878-80ad-55a38cd3a30f_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F4f%252F2a4f612bbbd4f1ec36b60172f241997f%252Fpa%252FSR88948_4be2f3ee677d5fab525a4499c3c518e0.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/4f/2a4f612bbbd4f1ec36b60172f241997f/pa/SR88948_4be2f3ee677d5fab525a4499c3c518e0.jpg saved to cache
2026-01-28 20:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4e511f1b-7d74-5878-80ad-55a38cd3a30f
2026-01-28 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F8a%252F348a3e75b70a5c6a5a857ba46d5af98e%252Fpa%252FCU51863_4032f5a4f0e58f59cbdaec58b59d6777.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/8a/348a3e75b70a5c6a5a857ba46d5af98e/pa/CU51863_4032f5a4f0e58f59cbdaec58b59d6777.jpg not downloaded yet
2026-01-28 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F5a%252F765a4222ce3836b6ffd97e3f1f7b8262%252Fpa%252FJD87332_96aed343583d6b6a2d6e58f8d86383e9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/5a/765a4222ce3836b6ffd97e3f1f7b8262/pa/JD87332_96aed343583d6b6a2d6e58f8d86383e9.jpg not downloaded yet
2026-01-28 20:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F4f%252F2a4f612bbbd4f1ec36b60172f241997f%252Fpa%252FSR88948_b282a3a14074be21e01534c08843cc0c.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/4f/2a4f612bbbd4f1ec36b60172f241997f/pa/SR88948_b282a3a14074be21e01534c08843cc0c.jpg not downloaded yet
2026-01-28 20:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/a4/57a41f04407b77fc18110f7a3d1df06f/pa/JY56965_a97f767950fb9ad23f155fd5cdd90801.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fce%252Fe7ce544553ed0429a1b886b86fc834cb%252Fpa%252FZX31921_a773bc2dc35b097520ddf77ef96900d4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/ce/e7ce544553ed0429a1b886b86fc834cb/pa/ZX31921_a773bc2dc35b097520ddf77ef96900d4.jpg not downloaded yet
2026-01-28 20:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F66%252Fe866a0d7aa28d0f3d11b71ff44fca61a%252Fpa%252FPK36389_fa716af178fc29dec5c7fd9da36088b0.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/66/e866a0d7aa28d0f3d11b71ff44fca61a/pa/PK36389_fa716af178fc29dec5c7fd9da36088b0.jpg not downloaded yet
2026-01-28 20:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fcd%252Fe1cd9ac9315909533fe538013abcce2c%252Fpa%252FAP23964_19117f3066dee66a24d98d07501cc0c7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_19117f3066dee66a24d98d07501cc0c7.jpg not downloaded yet
2026-01-28 20:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F8a%252F348a3e75b70a5c6a5a857ba46d5af98e%252Fpa%252FCU51863_0d1487fe9a292d2e09054c4ed1196987.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/8a/348a3e75b70a5c6a5a857ba46d5af98e/pa/CU51863_0d1487fe9a292d2e09054c4ed1196987.jpg not downloaded yet
2026-01-28 20:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F5a%252F765a4222ce3836b6ffd97e3f1f7b8262%252Fpa%252FJD87332_dcbe6c9cbb38333cc4cb925463a06fdc.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/5a/765a4222ce3836b6ffd97e3f1f7b8262/pa/JD87332_dcbe6c9cbb38333cc4cb925463a06fdc.jpg not downloaded yet
2026-01-28 20:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F4f%252F2a4f612bbbd4f1ec36b60172f241997f%252Fpa%252FSR88948_b70131576dd4ff9f3a3146fd819af73c.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/4f/2a4f612bbbd4f1ec36b60172f241997f/pa/SR88948_b70131576dd4ff9f3a3146fd819af73c.jpg not downloaded yet
2026-01-28 20:03:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:03:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08cedf90>
2026-01-28 20:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:03:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_697b49cf-5fb3-549c-8273-0f9f018d36a6/697b49cf-5fb3-549c-8273-0f9f018d36a6_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252Fb0%252Fb7b02e96c39b384924bc3a112ccefa59%252Fpa%252FXA03649_28f5afba35415327ccf8417b533350eb.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/b0/b7b02e96c39b384924bc3a112ccefa59/pa/XA03649_28f5afba35415327ccf8417b533350eb.jpg saved to cache
2026-01-28 20:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 697b49cf-5fb3-549c-8273-0f9f018d36a6
2026-01-28 20:03:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 697b49cf-5fb3-549c-8273-0f9f018d36a6, skipping ID generation
2026-01-28 20:03:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 697b49cf-5fb3-549c-8273-0f9f018d36a6 with scrape type 1
2026-01-28 20:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 697b49cf-5fb3-549c-8273-0f9f018d36a6 from tracking dictionaries
2026-01-28 20:03:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 697b49cf-5fb3-549c-8273-0f9f018d36a6 sending to next pipeline
2026-01-28 20:03:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 697b49cf-5fb3-549c-8273-0f9f018d36a6, identifier: XA03649
2026-01-28 20:03:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09d6dd10>
2026-01-28 20:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa8f0b27-091b-5c48-a778-9f0012ab28b2/fa8f0b27-091b-5c48-a778-9f0012ab28b2_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252Fe4%252F2de443a529edfde728e09f1928d64710%252Fpa%252FXP18402_f51058e9a8a454cd8659b29ee389edfd.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/e4/2de443a529edfde728e09f1928d64710/pa/XP18402_f51058e9a8a454cd8659b29ee389edfd.jpg saved to cache
2026-01-28 20:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item fa8f0b27-091b-5c48-a778-9f0012ab28b2
2026-01-28 20:03:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08c67750>
2026-01-28 20:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:03:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fc23a0d-7e51-556c-aa83-233656974dd8/1fc23a0d-7e51-556c-aa83-233656974dd8_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F8a%252F348a3e75b70a5c6a5a857ba46d5af98e%252Fpa%252FCU51863_9541b8796987c85ab9409c0a1a1a94b3.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/8a/348a3e75b70a5c6a5a857ba46d5af98e/pa/CU51863_9541b8796987c85ab9409c0a1a1a94b3.jpg saved to cache
2026-01-28 20:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1fc23a0d-7e51-556c-aa83-233656974dd8
2026-01-28 20:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fce%252Fe7ce544553ed0429a1b886b86fc834cb%252Fpa%252FZX31921_0df6e726b2d5329cae105466d116f13b.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/ce/e7ce544553ed0429a1b886b86fc834cb/pa/ZX31921_0df6e726b2d5329cae105466d116f13b.jpg not downloaded yet
2026-01-28 20:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F66%252Fe866a0d7aa28d0f3d11b71ff44fca61a%252Fpa%252FPK36389_0d69ec16a665e8924c0cc3271658228b.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/66/e866a0d7aa28d0f3d11b71ff44fca61a/pa/PK36389_0d69ec16a665e8924c0cc3271658228b.jpg not downloaded yet
2026-01-28 20:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fcd%252Fe1cd9ac9315909533fe538013abcce2c%252Fpa%252FAP23964_2d45ce36945f8558fbc3206587c72c12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_2d45ce36945f8558fbc3206587c72c12.jpg not downloaded yet
2026-01-28 20:03:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 697b49cf-5fb3-549c-8273-0f9f018d36a6 with identifier: XA03649
2026-01-28 20:03:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 697b49cf-5fb3-549c-8273-0f9f018d36a6 with identifier: XA03649
2026-01-28 20:03:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 697b49cf-5fb3-549c-8273-0f9f018d36a6 with identifier: XA03649 to the API
2026-01-28 20:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:03:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:03:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb7/b0/b7b02e96c39b384924bc3a112ccefa59/pa/XA03649_28f5afba35415327ccf8417b533350eb.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '0.9L',
 'engine_horse_power': 90,
 'expiration_date': '2026-01-29T16:07:28Z',
 'fuel_type': 'petrol',
 'id': '697b49cf-5fb3-549c-8273-0f9f018d36a6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XA03649',
 'listing': 'auction',
 'location': 'IT, Massa',
 'make': 'Smart',
 'model': 'fortwo',
 'odometer': 62761,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_697b49cf-5fb3-549c-8273-0f9f018d36a6/697b49cf-5fb3-549c-8273-0f9f018d36a6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3066489,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/b0/b7b02e96c39b384924bc3a112ccefa59/pa/XA03649_fa7cc1e0a4da47458db42338eab51fa9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_697b49cf-5fb3-549c-8273-0f9f018d36a6/697b49cf-5fb3-549c-8273-0f9f018d36a6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3168815,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/b0/b7b02e96c39b384924bc3a112ccefa59/pa/XA03649_7dfcec7dfc8453cffca2a78346e28f61.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_697b49cf-5fb3-549c-8273-0f9f018d36a6/697b49cf-5fb3-549c-8273-0f9f018d36a6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85612,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/b0/b7b02e96c39b384924bc3a112ccefa59/pa/XA03649_1370c01c2f746c0a236fb44513fe5a74.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_697b49cf-5fb3-549c-8273-0f9f018d36a6/697b49cf-5fb3-549c-8273-0f9f018d36a6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2602673,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/b0/b7b02e96c39b384924bc3a112ccefa59/pa/XA03649_4371229e52ee59563fb84f4a8e5c2e0d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_697b49cf-5fb3-549c-8273-0f9f018d36a6/697b49cf-5fb3-549c-8273-0f9f018d36a6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89865,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/b0/b7b02e96c39b384924bc3a112ccefa59/pa/XA03649_e2abe59c7c12cfff409aef46f360f0b7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_697b49cf-5fb3-549c-8273-0f9f018d36a6/697b49cf-5fb3-549c-8273-0f9f018d36a6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83481,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/b0/b7b02e96c39b384924bc3a112ccefa59/pa/XA03649_ed3fd0e90813ea245401dbe0846ba69e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_697b49cf-5fb3-549c-8273-0f9f018d36a6/697b49cf-5fb3-549c-8273-0f9f018d36a6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2450991,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/b0/b7b02e96c39b384924bc3a112ccefa59/pa/XA03649_28f5afba35415327ccf8417b533350eb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_697b49cf-5fb3-549c-8273-0f9f018d36a6/697b49cf-5fb3-549c-8273-0f9f018d36a6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102249,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/b0/b7b02e96c39b384924bc3a112ccefa59/pa/XA03649_9ffc276f10aba3175daa1d42b46b0747.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_697b49cf-5fb3-549c-8273-0f9f018d36a6/697b49cf-5fb3-549c-8273-0f9f018d36a6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3078344,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/b0/b7b02e96c39b384924bc3a112ccefa59/pa/XA03649_ba59089503a83c2b7b3ccf3a6b272809.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_697b49cf-5fb3-549c-8273-0f9f018d36a6/697b49cf-5fb3-549c-8273-0f9f018d36a6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3414015,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/b0/b7b02e96c39b384924bc3a112ccefa59/pa/XA03649_488603456a39ac5949e78e063b17fa15.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_697b49cf-5fb3-549c-8273-0f9f018d36a6/697b49cf-5fb3-549c-8273-0f9f018d36a6_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73708,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/b0/b7b02e96c39b384924bc3a112ccefa59/pa/XA03649_c09244ecb4d5d91c1f5b1e57926f3d6b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_697b49cf-5fb3-549c-8273-0f9f018d36a6/697b49cf-5fb3-549c-8273-0f9f018d36a6_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73606,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/b0/b7b02e96c39b384924bc3a112ccefa59/pa/XA03649_1579007b7431221b8d962d78d2259cc3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_697b49cf-5fb3-549c-8273-0f9f018d36a6/697b49cf-5fb3-549c-8273-0f9f018d36a6_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75244,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/b0/b7b02e96c39b384924bc3a112ccefa59/pa/XA03649_858a92446090fd6e6d41fd51857126dc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_697b49cf-5fb3-549c-8273-0f9f018d36a6/697b49cf-5fb3-549c-8273-0f9f018d36a6_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2693474,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/b0/b7b02e96c39b384924bc3a112ccefa59/pa/XA03649_8236e8ec8c8e5d43cb83b119782d5517.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_697b49cf-5fb3-549c-8273-0f9f018d36a6/697b49cf-5fb3-549c-8273-0f9f018d36a6_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81858,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/b0/b7b02e96c39b384924bc3a112ccefa59/pa/XA03649_e3b1d647392644f3ad79b915154fc1d1.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-09-13',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Smart fortwo 0.9 Turbo Basis Prime',
 'transmission': 'automatic',
 'trim': 'Basis Prime',
 'year': 2018}
2026-01-28 20:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XA03649%27 HTTP/1.1" 200 None
2026-01-28 20:03:55 [auto1.it] INFO: Saving data for XA03649: {'created_time': 1769630635.529938, 'last_price_update_time': 1769630635.529948, 'auction_closing_time': 1769702848.0}
2026-01-28 20:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XA03649') HTTP/1.1" 204 0
2026-01-28 20:03:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/e4/2de443a529edfde728e09f1928d64710/pa/XP18402_37c4b6ca0707c1627abbbfefdf544ac1.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/9b/5e9bd9af10ddf07ad6df01859299cca1/pa/XX61742_d631ad4c3e3620b6432a89e006bcdece.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F8a%252F348a3e75b70a5c6a5a857ba46d5af98e%252Fpa%252FCU51863_165b5ec0b42a04f4246e985e404d4f03.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/8a/348a3e75b70a5c6a5a857ba46d5af98e/pa/CU51863_165b5ec0b42a04f4246e985e404d4f03.jpg not downloaded yet
2026-01-28 20:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F5a%252F765a4222ce3836b6ffd97e3f1f7b8262%252Fpa%252FJD87332_f670f9d30e733118991a231063875eff.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/5a/765a4222ce3836b6ffd97e3f1f7b8262/pa/JD87332_f670f9d30e733118991a231063875eff.jpg not downloaded yet
2026-01-28 20:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F4f%252F2a4f612bbbd4f1ec36b60172f241997f%252Fpa%252FSR88948_11a16b9e30d91c870ed08becd57fa784.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/4f/2a4f612bbbd4f1ec36b60172f241997f/pa/SR88948_11a16b9e30d91c870ed08becd57fa784.jpg not downloaded yet
2026-01-28 20:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fce%252Fe7ce544553ed0429a1b886b86fc834cb%252Fpa%252FZX31921_aed1ba9fe0e2bd60e56a0ee7f316b3bf.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/ce/e7ce544553ed0429a1b886b86fc834cb/pa/ZX31921_aed1ba9fe0e2bd60e56a0ee7f316b3bf.jpg not downloaded yet
2026-01-28 20:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F66%252Fe866a0d7aa28d0f3d11b71ff44fca61a%252Fpa%252FPK36389_dc2432da1b706ce2d1abe939f60ef9ac.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/66/e866a0d7aa28d0f3d11b71ff44fca61a/pa/PK36389_dc2432da1b706ce2d1abe939f60ef9ac.jpg not downloaded yet
2026-01-28 20:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fcd%252Fe1cd9ac9315909533fe538013abcce2c%252Fpa%252FAP23964_bbebc8ef77ef386983b53484989b5303.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_bbebc8ef77ef386983b53484989b5303.jpg not downloaded yet
2026-01-28 20:03:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09f14910>
2026-01-28 20:03:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0218895-008c-5901-8d81-495dcbc7bbb2/c0218895-008c-5901-8d81-495dcbc7bbb2_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Fa4%252F57a41f04407b77fc18110f7a3d1df06f%252Fpa%252FJY56965_a97f767950fb9ad23f155fd5cdd90801.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/a4/57a41f04407b77fc18110f7a3d1df06f/pa/JY56965_a97f767950fb9ad23f155fd5cdd90801.jpg saved to cache
2026-01-28 20:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item c0218895-008c-5901-8d81-495dcbc7bbb2
2026-01-28 20:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F8a%252F348a3e75b70a5c6a5a857ba46d5af98e%252Fpa%252FCU51863_ad929bb1bb000021b7e323c553fd314f.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/8a/348a3e75b70a5c6a5a857ba46d5af98e/pa/CU51863_ad929bb1bb000021b7e323c553fd314f.jpg not downloaded yet
2026-01-28 20:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F5a%252F765a4222ce3836b6ffd97e3f1f7b8262%252Fpa%252FJD87332_d0f80bdcad2d578b123e6b0df42934d0.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/5a/765a4222ce3836b6ffd97e3f1f7b8262/pa/JD87332_d0f80bdcad2d578b123e6b0df42934d0.jpg not downloaded yet
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F4f%252F2a4f612bbbd4f1ec36b60172f241997f%252Fpa%252FSR88948_cc6e98f398292dd8b852eb077e6c7200.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/4f/2a4f612bbbd4f1ec36b60172f241997f/pa/SR88948_cc6e98f398292dd8b852eb077e6c7200.jpg not downloaded yet
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fce%252Fe7ce544553ed0429a1b886b86fc834cb%252Fpa%252FZX31921_0c730c50957a08c7806c16bb4c4f76f7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/ce/e7ce544553ed0429a1b886b86fc834cb/pa/ZX31921_0c730c50957a08c7806c16bb4c4f76f7.jpg not downloaded yet
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F66%252Fe866a0d7aa28d0f3d11b71ff44fca61a%252Fpa%252FPK36389_b87ac79c938797621b0865ba271efba2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/66/e866a0d7aa28d0f3d11b71ff44fca61a/pa/PK36389_b87ac79c938797621b0865ba271efba2.jpg not downloaded yet
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fcd%252Fe1cd9ac9315909533fe538013abcce2c%252Fpa%252FAP23964_6d6fbc23f3952d6a00b7d0c7dd932974.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_6d6fbc23f3952d6a00b7d0c7dd932974.jpg not downloaded yet
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F8a%252F348a3e75b70a5c6a5a857ba46d5af98e%252Fpa%252FCU51863_f73cf4f1a1e1ccbbbdd32f13eab40886.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/8a/348a3e75b70a5c6a5a857ba46d5af98e/pa/CU51863_f73cf4f1a1e1ccbbbdd32f13eab40886.jpg not downloaded yet
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F5a%252F765a4222ce3836b6ffd97e3f1f7b8262%252Fpa%252FJD87332_3f2681b19e5d4c494ae3caa57ca9f6d9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/5a/765a4222ce3836b6ffd97e3f1f7b8262/pa/JD87332_3f2681b19e5d4c494ae3caa57ca9f6d9.jpg not downloaded yet
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F4f%252F2a4f612bbbd4f1ec36b60172f241997f%252Fpa%252FSR88948_32723fa1e81da71c2c7621ae88d2b682.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/4f/2a4f612bbbd4f1ec36b60172f241997f/pa/SR88948_32723fa1e81da71c2c7621ae88d2b682.jpg not downloaded yet
2026-01-28 20:03:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08c05b50>
2026-01-28 20:03:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa8f0b27-091b-5c48-a778-9f0012ab28b2/fa8f0b27-091b-5c48-a778-9f0012ab28b2_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252Fe4%252F2de443a529edfde728e09f1928d64710%252Fpa%252FXP18402_37c4b6ca0707c1627abbbfefdf544ac1.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/e4/2de443a529edfde728e09f1928d64710/pa/XP18402_37c4b6ca0707c1627abbbfefdf544ac1.jpg saved to cache
2026-01-28 20:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item fa8f0b27-091b-5c48-a778-9f0012ab28b2
2026-01-28 20:03:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0a030950>
2026-01-28 20:03:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4d9f98b-ae16-55ce-83a2-f5c7c8a02d91/a4d9f98b-ae16-55ce-83a2-f5c7c8a02d91_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F9b%252F5e9bd9af10ddf07ad6df01859299cca1%252Fpa%252FXX61742_d631ad4c3e3620b6432a89e006bcdece.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/9b/5e9bd9af10ddf07ad6df01859299cca1/pa/XX61742_d631ad4c3e3620b6432a89e006bcdece.jpg saved to cache
2026-01-28 20:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item a4d9f98b-ae16-55ce-83a2-f5c7c8a02d91
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fce%252Fe7ce544553ed0429a1b886b86fc834cb%252Fpa%252FZX31921_18d8aa392503eb26e86c68538aa15095.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/ce/e7ce544553ed0429a1b886b86fc834cb/pa/ZX31921_18d8aa392503eb26e86c68538aa15095.jpg not downloaded yet
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F66%252Fe866a0d7aa28d0f3d11b71ff44fca61a%252Fpa%252FPK36389_b1c3d78350a1703d72d95c7c9bbfa43d.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/66/e866a0d7aa28d0f3d11b71ff44fca61a/pa/PK36389_b1c3d78350a1703d72d95c7c9bbfa43d.jpg not downloaded yet
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fcd%252Fe1cd9ac9315909533fe538013abcce2c%252Fpa%252FAP23964_8d846dc50d6c794d3db0af8a1581db78.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_8d846dc50d6c794d3db0af8a1581db78.jpg not downloaded yet
2026-01-28 20:03:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/4f/2a4f612bbbd4f1ec36b60172f241997f/pa/SR88948_fe5b61932c8befb2ec4d09cb6879197d.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/4f/2a4f612bbbd4f1ec36b60172f241997f/pa/SR88948_42993d47f2209fb0fa6fb767e5cb1b0e.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F4f%252F2a4f612bbbd4f1ec36b60172f241997f%252Fpa%252FSR88948_107474e021cb7b3d20d9a6b222996521.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/4f/2a4f612bbbd4f1ec36b60172f241997f/pa/SR88948_107474e021cb7b3d20d9a6b222996521.jpg not downloaded yet
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fce%252Fe7ce544553ed0429a1b886b86fc834cb%252Fpa%252FZX31921_61e71c22188c1fe5145e269d86fbd618.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/ce/e7ce544553ed0429a1b886b86fc834cb/pa/ZX31921_61e71c22188c1fe5145e269d86fbd618.jpg not downloaded yet
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F66%252Fe866a0d7aa28d0f3d11b71ff44fca61a%252Fpa%252FPK36389_b282f6fc5758a8bcbd00cab057bfe354.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/66/e866a0d7aa28d0f3d11b71ff44fca61a/pa/PK36389_b282f6fc5758a8bcbd00cab057bfe354.jpg not downloaded yet
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fcd%252Fe1cd9ac9315909533fe538013abcce2c%252Fpa%252FAP23964_47ad87d234cffd1af9a4b3aaddb0c85f.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_47ad87d234cffd1af9a4b3aaddb0c85f.jpg not downloaded yet
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F4f%252F2a4f612bbbd4f1ec36b60172f241997f%252Fpa%252FSR88948_1df7f4b439cf76feffd684a8395331ff.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/4f/2a4f612bbbd4f1ec36b60172f241997f/pa/SR88948_1df7f4b439cf76feffd684a8395331ff.jpg not downloaded yet
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fce%252Fe7ce544553ed0429a1b886b86fc834cb%252Fpa%252FZX31921_ca7313e5807e7c634ab5990bd39edb3b.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/ce/e7ce544553ed0429a1b886b86fc834cb/pa/ZX31921_ca7313e5807e7c634ab5990bd39edb3b.jpg not downloaded yet
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F66%252Fe866a0d7aa28d0f3d11b71ff44fca61a%252Fpa%252FPK36389_4432e27a7efc2bc3d832829c7dd5f926.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/66/e866a0d7aa28d0f3d11b71ff44fca61a/pa/PK36389_4432e27a7efc2bc3d832829c7dd5f926.jpg not downloaded yet
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fcd%252Fe1cd9ac9315909533fe538013abcce2c%252Fpa%252FAP23964_ca48c3a9546739a460dafda9b705f1b8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_ca48c3a9546739a460dafda9b705f1b8.jpg not downloaded yet
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fce%252Fe7ce544553ed0429a1b886b86fc834cb%252Fpa%252FZX31921_32a833fa6580fcc7517b8710ddff0de3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/ce/e7ce544553ed0429a1b886b86fc834cb/pa/ZX31921_32a833fa6580fcc7517b8710ddff0de3.jpg not downloaded yet
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F66%252Fe866a0d7aa28d0f3d11b71ff44fca61a%252Fpa%252FPK36389_8825d1fd4d031e1d52a5907d5b058b86.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/66/e866a0d7aa28d0f3d11b71ff44fca61a/pa/PK36389_8825d1fd4d031e1d52a5907d5b058b86.jpg not downloaded yet
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fcd%252Fe1cd9ac9315909533fe538013abcce2c%252Fpa%252FAP23964_5de68c96405fe5aade269215daaa031d.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_5de68c96405fe5aade269215daaa031d.jpg not downloaded yet
2026-01-28 20:03:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/5a/765a4222ce3836b6ffd97e3f1f7b8262/pa/JD87332_638dbae7eccab166cabb66508b8fc166.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fce%252Fe7ce544553ed0429a1b886b86fc834cb%252Fpa%252FZX31921_ed899fdf4a5155d1a331557a0a1685ef.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/ce/e7ce544553ed0429a1b886b86fc834cb/pa/ZX31921_ed899fdf4a5155d1a331557a0a1685ef.jpg not downloaded yet
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F66%252Fe866a0d7aa28d0f3d11b71ff44fca61a%252Fpa%252FPK36389_b9440188f1c6a92e712bb14ecf9a8546.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/66/e866a0d7aa28d0f3d11b71ff44fca61a/pa/PK36389_b9440188f1c6a92e712bb14ecf9a8546.jpg not downloaded yet
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fcd%252Fe1cd9ac9315909533fe538013abcce2c%252Fpa%252FAP23964_a08394dffa90447ed22cd79295822388.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_a08394dffa90447ed22cd79295822388.jpg not downloaded yet
2026-01-28 20:03:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09f57590>
2026-01-28 20:03:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:03:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e511f1b-7d74-5878-80ad-55a38cd3a30f/4e511f1b-7d74-5878-80ad-55a38cd3a30f_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F4f%252F2a4f612bbbd4f1ec36b60172f241997f%252Fpa%252FSR88948_fe5b61932c8befb2ec4d09cb6879197d.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/4f/2a4f612bbbd4f1ec36b60172f241997f/pa/SR88948_fe5b61932c8befb2ec4d09cb6879197d.jpg saved to cache
2026-01-28 20:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4e511f1b-7d74-5878-80ad-55a38cd3a30f
2026-01-28 20:03:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b086fb210>
2026-01-28 20:03:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e511f1b-7d74-5878-80ad-55a38cd3a30f/4e511f1b-7d74-5878-80ad-55a38cd3a30f_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F4f%252F2a4f612bbbd4f1ec36b60172f241997f%252Fpa%252FSR88948_42993d47f2209fb0fa6fb767e5cb1b0e.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/4f/2a4f612bbbd4f1ec36b60172f241997f/pa/SR88948_42993d47f2209fb0fa6fb767e5cb1b0e.jpg saved to cache
2026-01-28 20:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4e511f1b-7d74-5878-80ad-55a38cd3a30f
2026-01-28 20:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_35e16d4013f8467ea4298938c29860aa.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fce%252Fe7ce544553ed0429a1b886b86fc834cb%252Fpa%252FZX31921_60176a80929102600fcd2304eea8f636.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/ce/e7ce544553ed0429a1b886b86fc834cb/pa/ZX31921_60176a80929102600fcd2304eea8f636.jpg not downloaded yet
2026-01-28 20:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F66%252Fe866a0d7aa28d0f3d11b71ff44fca61a%252Fpa%252FPK36389_369aeebc8ccd5bdb0635883ad4abb107.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/66/e866a0d7aa28d0f3d11b71ff44fca61a/pa/PK36389_369aeebc8ccd5bdb0635883ad4abb107.jpg not downloaded yet
2026-01-28 20:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fcd%252Fe1cd9ac9315909533fe538013abcce2c%252Fpa%252FAP23964_f73be4b5a7af3020ee4e5d66417fb9b2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_f73be4b5a7af3020ee4e5d66417fb9b2.jpg not downloaded yet
2026-01-28 20:03:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0be2aad0>
2026-01-28 20:03:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:03:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0ca04ca-1890-54cc-80be-2205a411ef7d/f0ca04ca-1890-54cc-80be-2205a411ef7d_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F5a%252F765a4222ce3836b6ffd97e3f1f7b8262%252Fpa%252FJD87332_638dbae7eccab166cabb66508b8fc166.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/5a/765a4222ce3836b6ffd97e3f1f7b8262/pa/JD87332_638dbae7eccab166cabb66508b8fc166.jpg saved to cache
2026-01-28 20:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f0ca04ca-1890-54cc-80be-2205a411ef7d
2026-01-28 20:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_35517d133c1cb1491101acbbd58b0594.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_8ce46dfeed916921c4d6d36dca4dd68d.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0873e510>
2026-01-28 20:03:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:03:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6852bac-9c4b-5809-b41f-da869669d056/d6852bac-9c4b-5809-b41f-da869669d056_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fcd%252Fe1cd9ac9315909533fe538013abcce2c%252Fpa%252FAP23964_35e16d4013f8467ea4298938c29860aa.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_35e16d4013f8467ea4298938c29860aa.jpg saved to cache
2026-01-28 20:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d6852bac-9c4b-5809-b41f-da869669d056
2026-01-28 20:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/5a/765a4222ce3836b6ffd97e3f1f7b8262/pa/JD87332_0d2f7d1b698eb3f511c2edd0667f9c03.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/5a/765a4222ce3836b6ffd97e3f1f7b8262/pa/JD87332_886f2b90087af7e652496f05f6513cdb.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/5a/765a4222ce3836b6ffd97e3f1f7b8262/pa/JD87332_3efa8f3484bc87f6700c9f37ba27ca2a.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/66/e866a0d7aa28d0f3d11b71ff44fca61a/pa/PK36389_6bca44bc35ec2370bb953e800dde7024.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/5a/765a4222ce3836b6ffd97e3f1f7b8262/pa/JD87332_f6c4db9de265839aa03d9788a8e4ac6d.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b089bbd90>
2026-01-28 20:03:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:03:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6852bac-9c4b-5809-b41f-da869669d056/d6852bac-9c4b-5809-b41f-da869669d056_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fcd%252Fe1cd9ac9315909533fe538013abcce2c%252Fpa%252FAP23964_35517d133c1cb1491101acbbd58b0594.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_35517d133c1cb1491101acbbd58b0594.jpg saved to cache
2026-01-28 20:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d6852bac-9c4b-5809-b41f-da869669d056
2026-01-28 20:03:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08c1b1d0>
2026-01-28 20:03:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6852bac-9c4b-5809-b41f-da869669d056/d6852bac-9c4b-5809-b41f-da869669d056_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fcd%252Fe1cd9ac9315909533fe538013abcce2c%252Fpa%252FAP23964_8ce46dfeed916921c4d6d36dca4dd68d.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_8ce46dfeed916921c4d6d36dca4dd68d.jpg saved to cache
2026-01-28 20:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d6852bac-9c4b-5809-b41f-da869669d056
2026-01-28 20:03:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/5a/765a4222ce3836b6ffd97e3f1f7b8262/pa/JD87332_3f2681b19e5d4c494ae3caa57ca9f6d9.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/4f/2a4f612bbbd4f1ec36b60172f241997f/pa/SR88948_32723fa1e81da71c2c7621ae88d2b682.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/66/e866a0d7aa28d0f3d11b71ff44fca61a/pa/PK36389_0d69ec16a665e8924c0cc3271658228b.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/4f/2a4f612bbbd4f1ec36b60172f241997f/pa/SR88948_b282a3a14074be21e01534c08843cc0c.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/9b/5e9bd9af10ddf07ad6df01859299cca1/pa/XX61742_11e21e770c31bbb819199e42b5f791e8.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:03:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:03:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0a0321d0>
2026-01-28 20:03:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:03:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0ca04ca-1890-54cc-80be-2205a411ef7d/f0ca04ca-1890-54cc-80be-2205a411ef7d_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F5a%252F765a4222ce3836b6ffd97e3f1f7b8262%252Fpa%252FJD87332_0d2f7d1b698eb3f511c2edd0667f9c03.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/5a/765a4222ce3836b6ffd97e3f1f7b8262/pa/JD87332_0d2f7d1b698eb3f511c2edd0667f9c03.jpg saved to cache
2026-01-28 20:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f0ca04ca-1890-54cc-80be-2205a411ef7d
2026-01-28 20:03:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:03:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09dc5c90>
2026-01-28 20:03:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0ca04ca-1890-54cc-80be-2205a411ef7d/f0ca04ca-1890-54cc-80be-2205a411ef7d_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F5a%252F765a4222ce3836b6ffd97e3f1f7b8262%252Fpa%252FJD87332_886f2b90087af7e652496f05f6513cdb.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/5a/765a4222ce3836b6ffd97e3f1f7b8262/pa/JD87332_886f2b90087af7e652496f05f6513cdb.jpg saved to cache
2026-01-28 20:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f0ca04ca-1890-54cc-80be-2205a411ef7d
2026-01-28 20:03:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:03:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08b95c10>
2026-01-28 20:03:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:04:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0ca04ca-1890-54cc-80be-2205a411ef7d/f0ca04ca-1890-54cc-80be-2205a411ef7d_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F5a%252F765a4222ce3836b6ffd97e3f1f7b8262%252Fpa%252FJD87332_3efa8f3484bc87f6700c9f37ba27ca2a.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/5a/765a4222ce3836b6ffd97e3f1f7b8262/pa/JD87332_3efa8f3484bc87f6700c9f37ba27ca2a.jpg saved to cache
2026-01-28 20:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f0ca04ca-1890-54cc-80be-2205a411ef7d
2026-01-28 20:04:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09ea8810>
2026-01-28 20:04:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:04:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a287b3ca-f16d-5078-9162-132368cf1cbf/a287b3ca-f16d-5078-9162-132368cf1cbf_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F66%252Fe866a0d7aa28d0f3d11b71ff44fca61a%252Fpa%252FPK36389_6bca44bc35ec2370bb953e800dde7024.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/66/e866a0d7aa28d0f3d11b71ff44fca61a/pa/PK36389_6bca44bc35ec2370bb953e800dde7024.jpg saved to cache
2026-01-28 20:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a287b3ca-f16d-5078-9162-132368cf1cbf
2026-01-28 20:04:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:04:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09e47610>
2026-01-28 20:04:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:04:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0ca04ca-1890-54cc-80be-2205a411ef7d/f0ca04ca-1890-54cc-80be-2205a411ef7d_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F5a%252F765a4222ce3836b6ffd97e3f1f7b8262%252Fpa%252FJD87332_f6c4db9de265839aa03d9788a8e4ac6d.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/5a/765a4222ce3836b6ffd97e3f1f7b8262/pa/JD87332_f6c4db9de265839aa03d9788a8e4ac6d.jpg saved to cache
2026-01-28 20:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f0ca04ca-1890-54cc-80be-2205a411ef7d
2026-01-28 20:04:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_5de68c96405fe5aade269215daaa031d.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_a08394dffa90447ed22cd79295822388.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b086f96d0>
2026-01-28 20:04:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0ca04ca-1890-54cc-80be-2205a411ef7d/f0ca04ca-1890-54cc-80be-2205a411ef7d_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F5a%252F765a4222ce3836b6ffd97e3f1f7b8262%252Fpa%252FJD87332_3f2681b19e5d4c494ae3caa57ca9f6d9.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/5a/765a4222ce3836b6ffd97e3f1f7b8262/pa/JD87332_3f2681b19e5d4c494ae3caa57ca9f6d9.jpg saved to cache
2026-01-28 20:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item f0ca04ca-1890-54cc-80be-2205a411ef7d
2026-01-28 20:04:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0a0cd650>
2026-01-28 20:04:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e511f1b-7d74-5878-80ad-55a38cd3a30f/4e511f1b-7d74-5878-80ad-55a38cd3a30f_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F4f%252F2a4f612bbbd4f1ec36b60172f241997f%252Fpa%252FSR88948_32723fa1e81da71c2c7621ae88d2b682.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/4f/2a4f612bbbd4f1ec36b60172f241997f/pa/SR88948_32723fa1e81da71c2c7621ae88d2b682.jpg saved to cache
2026-01-28 20:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 4e511f1b-7d74-5878-80ad-55a38cd3a30f
2026-01-28 20:04:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09de7210>
2026-01-28 20:04:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a287b3ca-f16d-5078-9162-132368cf1cbf/a287b3ca-f16d-5078-9162-132368cf1cbf_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F66%252Fe866a0d7aa28d0f3d11b71ff44fca61a%252Fpa%252FPK36389_0d69ec16a665e8924c0cc3271658228b.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/66/e866a0d7aa28d0f3d11b71ff44fca61a/pa/PK36389_0d69ec16a665e8924c0cc3271658228b.jpg saved to cache
2026-01-28 20:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a287b3ca-f16d-5078-9162-132368cf1cbf
2026-01-28 20:04:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0a0cdb90>
2026-01-28 20:04:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:04:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e511f1b-7d74-5878-80ad-55a38cd3a30f/4e511f1b-7d74-5878-80ad-55a38cd3a30f_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F4f%252F2a4f612bbbd4f1ec36b60172f241997f%252Fpa%252FSR88948_b282a3a14074be21e01534c08843cc0c.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/4f/2a4f612bbbd4f1ec36b60172f241997f/pa/SR88948_b282a3a14074be21e01534c08843cc0c.jpg saved to cache
2026-01-28 20:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4e511f1b-7d74-5878-80ad-55a38cd3a30f
2026-01-28 20:04:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:04:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09dfb2d0>
2026-01-28 20:04:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:04:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4d9f98b-ae16-55ce-83a2-f5c7c8a02d91/a4d9f98b-ae16-55ce-83a2-f5c7c8a02d91_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F9b%252F5e9bd9af10ddf07ad6df01859299cca1%252Fpa%252FXX61742_11e21e770c31bbb819199e42b5f791e8.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/9b/5e9bd9af10ddf07ad6df01859299cca1/pa/XX61742_11e21e770c31bbb819199e42b5f791e8.jpg saved to cache
2026-01-28 20:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item a4d9f98b-ae16-55ce-83a2-f5c7c8a02d91
2026-01-28 20:04:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/66/e866a0d7aa28d0f3d11b71ff44fca61a/pa/PK36389_369aeebc8ccd5bdb0635883ad4abb107.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_f73be4b5a7af3020ee4e5d66417fb9b2.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/66/e866a0d7aa28d0f3d11b71ff44fca61a/pa/PK36389_b9440188f1c6a92e712bb14ecf9a8546.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/ce/e7ce544553ed0429a1b886b86fc834cb/pa/ZX31921_ed899fdf4a5155d1a331557a0a1685ef.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/ce/e7ce544553ed0429a1b886b86fc834cb/pa/ZX31921_60176a80929102600fcd2304eea8f636.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/66/e866a0d7aa28d0f3d11b71ff44fca61a/pa/PK36389_8825d1fd4d031e1d52a5907d5b058b86.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/4f/2a4f612bbbd4f1ec36b60172f241997f/pa/SR88948_b8fa73bb64c9ef56d02a8fd8288d0896.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0a0eba50>
2026-01-28 20:04:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:04:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6852bac-9c4b-5809-b41f-da869669d056/d6852bac-9c4b-5809-b41f-da869669d056_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fcd%252Fe1cd9ac9315909533fe538013abcce2c%252Fpa%252FAP23964_5de68c96405fe5aade269215daaa031d.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_5de68c96405fe5aade269215daaa031d.jpg saved to cache
2026-01-28 20:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item d6852bac-9c4b-5809-b41f-da869669d056
2026-01-28 20:04:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08c1a610>
2026-01-28 20:04:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:04:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6852bac-9c4b-5809-b41f-da869669d056/d6852bac-9c4b-5809-b41f-da869669d056_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fcd%252Fe1cd9ac9315909533fe538013abcce2c%252Fpa%252FAP23964_a08394dffa90447ed22cd79295822388.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_a08394dffa90447ed22cd79295822388.jpg saved to cache
2026-01-28 20:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item d6852bac-9c4b-5809-b41f-da869669d056
2026-01-28 20:04:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/ce/e7ce544553ed0429a1b886b86fc834cb/pa/ZX31921_32a833fa6580fcc7517b8710ddff0de3.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/66/e866a0d7aa28d0f3d11b71ff44fca61a/pa/PK36389_4432e27a7efc2bc3d832829c7dd5f926.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09eee110>
2026-01-28 20:04:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a287b3ca-f16d-5078-9162-132368cf1cbf/a287b3ca-f16d-5078-9162-132368cf1cbf_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F66%252Fe866a0d7aa28d0f3d11b71ff44fca61a%252Fpa%252FPK36389_369aeebc8ccd5bdb0635883ad4abb107.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/66/e866a0d7aa28d0f3d11b71ff44fca61a/pa/PK36389_369aeebc8ccd5bdb0635883ad4abb107.jpg saved to cache
2026-01-28 20:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item a287b3ca-f16d-5078-9162-132368cf1cbf
2026-01-28 20:04:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08b26c10>
2026-01-28 20:04:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:04:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6852bac-9c4b-5809-b41f-da869669d056/d6852bac-9c4b-5809-b41f-da869669d056_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fcd%252Fe1cd9ac9315909533fe538013abcce2c%252Fpa%252FAP23964_f73be4b5a7af3020ee4e5d66417fb9b2.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_f73be4b5a7af3020ee4e5d66417fb9b2.jpg saved to cache
2026-01-28 20:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item d6852bac-9c4b-5809-b41f-da869669d056
2026-01-28 20:04:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b086e09d0>
2026-01-28 20:04:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a287b3ca-f16d-5078-9162-132368cf1cbf/a287b3ca-f16d-5078-9162-132368cf1cbf_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F66%252Fe866a0d7aa28d0f3d11b71ff44fca61a%252Fpa%252FPK36389_b9440188f1c6a92e712bb14ecf9a8546.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/66/e866a0d7aa28d0f3d11b71ff44fca61a/pa/PK36389_b9440188f1c6a92e712bb14ecf9a8546.jpg saved to cache
2026-01-28 20:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item a287b3ca-f16d-5078-9162-132368cf1cbf
2026-01-28 20:04:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09eeed50>
2026-01-28 20:04:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a68fae47-969d-5ba4-b17d-2758a3bcdfdb/a68fae47-969d-5ba4-b17d-2758a3bcdfdb_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fce%252Fe7ce544553ed0429a1b886b86fc834cb%252Fpa%252FZX31921_ed899fdf4a5155d1a331557a0a1685ef.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/ce/e7ce544553ed0429a1b886b86fc834cb/pa/ZX31921_ed899fdf4a5155d1a331557a0a1685ef.jpg saved to cache
2026-01-28 20:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item a68fae47-969d-5ba4-b17d-2758a3bcdfdb
2026-01-28 20:04:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0899ee10>
2026-01-28 20:04:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:04:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a68fae47-969d-5ba4-b17d-2758a3bcdfdb/a68fae47-969d-5ba4-b17d-2758a3bcdfdb_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fce%252Fe7ce544553ed0429a1b886b86fc834cb%252Fpa%252FZX31921_60176a80929102600fcd2304eea8f636.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/ce/e7ce544553ed0429a1b886b86fc834cb/pa/ZX31921_60176a80929102600fcd2304eea8f636.jpg saved to cache
2026-01-28 20:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item a68fae47-969d-5ba4-b17d-2758a3bcdfdb
2026-01-28 20:04:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0871c610>
2026-01-28 20:04:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:04:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a287b3ca-f16d-5078-9162-132368cf1cbf/a287b3ca-f16d-5078-9162-132368cf1cbf_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F66%252Fe866a0d7aa28d0f3d11b71ff44fca61a%252Fpa%252FPK36389_8825d1fd4d031e1d52a5907d5b058b86.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/66/e866a0d7aa28d0f3d11b71ff44fca61a/pa/PK36389_8825d1fd4d031e1d52a5907d5b058b86.jpg saved to cache
2026-01-28 20:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item a287b3ca-f16d-5078-9162-132368cf1cbf
2026-01-28 20:04:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:04:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08b084d0>
2026-01-28 20:04:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:04:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e511f1b-7d74-5878-80ad-55a38cd3a30f/4e511f1b-7d74-5878-80ad-55a38cd3a30f_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F4f%252F2a4f612bbbd4f1ec36b60172f241997f%252Fpa%252FSR88948_b8fa73bb64c9ef56d02a8fd8288d0896.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/4f/2a4f612bbbd4f1ec36b60172f241997f/pa/SR88948_b8fa73bb64c9ef56d02a8fd8288d0896.jpg saved to cache
2026-01-28 20:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4e511f1b-7d74-5878-80ad-55a38cd3a30f
2026-01-28 20:04:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/ce/e7ce544553ed0429a1b886b86fc834cb/pa/ZX31921_61e71c22188c1fe5145e269d86fbd618.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/4f/2a4f612bbbd4f1ec36b60172f241997f/pa/SR88948_1df7f4b439cf76feffd684a8395331ff.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_47ad87d234cffd1af9a4b3aaddb0c85f.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/66/e866a0d7aa28d0f3d11b71ff44fca61a/pa/PK36389_b282f6fc5758a8bcbd00cab057bfe354.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0a0c1150>
2026-01-28 20:04:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a68fae47-969d-5ba4-b17d-2758a3bcdfdb/a68fae47-969d-5ba4-b17d-2758a3bcdfdb_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fce%252Fe7ce544553ed0429a1b886b86fc834cb%252Fpa%252FZX31921_32a833fa6580fcc7517b8710ddff0de3.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/ce/e7ce544553ed0429a1b886b86fc834cb/pa/ZX31921_32a833fa6580fcc7517b8710ddff0de3.jpg saved to cache
2026-01-28 20:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item a68fae47-969d-5ba4-b17d-2758a3bcdfdb
2026-01-28 20:04:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08b64f10>
2026-01-28 20:04:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a287b3ca-f16d-5078-9162-132368cf1cbf/a287b3ca-f16d-5078-9162-132368cf1cbf_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F66%252Fe866a0d7aa28d0f3d11b71ff44fca61a%252Fpa%252FPK36389_4432e27a7efc2bc3d832829c7dd5f926.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/66/e866a0d7aa28d0f3d11b71ff44fca61a/pa/PK36389_4432e27a7efc2bc3d832829c7dd5f926.jpg saved to cache
2026-01-28 20:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item a287b3ca-f16d-5078-9162-132368cf1cbf
2026-01-28 20:04:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/ce/e7ce544553ed0429a1b886b86fc834cb/pa/ZX31921_18d8aa392503eb26e86c68538aa15095.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08742750>
2026-01-28 20:04:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:04:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a68fae47-969d-5ba4-b17d-2758a3bcdfdb/a68fae47-969d-5ba4-b17d-2758a3bcdfdb_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fce%252Fe7ce544553ed0429a1b886b86fc834cb%252Fpa%252FZX31921_61e71c22188c1fe5145e269d86fbd618.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/ce/e7ce544553ed0429a1b886b86fc834cb/pa/ZX31921_61e71c22188c1fe5145e269d86fbd618.jpg saved to cache
2026-01-28 20:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item a68fae47-969d-5ba4-b17d-2758a3bcdfdb
2026-01-28 20:04:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08be6f90>
2026-01-28 20:04:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e511f1b-7d74-5878-80ad-55a38cd3a30f/4e511f1b-7d74-5878-80ad-55a38cd3a30f_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F4f%252F2a4f612bbbd4f1ec36b60172f241997f%252Fpa%252FSR88948_1df7f4b439cf76feffd684a8395331ff.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/4f/2a4f612bbbd4f1ec36b60172f241997f/pa/SR88948_1df7f4b439cf76feffd684a8395331ff.jpg saved to cache
2026-01-28 20:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 4e511f1b-7d74-5878-80ad-55a38cd3a30f
2026-01-28 20:04:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09d95bd0>
2026-01-28 20:04:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:04:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6852bac-9c4b-5809-b41f-da869669d056/d6852bac-9c4b-5809-b41f-da869669d056_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fcd%252Fe1cd9ac9315909533fe538013abcce2c%252Fpa%252FAP23964_47ad87d234cffd1af9a4b3aaddb0c85f.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_47ad87d234cffd1af9a4b3aaddb0c85f.jpg saved to cache
2026-01-28 20:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item d6852bac-9c4b-5809-b41f-da869669d056
2026-01-28 20:04:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0a0dde90>
2026-01-28 20:04:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:04:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a287b3ca-f16d-5078-9162-132368cf1cbf/a287b3ca-f16d-5078-9162-132368cf1cbf_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F66%252Fe866a0d7aa28d0f3d11b71ff44fca61a%252Fpa%252FPK36389_b282f6fc5758a8bcbd00cab057bfe354.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/66/e866a0d7aa28d0f3d11b71ff44fca61a/pa/PK36389_b282f6fc5758a8bcbd00cab057bfe354.jpg saved to cache
2026-01-28 20:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item a287b3ca-f16d-5078-9162-132368cf1cbf
2026-01-28 20:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/8a/348a3e75b70a5c6a5a857ba46d5af98e/pa/CU51863_f73cf4f1a1e1ccbbbdd32f13eab40886.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_6d6fbc23f3952d6a00b7d0c7dd932974.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0873ce50>
2026-01-28 20:04:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:04:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a68fae47-969d-5ba4-b17d-2758a3bcdfdb/a68fae47-969d-5ba4-b17d-2758a3bcdfdb_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fce%252Fe7ce544553ed0429a1b886b86fc834cb%252Fpa%252FZX31921_18d8aa392503eb26e86c68538aa15095.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/ce/e7ce544553ed0429a1b886b86fc834cb/pa/ZX31921_18d8aa392503eb26e86c68538aa15095.jpg saved to cache
2026-01-28 20:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a68fae47-969d-5ba4-b17d-2758a3bcdfdb
2026-01-28 20:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/66/e866a0d7aa28d0f3d11b71ff44fca61a/pa/PK36389_b87ac79c938797621b0865ba271efba2.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09fa41d0>
2026-01-28 20:04:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fc23a0d-7e51-556c-aa83-233656974dd8/1fc23a0d-7e51-556c-aa83-233656974dd8_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F8a%252F348a3e75b70a5c6a5a857ba46d5af98e%252Fpa%252FCU51863_f73cf4f1a1e1ccbbbdd32f13eab40886.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/8a/348a3e75b70a5c6a5a857ba46d5af98e/pa/CU51863_f73cf4f1a1e1ccbbbdd32f13eab40886.jpg saved to cache
2026-01-28 20:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 1fc23a0d-7e51-556c-aa83-233656974dd8
2026-01-28 20:04:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b089a2610>
2026-01-28 20:04:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6852bac-9c4b-5809-b41f-da869669d056/d6852bac-9c4b-5809-b41f-da869669d056_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fcd%252Fe1cd9ac9315909533fe538013abcce2c%252Fpa%252FAP23964_6d6fbc23f3952d6a00b7d0c7dd932974.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_6d6fbc23f3952d6a00b7d0c7dd932974.jpg saved to cache
2026-01-28 20:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d6852bac-9c4b-5809-b41f-da869669d056
2026-01-28 20:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_2d45ce36945f8558fbc3206587c72c12.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/ce/e7ce544553ed0429a1b886b86fc834cb/pa/ZX31921_0c730c50957a08c7806c16bb4c4f76f7.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0899f190>
2026-01-28 20:04:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:04:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a287b3ca-f16d-5078-9162-132368cf1cbf/a287b3ca-f16d-5078-9162-132368cf1cbf_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F66%252Fe866a0d7aa28d0f3d11b71ff44fca61a%252Fpa%252FPK36389_b87ac79c938797621b0865ba271efba2.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/66/e866a0d7aa28d0f3d11b71ff44fca61a/pa/PK36389_b87ac79c938797621b0865ba271efba2.jpg saved to cache
2026-01-28 20:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a287b3ca-f16d-5078-9162-132368cf1cbf
2026-01-28 20:04:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:04:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09d35690>
2026-01-28 20:04:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6852bac-9c4b-5809-b41f-da869669d056/d6852bac-9c4b-5809-b41f-da869669d056_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fcd%252Fe1cd9ac9315909533fe538013abcce2c%252Fpa%252FAP23964_2d45ce36945f8558fbc3206587c72c12.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_2d45ce36945f8558fbc3206587c72c12.jpg saved to cache
2026-01-28 20:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d6852bac-9c4b-5809-b41f-da869669d056
2026-01-28 20:04:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08b242d0>
2026-01-28 20:04:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:04:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a68fae47-969d-5ba4-b17d-2758a3bcdfdb/a68fae47-969d-5ba4-b17d-2758a3bcdfdb_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fce%252Fe7ce544553ed0429a1b886b86fc834cb%252Fpa%252FZX31921_0c730c50957a08c7806c16bb4c4f76f7.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/ce/e7ce544553ed0429a1b886b86fc834cb/pa/ZX31921_0c730c50957a08c7806c16bb4c4f76f7.jpg saved to cache
2026-01-28 20:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a68fae47-969d-5ba4-b17d-2758a3bcdfdb
2026-01-28 20:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/8a/348a3e75b70a5c6a5a857ba46d5af98e/pa/CU51863_ad929bb1bb000021b7e323c553fd314f.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_ca48c3a9546739a460dafda9b705f1b8.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_8d846dc50d6c794d3db0af8a1581db78.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/ce/e7ce544553ed0429a1b886b86fc834cb/pa/ZX31921_ca7313e5807e7c634ab5990bd39edb3b.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/4f/2a4f612bbbd4f1ec36b60172f241997f/pa/SR88948_107474e021cb7b3d20d9a6b222996521.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/66/e866a0d7aa28d0f3d11b71ff44fca61a/pa/PK36389_b1c3d78350a1703d72d95c7c9bbfa43d.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/4f/2a4f612bbbd4f1ec36b60172f241997f/pa/SR88948_cc6e98f398292dd8b852eb077e6c7200.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/4f/2a4f612bbbd4f1ec36b60172f241997f/pa/SR88948_11a16b9e30d91c870ed08becd57fa784.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09e17050>
2026-01-28 20:04:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:04:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fc23a0d-7e51-556c-aa83-233656974dd8/1fc23a0d-7e51-556c-aa83-233656974dd8_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F8a%252F348a3e75b70a5c6a5a857ba46d5af98e%252Fpa%252FCU51863_ad929bb1bb000021b7e323c553fd314f.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/8a/348a3e75b70a5c6a5a857ba46d5af98e/pa/CU51863_ad929bb1bb000021b7e323c553fd314f.jpg saved to cache
2026-01-28 20:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 1fc23a0d-7e51-556c-aa83-233656974dd8
2026-01-28 20:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/66/e866a0d7aa28d0f3d11b71ff44fca61a/pa/PK36389_dc2432da1b706ce2d1abe939f60ef9ac.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/5a/765a4222ce3836b6ffd97e3f1f7b8262/pa/JD87332_f670f9d30e733118991a231063875eff.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/8a/348a3e75b70a5c6a5a857ba46d5af98e/pa/CU51863_165b5ec0b42a04f4246e985e404d4f03.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_bbebc8ef77ef386983b53484989b5303.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:04:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08c07e50>
2026-01-28 20:04:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6852bac-9c4b-5809-b41f-da869669d056/d6852bac-9c4b-5809-b41f-da869669d056_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fcd%252Fe1cd9ac9315909533fe538013abcce2c%252Fpa%252FAP23964_ca48c3a9546739a460dafda9b705f1b8.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_ca48c3a9546739a460dafda9b705f1b8.jpg saved to cache
2026-01-28 20:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item d6852bac-9c4b-5809-b41f-da869669d056
2026-01-28 20:04:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:04:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09de6790>
2026-01-28 20:04:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:04:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6852bac-9c4b-5809-b41f-da869669d056/d6852bac-9c4b-5809-b41f-da869669d056_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fcd%252Fe1cd9ac9315909533fe538013abcce2c%252Fpa%252FAP23964_8d846dc50d6c794d3db0af8a1581db78.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_8d846dc50d6c794d3db0af8a1581db78.jpg saved to cache
2026-01-28 20:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d6852bac-9c4b-5809-b41f-da869669d056
2026-01-28 20:04:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:04:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b089aebd0>
2026-01-28 20:04:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:04:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a68fae47-969d-5ba4-b17d-2758a3bcdfdb/a68fae47-969d-5ba4-b17d-2758a3bcdfdb_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fce%252Fe7ce544553ed0429a1b886b86fc834cb%252Fpa%252FZX31921_ca7313e5807e7c634ab5990bd39edb3b.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/ce/e7ce544553ed0429a1b886b86fc834cb/pa/ZX31921_ca7313e5807e7c634ab5990bd39edb3b.jpg saved to cache
2026-01-28 20:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item a68fae47-969d-5ba4-b17d-2758a3bcdfdb
2026-01-28 20:04:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:04:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09e1b050>
2026-01-28 20:04:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e511f1b-7d74-5878-80ad-55a38cd3a30f/4e511f1b-7d74-5878-80ad-55a38cd3a30f_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F4f%252F2a4f612bbbd4f1ec36b60172f241997f%252Fpa%252FSR88948_107474e021cb7b3d20d9a6b222996521.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/4f/2a4f612bbbd4f1ec36b60172f241997f/pa/SR88948_107474e021cb7b3d20d9a6b222996521.jpg saved to cache
2026-01-28 20:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 4e511f1b-7d74-5878-80ad-55a38cd3a30f
2026-01-28 20:04:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:04:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0891bf10>
2026-01-28 20:04:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a287b3ca-f16d-5078-9162-132368cf1cbf/a287b3ca-f16d-5078-9162-132368cf1cbf_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F66%252Fe866a0d7aa28d0f3d11b71ff44fca61a%252Fpa%252FPK36389_b1c3d78350a1703d72d95c7c9bbfa43d.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/66/e866a0d7aa28d0f3d11b71ff44fca61a/pa/PK36389_b1c3d78350a1703d72d95c7c9bbfa43d.jpg saved to cache
2026-01-28 20:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a287b3ca-f16d-5078-9162-132368cf1cbf
2026-01-28 20:04:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:04:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09d455d0>
2026-01-28 20:04:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:04:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e511f1b-7d74-5878-80ad-55a38cd3a30f/4e511f1b-7d74-5878-80ad-55a38cd3a30f_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F4f%252F2a4f612bbbd4f1ec36b60172f241997f%252Fpa%252FSR88948_cc6e98f398292dd8b852eb077e6c7200.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/4f/2a4f612bbbd4f1ec36b60172f241997f/pa/SR88948_cc6e98f398292dd8b852eb077e6c7200.jpg saved to cache
2026-01-28 20:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 4e511f1b-7d74-5878-80ad-55a38cd3a30f
2026-01-28 20:04:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09ee2c50>
2026-01-28 20:04:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:04:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e511f1b-7d74-5878-80ad-55a38cd3a30f/4e511f1b-7d74-5878-80ad-55a38cd3a30f_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F4f%252F2a4f612bbbd4f1ec36b60172f241997f%252Fpa%252FSR88948_11a16b9e30d91c870ed08becd57fa784.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/4f/2a4f612bbbd4f1ec36b60172f241997f/pa/SR88948_11a16b9e30d91c870ed08becd57fa784.jpg saved to cache
2026-01-28 20:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4e511f1b-7d74-5878-80ad-55a38cd3a30f
2026-01-28 20:04:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/5a/765a4222ce3836b6ffd97e3f1f7b8262/pa/JD87332_d0f80bdcad2d578b123e6b0df42934d0.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08c64990>
2026-01-28 20:04:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a287b3ca-f16d-5078-9162-132368cf1cbf/a287b3ca-f16d-5078-9162-132368cf1cbf_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F66%252Fe866a0d7aa28d0f3d11b71ff44fca61a%252Fpa%252FPK36389_dc2432da1b706ce2d1abe939f60ef9ac.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/66/e866a0d7aa28d0f3d11b71ff44fca61a/pa/PK36389_dc2432da1b706ce2d1abe939f60ef9ac.jpg saved to cache
2026-01-28 20:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a287b3ca-f16d-5078-9162-132368cf1cbf
2026-01-28 20:04:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09dd1250>
2026-01-28 20:04:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0ca04ca-1890-54cc-80be-2205a411ef7d/f0ca04ca-1890-54cc-80be-2205a411ef7d_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F5a%252F765a4222ce3836b6ffd97e3f1f7b8262%252Fpa%252FJD87332_f670f9d30e733118991a231063875eff.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/5a/765a4222ce3836b6ffd97e3f1f7b8262/pa/JD87332_f670f9d30e733118991a231063875eff.jpg saved to cache
2026-01-28 20:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item f0ca04ca-1890-54cc-80be-2205a411ef7d
2026-01-28 20:04:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08bc67d0>
2026-01-28 20:04:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fc23a0d-7e51-556c-aa83-233656974dd8/1fc23a0d-7e51-556c-aa83-233656974dd8_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F8a%252F348a3e75b70a5c6a5a857ba46d5af98e%252Fpa%252FCU51863_165b5ec0b42a04f4246e985e404d4f03.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/8a/348a3e75b70a5c6a5a857ba46d5af98e/pa/CU51863_165b5ec0b42a04f4246e985e404d4f03.jpg saved to cache
2026-01-28 20:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 1fc23a0d-7e51-556c-aa83-233656974dd8
2026-01-28 20:04:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08bc5b50>
2026-01-28 20:04:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:04:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6852bac-9c4b-5809-b41f-da869669d056/d6852bac-9c4b-5809-b41f-da869669d056_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fcd%252Fe1cd9ac9315909533fe538013abcce2c%252Fpa%252FAP23964_bbebc8ef77ef386983b53484989b5303.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_bbebc8ef77ef386983b53484989b5303.jpg saved to cache
2026-01-28 20:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d6852bac-9c4b-5809-b41f-da869669d056
2026-01-28 20:04:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:04:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0a0ce850>
2026-01-28 20:04:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0ca04ca-1890-54cc-80be-2205a411ef7d/f0ca04ca-1890-54cc-80be-2205a411ef7d_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F5a%252F765a4222ce3836b6ffd97e3f1f7b8262%252Fpa%252FJD87332_d0f80bdcad2d578b123e6b0df42934d0.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/5a/765a4222ce3836b6ffd97e3f1f7b8262/pa/JD87332_d0f80bdcad2d578b123e6b0df42934d0.jpg saved to cache
2026-01-28 20:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item f0ca04ca-1890-54cc-80be-2205a411ef7d
2026-01-28 20:04:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/8a/348a3e75b70a5c6a5a857ba46d5af98e/pa/CU51863_0d1487fe9a292d2e09054c4ed1196987.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/66/e866a0d7aa28d0f3d11b71ff44fca61a/pa/PK36389_fa716af178fc29dec5c7fd9da36088b0.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_19117f3066dee66a24d98d07501cc0c7.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/ce/e7ce544553ed0429a1b886b86fc834cb/pa/ZX31921_0df6e726b2d5329cae105466d116f13b.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/ce/e7ce544553ed0429a1b886b86fc834cb/pa/ZX31921_aed1ba9fe0e2bd60e56a0ee7f316b3bf.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/4f/2a4f612bbbd4f1ec36b60172f241997f/pa/SR88948_b70131576dd4ff9f3a3146fd819af73c.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/5a/765a4222ce3836b6ffd97e3f1f7b8262/pa/JD87332_dcbe6c9cbb38333cc4cb925463a06fdc.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/66/e866a0d7aa28d0f3d11b71ff44fca61a/pa/PK36389_bc81aa4b3f44d1ac4260297f3a5488f5.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09e3f010>
2026-01-28 20:04:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:04:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fc23a0d-7e51-556c-aa83-233656974dd8/1fc23a0d-7e51-556c-aa83-233656974dd8_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F8a%252F348a3e75b70a5c6a5a857ba46d5af98e%252Fpa%252FCU51863_0d1487fe9a292d2e09054c4ed1196987.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/8a/348a3e75b70a5c6a5a857ba46d5af98e/pa/CU51863_0d1487fe9a292d2e09054c4ed1196987.jpg saved to cache
2026-01-28 20:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 1fc23a0d-7e51-556c-aa83-233656974dd8
2026-01-28 20:04:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/8a/348a3e75b70a5c6a5a857ba46d5af98e/pa/CU51863_104f5776ed017d5c371ae82d68933df0.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/8a/348a3e75b70a5c6a5a857ba46d5af98e/pa/CU51863_4032f5a4f0e58f59cbdaec58b59d6777.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_c04ea2507cc79d492260128cb22826f7.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08a18e10>
2026-01-28 20:04:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:04:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a287b3ca-f16d-5078-9162-132368cf1cbf/a287b3ca-f16d-5078-9162-132368cf1cbf_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F66%252Fe866a0d7aa28d0f3d11b71ff44fca61a%252Fpa%252FPK36389_fa716af178fc29dec5c7fd9da36088b0.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/66/e866a0d7aa28d0f3d11b71ff44fca61a/pa/PK36389_fa716af178fc29dec5c7fd9da36088b0.jpg saved to cache
2026-01-28 20:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a287b3ca-f16d-5078-9162-132368cf1cbf
2026-01-28 20:04:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08c35610>
2026-01-28 20:04:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6852bac-9c4b-5809-b41f-da869669d056/d6852bac-9c4b-5809-b41f-da869669d056_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fcd%252Fe1cd9ac9315909533fe538013abcce2c%252Fpa%252FAP23964_19117f3066dee66a24d98d07501cc0c7.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_19117f3066dee66a24d98d07501cc0c7.jpg saved to cache
2026-01-28 20:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d6852bac-9c4b-5809-b41f-da869669d056
2026-01-28 20:04:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:04:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09dc6010>
2026-01-28 20:04:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:04:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a68fae47-969d-5ba4-b17d-2758a3bcdfdb/a68fae47-969d-5ba4-b17d-2758a3bcdfdb_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fce%252Fe7ce544553ed0429a1b886b86fc834cb%252Fpa%252FZX31921_0df6e726b2d5329cae105466d116f13b.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/ce/e7ce544553ed0429a1b886b86fc834cb/pa/ZX31921_0df6e726b2d5329cae105466d116f13b.jpg saved to cache
2026-01-28 20:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a68fae47-969d-5ba4-b17d-2758a3bcdfdb
2026-01-28 20:04:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:04:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08c34350>
2026-01-28 20:04:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:04:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a68fae47-969d-5ba4-b17d-2758a3bcdfdb/a68fae47-969d-5ba4-b17d-2758a3bcdfdb_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fce%252Fe7ce544553ed0429a1b886b86fc834cb%252Fpa%252FZX31921_aed1ba9fe0e2bd60e56a0ee7f316b3bf.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/ce/e7ce544553ed0429a1b886b86fc834cb/pa/ZX31921_aed1ba9fe0e2bd60e56a0ee7f316b3bf.jpg saved to cache
2026-01-28 20:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a68fae47-969d-5ba4-b17d-2758a3bcdfdb
2026-01-28 20:04:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:04:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b088e1f10>
2026-01-28 20:04:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:04:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e511f1b-7d74-5878-80ad-55a38cd3a30f/4e511f1b-7d74-5878-80ad-55a38cd3a30f_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F4f%252F2a4f612bbbd4f1ec36b60172f241997f%252Fpa%252FSR88948_b70131576dd4ff9f3a3146fd819af73c.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/4f/2a4f612bbbd4f1ec36b60172f241997f/pa/SR88948_b70131576dd4ff9f3a3146fd819af73c.jpg saved to cache
2026-01-28 20:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4e511f1b-7d74-5878-80ad-55a38cd3a30f
2026-01-28 20:04:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:04:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b089a2a10>
2026-01-28 20:04:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:04:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0ca04ca-1890-54cc-80be-2205a411ef7d/f0ca04ca-1890-54cc-80be-2205a411ef7d_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F5a%252F765a4222ce3836b6ffd97e3f1f7b8262%252Fpa%252FJD87332_dcbe6c9cbb38333cc4cb925463a06fdc.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/5a/765a4222ce3836b6ffd97e3f1f7b8262/pa/JD87332_dcbe6c9cbb38333cc4cb925463a06fdc.jpg saved to cache
2026-01-28 20:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item f0ca04ca-1890-54cc-80be-2205a411ef7d
2026-01-28 20:04:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08722210>
2026-01-28 20:04:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:04:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a287b3ca-f16d-5078-9162-132368cf1cbf/a287b3ca-f16d-5078-9162-132368cf1cbf_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F66%252Fe866a0d7aa28d0f3d11b71ff44fca61a%252Fpa%252FPK36389_bc81aa4b3f44d1ac4260297f3a5488f5.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/66/e866a0d7aa28d0f3d11b71ff44fca61a/pa/PK36389_bc81aa4b3f44d1ac4260297f3a5488f5.jpg saved to cache
2026-01-28 20:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a287b3ca-f16d-5078-9162-132368cf1cbf
2026-01-28 20:04:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/4f/2a4f612bbbd4f1ec36b60172f241997f/pa/SR88948_eba2e4797ae044cac4b3be123a40f727.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09fd5050>
2026-01-28 20:04:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:04:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fc23a0d-7e51-556c-aa83-233656974dd8/1fc23a0d-7e51-556c-aa83-233656974dd8_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F8a%252F348a3e75b70a5c6a5a857ba46d5af98e%252Fpa%252FCU51863_104f5776ed017d5c371ae82d68933df0.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/8a/348a3e75b70a5c6a5a857ba46d5af98e/pa/CU51863_104f5776ed017d5c371ae82d68933df0.jpg saved to cache
2026-01-28 20:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1fc23a0d-7e51-556c-aa83-233656974dd8
2026-01-28 20:04:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08b0b250>
2026-01-28 20:04:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fc23a0d-7e51-556c-aa83-233656974dd8/1fc23a0d-7e51-556c-aa83-233656974dd8_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F8a%252F348a3e75b70a5c6a5a857ba46d5af98e%252Fpa%252FCU51863_4032f5a4f0e58f59cbdaec58b59d6777.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/8a/348a3e75b70a5c6a5a857ba46d5af98e/pa/CU51863_4032f5a4f0e58f59cbdaec58b59d6777.jpg saved to cache
2026-01-28 20:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 1fc23a0d-7e51-556c-aa83-233656974dd8
2026-01-28 20:04:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0a0a26d0>
2026-01-28 20:04:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6852bac-9c4b-5809-b41f-da869669d056/d6852bac-9c4b-5809-b41f-da869669d056_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fcd%252Fe1cd9ac9315909533fe538013abcce2c%252Fpa%252FAP23964_c04ea2507cc79d492260128cb22826f7.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_c04ea2507cc79d492260128cb22826f7.jpg saved to cache
2026-01-28 20:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d6852bac-9c4b-5809-b41f-da869669d056
2026-01-28 20:04:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/8a/348a3e75b70a5c6a5a857ba46d5af98e/pa/CU51863_a867b839db381aae1dbc59e39472fbaa.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/5a/765a4222ce3836b6ffd97e3f1f7b8262/pa/JD87332_1e8a35ffa8b57dce88e9a71ab1b73032.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b087231d0>
2026-01-28 20:04:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:04:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e511f1b-7d74-5878-80ad-55a38cd3a30f/4e511f1b-7d74-5878-80ad-55a38cd3a30f_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F4f%252F2a4f612bbbd4f1ec36b60172f241997f%252Fpa%252FSR88948_eba2e4797ae044cac4b3be123a40f727.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/4f/2a4f612bbbd4f1ec36b60172f241997f/pa/SR88948_eba2e4797ae044cac4b3be123a40f727.jpg saved to cache
2026-01-28 20:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4e511f1b-7d74-5878-80ad-55a38cd3a30f
2026-01-28 20:04:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08cc6e90>
2026-01-28 20:04:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:04:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fc23a0d-7e51-556c-aa83-233656974dd8/1fc23a0d-7e51-556c-aa83-233656974dd8_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F8a%252F348a3e75b70a5c6a5a857ba46d5af98e%252Fpa%252FCU51863_a867b839db381aae1dbc59e39472fbaa.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/8a/348a3e75b70a5c6a5a857ba46d5af98e/pa/CU51863_a867b839db381aae1dbc59e39472fbaa.jpg saved to cache
2026-01-28 20:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1fc23a0d-7e51-556c-aa83-233656974dd8
2026-01-28 20:04:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0a0dff90>
2026-01-28 20:04:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0ca04ca-1890-54cc-80be-2205a411ef7d/f0ca04ca-1890-54cc-80be-2205a411ef7d_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F5a%252F765a4222ce3836b6ffd97e3f1f7b8262%252Fpa%252FJD87332_1e8a35ffa8b57dce88e9a71ab1b73032.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/5a/765a4222ce3836b6ffd97e3f1f7b8262/pa/JD87332_1e8a35ffa8b57dce88e9a71ab1b73032.jpg saved to cache
2026-01-28 20:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f0ca04ca-1890-54cc-80be-2205a411ef7d
2026-01-28 20:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/5a/765a4222ce3836b6ffd97e3f1f7b8262/pa/JD87332_96aed343583d6b6a2d6e58f8d86383e9.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/ce/e7ce544553ed0429a1b886b86fc834cb/pa/ZX31921_a773bc2dc35b097520ddf77ef96900d4.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/ce/e7ce544553ed0429a1b886b86fc834cb/pa/ZX31921_938c6ad73a886a120e3c46b8e45fc615.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/5a/765a4222ce3836b6ffd97e3f1f7b8262/pa/JD87332_f999195152883e30410333448b19e204.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/ce/e7ce544553ed0429a1b886b86fc834cb/pa/ZX31921_086b4f22effb09b271f75bc7b08add02.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/4f/2a4f612bbbd4f1ec36b60172f241997f/pa/SR88948_ebb5fbeec228d1c6c026ff1902864dd4.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/ce/e7ce544553ed0429a1b886b86fc834cb/pa/ZX31921_c1e40b6577af0e5b615de2199d48d73d.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/ce/e7ce544553ed0429a1b886b86fc834cb/pa/ZX31921_5a42f150197b25bfa8ea146840be53db.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:04:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09d47d50>
2026-01-28 20:04:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:04:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0ca04ca-1890-54cc-80be-2205a411ef7d/f0ca04ca-1890-54cc-80be-2205a411ef7d_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F5a%252F765a4222ce3836b6ffd97e3f1f7b8262%252Fpa%252FJD87332_96aed343583d6b6a2d6e58f8d86383e9.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/5a/765a4222ce3836b6ffd97e3f1f7b8262/pa/JD87332_96aed343583d6b6a2d6e58f8d86383e9.jpg saved to cache
2026-01-28 20:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item f0ca04ca-1890-54cc-80be-2205a411ef7d
2026-01-28 20:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/8a/348a3e75b70a5c6a5a857ba46d5af98e/pa/CU51863_4ac400b7800d1e559491a501b847d583.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:04:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0899c350>
2026-01-28 20:04:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:04:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a68fae47-969d-5ba4-b17d-2758a3bcdfdb/a68fae47-969d-5ba4-b17d-2758a3bcdfdb_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fce%252Fe7ce544553ed0429a1b886b86fc834cb%252Fpa%252FZX31921_a773bc2dc35b097520ddf77ef96900d4.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/ce/e7ce544553ed0429a1b886b86fc834cb/pa/ZX31921_a773bc2dc35b097520ddf77ef96900d4.jpg saved to cache
2026-01-28 20:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a68fae47-969d-5ba4-b17d-2758a3bcdfdb
2026-01-28 20:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/66/e866a0d7aa28d0f3d11b71ff44fca61a/pa/PK36389_3cf247f56a2879accaeb8c0c1f0ceb06.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/8a/348a3e75b70a5c6a5a857ba46d5af98e/pa/CU51863_94372cc153a0a9e8e5b4900ebdae3231.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/66/e866a0d7aa28d0f3d11b71ff44fca61a/pa/PK36389_fe52c6a8cfd4d1b0f1b7b0a38ee1ebdc.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09d8de10>
2026-01-28 20:04:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a68fae47-969d-5ba4-b17d-2758a3bcdfdb/a68fae47-969d-5ba4-b17d-2758a3bcdfdb_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fce%252Fe7ce544553ed0429a1b886b86fc834cb%252Fpa%252FZX31921_938c6ad73a886a120e3c46b8e45fc615.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/ce/e7ce544553ed0429a1b886b86fc834cb/pa/ZX31921_938c6ad73a886a120e3c46b8e45fc615.jpg saved to cache
2026-01-28 20:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a68fae47-969d-5ba4-b17d-2758a3bcdfdb
2026-01-28 20:04:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:04:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b088e2650>
2026-01-28 20:04:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:04:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0ca04ca-1890-54cc-80be-2205a411ef7d/f0ca04ca-1890-54cc-80be-2205a411ef7d_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F5a%252F765a4222ce3836b6ffd97e3f1f7b8262%252Fpa%252FJD87332_f999195152883e30410333448b19e204.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/5a/765a4222ce3836b6ffd97e3f1f7b8262/pa/JD87332_f999195152883e30410333448b19e204.jpg saved to cache
2026-01-28 20:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f0ca04ca-1890-54cc-80be-2205a411ef7d
2026-01-28 20:04:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:04:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0891b390>
2026-01-28 20:04:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:04:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a68fae47-969d-5ba4-b17d-2758a3bcdfdb/a68fae47-969d-5ba4-b17d-2758a3bcdfdb_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fce%252Fe7ce544553ed0429a1b886b86fc834cb%252Fpa%252FZX31921_086b4f22effb09b271f75bc7b08add02.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/ce/e7ce544553ed0429a1b886b86fc834cb/pa/ZX31921_086b4f22effb09b271f75bc7b08add02.jpg saved to cache
2026-01-28 20:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a68fae47-969d-5ba4-b17d-2758a3bcdfdb
2026-01-28 20:04:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:04:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08cc6490>
2026-01-28 20:04:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:04:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e511f1b-7d74-5878-80ad-55a38cd3a30f/4e511f1b-7d74-5878-80ad-55a38cd3a30f_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F4f%252F2a4f612bbbd4f1ec36b60172f241997f%252Fpa%252FSR88948_ebb5fbeec228d1c6c026ff1902864dd4.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/4f/2a4f612bbbd4f1ec36b60172f241997f/pa/SR88948_ebb5fbeec228d1c6c026ff1902864dd4.jpg saved to cache
2026-01-28 20:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4e511f1b-7d74-5878-80ad-55a38cd3a30f
2026-01-28 20:04:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:04:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09d9d590>
2026-01-28 20:04:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:04:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a68fae47-969d-5ba4-b17d-2758a3bcdfdb/a68fae47-969d-5ba4-b17d-2758a3bcdfdb_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fce%252Fe7ce544553ed0429a1b886b86fc834cb%252Fpa%252FZX31921_c1e40b6577af0e5b615de2199d48d73d.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/ce/e7ce544553ed0429a1b886b86fc834cb/pa/ZX31921_c1e40b6577af0e5b615de2199d48d73d.jpg saved to cache
2026-01-28 20:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a68fae47-969d-5ba4-b17d-2758a3bcdfdb
2026-01-28 20:04:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09dfaa90>
2026-01-28 20:04:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:04:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a68fae47-969d-5ba4-b17d-2758a3bcdfdb/a68fae47-969d-5ba4-b17d-2758a3bcdfdb_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fce%252Fe7ce544553ed0429a1b886b86fc834cb%252Fpa%252FZX31921_5a42f150197b25bfa8ea146840be53db.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/ce/e7ce544553ed0429a1b886b86fc834cb/pa/ZX31921_5a42f150197b25bfa8ea146840be53db.jpg saved to cache
2026-01-28 20:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a68fae47-969d-5ba4-b17d-2758a3bcdfdb
2026-01-28 20:04:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08c12410>
2026-01-28 20:04:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:04:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fc23a0d-7e51-556c-aa83-233656974dd8/1fc23a0d-7e51-556c-aa83-233656974dd8_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F8a%252F348a3e75b70a5c6a5a857ba46d5af98e%252Fpa%252FCU51863_4ac400b7800d1e559491a501b847d583.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/8a/348a3e75b70a5c6a5a857ba46d5af98e/pa/CU51863_4ac400b7800d1e559491a501b847d583.jpg saved to cache
2026-01-28 20:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1fc23a0d-7e51-556c-aa83-233656974dd8
2026-01-28 20:04:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b086ec090>
2026-01-28 20:04:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a287b3ca-f16d-5078-9162-132368cf1cbf/a287b3ca-f16d-5078-9162-132368cf1cbf_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F66%252Fe866a0d7aa28d0f3d11b71ff44fca61a%252Fpa%252FPK36389_3cf247f56a2879accaeb8c0c1f0ceb06.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/66/e866a0d7aa28d0f3d11b71ff44fca61a/pa/PK36389_3cf247f56a2879accaeb8c0c1f0ceb06.jpg saved to cache
2026-01-28 20:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a287b3ca-f16d-5078-9162-132368cf1cbf
2026-01-28 20:04:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08a08510>
2026-01-28 20:04:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:04:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fc23a0d-7e51-556c-aa83-233656974dd8/1fc23a0d-7e51-556c-aa83-233656974dd8_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F8a%252F348a3e75b70a5c6a5a857ba46d5af98e%252Fpa%252FCU51863_94372cc153a0a9e8e5b4900ebdae3231.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/8a/348a3e75b70a5c6a5a857ba46d5af98e/pa/CU51863_94372cc153a0a9e8e5b4900ebdae3231.jpg saved to cache
2026-01-28 20:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1fc23a0d-7e51-556c-aa83-233656974dd8
2026-01-28 20:04:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0a02e150>
2026-01-28 20:04:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:04:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a287b3ca-f16d-5078-9162-132368cf1cbf/a287b3ca-f16d-5078-9162-132368cf1cbf_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F66%252Fe866a0d7aa28d0f3d11b71ff44fca61a%252Fpa%252FPK36389_fe52c6a8cfd4d1b0f1b7b0a38ee1ebdc.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/66/e866a0d7aa28d0f3d11b71ff44fca61a/pa/PK36389_fe52c6a8cfd4d1b0f1b7b0a38ee1ebdc.jpg saved to cache
2026-01-28 20:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a287b3ca-f16d-5078-9162-132368cf1cbf
2026-01-28 20:04:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/66/e866a0d7aa28d0f3d11b71ff44fca61a/pa/PK36389_5accd11b719e0b432b4e42dcbd1ee263.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/4f/2a4f612bbbd4f1ec36b60172f241997f/pa/SR88948_e7d288f5aeec2a4712d6e03c027058ce.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/5a/765a4222ce3836b6ffd97e3f1f7b8262/pa/JD87332_18d7e2d28916ff2fbfbd368bde3e2d22.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_7bf0ed8817a66a6bdd65410861800d2a.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/8a/348a3e75b70a5c6a5a857ba46d5af98e/pa/CU51863_b972ef4cf1aa404e0edb8d87ebbafacd.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/a4/57a41f04407b77fc18110f7a3d1df06f/pa/JY56965_6e1396e3716eeaa8d639b7a932a38893.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:04:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0a0c2c50>
2026-01-28 20:04:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:04:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a287b3ca-f16d-5078-9162-132368cf1cbf/a287b3ca-f16d-5078-9162-132368cf1cbf_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F66%252Fe866a0d7aa28d0f3d11b71ff44fca61a%252Fpa%252FPK36389_5accd11b719e0b432b4e42dcbd1ee263.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/66/e866a0d7aa28d0f3d11b71ff44fca61a/pa/PK36389_5accd11b719e0b432b4e42dcbd1ee263.jpg saved to cache
2026-01-28 20:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a287b3ca-f16d-5078-9162-132368cf1cbf
2026-01-28 20:04:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a287b3ca-f16d-5078-9162-132368cf1cbf, skipping ID generation
2026-01-28 20:04:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a287b3ca-f16d-5078-9162-132368cf1cbf with scrape type 1
2026-01-28 20:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Removing item a287b3ca-f16d-5078-9162-132368cf1cbf from tracking dictionaries
2026-01-28 20:04:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a287b3ca-f16d-5078-9162-132368cf1cbf sending to next pipeline
2026-01-28 20:04:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a287b3ca-f16d-5078-9162-132368cf1cbf, identifier: PK36389
2026-01-28 20:04:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a287b3ca-f16d-5078-9162-132368cf1cbf with identifier: PK36389
2026-01-28 20:04:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a287b3ca-f16d-5078-9162-132368cf1cbf with identifier: PK36389
2026-01-28 20:04:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a287b3ca-f16d-5078-9162-132368cf1cbf with identifier: PK36389 to the API
2026-01-28 20:04:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:04:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:04:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge8/66/e866a0d7aa28d0f3d11b71ff44fca61a/pa/PK36389_5accd11b719e0b432b4e42dcbd1ee263.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 90,
 'expiration_date': '2026-01-29T16:10:59Z',
 'fuel_type': 'petrol',
 'id': 'a287b3ca-f16d-5078-9162-132368cf1cbf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PK36389',
 'listing': 'auction',
 'location': 'IT, Massa',
 'make': 'Suzuki',
 'model': 'Ignis',
 'odometer': 9630,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a287b3ca-f16d-5078-9162-132368cf1cbf/a287b3ca-f16d-5078-9162-132368cf1cbf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92130,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/66/e866a0d7aa28d0f3d11b71ff44fca61a/pa/PK36389_3cf247f56a2879accaeb8c0c1f0ceb06.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a287b3ca-f16d-5078-9162-132368cf1cbf/a287b3ca-f16d-5078-9162-132368cf1cbf_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88165,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/66/e866a0d7aa28d0f3d11b71ff44fca61a/pa/PK36389_fe52c6a8cfd4d1b0f1b7b0a38ee1ebdc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a287b3ca-f16d-5078-9162-132368cf1cbf/a287b3ca-f16d-5078-9162-132368cf1cbf_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2805416,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/66/e866a0d7aa28d0f3d11b71ff44fca61a/pa/PK36389_5accd11b719e0b432b4e42dcbd1ee263.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a287b3ca-f16d-5078-9162-132368cf1cbf/a287b3ca-f16d-5078-9162-132368cf1cbf_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67703,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/66/e866a0d7aa28d0f3d11b71ff44fca61a/pa/PK36389_6bca44bc35ec2370bb953e800dde7024.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a287b3ca-f16d-5078-9162-132368cf1cbf/a287b3ca-f16d-5078-9162-132368cf1cbf_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89000,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/66/e866a0d7aa28d0f3d11b71ff44fca61a/pa/PK36389_bc81aa4b3f44d1ac4260297f3a5488f5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a287b3ca-f16d-5078-9162-132368cf1cbf/a287b3ca-f16d-5078-9162-132368cf1cbf_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93683,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/66/e866a0d7aa28d0f3d11b71ff44fca61a/pa/PK36389_fa716af178fc29dec5c7fd9da36088b0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a287b3ca-f16d-5078-9162-132368cf1cbf/a287b3ca-f16d-5078-9162-132368cf1cbf_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66112,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/66/e866a0d7aa28d0f3d11b71ff44fca61a/pa/PK36389_0d69ec16a665e8924c0cc3271658228b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a287b3ca-f16d-5078-9162-132368cf1cbf/a287b3ca-f16d-5078-9162-132368cf1cbf_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100187,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/66/e866a0d7aa28d0f3d11b71ff44fca61a/pa/PK36389_dc2432da1b706ce2d1abe939f60ef9ac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a287b3ca-f16d-5078-9162-132368cf1cbf/a287b3ca-f16d-5078-9162-132368cf1cbf_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103380,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/66/e866a0d7aa28d0f3d11b71ff44fca61a/pa/PK36389_b87ac79c938797621b0865ba271efba2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a287b3ca-f16d-5078-9162-132368cf1cbf/a287b3ca-f16d-5078-9162-132368cf1cbf_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3018175,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/66/e866a0d7aa28d0f3d11b71ff44fca61a/pa/PK36389_b1c3d78350a1703d72d95c7c9bbfa43d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a287b3ca-f16d-5078-9162-132368cf1cbf/a287b3ca-f16d-5078-9162-132368cf1cbf_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69592,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/66/e866a0d7aa28d0f3d11b71ff44fca61a/pa/PK36389_b282f6fc5758a8bcbd00cab057bfe354.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a287b3ca-f16d-5078-9162-132368cf1cbf/a287b3ca-f16d-5078-9162-132368cf1cbf_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60522,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/66/e866a0d7aa28d0f3d11b71ff44fca61a/pa/PK36389_4432e27a7efc2bc3d832829c7dd5f926.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a287b3ca-f16d-5078-9162-132368cf1cbf/a287b3ca-f16d-5078-9162-132368cf1cbf_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78124,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/66/e866a0d7aa28d0f3d11b71ff44fca61a/pa/PK36389_8825d1fd4d031e1d52a5907d5b058b86.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a287b3ca-f16d-5078-9162-132368cf1cbf/a287b3ca-f16d-5078-9162-132368cf1cbf_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53193,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/66/e866a0d7aa28d0f3d11b71ff44fca61a/pa/PK36389_b9440188f1c6a92e712bb14ecf9a8546.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a287b3ca-f16d-5078-9162-132368cf1cbf/a287b3ca-f16d-5078-9162-132368cf1cbf_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59634,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/66/e866a0d7aa28d0f3d11b71ff44fca61a/pa/PK36389_369aeebc8ccd5bdb0635883ad4abb107.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-01-11',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Suzuki Ignis 1.2 DualJet ITop',
 'transmission': 'manual',
 'trim': 'ITop',
 'year': 2018}
2026-01-28 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PK36389%27 HTTP/1.1" 200 None
2026-01-28 20:04:22 [auto1.it] INFO: Saving data for PK36389: {'created_time': 1769630662.731902, 'last_price_update_time': 1769630662.731916, 'auction_closing_time': 1769703059.0}
2026-01-28 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PK36389') HTTP/1.1" 204 0
2026-01-28 20:04:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/e4/2de443a529edfde728e09f1928d64710/pa/XP18402_5c29ad533554dccfd4b69dab7cda356f.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/a4/57a41f04407b77fc18110f7a3d1df06f/pa/JY56965_4a3e82bb14c3148d53b702b0908a0583.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/e4/2de443a529edfde728e09f1928d64710/pa/XP18402_ceea54df4bfef50267644325d21b828d.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/9b/5e9bd9af10ddf07ad6df01859299cca1/pa/XX61742_58e8e1c7b598f153babe7851f3aafb10.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/8a/348a3e75b70a5c6a5a857ba46d5af98e/pa/CU51863_afda6904984750e5b79eec1e1aaf516c.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:04:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09e93d50>
2026-01-28 20:04:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e511f1b-7d74-5878-80ad-55a38cd3a30f/4e511f1b-7d74-5878-80ad-55a38cd3a30f_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F4f%252F2a4f612bbbd4f1ec36b60172f241997f%252Fpa%252FSR88948_e7d288f5aeec2a4712d6e03c027058ce.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/4f/2a4f612bbbd4f1ec36b60172f241997f/pa/SR88948_e7d288f5aeec2a4712d6e03c027058ce.jpg saved to cache
2026-01-28 20:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4e511f1b-7d74-5878-80ad-55a38cd3a30f
2026-01-28 20:04:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4e511f1b-7d74-5878-80ad-55a38cd3a30f, skipping ID generation
2026-01-28 20:04:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e511f1b-7d74-5878-80ad-55a38cd3a30f with scrape type 1
2026-01-28 20:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 4e511f1b-7d74-5878-80ad-55a38cd3a30f from tracking dictionaries
2026-01-28 20:04:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4e511f1b-7d74-5878-80ad-55a38cd3a30f sending to next pipeline
2026-01-28 20:04:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4e511f1b-7d74-5878-80ad-55a38cd3a30f, identifier: SR88948
2026-01-28 20:04:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:04:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b086d5310>
2026-01-28 20:04:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0ca04ca-1890-54cc-80be-2205a411ef7d/f0ca04ca-1890-54cc-80be-2205a411ef7d_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F5a%252F765a4222ce3836b6ffd97e3f1f7b8262%252Fpa%252FJD87332_18d7e2d28916ff2fbfbd368bde3e2d22.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/5a/765a4222ce3836b6ffd97e3f1f7b8262/pa/JD87332_18d7e2d28916ff2fbfbd368bde3e2d22.jpg saved to cache
2026-01-28 20:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f0ca04ca-1890-54cc-80be-2205a411ef7d
2026-01-28 20:04:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:04:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0be062d0>
2026-01-28 20:04:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6852bac-9c4b-5809-b41f-da869669d056/d6852bac-9c4b-5809-b41f-da869669d056_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fcd%252Fe1cd9ac9315909533fe538013abcce2c%252Fpa%252FAP23964_7bf0ed8817a66a6bdd65410861800d2a.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_7bf0ed8817a66a6bdd65410861800d2a.jpg saved to cache
2026-01-28 20:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d6852bac-9c4b-5809-b41f-da869669d056
2026-01-28 20:04:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d6852bac-9c4b-5809-b41f-da869669d056, skipping ID generation
2026-01-28 20:04:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6852bac-9c4b-5809-b41f-da869669d056 with scrape type 1
2026-01-28 20:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Removing item d6852bac-9c4b-5809-b41f-da869669d056 from tracking dictionaries
2026-01-28 20:04:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d6852bac-9c4b-5809-b41f-da869669d056 sending to next pipeline
2026-01-28 20:04:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d6852bac-9c4b-5809-b41f-da869669d056, identifier: AP23964
2026-01-28 20:04:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b086d6110>
2026-01-28 20:04:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fc23a0d-7e51-556c-aa83-233656974dd8/1fc23a0d-7e51-556c-aa83-233656974dd8_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F8a%252F348a3e75b70a5c6a5a857ba46d5af98e%252Fpa%252FCU51863_b972ef4cf1aa404e0edb8d87ebbafacd.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/8a/348a3e75b70a5c6a5a857ba46d5af98e/pa/CU51863_b972ef4cf1aa404e0edb8d87ebbafacd.jpg saved to cache
2026-01-28 20:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1fc23a0d-7e51-556c-aa83-233656974dd8
2026-01-28 20:04:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09ddeb50>
2026-01-28 20:04:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:04:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0218895-008c-5901-8d81-495dcbc7bbb2/c0218895-008c-5901-8d81-495dcbc7bbb2_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Fa4%252F57a41f04407b77fc18110f7a3d1df06f%252Fpa%252FJY56965_6e1396e3716eeaa8d639b7a932a38893.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/a4/57a41f04407b77fc18110f7a3d1df06f/pa/JY56965_6e1396e3716eeaa8d639b7a932a38893.jpg saved to cache
2026-01-28 20:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item c0218895-008c-5901-8d81-495dcbc7bbb2
2026-01-28 20:04:24 [scrapy.extensions.logstats] INFO: Crawled 254 pages (at 39 pages/min), scraped 69 items (at 10 items/min)
2026-01-28 20:04:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4e511f1b-7d74-5878-80ad-55a38cd3a30f with identifier: SR88948
2026-01-28 20:04:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4e511f1b-7d74-5878-80ad-55a38cd3a30f with identifier: SR88948
2026-01-28 20:04:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4e511f1b-7d74-5878-80ad-55a38cd3a30f with identifier: SR88948 to the API
2026-01-28 20:04:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:04:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:04:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img2a/4f/2a4f612bbbd4f1ec36b60172f241997f/pa/SR88948_e7d288f5aeec2a4712d6e03c027058ce.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.5L',
 'engine_horse_power': 116,
 'expiration_date': '2026-01-29T16:51:32Z',
 'fuel_type': 'diesel',
 'id': '4e511f1b-7d74-5878-80ad-55a38cd3a30f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SR88948',
 'listing': 'auction',
 'location': 'IT, Catania',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 110144,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e511f1b-7d74-5878-80ad-55a38cd3a30f/4e511f1b-7d74-5878-80ad-55a38cd3a30f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71693,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/4f/2a4f612bbbd4f1ec36b60172f241997f/pa/SR88948_4be2f3ee677d5fab525a4499c3c518e0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e511f1b-7d74-5878-80ad-55a38cd3a30f/4e511f1b-7d74-5878-80ad-55a38cd3a30f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2518102,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/4f/2a4f612bbbd4f1ec36b60172f241997f/pa/SR88948_b8fa73bb64c9ef56d02a8fd8288d0896.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e511f1b-7d74-5878-80ad-55a38cd3a30f/4e511f1b-7d74-5878-80ad-55a38cd3a30f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64637,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/4f/2a4f612bbbd4f1ec36b60172f241997f/pa/SR88948_fe5b61932c8befb2ec4d09cb6879197d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e511f1b-7d74-5878-80ad-55a38cd3a30f/4e511f1b-7d74-5878-80ad-55a38cd3a30f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58812,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/4f/2a4f612bbbd4f1ec36b60172f241997f/pa/SR88948_42993d47f2209fb0fa6fb767e5cb1b0e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e511f1b-7d74-5878-80ad-55a38cd3a30f/4e511f1b-7d74-5878-80ad-55a38cd3a30f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2587628,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/4f/2a4f612bbbd4f1ec36b60172f241997f/pa/SR88948_e7d288f5aeec2a4712d6e03c027058ce.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e511f1b-7d74-5878-80ad-55a38cd3a30f/4e511f1b-7d74-5878-80ad-55a38cd3a30f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62950,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/4f/2a4f612bbbd4f1ec36b60172f241997f/pa/SR88948_eba2e4797ae044cac4b3be123a40f727.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e511f1b-7d74-5878-80ad-55a38cd3a30f/4e511f1b-7d74-5878-80ad-55a38cd3a30f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2472309,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/4f/2a4f612bbbd4f1ec36b60172f241997f/pa/SR88948_ebb5fbeec228d1c6c026ff1902864dd4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e511f1b-7d74-5878-80ad-55a38cd3a30f/4e511f1b-7d74-5878-80ad-55a38cd3a30f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70279,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/4f/2a4f612bbbd4f1ec36b60172f241997f/pa/SR88948_b282a3a14074be21e01534c08843cc0c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e511f1b-7d74-5878-80ad-55a38cd3a30f/4e511f1b-7d74-5878-80ad-55a38cd3a30f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2568680,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/4f/2a4f612bbbd4f1ec36b60172f241997f/pa/SR88948_b70131576dd4ff9f3a3146fd819af73c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e511f1b-7d74-5878-80ad-55a38cd3a30f/4e511f1b-7d74-5878-80ad-55a38cd3a30f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76610,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/4f/2a4f612bbbd4f1ec36b60172f241997f/pa/SR88948_11a16b9e30d91c870ed08becd57fa784.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e511f1b-7d74-5878-80ad-55a38cd3a30f/4e511f1b-7d74-5878-80ad-55a38cd3a30f_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2457957,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/4f/2a4f612bbbd4f1ec36b60172f241997f/pa/SR88948_cc6e98f398292dd8b852eb077e6c7200.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e511f1b-7d74-5878-80ad-55a38cd3a30f/4e511f1b-7d74-5878-80ad-55a38cd3a30f_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78815,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/4f/2a4f612bbbd4f1ec36b60172f241997f/pa/SR88948_32723fa1e81da71c2c7621ae88d2b682.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e511f1b-7d74-5878-80ad-55a38cd3a30f/4e511f1b-7d74-5878-80ad-55a38cd3a30f_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2865567,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/4f/2a4f612bbbd4f1ec36b60172f241997f/pa/SR88948_107474e021cb7b3d20d9a6b222996521.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e511f1b-7d74-5878-80ad-55a38cd3a30f/4e511f1b-7d74-5878-80ad-55a38cd3a30f_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59077,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/4f/2a4f612bbbd4f1ec36b60172f241997f/pa/SR88948_1df7f4b439cf76feffd684a8395331ff.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-09-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 180 d AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2020}
2026-01-28 20:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SR88948%27 HTTP/1.1" 200 None
2026-01-28 20:04:25 [auto1.it] INFO: Saving data for SR88948: {'created_time': 1769630665.046263, 'last_price_update_time': 1769630665.046273, 'auction_closing_time': 1769705492.0}
2026-01-28 20:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SR88948') HTTP/1.1" 204 0
2026-01-28 20:04:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d6852bac-9c4b-5809-b41f-da869669d056 with identifier: AP23964
2026-01-28 20:04:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d6852bac-9c4b-5809-b41f-da869669d056 with identifier: AP23964
2026-01-28 20:04:25 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 15, 'seller_name': None, 'price_includes_vat': True, 'title': 'ssangyong korando 1.6 td icon 4x2', 'price': 0, 'currency': 'eur', 'make': 'ssangyong', 'model': 'korando', 'transmission': 'manual', 'odometer': 96700, 'odometer_reading_unit': 'km', 'registration_date': '2021-05-31', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ap23964', 'expiration_date': '2026-01-29t16:26:18z', 'origin_country_code': 'it', 'trim': 'icon 4x2', 'year': 2021, 'fuel_type': 'diesel', 'listing': 'auction', 'engine_horse_power': 136, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.6l', 'location': 'it, mariano comense', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6d-temp', 'c_o_2_emission_value': 149, 'id': 'd6852bac-9c4b-5809-b41f-da869669d056', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6852bac-9c4b-5809-b41f-da869669d056/d6852bac-9c4b-5809-b41f-da869669d056_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_7bf0ed8817a66a6bdd65410861800d2a.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2491433}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6852bac-9c4b-5809-b41f-da869669d056/d6852bac-9c4b-5809-b41f-da869669d056_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_35e16d4013f8467ea4298938c29860aa.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 74584}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6852bac-9c4b-5809-b41f-da869669d056/d6852bac-9c4b-5809-b41f-da869669d056_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_8ce46dfeed916921c4d6d36dca4dd68d.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 70177}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6852bac-9c4b-5809-b41f-da869669d056/d6852bac-9c4b-5809-b41f-da869669d056_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_35517d133c1cb1491101acbbd58b0594.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 49661}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6852bac-9c4b-5809-b41f-da869669d056/d6852bac-9c4b-5809-b41f-da869669d056_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_c04ea2507cc79d492260128cb22826f7.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 71340}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6852bac-9c4b-5809-b41f-da869669d056/d6852bac-9c4b-5809-b41f-da869669d056_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_19117f3066dee66a24d98d07501cc0c7.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 76078}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6852bac-9c4b-5809-b41f-da869669d056/d6852bac-9c4b-5809-b41f-da869669d056_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_2d45ce36945f8558fbc3206587c72c12.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2321897}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6852bac-9c4b-5809-b41f-da869669d056/d6852bac-9c4b-5809-b41f-da869669d056_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_bbebc8ef77ef386983b53484989b5303.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 74783}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6852bac-9c4b-5809-b41f-da869669d056/d6852bac-9c4b-5809-b41f-da869669d056_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_6d6fbc23f3952d6a00b7d0c7dd932974.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 70183}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6852bac-9c4b-5809-b41f-da869669d056/d6852bac-9c4b-5809-b41f-da869669d056_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_8d846dc50d6c794d3db0af8a1581db78.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2406394}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6852bac-9c4b-5809-b41f-da869669d056/d6852bac-9c4b-5809-b41f-da869669d056_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_47ad87d234cffd1af9a4b3aaddb0c85f.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 56541}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6852bac-9c4b-5809-b41f-da869669d056/d6852bac-9c4b-5809-b41f-da869669d056_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_ca48c3a9546739a460dafda9b705f1b8.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2884399}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6852bac-9c4b-5809-b41f-da869669d056/d6852bac-9c4b-5809-b41f-da869669d056_image_12.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_5de68c96405fe5aade269215daaa031d.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 49943}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6852bac-9c4b-5809-b41f-da869669d056/d6852bac-9c4b-5809-b41f-da869669d056_image_13.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_a08394dffa90447ed22cd79295822388.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 36497}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6852bac-9c4b-5809-b41f-da869669d056/d6852bac-9c4b-5809-b41f-da869669d056_image_14.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_f73be4b5a7af3020ee4e5d66417fb9b2.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 64213}], 'current_year_diff': 5, 'age_in_months': 55, 'make_model': 'ssangyong korando', 'sanitized_make': 'ssangyong', 'odometer_in_km': 96700}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 55,
     'auction_title': '',
     'c_o_2_emission_value': 149,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 5,
     'doors_number': 5,
     'emission_standard': 'euro 6d-temp',
     'engine': '1.6l',
     'engine_horse_power': 136,
     'expiration_date': '2026-01-29t16:26:18z',
     'fuel_type': 'diesel',
     'id': 'd6852bac-9c4b-5809-b41f-da869669d056',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ap23964',
     'listing': 'auction',
     'location': 'it, mariano comense',
     'make': 'ssangyong',
     'make_model': 'ssangyong korando',
     'model': 'korando',
     'odometer': 96700,
     'odometer_in_km': 96700,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'it',
     'original_photo_count': 15,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6852bac-9c4b-5809-b41f-da869669d056/d6852bac-9c4b-5809-b41f-da869669d056_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 2491433,
                 'Height': 1536,
                 'OriginUrl': 'https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_7bf0ed8817a66a6bdd65410861800d2a.jpg',
                 'Width': 2048},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6852bac-9c4b-5809-b41f-da869669d056/d6852bac-9c4b-5809-b41f-da869669d056_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 74584,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_35e16d4013f8467ea4298938c29860aa.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6852bac-9c4b-5809-b41f-da869669d056/d6852bac-9c4b-5809-b41f-da869669d056_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 70177,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_8ce46dfeed916921c4d6d36dca4dd68d.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6852bac-9c4b-5809-b41f-da869669d056/d6852bac-9c4b-5809-b41f-da869669d056_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 49661,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_35517d133c1cb1491101acbbd58b0594.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6852bac-9c4b-5809-b41f-da869669d056/d6852bac-9c4b-5809-b41f-da869669d056_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 71340,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_c04ea2507cc79d492260128cb22826f7.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6852bac-9c4b-5809-b41f-da869669d056/d6852bac-9c4b-5809-b41f-da869669d056_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 76078,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_19117f3066dee66a24d98d07501cc0c7.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6852bac-9c4b-5809-b41f-da869669d056/d6852bac-9c4b-5809-b41f-da869669d056_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 2321897,
                 'Height': 1536,
                 'OriginUrl': 'https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_2d45ce36945f8558fbc3206587c72c12.jpg',
                 'Width': 2048},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6852bac-9c4b-5809-b41f-da869669d056/d6852bac-9c4b-5809-b41f-da869669d056_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 74783,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_bbebc8ef77ef386983b53484989b5303.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6852bac-9c4b-5809-b41f-da869669d056/d6852bac-9c4b-5809-b41f-da869669d056_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 70183,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_6d6fbc23f3952d6a00b7d0c7dd932974.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6852bac-9c4b-5809-b41f-da869669d056/d6852bac-9c4b-5809-b41f-da869669d056_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 2406394,
                 'Height': 1536,
                 'OriginUrl': 'https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_8d846dc50d6c794d3db0af8a1581db78.jpg',
                 'Width': 2048},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6852bac-9c4b-5809-b41f-da869669d056/d6852bac-9c4b-5809-b41f-da869669d056_image_10.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 56541,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_47ad87d234cffd1af9a4b3aaddb0c85f.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6852bac-9c4b-5809-b41f-da869669d056/d6852bac-9c4b-5809-b41f-da869669d056_image_11.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 2884399,
                 'Height': 1536,
                 'OriginUrl': 'https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_ca48c3a9546739a460dafda9b705f1b8.jpg',
                 'Width': 2048},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6852bac-9c4b-5809-b41f-da869669d056/d6852bac-9c4b-5809-b41f-da869669d056_image_12.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 49943,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_5de68c96405fe5aade269215daaa031d.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6852bac-9c4b-5809-b41f-da869669d056/d6852bac-9c4b-5809-b41f-da869669d056_image_13.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 36497,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_a08394dffa90447ed22cd79295822388.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6852bac-9c4b-5809-b41f-da869669d056/d6852bac-9c4b-5809-b41f-da869669d056_image_14.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 64213,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_f73be4b5a7af3020ee4e5d66417fb9b2.jpg',
                 'Width': 800}],
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2021-05-31',
     'sanitized_make': 'ssangyong',
     'seats_number': 5,
     'seller_name': None,
     'title': 'ssangyong korando 1.6 td icon 4x2',
     'transmission': 'manual',
     'trim': 'icon 4x2',
     'year': 2021}
2026-01-28 20:04:25 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_NOT_ALLOWED failed for item: d6852bac-9c4b-5809-b41f-da869669d056 spider: auto1.it
2026-01-28 20:04:25 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: d6852bac-9c4b-5809-b41f-da869669d056 due to rule: makes_not_allowed.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 15, 'seller_name': None, 'price_includes_vat': True, 'title': 'ssangyong korando 1.6 td icon 4x2', 'price': 0, 'currency': 'eur', 'make': 'ssangyong', 'model': 'korando', 'transmission': 'manual', 'odometer': 96700, 'odometer_reading_unit': 'km', 'registration_date': '2021-05-31', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ap23964', 'expiration_date': '2026-01-29t16:26:18z', 'origin_country_code': 'it', 'trim': 'icon 4x2', 'year': 2021, 'fuel_type': 'diesel', 'listing': 'auction', 'engine_horse_power': 136, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.6l', 'location': 'it, mariano comense', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6d-temp', 'c_o_2_emission_value': 149, 'id': 'd6852bac-9c4b-5809-b41f-da869669d056', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6852bac-9c4b-5809-b41f-da869669d056/d6852bac-9c4b-5809-b41f-da869669d056_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_7bf0ed8817a66a6bdd65410861800d2a.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2491433}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6852bac-9c4b-5809-b41f-da869669d056/d6852bac-9c4b-5809-b41f-da869669d056_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_35e16d4013f8467ea4298938c29860aa.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 74584}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6852bac-9c4b-5809-b41f-da869669d056/d6852bac-9c4b-5809-b41f-da869669d056_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_8ce46dfeed916921c4d6d36dca4dd68d.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 70177}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6852bac-9c4b-5809-b41f-da869669d056/d6852bac-9c4b-5809-b41f-da869669d056_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_35517d133c1cb1491101acbbd58b0594.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 49661}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6852bac-9c4b-5809-b41f-da869669d056/d6852bac-9c4b-5809-b41f-da869669d056_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_c04ea2507cc79d492260128cb22826f7.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 71340}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6852bac-9c4b-5809-b41f-da869669d056/d6852bac-9c4b-5809-b41f-da869669d056_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_19117f3066dee66a24d98d07501cc0c7.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 76078}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6852bac-9c4b-5809-b41f-da869669d056/d6852bac-9c4b-5809-b41f-da869669d056_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_2d45ce36945f8558fbc3206587c72c12.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2321897}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6852bac-9c4b-5809-b41f-da869669d056/d6852bac-9c4b-5809-b41f-da869669d056_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_bbebc8ef77ef386983b53484989b5303.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 74783}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6852bac-9c4b-5809-b41f-da869669d056/d6852bac-9c4b-5809-b41f-da869669d056_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_6d6fbc23f3952d6a00b7d0c7dd932974.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 70183}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6852bac-9c4b-5809-b41f-da869669d056/d6852bac-9c4b-5809-b41f-da869669d056_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_8d846dc50d6c794d3db0af8a1581db78.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2406394}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6852bac-9c4b-5809-b41f-da869669d056/d6852bac-9c4b-5809-b41f-da869669d056_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_47ad87d234cffd1af9a4b3aaddb0c85f.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 56541}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6852bac-9c4b-5809-b41f-da869669d056/d6852bac-9c4b-5809-b41f-da869669d056_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_ca48c3a9546739a460dafda9b705f1b8.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2884399}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6852bac-9c4b-5809-b41f-da869669d056/d6852bac-9c4b-5809-b41f-da869669d056_image_12.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_5de68c96405fe5aade269215daaa031d.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 49943}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6852bac-9c4b-5809-b41f-da869669d056/d6852bac-9c4b-5809-b41f-da869669d056_image_13.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_a08394dffa90447ed22cd79295822388.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 36497}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6852bac-9c4b-5809-b41f-da869669d056/d6852bac-9c4b-5809-b41f-da869669d056_image_14.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_f73be4b5a7af3020ee4e5d66417fb9b2.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 64213}], 'current_year_diff': 5, 'age_in_months': 55, 'make_model': 'ssangyong korando', 'sanitized_make': 'ssangyong', 'odometer_in_km': 96700}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 55,
     'auction_title': '',
     'c_o_2_emission_value': 149,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 5,
     'doors_number': 5,
     'emission_standard': 'euro 6d-temp',
     'engine': '1.6l',
     'engine_horse_power': 136,
     'expiration_date': '2026-01-29t16:26:18z',
     'fuel_type': 'diesel',
     'id': 'd6852bac-9c4b-5809-b41f-da869669d056',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ap23964',
     'listing': 'auction',
     'location': 'it, mariano comense',
     'make': 'ssangyong',
     'make_model': 'ssangyong korando',
     'model': 'korando',
     'odometer': 96700,
     'odometer_in_km': 96700,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'it',
     'original_photo_count': 15,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6852bac-9c4b-5809-b41f-da869669d056/d6852bac-9c4b-5809-b41f-da869669d056_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 2491433,
                 'Height': 1536,
                 'OriginUrl': 'https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_7bf0ed8817a66a6bdd65410861800d2a.jpg',
                 'Width': 2048},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6852bac-9c4b-5809-b41f-da869669d056/d6852bac-9c4b-5809-b41f-da869669d056_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 74584,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_35e16d4013f8467ea4298938c29860aa.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6852bac-9c4b-5809-b41f-da869669d056/d6852bac-9c4b-5809-b41f-da869669d056_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 70177,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_8ce46dfeed916921c4d6d36dca4dd68d.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6852bac-9c4b-5809-b41f-da869669d056/d6852bac-9c4b-5809-b41f-da869669d056_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 49661,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_35517d133c1cb1491101acbbd58b0594.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6852bac-9c4b-5809-b41f-da869669d056/d6852bac-9c4b-5809-b41f-da869669d056_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 71340,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_c04ea2507cc79d492260128cb22826f7.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6852bac-9c4b-5809-b41f-da869669d056/d6852bac-9c4b-5809-b41f-da869669d056_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 76078,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_19117f3066dee66a24d98d07501cc0c7.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6852bac-9c4b-5809-b41f-da869669d056/d6852bac-9c4b-5809-b41f-da869669d056_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 2321897,
                 'Height': 1536,
                 'OriginUrl': 'https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_2d45ce36945f8558fbc3206587c72c12.jpg',
                 'Width': 2048},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6852bac-9c4b-5809-b41f-da869669d056/d6852bac-9c4b-5809-b41f-da869669d056_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 74783,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_bbebc8ef77ef386983b53484989b5303.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6852bac-9c4b-5809-b41f-da869669d056/d6852bac-9c4b-5809-b41f-da869669d056_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 70183,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_6d6fbc23f3952d6a00b7d0c7dd932974.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6852bac-9c4b-5809-b41f-da869669d056/d6852bac-9c4b-5809-b41f-da869669d056_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 2406394,
                 'Height': 1536,
                 'OriginUrl': 'https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_8d846dc50d6c794d3db0af8a1581db78.jpg',
                 'Width': 2048},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6852bac-9c4b-5809-b41f-da869669d056/d6852bac-9c4b-5809-b41f-da869669d056_image_10.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 56541,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_47ad87d234cffd1af9a4b3aaddb0c85f.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6852bac-9c4b-5809-b41f-da869669d056/d6852bac-9c4b-5809-b41f-da869669d056_image_11.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 2884399,
                 'Height': 1536,
                 'OriginUrl': 'https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_ca48c3a9546739a460dafda9b705f1b8.jpg',
                 'Width': 2048},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6852bac-9c4b-5809-b41f-da869669d056/d6852bac-9c4b-5809-b41f-da869669d056_image_12.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 49943,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_5de68c96405fe5aade269215daaa031d.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6852bac-9c4b-5809-b41f-da869669d056/d6852bac-9c4b-5809-b41f-da869669d056_image_13.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 36497,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_a08394dffa90447ed22cd79295822388.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6852bac-9c4b-5809-b41f-da869669d056/d6852bac-9c4b-5809-b41f-da869669d056_image_14.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 64213,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_f73be4b5a7af3020ee4e5d66417fb9b2.jpg',
                 'Width': 800}],
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2021-05-31',
     'sanitized_make': 'ssangyong',
     'seats_number': 5,
     'seller_name': None,
     'title': 'ssangyong korando 1.6 td icon 4x2',
     'transmission': 'manual',
     'trim': 'icon 4x2',
     'year': 2021}
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.6L',
 'engine_horse_power': 136,
 'expiration_date': '2026-01-29T16:26:18Z',
 'fuel_type': 'diesel',
 'id': 'd6852bac-9c4b-5809-b41f-da869669d056',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AP23964',
 'listing': 'auction',
 'location': 'IT, Mariano Comense',
 'make': 'Ssangyong',
 'model': 'Korando',
 'odometer': 96700,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6852bac-9c4b-5809-b41f-da869669d056/d6852bac-9c4b-5809-b41f-da869669d056_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2491433,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_7bf0ed8817a66a6bdd65410861800d2a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6852bac-9c4b-5809-b41f-da869669d056/d6852bac-9c4b-5809-b41f-da869669d056_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74584,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_35e16d4013f8467ea4298938c29860aa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6852bac-9c4b-5809-b41f-da869669d056/d6852bac-9c4b-5809-b41f-da869669d056_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70177,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_8ce46dfeed916921c4d6d36dca4dd68d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6852bac-9c4b-5809-b41f-da869669d056/d6852bac-9c4b-5809-b41f-da869669d056_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49661,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_35517d133c1cb1491101acbbd58b0594.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6852bac-9c4b-5809-b41f-da869669d056/d6852bac-9c4b-5809-b41f-da869669d056_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71340,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_c04ea2507cc79d492260128cb22826f7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6852bac-9c4b-5809-b41f-da869669d056/d6852bac-9c4b-5809-b41f-da869669d056_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76078,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_19117f3066dee66a24d98d07501cc0c7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6852bac-9c4b-5809-b41f-da869669d056/d6852bac-9c4b-5809-b41f-da869669d056_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2321897,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_2d45ce36945f8558fbc3206587c72c12.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6852bac-9c4b-5809-b41f-da869669d056/d6852bac-9c4b-5809-b41f-da869669d056_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74783,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_bbebc8ef77ef386983b53484989b5303.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6852bac-9c4b-5809-b41f-da869669d056/d6852bac-9c4b-5809-b41f-da869669d056_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70183,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_6d6fbc23f3952d6a00b7d0c7dd932974.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6852bac-9c4b-5809-b41f-da869669d056/d6852bac-9c4b-5809-b41f-da869669d056_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2406394,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_8d846dc50d6c794d3db0af8a1581db78.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6852bac-9c4b-5809-b41f-da869669d056/d6852bac-9c4b-5809-b41f-da869669d056_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56541,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_47ad87d234cffd1af9a4b3aaddb0c85f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6852bac-9c4b-5809-b41f-da869669d056/d6852bac-9c4b-5809-b41f-da869669d056_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2884399,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_ca48c3a9546739a460dafda9b705f1b8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6852bac-9c4b-5809-b41f-da869669d056/d6852bac-9c4b-5809-b41f-da869669d056_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49943,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_5de68c96405fe5aade269215daaa031d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6852bac-9c4b-5809-b41f-da869669d056/d6852bac-9c4b-5809-b41f-da869669d056_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36497,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_a08394dffa90447ed22cd79295822388.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6852bac-9c4b-5809-b41f-da869669d056/d6852bac-9c4b-5809-b41f-da869669d056_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64213,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/cd/e1cd9ac9315909533fe538013abcce2c/pa/AP23964_f73be4b5a7af3020ee4e5d66417fb9b2.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-05-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ssangyong Korando 1.6 TD Icon 4x2',
 'transmission': 'manual',
 'trim': 'Icon 4x2',
 'year': 2021}
2026-01-28 20:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AP23964%27 HTTP/1.1" 200 None
2026-01-28 20:04:25 [auto1.it] INFO: Saving data for AP23964: {'created_time': 1769630665.311603, 'last_price_update_time': 1769630665.311613, 'auction_closing_time': 1769703978.0}
2026-01-28 20:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AP23964') HTTP/1.1" 204 0
2026-01-28 20:04:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/e4/2de443a529edfde728e09f1928d64710/pa/XP18402_d41f2e3da6e33d7ccfebc7b6026c6757.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/a4/57a41f04407b77fc18110f7a3d1df06f/pa/JY56965_fcd23ad8bd38b970a416bc15f34734a1.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/9b/5e9bd9af10ddf07ad6df01859299cca1/pa/XX61742_f9dd6a9b2cb7a2b3bcbc06a8557d9aed.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0be05c10>
2026-01-28 20:04:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa8f0b27-091b-5c48-a778-9f0012ab28b2/fa8f0b27-091b-5c48-a778-9f0012ab28b2_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252Fe4%252F2de443a529edfde728e09f1928d64710%252Fpa%252FXP18402_5c29ad533554dccfd4b69dab7cda356f.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/e4/2de443a529edfde728e09f1928d64710/pa/XP18402_5c29ad533554dccfd4b69dab7cda356f.jpg saved to cache
2026-01-28 20:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item fa8f0b27-091b-5c48-a778-9f0012ab28b2
2026-01-28 20:04:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09ea8950>
2026-01-28 20:04:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:04:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0218895-008c-5901-8d81-495dcbc7bbb2/c0218895-008c-5901-8d81-495dcbc7bbb2_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Fa4%252F57a41f04407b77fc18110f7a3d1df06f%252Fpa%252FJY56965_4a3e82bb14c3148d53b702b0908a0583.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/a4/57a41f04407b77fc18110f7a3d1df06f/pa/JY56965_4a3e82bb14c3148d53b702b0908a0583.jpg saved to cache
2026-01-28 20:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item c0218895-008c-5901-8d81-495dcbc7bbb2
2026-01-28 20:04:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b089a2110>
2026-01-28 20:04:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa8f0b27-091b-5c48-a778-9f0012ab28b2/fa8f0b27-091b-5c48-a778-9f0012ab28b2_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252Fe4%252F2de443a529edfde728e09f1928d64710%252Fpa%252FXP18402_ceea54df4bfef50267644325d21b828d.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/e4/2de443a529edfde728e09f1928d64710/pa/XP18402_ceea54df4bfef50267644325d21b828d.jpg saved to cache
2026-01-28 20:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item fa8f0b27-091b-5c48-a778-9f0012ab28b2
2026-01-28 20:04:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09df8d50>
2026-01-28 20:04:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4d9f98b-ae16-55ce-83a2-f5c7c8a02d91/a4d9f98b-ae16-55ce-83a2-f5c7c8a02d91_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F9b%252F5e9bd9af10ddf07ad6df01859299cca1%252Fpa%252FXX61742_58e8e1c7b598f153babe7851f3aafb10.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/9b/5e9bd9af10ddf07ad6df01859299cca1/pa/XX61742_58e8e1c7b598f153babe7851f3aafb10.jpg saved to cache
2026-01-28 20:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item a4d9f98b-ae16-55ce-83a2-f5c7c8a02d91
2026-01-28 20:04:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08cc7a90>
2026-01-28 20:04:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:04:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fc23a0d-7e51-556c-aa83-233656974dd8/1fc23a0d-7e51-556c-aa83-233656974dd8_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F8a%252F348a3e75b70a5c6a5a857ba46d5af98e%252Fpa%252FCU51863_afda6904984750e5b79eec1e1aaf516c.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/8a/348a3e75b70a5c6a5a857ba46d5af98e/pa/CU51863_afda6904984750e5b79eec1e1aaf516c.jpg saved to cache
2026-01-28 20:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1fc23a0d-7e51-556c-aa83-233656974dd8
2026-01-28 20:04:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1fc23a0d-7e51-556c-aa83-233656974dd8, skipping ID generation
2026-01-28 20:04:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1fc23a0d-7e51-556c-aa83-233656974dd8 with scrape type 1
2026-01-28 20:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 1fc23a0d-7e51-556c-aa83-233656974dd8 from tracking dictionaries
2026-01-28 20:04:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1fc23a0d-7e51-556c-aa83-233656974dd8 sending to next pipeline
2026-01-28 20:04:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1fc23a0d-7e51-556c-aa83-233656974dd8, identifier: CU51863
2026-01-28 20:04:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1fc23a0d-7e51-556c-aa83-233656974dd8 with identifier: CU51863
2026-01-28 20:04:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1fc23a0d-7e51-556c-aa83-233656974dd8 with identifier: CU51863
2026-01-28 20:04:26 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 167452 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    167452
2026-01-28 20:04:26 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 1fc23a0d-7e51-556c-aa83-233656974dd8 spider: auto1.it
2026-01-28 20:04:26 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 1fc23a0d-7e51-556c-aa83-233656974dd8 due to rule: high_mileage_for_country.json, error: 167452 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    167452
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.5L',
 'engine_horse_power': 115,
 'expiration_date': '2026-01-29T16:26:05Z',
 'fuel_type': 'diesel',
 'id': '1fc23a0d-7e51-556c-aa83-233656974dd8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CU51863',
 'listing': 'auction',
 'location': 'IT, Treviolo',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 167452,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fc23a0d-7e51-556c-aa83-233656974dd8/1fc23a0d-7e51-556c-aa83-233656974dd8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59340,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/8a/348a3e75b70a5c6a5a857ba46d5af98e/pa/CU51863_b2978ff22737e27be155c68b71e1c51a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fc23a0d-7e51-556c-aa83-233656974dd8/1fc23a0d-7e51-556c-aa83-233656974dd8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56410,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/8a/348a3e75b70a5c6a5a857ba46d5af98e/pa/CU51863_d6721547c3094646544f3fe96ed6c498.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fc23a0d-7e51-556c-aa83-233656974dd8/1fc23a0d-7e51-556c-aa83-233656974dd8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54658,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/8a/348a3e75b70a5c6a5a857ba46d5af98e/pa/CU51863_bfb4e01f297635aa2dc1b6857f4146c1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fc23a0d-7e51-556c-aa83-233656974dd8/1fc23a0d-7e51-556c-aa83-233656974dd8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42781,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/8a/348a3e75b70a5c6a5a857ba46d5af98e/pa/CU51863_9541b8796987c85ab9409c0a1a1a94b3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fc23a0d-7e51-556c-aa83-233656974dd8/1fc23a0d-7e51-556c-aa83-233656974dd8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57340,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/8a/348a3e75b70a5c6a5a857ba46d5af98e/pa/CU51863_b972ef4cf1aa404e0edb8d87ebbafacd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fc23a0d-7e51-556c-aa83-233656974dd8/1fc23a0d-7e51-556c-aa83-233656974dd8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64926,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/8a/348a3e75b70a5c6a5a857ba46d5af98e/pa/CU51863_afda6904984750e5b79eec1e1aaf516c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fc23a0d-7e51-556c-aa83-233656974dd8/1fc23a0d-7e51-556c-aa83-233656974dd8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53808,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/8a/348a3e75b70a5c6a5a857ba46d5af98e/pa/CU51863_4ac400b7800d1e559491a501b847d583.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fc23a0d-7e51-556c-aa83-233656974dd8/1fc23a0d-7e51-556c-aa83-233656974dd8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68746,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/8a/348a3e75b70a5c6a5a857ba46d5af98e/pa/CU51863_94372cc153a0a9e8e5b4900ebdae3231.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fc23a0d-7e51-556c-aa83-233656974dd8/1fc23a0d-7e51-556c-aa83-233656974dd8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54394,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/8a/348a3e75b70a5c6a5a857ba46d5af98e/pa/CU51863_a867b839db381aae1dbc59e39472fbaa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fc23a0d-7e51-556c-aa83-233656974dd8/1fc23a0d-7e51-556c-aa83-233656974dd8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53079,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/8a/348a3e75b70a5c6a5a857ba46d5af98e/pa/CU51863_104f5776ed017d5c371ae82d68933df0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fc23a0d-7e51-556c-aa83-233656974dd8/1fc23a0d-7e51-556c-aa83-233656974dd8_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61379,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/8a/348a3e75b70a5c6a5a857ba46d5af98e/pa/CU51863_4032f5a4f0e58f59cbdaec58b59d6777.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fc23a0d-7e51-556c-aa83-233656974dd8/1fc23a0d-7e51-556c-aa83-233656974dd8_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62300,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/8a/348a3e75b70a5c6a5a857ba46d5af98e/pa/CU51863_0d1487fe9a292d2e09054c4ed1196987.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fc23a0d-7e51-556c-aa83-233656974dd8/1fc23a0d-7e51-556c-aa83-233656974dd8_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69544,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/8a/348a3e75b70a5c6a5a857ba46d5af98e/pa/CU51863_165b5ec0b42a04f4246e985e404d4f03.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fc23a0d-7e51-556c-aa83-233656974dd8/1fc23a0d-7e51-556c-aa83-233656974dd8_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53599,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/8a/348a3e75b70a5c6a5a857ba46d5af98e/pa/CU51863_ad929bb1bb000021b7e323c553fd314f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fc23a0d-7e51-556c-aa83-233656974dd8/1fc23a0d-7e51-556c-aa83-233656974dd8_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48235,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/8a/348a3e75b70a5c6a5a857ba46d5af98e/pa/CU51863_f73cf4f1a1e1ccbbbdd32f13eab40886.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-09-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 d Premium',
 'transmission': 'automatic',
 'trim': 'Premium',
 'year': 2019}
2026-01-28 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CU51863%27 HTTP/1.1" 200 None
2026-01-28 20:04:26 [auto1.it] INFO: Saving data for CU51863: {'created_time': 1769630666.967523, 'last_price_update_time': 1769630666.967535, 'auction_closing_time': 1769703965.0}
2026-01-28 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CU51863') HTTP/1.1" 204 0
2026-01-28 20:04:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:04:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:04:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:04:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:04:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:04:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08c7a790>
2026-01-28 20:04:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa8f0b27-091b-5c48-a778-9f0012ab28b2/fa8f0b27-091b-5c48-a778-9f0012ab28b2_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252Fe4%252F2de443a529edfde728e09f1928d64710%252Fpa%252FXP18402_d41f2e3da6e33d7ccfebc7b6026c6757.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/e4/2de443a529edfde728e09f1928d64710/pa/XP18402_d41f2e3da6e33d7ccfebc7b6026c6757.jpg saved to cache
2026-01-28 20:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fa8f0b27-091b-5c48-a778-9f0012ab28b2
2026-01-28 20:04:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0a01f750>
2026-01-28 20:04:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0218895-008c-5901-8d81-495dcbc7bbb2/c0218895-008c-5901-8d81-495dcbc7bbb2_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Fa4%252F57a41f04407b77fc18110f7a3d1df06f%252Fpa%252FJY56965_fcd23ad8bd38b970a416bc15f34734a1.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/a4/57a41f04407b77fc18110f7a3d1df06f/pa/JY56965_fcd23ad8bd38b970a416bc15f34734a1.jpg saved to cache
2026-01-28 20:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c0218895-008c-5901-8d81-495dcbc7bbb2
2026-01-28 20:04:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09d7b810>
2026-01-28 20:04:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:04:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4d9f98b-ae16-55ce-83a2-f5c7c8a02d91/a4d9f98b-ae16-55ce-83a2-f5c7c8a02d91_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F9b%252F5e9bd9af10ddf07ad6df01859299cca1%252Fpa%252FXX61742_f9dd6a9b2cb7a2b3bcbc06a8557d9aed.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/9b/5e9bd9af10ddf07ad6df01859299cca1/pa/XX61742_f9dd6a9b2cb7a2b3bcbc06a8557d9aed.jpg saved to cache
2026-01-28 20:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a4d9f98b-ae16-55ce-83a2-f5c7c8a02d91
2026-01-28 20:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/5a/765a4222ce3836b6ffd97e3f1f7b8262/pa/JD87332_6b0505192a8fd35aeff1ad539a0cbb9b.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/5a/765a4222ce3836b6ffd97e3f1f7b8262/pa/JD87332_a99da0c3515d9bf4ad034182d84eb374.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/ce/e7ce544553ed0429a1b886b86fc834cb/pa/ZX31921_4bfebe2c3f53b7c3a1e53e0546a28b5c.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/9b/5e9bd9af10ddf07ad6df01859299cca1/pa/XX61742_56688d712bba6189f0d8a47aa52c9647.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/a4/57a41f04407b77fc18110f7a3d1df06f/pa/JY56965_00609c4172c1ab768c60d62f132c08b9.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:04:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08cd1e50>
2026-01-28 20:04:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0ca04ca-1890-54cc-80be-2205a411ef7d/f0ca04ca-1890-54cc-80be-2205a411ef7d_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F5a%252F765a4222ce3836b6ffd97e3f1f7b8262%252Fpa%252FJD87332_6b0505192a8fd35aeff1ad539a0cbb9b.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/5a/765a4222ce3836b6ffd97e3f1f7b8262/pa/JD87332_6b0505192a8fd35aeff1ad539a0cbb9b.jpg saved to cache
2026-01-28 20:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f0ca04ca-1890-54cc-80be-2205a411ef7d
2026-01-28 20:04:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/e4/2de443a529edfde728e09f1928d64710/pa/XP18402_e19bb9bfbb83f202924dacecbe71c713.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/e4/2de443a529edfde728e09f1928d64710/pa/XP18402_b0d94e9cb8c384726631623c75fa6875.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/a4/57a41f04407b77fc18110f7a3d1df06f/pa/JY56965_c6c3698aab43303ed80423bc01f2a436.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/9b/5e9bd9af10ddf07ad6df01859299cca1/pa/XX61742_fd47c3215c74c23acf2668aaa237e71b.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/a4/57a41f04407b77fc18110f7a3d1df06f/pa/JY56965_0a2f6bfad43d30a6544565cfc62defce.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/a4/57a41f04407b77fc18110f7a3d1df06f/pa/JY56965_050f804855e288a819f8d590d8aff6d2.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:04:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0a0a0c90>
2026-01-28 20:04:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:04:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0ca04ca-1890-54cc-80be-2205a411ef7d/f0ca04ca-1890-54cc-80be-2205a411ef7d_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F5a%252F765a4222ce3836b6ffd97e3f1f7b8262%252Fpa%252FJD87332_a99da0c3515d9bf4ad034182d84eb374.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/5a/765a4222ce3836b6ffd97e3f1f7b8262/pa/JD87332_a99da0c3515d9bf4ad034182d84eb374.jpg saved to cache
2026-01-28 20:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f0ca04ca-1890-54cc-80be-2205a411ef7d
2026-01-28 20:04:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f0ca04ca-1890-54cc-80be-2205a411ef7d, skipping ID generation
2026-01-28 20:04:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f0ca04ca-1890-54cc-80be-2205a411ef7d with scrape type 1
2026-01-28 20:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Removing item f0ca04ca-1890-54cc-80be-2205a411ef7d from tracking dictionaries
2026-01-28 20:04:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f0ca04ca-1890-54cc-80be-2205a411ef7d sending to next pipeline
2026-01-28 20:04:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f0ca04ca-1890-54cc-80be-2205a411ef7d, identifier: JD87332
2026-01-28 20:04:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:04:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08cd0b90>
2026-01-28 20:04:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:04:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a68fae47-969d-5ba4-b17d-2758a3bcdfdb/a68fae47-969d-5ba4-b17d-2758a3bcdfdb_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fce%252Fe7ce544553ed0429a1b886b86fc834cb%252Fpa%252FZX31921_4bfebe2c3f53b7c3a1e53e0546a28b5c.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/ce/e7ce544553ed0429a1b886b86fc834cb/pa/ZX31921_4bfebe2c3f53b7c3a1e53e0546a28b5c.jpg saved to cache
2026-01-28 20:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a68fae47-969d-5ba4-b17d-2758a3bcdfdb
2026-01-28 20:04:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a68fae47-969d-5ba4-b17d-2758a3bcdfdb, skipping ID generation
2026-01-28 20:04:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a68fae47-969d-5ba4-b17d-2758a3bcdfdb with scrape type 1
2026-01-28 20:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Removing item a68fae47-969d-5ba4-b17d-2758a3bcdfdb from tracking dictionaries
2026-01-28 20:04:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a68fae47-969d-5ba4-b17d-2758a3bcdfdb sending to next pipeline
2026-01-28 20:04:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a68fae47-969d-5ba4-b17d-2758a3bcdfdb, identifier: ZX31921
2026-01-28 20:04:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08cba3d0>
2026-01-28 20:04:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:04:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4d9f98b-ae16-55ce-83a2-f5c7c8a02d91/a4d9f98b-ae16-55ce-83a2-f5c7c8a02d91_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F9b%252F5e9bd9af10ddf07ad6df01859299cca1%252Fpa%252FXX61742_56688d712bba6189f0d8a47aa52c9647.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/9b/5e9bd9af10ddf07ad6df01859299cca1/pa/XX61742_56688d712bba6189f0d8a47aa52c9647.jpg saved to cache
2026-01-28 20:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a4d9f98b-ae16-55ce-83a2-f5c7c8a02d91
2026-01-28 20:04:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08b29810>
2026-01-28 20:04:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:04:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0218895-008c-5901-8d81-495dcbc7bbb2/c0218895-008c-5901-8d81-495dcbc7bbb2_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Fa4%252F57a41f04407b77fc18110f7a3d1df06f%252Fpa%252FJY56965_00609c4172c1ab768c60d62f132c08b9.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/a4/57a41f04407b77fc18110f7a3d1df06f/pa/JY56965_00609c4172c1ab768c60d62f132c08b9.jpg saved to cache
2026-01-28 20:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c0218895-008c-5901-8d81-495dcbc7bbb2
2026-01-28 20:04:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f0ca04ca-1890-54cc-80be-2205a411ef7d with identifier: JD87332
2026-01-28 20:04:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f0ca04ca-1890-54cc-80be-2205a411ef7d with identifier: JD87332
2026-01-28 20:04:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f0ca04ca-1890-54cc-80be-2205a411ef7d with identifier: JD87332 to the API
2026-01-28 20:04:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:04:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:04:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img76/5a/765a4222ce3836b6ffd97e3f1f7b8262/pa/JD87332_a99da0c3515d9bf4ad034182d84eb374.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.6L',
 'engine_horse_power': 143,
 'expiration_date': '2026-01-29T16:43:30Z',
 'fuel_type': 'hybrid',
 'id': 'f0ca04ca-1890-54cc-80be-2205a411ef7d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JD87332',
 'listing': 'auction',
 'location': 'IT, Massa',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 33478,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0ca04ca-1890-54cc-80be-2205a411ef7d/f0ca04ca-1890-54cc-80be-2205a411ef7d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2630550,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img76/5a/765a4222ce3836b6ffd97e3f1f7b8262/pa/JD87332_0d2f7d1b698eb3f511c2edd0667f9c03.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0ca04ca-1890-54cc-80be-2205a411ef7d/f0ca04ca-1890-54cc-80be-2205a411ef7d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2538791,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img76/5a/765a4222ce3836b6ffd97e3f1f7b8262/pa/JD87332_886f2b90087af7e652496f05f6513cdb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0ca04ca-1890-54cc-80be-2205a411ef7d/f0ca04ca-1890-54cc-80be-2205a411ef7d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2440672,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img76/5a/765a4222ce3836b6ffd97e3f1f7b8262/pa/JD87332_3efa8f3484bc87f6700c9f37ba27ca2a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0ca04ca-1890-54cc-80be-2205a411ef7d/f0ca04ca-1890-54cc-80be-2205a411ef7d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2340610,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img76/5a/765a4222ce3836b6ffd97e3f1f7b8262/pa/JD87332_f6c4db9de265839aa03d9788a8e4ac6d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0ca04ca-1890-54cc-80be-2205a411ef7d/f0ca04ca-1890-54cc-80be-2205a411ef7d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2396470,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img76/5a/765a4222ce3836b6ffd97e3f1f7b8262/pa/JD87332_a99da0c3515d9bf4ad034182d84eb374.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0ca04ca-1890-54cc-80be-2205a411ef7d/f0ca04ca-1890-54cc-80be-2205a411ef7d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2436328,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img76/5a/765a4222ce3836b6ffd97e3f1f7b8262/pa/JD87332_6b0505192a8fd35aeff1ad539a0cbb9b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0ca04ca-1890-54cc-80be-2205a411ef7d/f0ca04ca-1890-54cc-80be-2205a411ef7d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63866,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/5a/765a4222ce3836b6ffd97e3f1f7b8262/pa/JD87332_638dbae7eccab166cabb66508b8fc166.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0ca04ca-1890-54cc-80be-2205a411ef7d/f0ca04ca-1890-54cc-80be-2205a411ef7d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2562379,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img76/5a/765a4222ce3836b6ffd97e3f1f7b8262/pa/JD87332_18d7e2d28916ff2fbfbd368bde3e2d22.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0ca04ca-1890-54cc-80be-2205a411ef7d/f0ca04ca-1890-54cc-80be-2205a411ef7d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72174,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/5a/765a4222ce3836b6ffd97e3f1f7b8262/pa/JD87332_1e8a35ffa8b57dce88e9a71ab1b73032.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0ca04ca-1890-54cc-80be-2205a411ef7d/f0ca04ca-1890-54cc-80be-2205a411ef7d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2496537,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img76/5a/765a4222ce3836b6ffd97e3f1f7b8262/pa/JD87332_f999195152883e30410333448b19e204.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0ca04ca-1890-54cc-80be-2205a411ef7d/f0ca04ca-1890-54cc-80be-2205a411ef7d_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2282735,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img76/5a/765a4222ce3836b6ffd97e3f1f7b8262/pa/JD87332_96aed343583d6b6a2d6e58f8d86383e9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0ca04ca-1890-54cc-80be-2205a411ef7d/f0ca04ca-1890-54cc-80be-2205a411ef7d_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2392278,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img76/5a/765a4222ce3836b6ffd97e3f1f7b8262/pa/JD87332_dcbe6c9cbb38333cc4cb925463a06fdc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0ca04ca-1890-54cc-80be-2205a411ef7d/f0ca04ca-1890-54cc-80be-2205a411ef7d_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50737,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/5a/765a4222ce3836b6ffd97e3f1f7b8262/pa/JD87332_f670f9d30e733118991a231063875eff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0ca04ca-1890-54cc-80be-2205a411ef7d/f0ca04ca-1890-54cc-80be-2205a411ef7d_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2212599,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img76/5a/765a4222ce3836b6ffd97e3f1f7b8262/pa/JD87332_d0f80bdcad2d578b123e6b0df42934d0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0ca04ca-1890-54cc-80be-2205a411ef7d/f0ca04ca-1890-54cc-80be-2205a411ef7d_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61179,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/5a/765a4222ce3836b6ffd97e3f1f7b8262/pa/JD87332_3f2681b19e5d4c494ae3caa57ca9f6d9.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-04-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Captur 1.6 Hybrid E-Tech Intens',
 'transmission': 'automatic',
 'trim': 'Intens',
 'year': 2022}
2026-01-28 20:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JD87332%27 HTTP/1.1" 200 None
2026-01-28 20:04:30 [auto1.it] INFO: Saving data for JD87332: {'created_time': 1769630670.117354, 'last_price_update_time': 1769630670.117365, 'auction_closing_time': 1769705010.0}
2026-01-28 20:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JD87332') HTTP/1.1" 204 0
2026-01-28 20:04:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a68fae47-969d-5ba4-b17d-2758a3bcdfdb with identifier: ZX31921
2026-01-28 20:04:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a68fae47-969d-5ba4-b17d-2758a3bcdfdb with identifier: ZX31921
2026-01-28 20:04:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a68fae47-969d-5ba4-b17d-2758a3bcdfdb with identifier: ZX31921 to the API
2026-01-28 20:04:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:04:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:04:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge7/ce/e7ce544553ed0429a1b886b86fc834cb/pa/ZX31921_4bfebe2c3f53b7c3a1e53e0546a28b5c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.0L',
 'engine_horse_power': 95,
 'expiration_date': '2026-01-29T16:16:37Z',
 'fuel_type': 'petrol',
 'id': 'a68fae47-969d-5ba4-b17d-2758a3bcdfdb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZX31921',
 'listing': 'auction',
 'location': 'IT, Ravenna',
 'make': 'Seat',
 'model': 'Arona',
 'odometer': 62968,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a68fae47-969d-5ba4-b17d-2758a3bcdfdb/a68fae47-969d-5ba4-b17d-2758a3bcdfdb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2689966,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/ce/e7ce544553ed0429a1b886b86fc834cb/pa/ZX31921_4bfebe2c3f53b7c3a1e53e0546a28b5c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a68fae47-969d-5ba4-b17d-2758a3bcdfdb/a68fae47-969d-5ba4-b17d-2758a3bcdfdb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69458,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/ce/e7ce544553ed0429a1b886b86fc834cb/pa/ZX31921_5a42f150197b25bfa8ea146840be53db.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a68fae47-969d-5ba4-b17d-2758a3bcdfdb/a68fae47-969d-5ba4-b17d-2758a3bcdfdb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74871,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/ce/e7ce544553ed0429a1b886b86fc834cb/pa/ZX31921_938c6ad73a886a120e3c46b8e45fc615.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a68fae47-969d-5ba4-b17d-2758a3bcdfdb/a68fae47-969d-5ba4-b17d-2758a3bcdfdb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2296317,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/ce/e7ce544553ed0429a1b886b86fc834cb/pa/ZX31921_c1e40b6577af0e5b615de2199d48d73d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a68fae47-969d-5ba4-b17d-2758a3bcdfdb/a68fae47-969d-5ba4-b17d-2758a3bcdfdb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2615391,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/ce/e7ce544553ed0429a1b886b86fc834cb/pa/ZX31921_086b4f22effb09b271f75bc7b08add02.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a68fae47-969d-5ba4-b17d-2758a3bcdfdb/a68fae47-969d-5ba4-b17d-2758a3bcdfdb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2646751,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/ce/e7ce544553ed0429a1b886b86fc834cb/pa/ZX31921_a773bc2dc35b097520ddf77ef96900d4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a68fae47-969d-5ba4-b17d-2758a3bcdfdb/a68fae47-969d-5ba4-b17d-2758a3bcdfdb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2253745,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/ce/e7ce544553ed0429a1b886b86fc834cb/pa/ZX31921_0df6e726b2d5329cae105466d116f13b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a68fae47-969d-5ba4-b17d-2758a3bcdfdb/a68fae47-969d-5ba4-b17d-2758a3bcdfdb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2501473,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/ce/e7ce544553ed0429a1b886b86fc834cb/pa/ZX31921_aed1ba9fe0e2bd60e56a0ee7f316b3bf.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a68fae47-969d-5ba4-b17d-2758a3bcdfdb/a68fae47-969d-5ba4-b17d-2758a3bcdfdb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79714,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/ce/e7ce544553ed0429a1b886b86fc834cb/pa/ZX31921_0c730c50957a08c7806c16bb4c4f76f7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a68fae47-969d-5ba4-b17d-2758a3bcdfdb/a68fae47-969d-5ba4-b17d-2758a3bcdfdb_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64395,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/ce/e7ce544553ed0429a1b886b86fc834cb/pa/ZX31921_18d8aa392503eb26e86c68538aa15095.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a68fae47-969d-5ba4-b17d-2758a3bcdfdb/a68fae47-969d-5ba4-b17d-2758a3bcdfdb_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50096,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/ce/e7ce544553ed0429a1b886b86fc834cb/pa/ZX31921_61e71c22188c1fe5145e269d86fbd618.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a68fae47-969d-5ba4-b17d-2758a3bcdfdb/a68fae47-969d-5ba4-b17d-2758a3bcdfdb_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3055129,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/ce/e7ce544553ed0429a1b886b86fc834cb/pa/ZX31921_ca7313e5807e7c634ab5990bd39edb3b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a68fae47-969d-5ba4-b17d-2758a3bcdfdb/a68fae47-969d-5ba4-b17d-2758a3bcdfdb_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48968,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/ce/e7ce544553ed0429a1b886b86fc834cb/pa/ZX31921_32a833fa6580fcc7517b8710ddff0de3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a68fae47-969d-5ba4-b17d-2758a3bcdfdb/a68fae47-969d-5ba4-b17d-2758a3bcdfdb_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38502,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/ce/e7ce544553ed0429a1b886b86fc834cb/pa/ZX31921_ed899fdf4a5155d1a331557a0a1685ef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a68fae47-969d-5ba4-b17d-2758a3bcdfdb/a68fae47-969d-5ba4-b17d-2758a3bcdfdb_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39976,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/ce/e7ce544553ed0429a1b886b86fc834cb/pa/ZX31921_60176a80929102600fcd2304eea8f636.jpg',
             'Width': 450}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-03-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Arona 1.0 TSI FR',
 'transmission': 'manual',
 'trim': 'FR',
 'year': 2023}
2026-01-28 20:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZX31921%27 HTTP/1.1" 200 None
2026-01-28 20:04:30 [auto1.it] INFO: Saving data for ZX31921: {'created_time': 1769630670.529127, 'last_price_update_time': 1769630670.529139, 'auction_closing_time': 1769703397.0}
2026-01-28 20:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZX31921') HTTP/1.1" 204 0
2026-01-28 20:04:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BM83226/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:04:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PW84021/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:04:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NF03892/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:04:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YE02110/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:04:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UD73720/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:04:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:04:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:04:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:04:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:04:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:04:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:04:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09e62650>
2026-01-28 20:04:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:04:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa8f0b27-091b-5c48-a778-9f0012ab28b2/fa8f0b27-091b-5c48-a778-9f0012ab28b2_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252Fe4%252F2de443a529edfde728e09f1928d64710%252Fpa%252FXP18402_e19bb9bfbb83f202924dacecbe71c713.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/e4/2de443a529edfde728e09f1928d64710/pa/XP18402_e19bb9bfbb83f202924dacecbe71c713.jpg saved to cache
2026-01-28 20:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fa8f0b27-091b-5c48-a778-9f0012ab28b2
2026-01-28 20:04:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08c66d10>
2026-01-28 20:04:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:04:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa8f0b27-091b-5c48-a778-9f0012ab28b2/fa8f0b27-091b-5c48-a778-9f0012ab28b2_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252Fe4%252F2de443a529edfde728e09f1928d64710%252Fpa%252FXP18402_b0d94e9cb8c384726631623c75fa6875.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/e4/2de443a529edfde728e09f1928d64710/pa/XP18402_b0d94e9cb8c384726631623c75fa6875.jpg saved to cache
2026-01-28 20:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fa8f0b27-091b-5c48-a778-9f0012ab28b2
2026-01-28 20:04:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fa8f0b27-091b-5c48-a778-9f0012ab28b2, skipping ID generation
2026-01-28 20:04:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa8f0b27-091b-5c48-a778-9f0012ab28b2 with scrape type 1
2026-01-28 20:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Removing item fa8f0b27-091b-5c48-a778-9f0012ab28b2 from tracking dictionaries
2026-01-28 20:04:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fa8f0b27-091b-5c48-a778-9f0012ab28b2 sending to next pipeline
2026-01-28 20:04:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: fa8f0b27-091b-5c48-a778-9f0012ab28b2, identifier: XP18402
2026-01-28 20:04:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b089b9950>
2026-01-28 20:04:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:04:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0218895-008c-5901-8d81-495dcbc7bbb2/c0218895-008c-5901-8d81-495dcbc7bbb2_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Fa4%252F57a41f04407b77fc18110f7a3d1df06f%252Fpa%252FJY56965_c6c3698aab43303ed80423bc01f2a436.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/a4/57a41f04407b77fc18110f7a3d1df06f/pa/JY56965_c6c3698aab43303ed80423bc01f2a436.jpg saved to cache
2026-01-28 20:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c0218895-008c-5901-8d81-495dcbc7bbb2
2026-01-28 20:04:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b086fa890>
2026-01-28 20:04:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:04:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4d9f98b-ae16-55ce-83a2-f5c7c8a02d91/a4d9f98b-ae16-55ce-83a2-f5c7c8a02d91_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F9b%252F5e9bd9af10ddf07ad6df01859299cca1%252Fpa%252FXX61742_fd47c3215c74c23acf2668aaa237e71b.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/9b/5e9bd9af10ddf07ad6df01859299cca1/pa/XX61742_fd47c3215c74c23acf2668aaa237e71b.jpg saved to cache
2026-01-28 20:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a4d9f98b-ae16-55ce-83a2-f5c7c8a02d91
2026-01-28 20:04:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a4d9f98b-ae16-55ce-83a2-f5c7c8a02d91, skipping ID generation
2026-01-28 20:04:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4d9f98b-ae16-55ce-83a2-f5c7c8a02d91 with scrape type 1
2026-01-28 20:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Removing item a4d9f98b-ae16-55ce-83a2-f5c7c8a02d91 from tracking dictionaries
2026-01-28 20:04:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a4d9f98b-ae16-55ce-83a2-f5c7c8a02d91 sending to next pipeline
2026-01-28 20:04:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a4d9f98b-ae16-55ce-83a2-f5c7c8a02d91, identifier: XX61742
2026-01-28 20:04:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09ea9650>
2026-01-28 20:04:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:04:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0218895-008c-5901-8d81-495dcbc7bbb2/c0218895-008c-5901-8d81-495dcbc7bbb2_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Fa4%252F57a41f04407b77fc18110f7a3d1df06f%252Fpa%252FJY56965_0a2f6bfad43d30a6544565cfc62defce.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/a4/57a41f04407b77fc18110f7a3d1df06f/pa/JY56965_0a2f6bfad43d30a6544565cfc62defce.jpg saved to cache
2026-01-28 20:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c0218895-008c-5901-8d81-495dcbc7bbb2
2026-01-28 20:04:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0a03b6d0>
2026-01-28 20:04:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:04:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0218895-008c-5901-8d81-495dcbc7bbb2/c0218895-008c-5901-8d81-495dcbc7bbb2_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Fa4%252F57a41f04407b77fc18110f7a3d1df06f%252Fpa%252FJY56965_050f804855e288a819f8d590d8aff6d2.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/a4/57a41f04407b77fc18110f7a3d1df06f/pa/JY56965_050f804855e288a819f8d590d8aff6d2.jpg saved to cache
2026-01-28 20:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c0218895-008c-5901-8d81-495dcbc7bbb2
2026-01-28 20:04:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c0218895-008c-5901-8d81-495dcbc7bbb2, skipping ID generation
2026-01-28 20:04:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0218895-008c-5901-8d81-495dcbc7bbb2 with scrape type 1
2026-01-28 20:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Removing item c0218895-008c-5901-8d81-495dcbc7bbb2 from tracking dictionaries
2026-01-28 20:04:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c0218895-008c-5901-8d81-495dcbc7bbb2 sending to next pipeline
2026-01-28 20:04:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c0218895-008c-5901-8d81-495dcbc7bbb2, identifier: JY56965
2026-01-28 20:04:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: fa8f0b27-091b-5c48-a778-9f0012ab28b2 with identifier: XP18402
2026-01-28 20:04:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: fa8f0b27-091b-5c48-a778-9f0012ab28b2 with identifier: XP18402
2026-01-28 20:04:32 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 152064 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    152064
2026-01-28 20:04:32 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: fa8f0b27-091b-5c48-a778-9f0012ab28b2 spider: auto1.it
2026-01-28 20:04:32 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: fa8f0b27-091b-5c48-a778-9f0012ab28b2 due to rule: high_mileage_for_country.json, error: 152064 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    152064
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.9L',
 'engine_horse_power': 116,
 'expiration_date': '2026-01-29T16:37:49Z',
 'fuel_type': 'diesel',
 'id': 'fa8f0b27-091b-5c48-a778-9f0012ab28b2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XP18402',
 'listing': 'auction',
 'location': 'IT, Torino',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 152064,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa8f0b27-091b-5c48-a778-9f0012ab28b2/fa8f0b27-091b-5c48-a778-9f0012ab28b2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57019,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/e4/2de443a529edfde728e09f1928d64710/pa/XP18402_2c15ce9b267c2bc6a3a0cd139e588cfe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa8f0b27-091b-5c48-a778-9f0012ab28b2/fa8f0b27-091b-5c48-a778-9f0012ab28b2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50598,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/e4/2de443a529edfde728e09f1928d64710/pa/XP18402_b0d94e9cb8c384726631623c75fa6875.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa8f0b27-091b-5c48-a778-9f0012ab28b2/fa8f0b27-091b-5c48-a778-9f0012ab28b2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55140,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/e4/2de443a529edfde728e09f1928d64710/pa/XP18402_e19bb9bfbb83f202924dacecbe71c713.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa8f0b27-091b-5c48-a778-9f0012ab28b2/fa8f0b27-091b-5c48-a778-9f0012ab28b2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40393,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/e4/2de443a529edfde728e09f1928d64710/pa/XP18402_236365bb07935c4c80f6556a2350cb78.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa8f0b27-091b-5c48-a778-9f0012ab28b2/fa8f0b27-091b-5c48-a778-9f0012ab28b2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50803,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/e4/2de443a529edfde728e09f1928d64710/pa/XP18402_b4d89e4f58a20340e30c4835646acfaf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa8f0b27-091b-5c48-a778-9f0012ab28b2/fa8f0b27-091b-5c48-a778-9f0012ab28b2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54292,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/e4/2de443a529edfde728e09f1928d64710/pa/XP18402_d39670086632f2690b93db51ba841997.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa8f0b27-091b-5c48-a778-9f0012ab28b2/fa8f0b27-091b-5c48-a778-9f0012ab28b2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43471,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/e4/2de443a529edfde728e09f1928d64710/pa/XP18402_acb9276a682ba1cab636099711389da9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa8f0b27-091b-5c48-a778-9f0012ab28b2/fa8f0b27-091b-5c48-a778-9f0012ab28b2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55197,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/e4/2de443a529edfde728e09f1928d64710/pa/XP18402_d41f2e3da6e33d7ccfebc7b6026c6757.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa8f0b27-091b-5c48-a778-9f0012ab28b2/fa8f0b27-091b-5c48-a778-9f0012ab28b2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56221,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/e4/2de443a529edfde728e09f1928d64710/pa/XP18402_be489d1b440dabb7fcd0a388254f6f51.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa8f0b27-091b-5c48-a778-9f0012ab28b2/fa8f0b27-091b-5c48-a778-9f0012ab28b2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60215,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/e4/2de443a529edfde728e09f1928d64710/pa/XP18402_b1b3143445852d3e711aa5e1a18c661f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa8f0b27-091b-5c48-a778-9f0012ab28b2/fa8f0b27-091b-5c48-a778-9f0012ab28b2_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46117,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/e4/2de443a529edfde728e09f1928d64710/pa/XP18402_ceea54df4bfef50267644325d21b828d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa8f0b27-091b-5c48-a778-9f0012ab28b2/fa8f0b27-091b-5c48-a778-9f0012ab28b2_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59463,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/e4/2de443a529edfde728e09f1928d64710/pa/XP18402_cc5781d90409e0f5672023e79e32c5cc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa8f0b27-091b-5c48-a778-9f0012ab28b2/fa8f0b27-091b-5c48-a778-9f0012ab28b2_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60369,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/e4/2de443a529edfde728e09f1928d64710/pa/XP18402_f51058e9a8a454cd8659b29ee389edfd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa8f0b27-091b-5c48-a778-9f0012ab28b2/fa8f0b27-091b-5c48-a778-9f0012ab28b2_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40436,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/e4/2de443a529edfde728e09f1928d64710/pa/XP18402_37c4b6ca0707c1627abbbfefdf544ac1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa8f0b27-091b-5c48-a778-9f0012ab28b2/fa8f0b27-091b-5c48-a778-9f0012ab28b2_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44534,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/e4/2de443a529edfde728e09f1928d64710/pa/XP18402_5c29ad533554dccfd4b69dab7cda356f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-02-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 180 d Progressive',
 'transmission': 'automatic',
 'trim': 'Progressive',
 'year': 2023}
2026-01-28 20:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XP18402%27 HTTP/1.1" 200 None
2026-01-28 20:04:32 [auto1.it] INFO: Saving data for XP18402: {'created_time': 1769630672.839893, 'last_price_update_time': 1769630672.839904, 'auction_closing_time': 1769704669.0}
2026-01-28 20:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XP18402') HTTP/1.1" 204 0
2026-01-28 20:04:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a4d9f98b-ae16-55ce-83a2-f5c7c8a02d91 with identifier: XX61742
2026-01-28 20:04:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a4d9f98b-ae16-55ce-83a2-f5c7c8a02d91 with identifier: XX61742
2026-01-28 20:04:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a4d9f98b-ae16-55ce-83a2-f5c7c8a02d91 with identifier: XX61742 to the API
2026-01-28 20:04:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:04:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:04:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img5e/9b/5e9bd9af10ddf07ad6df01859299cca1/pa/XX61742_fd47c3215c74c23acf2668aaa237e71b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.0L',
 'engine_horse_power': 101,
 'expiration_date': '2026-01-29T16:57:53Z',
 'fuel_type': 'gas',
 'id': 'a4d9f98b-ae16-55ce-83a2-f5c7c8a02d91',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XX61742',
 'listing': 'auction',
 'location': 'IT, Perugia',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 63093,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4d9f98b-ae16-55ce-83a2-f5c7c8a02d91/a4d9f98b-ae16-55ce-83a2-f5c7c8a02d91_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48246,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/9b/5e9bd9af10ddf07ad6df01859299cca1/pa/XX61742_c8fb31742eedcd4f07abea42a8352e4d.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4d9f98b-ae16-55ce-83a2-f5c7c8a02d91/a4d9f98b-ae16-55ce-83a2-f5c7c8a02d91_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102477,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/9b/5e9bd9af10ddf07ad6df01859299cca1/pa/XX61742_56688d712bba6189f0d8a47aa52c9647.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4d9f98b-ae16-55ce-83a2-f5c7c8a02d91/a4d9f98b-ae16-55ce-83a2-f5c7c8a02d91_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52479,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/9b/5e9bd9af10ddf07ad6df01859299cca1/pa/XX61742_fd47c3215c74c23acf2668aaa237e71b.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4d9f98b-ae16-55ce-83a2-f5c7c8a02d91/a4d9f98b-ae16-55ce-83a2-f5c7c8a02d91_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76681,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/9b/5e9bd9af10ddf07ad6df01859299cca1/pa/XX61742_401647714336b4339515822649e9dc5c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4d9f98b-ae16-55ce-83a2-f5c7c8a02d91/a4d9f98b-ae16-55ce-83a2-f5c7c8a02d91_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41172,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/9b/5e9bd9af10ddf07ad6df01859299cca1/pa/XX61742_5ef9c9da55148f34bc0b39f65427b656.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4d9f98b-ae16-55ce-83a2-f5c7c8a02d91/a4d9f98b-ae16-55ce-83a2-f5c7c8a02d91_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48988,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/9b/5e9bd9af10ddf07ad6df01859299cca1/pa/XX61742_bd0c58dd4b24d7b399e4822ae2e0e5c0.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4d9f98b-ae16-55ce-83a2-f5c7c8a02d91/a4d9f98b-ae16-55ce-83a2-f5c7c8a02d91_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91419,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/9b/5e9bd9af10ddf07ad6df01859299cca1/pa/XX61742_70acfbb53262fb1288c0f0811ee2f1e6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4d9f98b-ae16-55ce-83a2-f5c7c8a02d91/a4d9f98b-ae16-55ce-83a2-f5c7c8a02d91_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92003,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/9b/5e9bd9af10ddf07ad6df01859299cca1/pa/XX61742_f9dd6a9b2cb7a2b3bcbc06a8557d9aed.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4d9f98b-ae16-55ce-83a2-f5c7c8a02d91/a4d9f98b-ae16-55ce-83a2-f5c7c8a02d91_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42358,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/9b/5e9bd9af10ddf07ad6df01859299cca1/pa/XX61742_9865870780dac156c10b92c8517270bd.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4d9f98b-ae16-55ce-83a2-f5c7c8a02d91/a4d9f98b-ae16-55ce-83a2-f5c7c8a02d91_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78583,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/9b/5e9bd9af10ddf07ad6df01859299cca1/pa/XX61742_e550ec4f5ea0d15db4f52b1f472dfac9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4d9f98b-ae16-55ce-83a2-f5c7c8a02d91/a4d9f98b-ae16-55ce-83a2-f5c7c8a02d91_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81539,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/9b/5e9bd9af10ddf07ad6df01859299cca1/pa/XX61742_c9fc1839b164bd1c0789da07d7653d33.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4d9f98b-ae16-55ce-83a2-f5c7c8a02d91/a4d9f98b-ae16-55ce-83a2-f5c7c8a02d91_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83010,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/9b/5e9bd9af10ddf07ad6df01859299cca1/pa/XX61742_29c73269c418087a349f25da1a5d733d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4d9f98b-ae16-55ce-83a2-f5c7c8a02d91/a4d9f98b-ae16-55ce-83a2-f5c7c8a02d91_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2521584,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/9b/5e9bd9af10ddf07ad6df01859299cca1/pa/XX61742_11e21e770c31bbb819199e42b5f791e8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4d9f98b-ae16-55ce-83a2-f5c7c8a02d91/a4d9f98b-ae16-55ce-83a2-f5c7c8a02d91_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60372,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/9b/5e9bd9af10ddf07ad6df01859299cca1/pa/XX61742_d631ad4c3e3620b6432a89e006bcdece.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4d9f98b-ae16-55ce-83a2-f5c7c8a02d91/a4d9f98b-ae16-55ce-83a2-f5c7c8a02d91_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81214,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/9b/5e9bd9af10ddf07ad6df01859299cca1/pa/XX61742_58e8e1c7b598f153babe7851f3aafb10.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-01-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Dacia Sandero 1.0 TCe LPG Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2022}
2026-01-28 20:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XX61742%27 HTTP/1.1" 200 None
2026-01-28 20:04:33 [auto1.it] INFO: Saving data for XX61742: {'created_time': 1769630673.262667, 'last_price_update_time': 1769630673.262677, 'auction_closing_time': 1769705873.0}
2026-01-28 20:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XX61742') HTTP/1.1" 204 0
2026-01-28 20:04:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c0218895-008c-5901-8d81-495dcbc7bbb2 with identifier: JY56965
2026-01-28 20:04:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c0218895-008c-5901-8d81-495dcbc7bbb2 with identifier: JY56965
2026-01-28 20:04:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c0218895-008c-5901-8d81-495dcbc7bbb2 with identifier: JY56965 to the API
2026-01-28 20:04:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:04:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:04:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img57/a4/57a41f04407b77fc18110f7a3d1df06f/pa/JY56965_050f804855e288a819f8d590d8aff6d2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.0L',
 'engine_horse_power': 120,
 'expiration_date': '2026-01-29T16:13:31Z',
 'fuel_type': 'petrol',
 'id': 'c0218895-008c-5901-8d81-495dcbc7bbb2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JY56965',
 'listing': 'auction',
 'location': 'IT, Ferrara',
 'make': 'Fiat',
 'model': '500X',
 'odometer': 78834,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0218895-008c-5901-8d81-495dcbc7bbb2/c0218895-008c-5901-8d81-495dcbc7bbb2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69776,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/a4/57a41f04407b77fc18110f7a3d1df06f/pa/JY56965_00609c4172c1ab768c60d62f132c08b9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0218895-008c-5901-8d81-495dcbc7bbb2/c0218895-008c-5901-8d81-495dcbc7bbb2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69006,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/a4/57a41f04407b77fc18110f7a3d1df06f/pa/JY56965_050f804855e288a819f8d590d8aff6d2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0218895-008c-5901-8d81-495dcbc7bbb2/c0218895-008c-5901-8d81-495dcbc7bbb2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62845,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/a4/57a41f04407b77fc18110f7a3d1df06f/pa/JY56965_c6c3698aab43303ed80423bc01f2a436.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0218895-008c-5901-8d81-495dcbc7bbb2/c0218895-008c-5901-8d81-495dcbc7bbb2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59641,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/a4/57a41f04407b77fc18110f7a3d1df06f/pa/JY56965_372381d539c1b0995dd4388a6739c767.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0218895-008c-5901-8d81-495dcbc7bbb2/c0218895-008c-5901-8d81-495dcbc7bbb2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57269,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/a4/57a41f04407b77fc18110f7a3d1df06f/pa/JY56965_0a2f6bfad43d30a6544565cfc62defce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0218895-008c-5901-8d81-495dcbc7bbb2/c0218895-008c-5901-8d81-495dcbc7bbb2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61984,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/a4/57a41f04407b77fc18110f7a3d1df06f/pa/JY56965_fcd23ad8bd38b970a416bc15f34734a1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0218895-008c-5901-8d81-495dcbc7bbb2/c0218895-008c-5901-8d81-495dcbc7bbb2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52619,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/a4/57a41f04407b77fc18110f7a3d1df06f/pa/JY56965_cdb40600efed209cfb0d131938229766.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0218895-008c-5901-8d81-495dcbc7bbb2/c0218895-008c-5901-8d81-495dcbc7bbb2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66804,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/a4/57a41f04407b77fc18110f7a3d1df06f/pa/JY56965_438a4cf6d12dd904749875de19ac2d7a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0218895-008c-5901-8d81-495dcbc7bbb2/c0218895-008c-5901-8d81-495dcbc7bbb2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69549,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/a4/57a41f04407b77fc18110f7a3d1df06f/pa/JY56965_cee2a34e15751f469f06a7a7e4dbe3b8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0218895-008c-5901-8d81-495dcbc7bbb2/c0218895-008c-5901-8d81-495dcbc7bbb2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49844,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/a4/57a41f04407b77fc18110f7a3d1df06f/pa/JY56965_07d976453195704ce8a6b57f26e06881.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0218895-008c-5901-8d81-495dcbc7bbb2/c0218895-008c-5901-8d81-495dcbc7bbb2_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58759,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/a4/57a41f04407b77fc18110f7a3d1df06f/pa/JY56965_4a3e82bb14c3148d53b702b0908a0583.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0218895-008c-5901-8d81-495dcbc7bbb2/c0218895-008c-5901-8d81-495dcbc7bbb2_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61035,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/a4/57a41f04407b77fc18110f7a3d1df06f/pa/JY56965_3d0d6d1ad33043bad1af430d3e7b2538.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0218895-008c-5901-8d81-495dcbc7bbb2/c0218895-008c-5901-8d81-495dcbc7bbb2_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78347,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/a4/57a41f04407b77fc18110f7a3d1df06f/pa/JY56965_411dadb1ece1152e6a47c28ff09aebb0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0218895-008c-5901-8d81-495dcbc7bbb2/c0218895-008c-5901-8d81-495dcbc7bbb2_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46190,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/a4/57a41f04407b77fc18110f7a3d1df06f/pa/JY56965_6e1396e3716eeaa8d639b7a932a38893.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c0218895-008c-5901-8d81-495dcbc7bbb2/c0218895-008c-5901-8d81-495dcbc7bbb2_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38974,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/a4/57a41f04407b77fc18110f7a3d1df06f/pa/JY56965_a97f767950fb9ad23f155fd5cdd90801.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-10-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat 500X 1.0 Turbo Urban',
 'transmission': 'manual',
 'trim': 'Urban',
 'year': 2018}
2026-01-28 20:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JY56965%27 HTTP/1.1" 200 None
2026-01-28 20:04:33 [auto1.it] INFO: Saving data for JY56965: {'created_time': 1769630673.667911, 'last_price_update_time': 1769630673.667922, 'auction_closing_time': 1769703211.0}
2026-01-28 20:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JY56965') HTTP/1.1" 204 0
2026-01-28 20:04:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YX37505/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:04:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JN05485/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:04:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:04:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UP17064/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:04:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CK43710/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:04:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PP05492/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:04:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YG15382/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:04:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KF08387> (referer: https://www.auto1.com/v1/car-details-view/KF08387/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:04:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HU90428/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:04:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UZ46554/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:04:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:04:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 217a9dbe-02ef-53e4-9b51-10ba9443b045 with identifier: KF08387
2026-01-28 20:04:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 217a9dbe-02ef-53e4-9b51-10ba9443b045 with scrape type 2
2026-01-28 20:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 217a9dbe-02ef-53e4-9b51-10ba9443b045 with scrape type 2
2026-01-28 20:04:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 217a9dbe-02ef-53e4-9b51-10ba9443b045, identifier: KF08387
2026-01-28 20:04:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 217a9dbe-02ef-53e4-9b51-10ba9443b045 with identifier: KF08387
2026-01-28 20:04:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 217a9dbe-02ef-53e4-9b51-10ba9443b045 with identifier: KF08387
2026-01-28 20:04:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 217a9dbe-02ef-53e4-9b51-10ba9443b045 with identifier: KF08387 to the API
2026-01-28 20:04:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:04:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:04:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KF08387>
{'auction_title': '',
 'c_o_2_emission_value': 152,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '2.0L',
 'engine_horse_power': 235,
 'expiration_date': '2026-01-29T16:51:31Z',
 'fuel_type': 'diesel',
 'id': '217a9dbe-02ef-53e4-9b51-10ba9443b045',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KF08387',
 'listing': 'auction',
 'location': 'IT, Reggio Emilia',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 142961,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-05-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo XC60 2.0 D5 R Design AWD',
 'transmission': 'automatic',
 'trim': 'R Design AWD',
 'year': 2019}
2026-01-28 20:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KF08387%27 HTTP/1.1" 200 None
2026-01-28 20:04:35 [auto1.it] INFO: Saving data for KF08387: {'auction_closing_time': 1769705491.0, 'created_time': 1768298881.401558, 'last_price_update_time': 1769630675.185867}
2026-01-28 20:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KF08387') HTTP/1.1" 204 0
2026-01-28 20:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VV31468/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:04:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NJ76886/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:04:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TE90440/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:04:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NP54569/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:04:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VL02819/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:04:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TJ68491/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:04:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TK24342/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:04:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GZ60590/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:04:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CY86412/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:04:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:04:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JN05485> (referer: https://www.auto1.com/v1/car-details-view/JN05485/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:04:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:04:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 12030353-733c-50b6-8c6e-5c5690430b21 with identifier: JN05485
2026-01-28 20:04:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12030353-733c-50b6-8c6e-5c5690430b21 with scrape type 1
2026-01-28 20:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 12030353-733c-50b6-8c6e-5c5690430b21
2026-01-28 20:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F70%252F28702cf6018446708895c5287c47e2b5%252Fpa%252FJN05485_c0bb81c779c65617ca2dec79481089df.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/70/28702cf6018446708895c5287c47e2b5/pa/JN05485_c0bb81c779c65617ca2dec79481089df.jpg already downloaded
2026-01-28 20:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F70%252F28702cf6018446708895c5287c47e2b5%252Fpa%252FJN05485_6b588430571c795459ea2216cd464567.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/70/28702cf6018446708895c5287c47e2b5/pa/JN05485_6b588430571c795459ea2216cd464567.jpg already downloaded
2026-01-28 20:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F70%252F28702cf6018446708895c5287c47e2b5%252Fpa%252FJN05485_5354e55cc25c8ae1b945a7be6ed178ed.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/70/28702cf6018446708895c5287c47e2b5/pa/JN05485_5354e55cc25c8ae1b945a7be6ed178ed.jpg already downloaded
2026-01-28 20:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F70%252F28702cf6018446708895c5287c47e2b5%252Fpa%252FJN05485_aa6e4337387a6c6f2bcdf4dfe3315a47.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/70/28702cf6018446708895c5287c47e2b5/pa/JN05485_aa6e4337387a6c6f2bcdf4dfe3315a47.jpg already downloaded
2026-01-28 20:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F70%252F28702cf6018446708895c5287c47e2b5%252Fpa%252FJN05485_a57a537bc8476a745faab4b6275736c9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/70/28702cf6018446708895c5287c47e2b5/pa/JN05485_a57a537bc8476a745faab4b6275736c9.jpg already downloaded
2026-01-28 20:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F70%252F28702cf6018446708895c5287c47e2b5%252Fpa%252FJN05485_444a06ed39a0a37a93837111a79e1d8e.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/70/28702cf6018446708895c5287c47e2b5/pa/JN05485_444a06ed39a0a37a93837111a79e1d8e.jpg already downloaded
2026-01-28 20:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F70%252F28702cf6018446708895c5287c47e2b5%252Fpa%252FJN05485_b13d20e72e8658e8f216cf8f24a7c07a.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/70/28702cf6018446708895c5287c47e2b5/pa/JN05485_b13d20e72e8658e8f216cf8f24a7c07a.jpg already downloaded
2026-01-28 20:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F70%252F28702cf6018446708895c5287c47e2b5%252Fpa%252FJN05485_9a2f803372b7f88489b92c003f290582.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/70/28702cf6018446708895c5287c47e2b5/pa/JN05485_9a2f803372b7f88489b92c003f290582.jpg already downloaded
2026-01-28 20:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F70%252F28702cf6018446708895c5287c47e2b5%252Fpa%252FJN05485_b416245d10cfb9b81b1d311c40d6c497.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/70/28702cf6018446708895c5287c47e2b5/pa/JN05485_b416245d10cfb9b81b1d311c40d6c497.jpg already downloaded
2026-01-28 20:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F70%252F28702cf6018446708895c5287c47e2b5%252Fpa%252FJN05485_d6ecc5c0b69c46c98985fe43fb34b28c.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/70/28702cf6018446708895c5287c47e2b5/pa/JN05485_d6ecc5c0b69c46c98985fe43fb34b28c.jpg already downloaded
2026-01-28 20:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F70%252F28702cf6018446708895c5287c47e2b5%252Fpa%252FJN05485_f7de649c5dba33f027432b50466ac304.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/70/28702cf6018446708895c5287c47e2b5/pa/JN05485_f7de649c5dba33f027432b50466ac304.jpg already downloaded
2026-01-28 20:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F70%252F28702cf6018446708895c5287c47e2b5%252Fpa%252FJN05485_1648d1c41b44a10052ab672eb561cc5f.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/70/28702cf6018446708895c5287c47e2b5/pa/JN05485_1648d1c41b44a10052ab672eb561cc5f.jpg already downloaded
2026-01-28 20:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F70%252F28702cf6018446708895c5287c47e2b5%252Fpa%252FJN05485_b4a336f556b839f63babc0bc1784fd97.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/70/28702cf6018446708895c5287c47e2b5/pa/JN05485_b4a336f556b839f63babc0bc1784fd97.jpg already downloaded
2026-01-28 20:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F70%252F28702cf6018446708895c5287c47e2b5%252Fpa%252FJN05485_ad88906503b8a59837632542d459b30e.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/70/28702cf6018446708895c5287c47e2b5/pa/JN05485_ad88906503b8a59837632542d459b30e.jpg already downloaded
2026-01-28 20:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F70%252F28702cf6018446708895c5287c47e2b5%252Fpa%252FJN05485_3b0efd6fb0761c7db276573251d4dc9d.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/70/28702cf6018446708895c5287c47e2b5/pa/JN05485_3b0efd6fb0761c7db276573251d4dc9d.jpg already downloaded
2026-01-28 20:04:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 12030353-733c-50b6-8c6e-5c5690430b21, identifier: JN05485
2026-01-28 20:04:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 12030353-733c-50b6-8c6e-5c5690430b21 with identifier: JN05485
2026-01-28 20:04:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 12030353-733c-50b6-8c6e-5c5690430b21 with identifier: JN05485
2026-01-28 20:04:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 12030353-733c-50b6-8c6e-5c5690430b21 with identifier: JN05485 to the API
2026-01-28 20:04:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:04:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:04:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JN05485>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.2L',
 'engine_horse_power': 101,
 'expiration_date': '2026-01-29T16:13:56Z',
 'fuel_type': 'petrol',
 'id': '12030353-733c-50b6-8c6e-5c5690430b21',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JN05485',
 'listing': 'auction',
 'location': 'IT, Settimo Torinese',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 36324,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img28/70/28702cf6018446708895c5287c47e2b5/pa/JN05485_c0bb81c779c65617ca2dec79481089df.jpg',
                'https://img-pa.auto1.com/img28/70/28702cf6018446708895c5287c47e2b5/pa/JN05485_6b588430571c795459ea2216cd464567.jpg',
                'https://img-pa.auto1.com/img28/70/28702cf6018446708895c5287c47e2b5/pa/JN05485_5354e55cc25c8ae1b945a7be6ed178ed.jpg',
                'https://img-pa.auto1.com/img28/70/28702cf6018446708895c5287c47e2b5/pa/JN05485_aa6e4337387a6c6f2bcdf4dfe3315a47.jpg',
                'https://img-pa.auto1.com/img28/70/28702cf6018446708895c5287c47e2b5/pa/JN05485_a57a537bc8476a745faab4b6275736c9.jpg',
                'https://img-pa.auto1.com/img28/70/28702cf6018446708895c5287c47e2b5/pa/JN05485_444a06ed39a0a37a93837111a79e1d8e.jpg',
                'https://img-pa.auto1.com/img28/70/28702cf6018446708895c5287c47e2b5/pa/JN05485_b13d20e72e8658e8f216cf8f24a7c07a.jpg',
                'https://img-pa.auto1.com/img28/70/28702cf6018446708895c5287c47e2b5/pa/JN05485_9a2f803372b7f88489b92c003f290582.jpg',
                'https://img-pa.auto1.com/img28/70/28702cf6018446708895c5287c47e2b5/pa/JN05485_b416245d10cfb9b81b1d311c40d6c497.jpg',
                'https://img-pa.auto1.com/img28/70/28702cf6018446708895c5287c47e2b5/pa/JN05485_d6ecc5c0b69c46c98985fe43fb34b28c.jpg',
                'https://img-pa.auto1.com/img28/70/28702cf6018446708895c5287c47e2b5/pa/JN05485_f7de649c5dba33f027432b50466ac304.jpg',
                'https://img-pa.auto1.com/img28/70/28702cf6018446708895c5287c47e2b5/pa/JN05485_1648d1c41b44a10052ab672eb561cc5f.jpg',
                'https://img-pa.auto1.com/img28/70/28702cf6018446708895c5287c47e2b5/pa/JN05485_b4a336f556b839f63babc0bc1784fd97.jpg',
                'https://img-pa.auto1.com/img28/70/28702cf6018446708895c5287c47e2b5/pa/JN05485_ad88906503b8a59837632542d459b30e.jpg',
                'https://img-pa.auto1.com/img28/70/28702cf6018446708895c5287c47e2b5/pa/JN05485_3b0efd6fb0761c7db276573251d4dc9d.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12030353-733c-50b6-8c6e-5c5690430b21/12030353-733c-50b6-8c6e-5c5690430b21_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62591,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/70/28702cf6018446708895c5287c47e2b5/pa/JN05485_c0bb81c779c65617ca2dec79481089df.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12030353-733c-50b6-8c6e-5c5690430b21/12030353-733c-50b6-8c6e-5c5690430b21_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2597630,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img28/70/28702cf6018446708895c5287c47e2b5/pa/JN05485_6b588430571c795459ea2216cd464567.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12030353-733c-50b6-8c6e-5c5690430b21/12030353-733c-50b6-8c6e-5c5690430b21_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61327,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/70/28702cf6018446708895c5287c47e2b5/pa/JN05485_5354e55cc25c8ae1b945a7be6ed178ed.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12030353-733c-50b6-8c6e-5c5690430b21/12030353-733c-50b6-8c6e-5c5690430b21_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46749,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/70/28702cf6018446708895c5287c47e2b5/pa/JN05485_aa6e4337387a6c6f2bcdf4dfe3315a47.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12030353-733c-50b6-8c6e-5c5690430b21/12030353-733c-50b6-8c6e-5c5690430b21_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2515531,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img28/70/28702cf6018446708895c5287c47e2b5/pa/JN05485_a57a537bc8476a745faab4b6275736c9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12030353-733c-50b6-8c6e-5c5690430b21/12030353-733c-50b6-8c6e-5c5690430b21_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67503,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/70/28702cf6018446708895c5287c47e2b5/pa/JN05485_444a06ed39a0a37a93837111a79e1d8e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12030353-733c-50b6-8c6e-5c5690430b21/12030353-733c-50b6-8c6e-5c5690430b21_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2608113,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img28/70/28702cf6018446708895c5287c47e2b5/pa/JN05485_b13d20e72e8658e8f216cf8f24a7c07a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12030353-733c-50b6-8c6e-5c5690430b21/12030353-733c-50b6-8c6e-5c5690430b21_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63757,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/70/28702cf6018446708895c5287c47e2b5/pa/JN05485_9a2f803372b7f88489b92c003f290582.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12030353-733c-50b6-8c6e-5c5690430b21/12030353-733c-50b6-8c6e-5c5690430b21_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2482155,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img28/70/28702cf6018446708895c5287c47e2b5/pa/JN05485_b416245d10cfb9b81b1d311c40d6c497.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12030353-733c-50b6-8c6e-5c5690430b21/12030353-733c-50b6-8c6e-5c5690430b21_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68059,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/70/28702cf6018446708895c5287c47e2b5/pa/JN05485_d6ecc5c0b69c46c98985fe43fb34b28c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12030353-733c-50b6-8c6e-5c5690430b21/12030353-733c-50b6-8c6e-5c5690430b21_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57242,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/70/28702cf6018446708895c5287c47e2b5/pa/JN05485_f7de649c5dba33f027432b50466ac304.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12030353-733c-50b6-8c6e-5c5690430b21/12030353-733c-50b6-8c6e-5c5690430b21_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61378,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/70/28702cf6018446708895c5287c47e2b5/pa/JN05485_1648d1c41b44a10052ab672eb561cc5f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12030353-733c-50b6-8c6e-5c5690430b21/12030353-733c-50b6-8c6e-5c5690430b21_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37845,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/70/28702cf6018446708895c5287c47e2b5/pa/JN05485_b4a336f556b839f63babc0bc1784fd97.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12030353-733c-50b6-8c6e-5c5690430b21/12030353-733c-50b6-8c6e-5c5690430b21_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48165,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/70/28702cf6018446708895c5287c47e2b5/pa/JN05485_ad88906503b8a59837632542d459b30e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12030353-733c-50b6-8c6e-5c5690430b21/12030353-733c-50b6-8c6e-5c5690430b21_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69918,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/70/28702cf6018446708895c5287c47e2b5/pa/JN05485_3b0efd6fb0761c7db276573251d4dc9d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-03-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Turbo GS Line',
 'transmission': 'manual',
 'trim': 'GS Line',
 'year': 2023}
2026-01-28 20:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JN05485%27 HTTP/1.1" 200 None
2026-01-28 20:04:37 [auto1.it] INFO: Saving data for JN05485: {'created_time': 1769630677.24621, 'last_price_update_time': 1769630677.246221, 'auction_closing_time': 1769703236.0}
2026-01-28 20:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JN05485') HTTP/1.1" 204 0
2026-01-28 20:04:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UP17064> (referer: https://www.auto1.com/v1/car-details-view/UP17064/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:04:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YX37505> (referer: https://www.auto1.com/v1/car-details-view/YX37505/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:04:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UD73720> (referer: https://www.auto1.com/v1/car-details-view/UD73720/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:04:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YE02110> (referer: https://www.auto1.com/v1/car-details-view/YE02110/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:04:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:04:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:04:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:04:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:04:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YG15382> (referer: https://www.auto1.com/v1/car-details-view/YG15382/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:04:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PP05492> (referer: https://www.auto1.com/v1/car-details-view/PP05492/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:04:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CK43710> (referer: https://www.auto1.com/v1/car-details-view/CK43710/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:04:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:04:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:04:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:04:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 352e36d3-8cf1-51d6-9eae-3613362bc3e4 with identifier: UP17064
2026-01-28 20:04:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 352e36d3-8cf1-51d6-9eae-3613362bc3e4 with scrape type 1
2026-01-28 20:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 352e36d3-8cf1-51d6-9eae-3613362bc3e4
2026-01-28 20:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252Fe4%252Fa6e425f4947af594305d5000e9a05c30%252Fpa%252FUP17064_de9fe6afadbf914a08b0e625150fbc6b.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/e4/a6e425f4947af594305d5000e9a05c30/pa/UP17064_de9fe6afadbf914a08b0e625150fbc6b.jpg not downloaded yet
2026-01-28 20:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252Fe4%252Fa6e425f4947af594305d5000e9a05c30%252Fpa%252FUP17064_aae8f384fbc61b11ba3bd86c95db8cac.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/e4/a6e425f4947af594305d5000e9a05c30/pa/UP17064_aae8f384fbc61b11ba3bd86c95db8cac.jpg not downloaded yet
2026-01-28 20:04:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47641bc6-87ee-5c7b-b578-bf967fb554f9 with identifier: YX37505
2026-01-28 20:04:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47641bc6-87ee-5c7b-b578-bf967fb554f9 with scrape type 1
2026-01-28 20:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 47641bc6-87ee-5c7b-b578-bf967fb554f9
2026-01-28 20:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F6a%252F026a7fb3fb786a2a92e1dc0c289291c9%252Fpa%252FYX37505_3a01401f70fea0200a04398e4d729b88.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/6a/026a7fb3fb786a2a92e1dc0c289291c9/pa/YX37505_3a01401f70fea0200a04398e4d729b88.jpg not downloaded yet
2026-01-28 20:04:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e38ee64-bcbd-59a3-8791-d7d1c58e212f with identifier: UD73720
2026-01-28 20:04:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e38ee64-bcbd-59a3-8791-d7d1c58e212f with scrape type 1
2026-01-28 20:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 5e38ee64-bcbd-59a3-8791-d7d1c58e212f
2026-01-28 20:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252Fae%252Fceaec425c7106ce417963ef635dd8240%252Fpa%252FUD73720_e6c83456610b25219d5011aa15843819.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/ae/ceaec425c7106ce417963ef635dd8240/pa/UD73720_e6c83456610b25219d5011aa15843819.jpg not downloaded yet
2026-01-28 20:04:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ed46455-96fb-531a-8c68-e48daae72e3a with identifier: YE02110
2026-01-28 20:04:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ed46455-96fb-531a-8c68-e48daae72e3a with scrape type 1
2026-01-28 20:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 13 photos for item 8ed46455-96fb-531a-8c68-e48daae72e3a
2026-01-28 20:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Ff2%252Fabf219bf7cd89b5581a33fe893870cc8%252Fpa%252FYE02110_3edc5046274e9eab7c42407a480a7c4e.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/f2/abf219bf7cd89b5581a33fe893870cc8/pa/YE02110_3edc5046274e9eab7c42407a480a7c4e.jpg not downloaded yet
2026-01-28 20:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252Fe4%252Fa6e425f4947af594305d5000e9a05c30%252Fpa%252FUP17064_898d76f3f3a583d0a2aee1bde080e09f.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/e4/a6e425f4947af594305d5000e9a05c30/pa/UP17064_898d76f3f3a583d0a2aee1bde080e09f.jpg not downloaded yet
2026-01-28 20:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F6a%252F026a7fb3fb786a2a92e1dc0c289291c9%252Fpa%252FYX37505_51440dda166027a42c2282331549be98.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/6a/026a7fb3fb786a2a92e1dc0c289291c9/pa/YX37505_51440dda166027a42c2282331549be98.jpg not downloaded yet
2026-01-28 20:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252Fae%252Fceaec425c7106ce417963ef635dd8240%252Fpa%252FUD73720_9b3b12b974fb70b38fa870633dad44aa.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/ae/ceaec425c7106ce417963ef635dd8240/pa/UD73720_9b3b12b974fb70b38fa870633dad44aa.jpg not downloaded yet
2026-01-28 20:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Ff2%252Fabf219bf7cd89b5581a33fe893870cc8%252Fpa%252FYE02110_806ec9cee76524ae0f693b18e0540310.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/f2/abf219bf7cd89b5581a33fe893870cc8/pa/YE02110_806ec9cee76524ae0f693b18e0540310.jpg not downloaded yet
2026-01-28 20:04:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ba1af05-9c36-5ac8-8700-2bf5d36384e8 with identifier: YG15382
2026-01-28 20:04:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ba1af05-9c36-5ac8-8700-2bf5d36384e8 with scrape type 1
2026-01-28 20:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 6ba1af05-9c36-5ac8-8700-2bf5d36384e8
2026-01-28 20:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F6a%252F656a19187558a79bf41101eddfcd5ceb%252Fpa%252FYG15382_0ad8db538f381a6b91a62babd991dac5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/6a/656a19187558a79bf41101eddfcd5ceb/pa/YG15382_0ad8db538f381a6b91a62babd991dac5.jpg not downloaded yet
2026-01-28 20:04:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6950582b-8a41-59e4-8a8d-9e2a94de413d with identifier: PP05492
2026-01-28 20:04:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6950582b-8a41-59e4-8a8d-9e2a94de413d with scrape type 2
2026-01-28 20:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6950582b-8a41-59e4-8a8d-9e2a94de413d with scrape type 2
2026-01-28 20:04:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6950582b-8a41-59e4-8a8d-9e2a94de413d, identifier: PP05492
2026-01-28 20:04:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4264e757-58cd-5973-acba-f635b01dd433 with identifier: CK43710
2026-01-28 20:04:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4264e757-58cd-5973-acba-f635b01dd433 with scrape type 1
2026-01-28 20:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 4264e757-58cd-5973-acba-f635b01dd433
2026-01-28 20:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F92%252F6792c7bdf6deac7b3dc297643c62a409%252Fpa%252FCK43710_6d6b619b149bdc607f6b38cf28355f6b.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/92/6792c7bdf6deac7b3dc297643c62a409/pa/CK43710_6d6b619b149bdc607f6b38cf28355f6b.jpg already downloaded
2026-01-28 20:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F92%252F6792c7bdf6deac7b3dc297643c62a409%252Fpa%252FCK43710_88626544c7284890d7e4f7b47eaff6e8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/92/6792c7bdf6deac7b3dc297643c62a409/pa/CK43710_88626544c7284890d7e4f7b47eaff6e8.jpg already downloaded
2026-01-28 20:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F92%252F6792c7bdf6deac7b3dc297643c62a409%252Fpa%252FCK43710_9d301c54cefe4116b879ff89c67daa17.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/92/6792c7bdf6deac7b3dc297643c62a409/pa/CK43710_9d301c54cefe4116b879ff89c67daa17.jpg already downloaded
2026-01-28 20:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F92%252F6792c7bdf6deac7b3dc297643c62a409%252Fpa%252FCK43710_189b344051c9db86882525cdddc8aac0.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/92/6792c7bdf6deac7b3dc297643c62a409/pa/CK43710_189b344051c9db86882525cdddc8aac0.jpg already downloaded
2026-01-28 20:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F92%252F6792c7bdf6deac7b3dc297643c62a409%252Fpa%252FCK43710_5cb8a58707cba0c2f69d80340fe69395.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/92/6792c7bdf6deac7b3dc297643c62a409/pa/CK43710_5cb8a58707cba0c2f69d80340fe69395.jpg already downloaded
2026-01-28 20:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F92%252F6792c7bdf6deac7b3dc297643c62a409%252Fpa%252FCK43710_b04ae2c10dded5e0551092c0f7ce6a6b.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/92/6792c7bdf6deac7b3dc297643c62a409/pa/CK43710_b04ae2c10dded5e0551092c0f7ce6a6b.jpg already downloaded
2026-01-28 20:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F92%252F6792c7bdf6deac7b3dc297643c62a409%252Fpa%252FCK43710_f97b1fec9ac54dddf70b9bb568fc43e2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/92/6792c7bdf6deac7b3dc297643c62a409/pa/CK43710_f97b1fec9ac54dddf70b9bb568fc43e2.jpg already downloaded
2026-01-28 20:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F92%252F6792c7bdf6deac7b3dc297643c62a409%252Fpa%252FCK43710_bfe68e06098bc26fb8b778f505587947.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/92/6792c7bdf6deac7b3dc297643c62a409/pa/CK43710_bfe68e06098bc26fb8b778f505587947.jpg already downloaded
2026-01-28 20:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F92%252F6792c7bdf6deac7b3dc297643c62a409%252Fpa%252FCK43710_19f883af1cfdb7c0453b5d28f763effd.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/92/6792c7bdf6deac7b3dc297643c62a409/pa/CK43710_19f883af1cfdb7c0453b5d28f763effd.jpg already downloaded
2026-01-28 20:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F92%252F6792c7bdf6deac7b3dc297643c62a409%252Fpa%252FCK43710_7f56120780a9abf5bb54522c01ef2eb1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/92/6792c7bdf6deac7b3dc297643c62a409/pa/CK43710_7f56120780a9abf5bb54522c01ef2eb1.jpg already downloaded
2026-01-28 20:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F92%252F6792c7bdf6deac7b3dc297643c62a409%252Fpa%252FCK43710_7cc24815ab278e5d0d1848b8db39d819.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/92/6792c7bdf6deac7b3dc297643c62a409/pa/CK43710_7cc24815ab278e5d0d1848b8db39d819.jpg already downloaded
2026-01-28 20:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F92%252F6792c7bdf6deac7b3dc297643c62a409%252Fpa%252FCK43710_f42b8d01b6b609602ed79012e3e96e8f.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/92/6792c7bdf6deac7b3dc297643c62a409/pa/CK43710_f42b8d01b6b609602ed79012e3e96e8f.jpg already downloaded
2026-01-28 20:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F92%252F6792c7bdf6deac7b3dc297643c62a409%252Fpa%252FCK43710_58de2f4afa71dce8ebb73f3c87bad6b0.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/92/6792c7bdf6deac7b3dc297643c62a409/pa/CK43710_58de2f4afa71dce8ebb73f3c87bad6b0.jpg already downloaded
2026-01-28 20:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F92%252F6792c7bdf6deac7b3dc297643c62a409%252Fpa%252FCK43710_c25d73fbfd1e6a314807b6fbfabbb432.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/92/6792c7bdf6deac7b3dc297643c62a409/pa/CK43710_c25d73fbfd1e6a314807b6fbfabbb432.jpg already downloaded
2026-01-28 20:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F92%252F6792c7bdf6deac7b3dc297643c62a409%252Fpa%252FCK43710_7b8e01d74cc74d7df951277f55d5e820.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/92/6792c7bdf6deac7b3dc297643c62a409/pa/CK43710_7b8e01d74cc74d7df951277f55d5e820.jpg already downloaded
2026-01-28 20:04:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4264e757-58cd-5973-acba-f635b01dd433, identifier: CK43710
2026-01-28 20:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252Fe4%252Fa6e425f4947af594305d5000e9a05c30%252Fpa%252FUP17064_728896be30e6aa28e194e908fb1172d3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/e4/a6e425f4947af594305d5000e9a05c30/pa/UP17064_728896be30e6aa28e194e908fb1172d3.jpg not downloaded yet
2026-01-28 20:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F6a%252F026a7fb3fb786a2a92e1dc0c289291c9%252Fpa%252FYX37505_3aa8d503aa2ed101e104959147297d12.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/6a/026a7fb3fb786a2a92e1dc0c289291c9/pa/YX37505_3aa8d503aa2ed101e104959147297d12.jpg not downloaded yet
2026-01-28 20:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252Fae%252Fceaec425c7106ce417963ef635dd8240%252Fpa%252FUD73720_7d81424286745d22360f4465ef0c1470.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/ae/ceaec425c7106ce417963ef635dd8240/pa/UD73720_7d81424286745d22360f4465ef0c1470.jpg not downloaded yet
2026-01-28 20:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Ff2%252Fabf219bf7cd89b5581a33fe893870cc8%252Fpa%252FYE02110_3aa8bb2b5ca5adb82196452038c2ec2c.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/f2/abf219bf7cd89b5581a33fe893870cc8/pa/YE02110_3aa8bb2b5ca5adb82196452038c2ec2c.jpg not downloaded yet
2026-01-28 20:04:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6950582b-8a41-59e4-8a8d-9e2a94de413d with identifier: PP05492
2026-01-28 20:04:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6950582b-8a41-59e4-8a8d-9e2a94de413d with identifier: PP05492
2026-01-28 20:04:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6950582b-8a41-59e4-8a8d-9e2a94de413d with identifier: PP05492 to the API
2026-01-28 20:04:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:04:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:04:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PP05492>
{'auction_title': '',
 'c_o_2_emission_value': 200,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '3.0L',
 'engine_horse_power': 351,
 'expiration_date': '2026-01-29T16:09:49Z',
 'fuel_type': 'diesel',
 'id': '6950582b-8a41-59e4-8a8d-9e2a94de413d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PP05492',
 'listing': 'auction',
 'location': 'IT, Bentivoglio (BO)',
 'make': 'BMW',
 'model': 'X5',
 'odometer': 78736,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-04-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X5 xDrive 40d Mild-Hybrid M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2021}
2026-01-28 20:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PP05492%27 HTTP/1.1" 200 None
2026-01-28 20:04:38 [auto1.it] INFO: Saving data for PP05492: {'auction_closing_time': 1769702989.0, 'created_time': 1767039086.599176, 'last_price_update_time': 1769630678.57848}
2026-01-28 20:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PP05492') HTTP/1.1" 204 0
2026-01-28 20:04:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4264e757-58cd-5973-acba-f635b01dd433 with identifier: CK43710
2026-01-28 20:04:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4264e757-58cd-5973-acba-f635b01dd433 with identifier: CK43710
2026-01-28 20:04:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4264e757-58cd-5973-acba-f635b01dd433 with identifier: CK43710 to the API
2026-01-28 20:04:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:04:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:04:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CK43710>
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.6L',
 'engine_horse_power': 230,
 'expiration_date': '2026-01-29T16:03:28Z',
 'fuel_type': 'hybrid',
 'id': '4264e757-58cd-5973-acba-f635b01dd433',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CK43710',
 'listing': 'auction',
 'location': 'IT, Varedo (MB)',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 8167,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img67/92/6792c7bdf6deac7b3dc297643c62a409/pa/CK43710_6d6b619b149bdc607f6b38cf28355f6b.jpg',
                'https://img-pa.auto1.com/img67/92/6792c7bdf6deac7b3dc297643c62a409/pa/CK43710_88626544c7284890d7e4f7b47eaff6e8.jpg',
                'https://img-pa.auto1.com/img67/92/6792c7bdf6deac7b3dc297643c62a409/pa/CK43710_9d301c54cefe4116b879ff89c67daa17.jpg',
                'https://img-pa.auto1.com/img67/92/6792c7bdf6deac7b3dc297643c62a409/pa/CK43710_189b344051c9db86882525cdddc8aac0.jpg',
                'https://img-pa.auto1.com/img67/92/6792c7bdf6deac7b3dc297643c62a409/pa/CK43710_5cb8a58707cba0c2f69d80340fe69395.jpg',
                'https://img-pa.auto1.com/img67/92/6792c7bdf6deac7b3dc297643c62a409/pa/CK43710_b04ae2c10dded5e0551092c0f7ce6a6b.jpg',
                'https://img-pa.auto1.com/img67/92/6792c7bdf6deac7b3dc297643c62a409/pa/CK43710_f97b1fec9ac54dddf70b9bb568fc43e2.jpg',
                'https://img-pa.auto1.com/img67/92/6792c7bdf6deac7b3dc297643c62a409/pa/CK43710_bfe68e06098bc26fb8b778f505587947.jpg',
                'https://img-pa.auto1.com/img67/92/6792c7bdf6deac7b3dc297643c62a409/pa/CK43710_19f883af1cfdb7c0453b5d28f763effd.jpg',
                'https://img-pa.auto1.com/img67/92/6792c7bdf6deac7b3dc297643c62a409/pa/CK43710_7f56120780a9abf5bb54522c01ef2eb1.jpg',
                'https://img-pa.auto1.com/img67/92/6792c7bdf6deac7b3dc297643c62a409/pa/CK43710_7cc24815ab278e5d0d1848b8db39d819.jpg',
                'https://img-pa.auto1.com/img67/92/6792c7bdf6deac7b3dc297643c62a409/pa/CK43710_f42b8d01b6b609602ed79012e3e96e8f.jpg',
                'https://img-pa.auto1.com/img67/92/6792c7bdf6deac7b3dc297643c62a409/pa/CK43710_58de2f4afa71dce8ebb73f3c87bad6b0.jpg',
                'https://img-pa.auto1.com/img67/92/6792c7bdf6deac7b3dc297643c62a409/pa/CK43710_c25d73fbfd1e6a314807b6fbfabbb432.jpg',
                'https://img-pa.auto1.com/img67/92/6792c7bdf6deac7b3dc297643c62a409/pa/CK43710_7b8e01d74cc74d7df951277f55d5e820.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4264e757-58cd-5973-acba-f635b01dd433/4264e757-58cd-5973-acba-f635b01dd433_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98611,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/92/6792c7bdf6deac7b3dc297643c62a409/pa/CK43710_6d6b619b149bdc607f6b38cf28355f6b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4264e757-58cd-5973-acba-f635b01dd433/4264e757-58cd-5973-acba-f635b01dd433_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88735,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/92/6792c7bdf6deac7b3dc297643c62a409/pa/CK43710_88626544c7284890d7e4f7b47eaff6e8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4264e757-58cd-5973-acba-f635b01dd433/4264e757-58cd-5973-acba-f635b01dd433_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80622,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/92/6792c7bdf6deac7b3dc297643c62a409/pa/CK43710_9d301c54cefe4116b879ff89c67daa17.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4264e757-58cd-5973-acba-f635b01dd433/4264e757-58cd-5973-acba-f635b01dd433_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66382,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/92/6792c7bdf6deac7b3dc297643c62a409/pa/CK43710_189b344051c9db86882525cdddc8aac0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4264e757-58cd-5973-acba-f635b01dd433/4264e757-58cd-5973-acba-f635b01dd433_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79701,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/92/6792c7bdf6deac7b3dc297643c62a409/pa/CK43710_5cb8a58707cba0c2f69d80340fe69395.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4264e757-58cd-5973-acba-f635b01dd433/4264e757-58cd-5973-acba-f635b01dd433_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82651,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/92/6792c7bdf6deac7b3dc297643c62a409/pa/CK43710_b04ae2c10dded5e0551092c0f7ce6a6b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4264e757-58cd-5973-acba-f635b01dd433/4264e757-58cd-5973-acba-f635b01dd433_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40224,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/92/6792c7bdf6deac7b3dc297643c62a409/pa/CK43710_f97b1fec9ac54dddf70b9bb568fc43e2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4264e757-58cd-5973-acba-f635b01dd433/4264e757-58cd-5973-acba-f635b01dd433_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90773,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/92/6792c7bdf6deac7b3dc297643c62a409/pa/CK43710_bfe68e06098bc26fb8b778f505587947.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4264e757-58cd-5973-acba-f635b01dd433/4264e757-58cd-5973-acba-f635b01dd433_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93468,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/92/6792c7bdf6deac7b3dc297643c62a409/pa/CK43710_19f883af1cfdb7c0453b5d28f763effd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4264e757-58cd-5973-acba-f635b01dd433/4264e757-58cd-5973-acba-f635b01dd433_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75308,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/92/6792c7bdf6deac7b3dc297643c62a409/pa/CK43710_7f56120780a9abf5bb54522c01ef2eb1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4264e757-58cd-5973-acba-f635b01dd433/4264e757-58cd-5973-acba-f635b01dd433_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54003,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/92/6792c7bdf6deac7b3dc297643c62a409/pa/CK43710_7cc24815ab278e5d0d1848b8db39d819.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4264e757-58cd-5973-acba-f635b01dd433/4264e757-58cd-5973-acba-f635b01dd433_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65442,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/92/6792c7bdf6deac7b3dc297643c62a409/pa/CK43710_f42b8d01b6b609602ed79012e3e96e8f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4264e757-58cd-5973-acba-f635b01dd433/4264e757-58cd-5973-acba-f635b01dd433_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63187,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/92/6792c7bdf6deac7b3dc297643c62a409/pa/CK43710_58de2f4afa71dce8ebb73f3c87bad6b0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4264e757-58cd-5973-acba-f635b01dd433/4264e757-58cd-5973-acba-f635b01dd433_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39669,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/92/6792c7bdf6deac7b3dc297643c62a409/pa/CK43710_c25d73fbfd1e6a314807b6fbfabbb432.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4264e757-58cd-5973-acba-f635b01dd433/4264e757-58cd-5973-acba-f635b01dd433_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58855,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/92/6792c7bdf6deac7b3dc297643c62a409/pa/CK43710_7b8e01d74cc74d7df951277f55d5e820.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-04-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 T-GDI Hybrid N Line 2WD',
 'transmission': 'automatic',
 'trim': 'N Line 2WD',
 'year': 2022}
2026-01-28 20:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CK43710%27 HTTP/1.1" 200 None
2026-01-28 20:04:38 [auto1.it] INFO: Saving data for CK43710: {'created_time': 1769630678.982646, 'last_price_update_time': 1769630678.982659, 'auction_closing_time': 1769702608.0}
2026-01-28 20:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CK43710') HTTP/1.1" 204 0
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F6a%252F656a19187558a79bf41101eddfcd5ceb%252Fpa%252FYG15382_308fe0e5812791767fa9bd7fddbbed70.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/6a/656a19187558a79bf41101eddfcd5ceb/pa/YG15382_308fe0e5812791767fa9bd7fddbbed70.jpg not downloaded yet
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252Fe4%252Fa6e425f4947af594305d5000e9a05c30%252Fpa%252FUP17064_384cfc22f44dee025095c047fed9ea5c.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/e4/a6e425f4947af594305d5000e9a05c30/pa/UP17064_384cfc22f44dee025095c047fed9ea5c.jpg not downloaded yet
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F6a%252F026a7fb3fb786a2a92e1dc0c289291c9%252Fpa%252FYX37505_28dcc7fe0d1bc7831acd54ec3a1176a7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/6a/026a7fb3fb786a2a92e1dc0c289291c9/pa/YX37505_28dcc7fe0d1bc7831acd54ec3a1176a7.jpg not downloaded yet
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252Fae%252Fceaec425c7106ce417963ef635dd8240%252Fpa%252FUD73720_d346890b5c4ca321644520d16986fd84.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/ae/ceaec425c7106ce417963ef635dd8240/pa/UD73720_d346890b5c4ca321644520d16986fd84.jpg not downloaded yet
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Ff2%252Fabf219bf7cd89b5581a33fe893870cc8%252Fpa%252FYE02110_e19097f5f1127bba679ad43a9fb1b4d0.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/f2/abf219bf7cd89b5581a33fe893870cc8/pa/YE02110_e19097f5f1127bba679ad43a9fb1b4d0.jpg not downloaded yet
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F6a%252F656a19187558a79bf41101eddfcd5ceb%252Fpa%252FYG15382_24a8fa3bc20d1c0f4ebd325173929816.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/6a/656a19187558a79bf41101eddfcd5ceb/pa/YG15382_24a8fa3bc20d1c0f4ebd325173929816.jpg not downloaded yet
2026-01-28 20:04:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UZ46554> (referer: https://www.auto1.com/v1/car-details-view/UZ46554/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252Fe4%252Fa6e425f4947af594305d5000e9a05c30%252Fpa%252FUP17064_64e7af4f2a8999bbacb5b321f13d0365.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/e4/a6e425f4947af594305d5000e9a05c30/pa/UP17064_64e7af4f2a8999bbacb5b321f13d0365.jpg not downloaded yet
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F6a%252F026a7fb3fb786a2a92e1dc0c289291c9%252Fpa%252FYX37505_8458917ba2f685b3efece060178b12bd.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/6a/026a7fb3fb786a2a92e1dc0c289291c9/pa/YX37505_8458917ba2f685b3efece060178b12bd.jpg not downloaded yet
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252Fae%252Fceaec425c7106ce417963ef635dd8240%252Fpa%252FUD73720_409b5a5276225566b200900d6722d164.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/ae/ceaec425c7106ce417963ef635dd8240/pa/UD73720_409b5a5276225566b200900d6722d164.jpg not downloaded yet
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Ff2%252Fabf219bf7cd89b5581a33fe893870cc8%252Fpa%252FYE02110_f1130811d4ba4753c8e54738d97bb037.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/f2/abf219bf7cd89b5581a33fe893870cc8/pa/YE02110_f1130811d4ba4753c8e54738d97bb037.jpg not downloaded yet
2026-01-28 20:04:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F6a%252F656a19187558a79bf41101eddfcd5ceb%252Fpa%252FYG15382_d3eeee5e66d25cb67a9d1a100e5b3991.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/6a/656a19187558a79bf41101eddfcd5ceb/pa/YG15382_d3eeee5e66d25cb67a9d1a100e5b3991.jpg not downloaded yet
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252Fe4%252Fa6e425f4947af594305d5000e9a05c30%252Fpa%252FUP17064_38aa8a3cb7409bfff6c0bfdc3177bf07.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/e4/a6e425f4947af594305d5000e9a05c30/pa/UP17064_38aa8a3cb7409bfff6c0bfdc3177bf07.jpg not downloaded yet
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F6a%252F026a7fb3fb786a2a92e1dc0c289291c9%252Fpa%252FYX37505_747db23ee751a6e9e51204749fdcb380.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/6a/026a7fb3fb786a2a92e1dc0c289291c9/pa/YX37505_747db23ee751a6e9e51204749fdcb380.jpg not downloaded yet
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252Fae%252Fceaec425c7106ce417963ef635dd8240%252Fpa%252FUD73720_dd470b36f276d0f033cb3bb1c5321290.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/ae/ceaec425c7106ce417963ef635dd8240/pa/UD73720_dd470b36f276d0f033cb3bb1c5321290.jpg not downloaded yet
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Ff2%252Fabf219bf7cd89b5581a33fe893870cc8%252Fpa%252FYE02110_b8a3d988c14f85cc2016741b54ab296f.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/f2/abf219bf7cd89b5581a33fe893870cc8/pa/YE02110_b8a3d988c14f85cc2016741b54ab296f.jpg not downloaded yet
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F6a%252F656a19187558a79bf41101eddfcd5ceb%252Fpa%252FYG15382_7fa38e1d7d2b9c57cecaaf49d4a4b181.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/6a/656a19187558a79bf41101eddfcd5ceb/pa/YG15382_7fa38e1d7d2b9c57cecaaf49d4a4b181.jpg not downloaded yet
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252Fe4%252Fa6e425f4947af594305d5000e9a05c30%252Fpa%252FUP17064_48a28b2eac41d51029e38d0e35b4a95a.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/e4/a6e425f4947af594305d5000e9a05c30/pa/UP17064_48a28b2eac41d51029e38d0e35b4a95a.jpg not downloaded yet
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F6a%252F026a7fb3fb786a2a92e1dc0c289291c9%252Fpa%252FYX37505_562d9f0d18a91a8d5d1a2b3d3cc72d41.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/6a/026a7fb3fb786a2a92e1dc0c289291c9/pa/YX37505_562d9f0d18a91a8d5d1a2b3d3cc72d41.jpg not downloaded yet
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252Fae%252Fceaec425c7106ce417963ef635dd8240%252Fpa%252FUD73720_f28349facff6c8052a3b25c14c338bb8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/ae/ceaec425c7106ce417963ef635dd8240/pa/UD73720_f28349facff6c8052a3b25c14c338bb8.jpg not downloaded yet
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Ff2%252Fabf219bf7cd89b5581a33fe893870cc8%252Fpa%252FYE02110_b0f95c201f6b26f09e2d380a699180cf.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/f2/abf219bf7cd89b5581a33fe893870cc8/pa/YE02110_b0f95c201f6b26f09e2d380a699180cf.jpg not downloaded yet
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F6a%252F656a19187558a79bf41101eddfcd5ceb%252Fpa%252FYG15382_106c8b2e7f2f56cf88963b4d0e0c9b31.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/6a/656a19187558a79bf41101eddfcd5ceb/pa/YG15382_106c8b2e7f2f56cf88963b4d0e0c9b31.jpg not downloaded yet
2026-01-28 20:04:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58076a85-30b9-5b3c-b271-24664f63fb14 with identifier: UZ46554
2026-01-28 20:04:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58076a85-30b9-5b3c-b271-24664f63fb14 with scrape type 1
2026-01-28 20:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 58076a85-30b9-5b3c-b271-24664f63fb14
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F14%252Fdc144b424d7312fa7623fc855e117e76%252Fpa%252FUZ46554_f2350bfd5c8c0e065fc7207632956861.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/14/dc144b424d7312fa7623fc855e117e76/pa/UZ46554_f2350bfd5c8c0e065fc7207632956861.jpg not downloaded yet
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252Fe4%252Fa6e425f4947af594305d5000e9a05c30%252Fpa%252FUP17064_d6b360b4e01c728432adec5e845474a7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/e4/a6e425f4947af594305d5000e9a05c30/pa/UP17064_d6b360b4e01c728432adec5e845474a7.jpg not downloaded yet
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F6a%252F026a7fb3fb786a2a92e1dc0c289291c9%252Fpa%252FYX37505_d2a39009533a1447027d536b94f5bc8e.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/6a/026a7fb3fb786a2a92e1dc0c289291c9/pa/YX37505_d2a39009533a1447027d536b94f5bc8e.jpg not downloaded yet
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252Fae%252Fceaec425c7106ce417963ef635dd8240%252Fpa%252FUD73720_2f22d4f3e6353f8bcba88db4f27e84d1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/ae/ceaec425c7106ce417963ef635dd8240/pa/UD73720_2f22d4f3e6353f8bcba88db4f27e84d1.jpg not downloaded yet
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Ff2%252Fabf219bf7cd89b5581a33fe893870cc8%252Fpa%252FYE02110_a2d6c3d3294880b5b2e417883912354c.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/f2/abf219bf7cd89b5581a33fe893870cc8/pa/YE02110_a2d6c3d3294880b5b2e417883912354c.jpg not downloaded yet
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F6a%252F656a19187558a79bf41101eddfcd5ceb%252Fpa%252FYG15382_34c1ff8652e601c079955168d9e5b0e3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/6a/656a19187558a79bf41101eddfcd5ceb/pa/YG15382_34c1ff8652e601c079955168d9e5b0e3.jpg not downloaded yet
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F14%252Fdc144b424d7312fa7623fc855e117e76%252Fpa%252FUZ46554_ff4fba21f76ec4862408d52b455d4737.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/14/dc144b424d7312fa7623fc855e117e76/pa/UZ46554_ff4fba21f76ec4862408d52b455d4737.jpg not downloaded yet
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252Fe4%252Fa6e425f4947af594305d5000e9a05c30%252Fpa%252FUP17064_4c8dbb06c62efefff261ccf1f3193ae6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/e4/a6e425f4947af594305d5000e9a05c30/pa/UP17064_4c8dbb06c62efefff261ccf1f3193ae6.jpg not downloaded yet
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F6a%252F026a7fb3fb786a2a92e1dc0c289291c9%252Fpa%252FYX37505_47c3a3f61d1d29c80c43fc9094357bf0.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/6a/026a7fb3fb786a2a92e1dc0c289291c9/pa/YX37505_47c3a3f61d1d29c80c43fc9094357bf0.jpg not downloaded yet
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252Fae%252Fceaec425c7106ce417963ef635dd8240%252Fpa%252FUD73720_9eaa7328cc842cb5e38d8ad7858c8d1b.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/ae/ceaec425c7106ce417963ef635dd8240/pa/UD73720_9eaa7328cc842cb5e38d8ad7858c8d1b.jpg not downloaded yet
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Ff2%252Fabf219bf7cd89b5581a33fe893870cc8%252Fpa%252FYE02110_f591cbee3676eeebe0f1dbd21223befd.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/f2/abf219bf7cd89b5581a33fe893870cc8/pa/YE02110_f591cbee3676eeebe0f1dbd21223befd.jpg not downloaded yet
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F6a%252F656a19187558a79bf41101eddfcd5ceb%252Fpa%252FYG15382_f9f642b3509ecf551626286137bb50d6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/6a/656a19187558a79bf41101eddfcd5ceb/pa/YG15382_f9f642b3509ecf551626286137bb50d6.jpg not downloaded yet
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F14%252Fdc144b424d7312fa7623fc855e117e76%252Fpa%252FUZ46554_f58be382f38e45dbd5d41007ad71111f.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/14/dc144b424d7312fa7623fc855e117e76/pa/UZ46554_f58be382f38e45dbd5d41007ad71111f.jpg not downloaded yet
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252Fe4%252Fa6e425f4947af594305d5000e9a05c30%252Fpa%252FUP17064_e100f7dc4878ac7040644243863a14c8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/e4/a6e425f4947af594305d5000e9a05c30/pa/UP17064_e100f7dc4878ac7040644243863a14c8.jpg not downloaded yet
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F6a%252F026a7fb3fb786a2a92e1dc0c289291c9%252Fpa%252FYX37505_0d36028b7486243f13ed40d05b5a93e7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/6a/026a7fb3fb786a2a92e1dc0c289291c9/pa/YX37505_0d36028b7486243f13ed40d05b5a93e7.jpg not downloaded yet
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252Fae%252Fceaec425c7106ce417963ef635dd8240%252Fpa%252FUD73720_5a7044615579736e1771750674824aaf.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/ae/ceaec425c7106ce417963ef635dd8240/pa/UD73720_5a7044615579736e1771750674824aaf.jpg not downloaded yet
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Ff2%252Fabf219bf7cd89b5581a33fe893870cc8%252Fpa%252FYE02110_1fb8ad44dd96de23a175b475ae1f3743.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/f2/abf219bf7cd89b5581a33fe893870cc8/pa/YE02110_1fb8ad44dd96de23a175b475ae1f3743.jpg not downloaded yet
2026-01-28 20:04:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/f2/abf219bf7cd89b5581a33fe893870cc8/pa/YE02110_e19097f5f1127bba679ad43a9fb1b4d0.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F6a%252F656a19187558a79bf41101eddfcd5ceb%252Fpa%252FYG15382_70b3551bc5784fe1816c454a4030f350.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/6a/656a19187558a79bf41101eddfcd5ceb/pa/YG15382_70b3551bc5784fe1816c454a4030f350.jpg not downloaded yet
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F14%252Fdc144b424d7312fa7623fc855e117e76%252Fpa%252FUZ46554_2ee36005693e75f7b170d62dc91de480.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/14/dc144b424d7312fa7623fc855e117e76/pa/UZ46554_2ee36005693e75f7b170d62dc91de480.jpg not downloaded yet
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252Fe4%252Fa6e425f4947af594305d5000e9a05c30%252Fpa%252FUP17064_ba8f597b98ca848bbec1c75a3f441471.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/e4/a6e425f4947af594305d5000e9a05c30/pa/UP17064_ba8f597b98ca848bbec1c75a3f441471.jpg not downloaded yet
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F6a%252F026a7fb3fb786a2a92e1dc0c289291c9%252Fpa%252FYX37505_29476fcb52a4b8bed17d89b38e02511b.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/6a/026a7fb3fb786a2a92e1dc0c289291c9/pa/YX37505_29476fcb52a4b8bed17d89b38e02511b.jpg not downloaded yet
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252Fae%252Fceaec425c7106ce417963ef635dd8240%252Fpa%252FUD73720_24d1ea428f17f9650cdfcb83227830ac.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/ae/ceaec425c7106ce417963ef635dd8240/pa/UD73720_24d1ea428f17f9650cdfcb83227830ac.jpg not downloaded yet
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Ff2%252Fabf219bf7cd89b5581a33fe893870cc8%252Fpa%252FYE02110_7bfb1d85a15ffa0ed545fd0d2d13b5b2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/f2/abf219bf7cd89b5581a33fe893870cc8/pa/YE02110_7bfb1d85a15ffa0ed545fd0d2d13b5b2.jpg not downloaded yet
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F6a%252F656a19187558a79bf41101eddfcd5ceb%252Fpa%252FYG15382_a76a2abdd92e2b011252958d307d7f80.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/6a/656a19187558a79bf41101eddfcd5ceb/pa/YG15382_a76a2abdd92e2b011252958d307d7f80.jpg not downloaded yet
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F14%252Fdc144b424d7312fa7623fc855e117e76%252Fpa%252FUZ46554_4d54f67e3def655fc78f876f618a3a2d.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/14/dc144b424d7312fa7623fc855e117e76/pa/UZ46554_4d54f67e3def655fc78f876f618a3a2d.jpg not downloaded yet
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252Fe4%252Fa6e425f4947af594305d5000e9a05c30%252Fpa%252FUP17064_92e715a012219ed83c914476c7ae455b.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/e4/a6e425f4947af594305d5000e9a05c30/pa/UP17064_92e715a012219ed83c914476c7ae455b.jpg not downloaded yet
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F6a%252F026a7fb3fb786a2a92e1dc0c289291c9%252Fpa%252FYX37505_5501874c4323db06dba35dc4088185d7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/6a/026a7fb3fb786a2a92e1dc0c289291c9/pa/YX37505_5501874c4323db06dba35dc4088185d7.jpg not downloaded yet
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252Fae%252Fceaec425c7106ce417963ef635dd8240%252Fpa%252FUD73720_98f3dd0ef6fc5b0cfe64edd74b43ffbd.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/ae/ceaec425c7106ce417963ef635dd8240/pa/UD73720_98f3dd0ef6fc5b0cfe64edd74b43ffbd.jpg not downloaded yet
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Ff2%252Fabf219bf7cd89b5581a33fe893870cc8%252Fpa%252FYE02110_94e1afa61b765c2f77aeb8ea826d1daa.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/f2/abf219bf7cd89b5581a33fe893870cc8/pa/YE02110_94e1afa61b765c2f77aeb8ea826d1daa.jpg not downloaded yet
2026-01-28 20:04:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VL02819> (referer: https://www.auto1.com/v1/car-details-view/VL02819/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F6a%252F656a19187558a79bf41101eddfcd5ceb%252Fpa%252FYG15382_fc84da3d516115015f3c1477cccf7960.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/6a/656a19187558a79bf41101eddfcd5ceb/pa/YG15382_fc84da3d516115015f3c1477cccf7960.jpg not downloaded yet
2026-01-28 20:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F14%252Fdc144b424d7312fa7623fc855e117e76%252Fpa%252FUZ46554_5ad90805b6d4883073934ad0313de975.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/14/dc144b424d7312fa7623fc855e117e76/pa/UZ46554_5ad90805b6d4883073934ad0313de975.jpg not downloaded yet
2026-01-28 20:04:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NP54569> (referer: https://www.auto1.com/v1/car-details-view/NP54569/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HU90428> (referer: https://www.auto1.com/v1/car-details-view/HU90428/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252Fe4%252Fa6e425f4947af594305d5000e9a05c30%252Fpa%252FUP17064_160adf79d7a2a81248ee2d3810b04c20.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/e4/a6e425f4947af594305d5000e9a05c30/pa/UP17064_160adf79d7a2a81248ee2d3810b04c20.jpg not downloaded yet
2026-01-28 20:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F6a%252F026a7fb3fb786a2a92e1dc0c289291c9%252Fpa%252FYX37505_b54b91cd52a539eabc9dc0a566e7700d.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/6a/026a7fb3fb786a2a92e1dc0c289291c9/pa/YX37505_b54b91cd52a539eabc9dc0a566e7700d.jpg not downloaded yet
2026-01-28 20:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252Fae%252Fceaec425c7106ce417963ef635dd8240%252Fpa%252FUD73720_03eb7ab1bd5e93117fda90063cff132b.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/ae/ceaec425c7106ce417963ef635dd8240/pa/UD73720_03eb7ab1bd5e93117fda90063cff132b.jpg not downloaded yet
2026-01-28 20:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Ff2%252Fabf219bf7cd89b5581a33fe893870cc8%252Fpa%252FYE02110_a31d14b638a61115773301259dc3a26e.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/f2/abf219bf7cd89b5581a33fe893870cc8/pa/YE02110_a31d14b638a61115773301259dc3a26e.jpg not downloaded yet
2026-01-28 20:04:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:04:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VV31468> (referer: https://www.auto1.com/v1/car-details-view/VV31468/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:04:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08cef3d0>
2026-01-28 20:04:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ed46455-96fb-531a-8c68-e48daae72e3a/8ed46455-96fb-531a-8c68-e48daae72e3a_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Ff2%252Fabf219bf7cd89b5581a33fe893870cc8%252Fpa%252FYE02110_e19097f5f1127bba679ad43a9fb1b4d0.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/f2/abf219bf7cd89b5581a33fe893870cc8/pa/YE02110_e19097f5f1127bba679ad43a9fb1b4d0.jpg saved to cache
2026-01-28 20:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8ed46455-96fb-531a-8c68-e48daae72e3a
2026-01-28 20:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F6a%252F656a19187558a79bf41101eddfcd5ceb%252Fpa%252FYG15382_ca00e2f40c0e7717b89b65d81371dece.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/6a/656a19187558a79bf41101eddfcd5ceb/pa/YG15382_ca00e2f40c0e7717b89b65d81371dece.jpg not downloaded yet
2026-01-28 20:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F14%252Fdc144b424d7312fa7623fc855e117e76%252Fpa%252FUZ46554_4bf25b1e90f4cc6cfb2873bc3583b94d.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/14/dc144b424d7312fa7623fc855e117e76/pa/UZ46554_4bf25b1e90f4cc6cfb2873bc3583b94d.jpg not downloaded yet
2026-01-28 20:04:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252Fe4%252Fa6e425f4947af594305d5000e9a05c30%252Fpa%252FUP17064_5158424e15cebf47a3414227dab580f5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/e4/a6e425f4947af594305d5000e9a05c30/pa/UP17064_5158424e15cebf47a3414227dab580f5.jpg not downloaded yet
2026-01-28 20:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F6a%252F026a7fb3fb786a2a92e1dc0c289291c9%252Fpa%252FYX37505_faa610ede2c643e9fdddf140934ac3d3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/6a/026a7fb3fb786a2a92e1dc0c289291c9/pa/YX37505_faa610ede2c643e9fdddf140934ac3d3.jpg not downloaded yet
2026-01-28 20:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252Fae%252Fceaec425c7106ce417963ef635dd8240%252Fpa%252FUD73720_6429025b1abb14d29c13f0e9de47e63e.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/ae/ceaec425c7106ce417963ef635dd8240/pa/UD73720_6429025b1abb14d29c13f0e9de47e63e.jpg not downloaded yet
2026-01-28 20:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F6a%252F656a19187558a79bf41101eddfcd5ceb%252Fpa%252FYG15382_dda43ebf79e41e450cc478d82439c685.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/6a/656a19187558a79bf41101eddfcd5ceb/pa/YG15382_dda43ebf79e41e450cc478d82439c685.jpg not downloaded yet
2026-01-28 20:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F14%252Fdc144b424d7312fa7623fc855e117e76%252Fpa%252FUZ46554_858530a047aff355f4084b1f1c130928.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/14/dc144b424d7312fa7623fc855e117e76/pa/UZ46554_858530a047aff355f4084b1f1c130928.jpg not downloaded yet
2026-01-28 20:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NJ76886> (referer: https://www.auto1.com/v1/car-details-view/NJ76886/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TE90440> (referer: https://www.auto1.com/v1/car-details-view/TE90440/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NF03892> (referer: https://www.auto1.com/v1/car-details-view/NF03892/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:04:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f0e251a8-c0b2-505f-98b4-1cc01c2a94ba with identifier: VL02819
2026-01-28 20:04:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f0e251a8-c0b2-505f-98b4-1cc01c2a94ba with scrape type 2
2026-01-28 20:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f0e251a8-c0b2-505f-98b4-1cc01c2a94ba with scrape type 2
2026-01-28 20:04:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f0e251a8-c0b2-505f-98b4-1cc01c2a94ba, identifier: VL02819
2026-01-28 20:04:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3542d180-bfa5-5f73-b34a-0e4239086fc5 with identifier: NP54569
2026-01-28 20:04:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3542d180-bfa5-5f73-b34a-0e4239086fc5 with scrape type 1
2026-01-28 20:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 3542d180-bfa5-5f73-b34a-0e4239086fc5
2026-01-28 20:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F3a%252F683a30f2daff595c3446995e59787c8f%252Fpa%252FNP54569_2e59dd006cf7bc5689ce1961ea64b023.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/3a/683a30f2daff595c3446995e59787c8f/pa/NP54569_2e59dd006cf7bc5689ce1961ea64b023.jpg not downloaded yet
2026-01-28 20:04:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 938cfd71-b044-5a72-95cb-a6dd8b1465e3 with identifier: HU90428
2026-01-28 20:04:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 938cfd71-b044-5a72-95cb-a6dd8b1465e3 with scrape type 1
2026-01-28 20:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 938cfd71-b044-5a72-95cb-a6dd8b1465e3
2026-01-28 20:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fcc%252Ff8cc2d967a2292b1434472d516494abd%252Fpa%252FHU90428_7bf0ed507e7fc7b7ca6ada6f9124f7d2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/cc/f8cc2d967a2292b1434472d516494abd/pa/HU90428_7bf0ed507e7fc7b7ca6ada6f9124f7d2.jpg not downloaded yet
2026-01-28 20:04:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bd588ff9-5f4e-538f-a4db-59dbd9d19bb7 with identifier: VV31468
2026-01-28 20:04:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd588ff9-5f4e-538f-a4db-59dbd9d19bb7 with scrape type 2
2026-01-28 20:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bd588ff9-5f4e-538f-a4db-59dbd9d19bb7 with scrape type 2
2026-01-28 20:04:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: bd588ff9-5f4e-538f-a4db-59dbd9d19bb7, identifier: VV31468
2026-01-28 20:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/6a/026a7fb3fb786a2a92e1dc0c289291c9/pa/YX37505_5501874c4323db06dba35dc4088185d7.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F6a%252F026a7fb3fb786a2a92e1dc0c289291c9%252Fpa%252FYX37505_7e3e9cfc81f0431f4f5122e3a06f415c.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/6a/026a7fb3fb786a2a92e1dc0c289291c9/pa/YX37505_7e3e9cfc81f0431f4f5122e3a06f415c.jpg not downloaded yet
2026-01-28 20:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252Fae%252Fceaec425c7106ce417963ef635dd8240%252Fpa%252FUD73720_2c5439af85f60a962e6a1b5e26e3ca0a.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/ae/ceaec425c7106ce417963ef635dd8240/pa/UD73720_2c5439af85f60a962e6a1b5e26e3ca0a.jpg not downloaded yet
2026-01-28 20:04:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:04:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:04:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:04:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f0e251a8-c0b2-505f-98b4-1cc01c2a94ba with identifier: VL02819
2026-01-28 20:04:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f0e251a8-c0b2-505f-98b4-1cc01c2a94ba with identifier: VL02819
2026-01-28 20:04:40 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 186963 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    186963
2026-01-28 20:04:40 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: f0e251a8-c0b2-505f-98b4-1cc01c2a94ba spider: auto1.it
2026-01-28 20:04:41 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: f0e251a8-c0b2-505f-98b4-1cc01c2a94ba due to rule: high_mileage_for_country.json, error: 186963 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    186963
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 100,
 'expiration_date': '2026-01-29T16:53:33Z',
 'fuel_type': 'diesel',
 'id': 'f0e251a8-c0b2-505f-98b4-1cc01c2a94ba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VL02819',
 'listing': 'auction',
 'location': 'IT',
 'make': 'Citroen',
 'model': 'C3 Aircross',
 'odometer': 186963,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-04-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 Aircross 1.6 Blue-HDi Feel',
 'transmission': 'manual',
 'trim': 'Feel',
 'year': 2018}
2026-01-28 20:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VL02819%27 HTTP/1.1" 200 None
2026-01-28 20:04:41 [auto1.it] INFO: Saving data for VL02819: {'auction_closing_time': 1769705613.0, 'created_time': 1769457980.475941, 'last_price_update_time': 1769630681.122691}
2026-01-28 20:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VL02819') HTTP/1.1" 204 0
2026-01-28 20:04:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: bd588ff9-5f4e-538f-a4db-59dbd9d19bb7 with identifier: VV31468
2026-01-28 20:04:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: bd588ff9-5f4e-538f-a4db-59dbd9d19bb7 with identifier: VV31468
2026-01-28 20:04:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: bd588ff9-5f4e-538f-a4db-59dbd9d19bb7 with identifier: VV31468 to the API
2026-01-28 20:04:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:04:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:04:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VV31468>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.0L',
 'engine_horse_power': 120,
 'expiration_date': '2026-01-29T16:18:23Z',
 'fuel_type': 'gas',
 'id': 'bd588ff9-5f4e-538f-a4db-59dbd9d19bb7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VV31468',
 'listing': 'auction',
 'location': 'IT, Reggio Emilia',
 'make': 'Kia',
 'model': 'XCeed',
 'odometer': 112202,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-02-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Kia XCeed 1.0 TGDI LPG Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2021}
2026-01-28 20:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VV31468%27 HTTP/1.1" 200 None
2026-01-28 20:04:41 [auto1.it] INFO: Saving data for VV31468: {'auction_closing_time': 1769703503.0, 'created_time': 1766692898.425717, 'last_price_update_time': 1769630681.509383}
2026-01-28 20:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VV31468') HTTP/1.1" 204 0
2026-01-28 20:04:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/ae/ceaec425c7106ce417963ef635dd8240/pa/UD73720_98f3dd0ef6fc5b0cfe64edd74b43ffbd.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F6a%252F656a19187558a79bf41101eddfcd5ceb%252Fpa%252FYG15382_9ba0a4b5403a4a0ec512cb1cdf3faea9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/6a/656a19187558a79bf41101eddfcd5ceb/pa/YG15382_9ba0a4b5403a4a0ec512cb1cdf3faea9.jpg not downloaded yet
2026-01-28 20:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F14%252Fdc144b424d7312fa7623fc855e117e76%252Fpa%252FUZ46554_db8eee083770447322d2a356b8dacaa4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/14/dc144b424d7312fa7623fc855e117e76/pa/UZ46554_db8eee083770447322d2a356b8dacaa4.jpg not downloaded yet
2026-01-28 20:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F3a%252F683a30f2daff595c3446995e59787c8f%252Fpa%252FNP54569_41c876120c3c8be292578f3747a526da.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/3a/683a30f2daff595c3446995e59787c8f/pa/NP54569_41c876120c3c8be292578f3747a526da.jpg not downloaded yet
2026-01-28 20:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fcc%252Ff8cc2d967a2292b1434472d516494abd%252Fpa%252FHU90428_b2c9429e6b3fe825d63bb0f82edc4cfe.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/cc/f8cc2d967a2292b1434472d516494abd/pa/HU90428_b2c9429e6b3fe825d63bb0f82edc4cfe.jpg not downloaded yet
2026-01-28 20:04:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/f2/abf219bf7cd89b5581a33fe893870cc8/pa/YE02110_94e1afa61b765c2f77aeb8ea826d1daa.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CY86412> (referer: https://www.auto1.com/v1/car-details-view/CY86412/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F6a%252F656a19187558a79bf41101eddfcd5ceb%252Fpa%252FYG15382_51454687462cc1e6b3692291e1ba9972.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/6a/656a19187558a79bf41101eddfcd5ceb/pa/YG15382_51454687462cc1e6b3692291e1ba9972.jpg not downloaded yet
2026-01-28 20:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F14%252Fdc144b424d7312fa7623fc855e117e76%252Fpa%252FUZ46554_0418032ef193a057d5816c9fc4833813.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/14/dc144b424d7312fa7623fc855e117e76/pa/UZ46554_0418032ef193a057d5816c9fc4833813.jpg not downloaded yet
2026-01-28 20:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F3a%252F683a30f2daff595c3446995e59787c8f%252Fpa%252FNP54569_8dba787b053c28c69e19e00f4cfdabb2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/3a/683a30f2daff595c3446995e59787c8f/pa/NP54569_8dba787b053c28c69e19e00f4cfdabb2.jpg not downloaded yet
2026-01-28 20:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fcc%252Ff8cc2d967a2292b1434472d516494abd%252Fpa%252FHU90428_2c030ed4c299d814f2a8db8cee120f8e.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/cc/f8cc2d967a2292b1434472d516494abd/pa/HU90428_2c030ed4c299d814f2a8db8cee120f8e.jpg not downloaded yet
2026-01-28 20:04:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b3507785-975f-501c-af87-ebe606a7d07e with identifier: NJ76886
2026-01-28 20:04:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3507785-975f-501c-af87-ebe606a7d07e with scrape type 1
2026-01-28 20:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item b3507785-975f-501c-af87-ebe606a7d07e
2026-01-28 20:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Fcc%252Fa8cc7587f9ff20c96ea881986acaf5a9%252Fpa%252FNJ76886_4a02303ad1da612dc17cbbac5366f4e4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/cc/a8cc7587f9ff20c96ea881986acaf5a9/pa/NJ76886_4a02303ad1da612dc17cbbac5366f4e4.jpg not downloaded yet
2026-01-28 20:04:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a5b40882-2653-5b65-adc3-660731917271 with identifier: TE90440
2026-01-28 20:04:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a5b40882-2653-5b65-adc3-660731917271 with scrape type 2
2026-01-28 20:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a5b40882-2653-5b65-adc3-660731917271 with scrape type 2
2026-01-28 20:04:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a5b40882-2653-5b65-adc3-660731917271, identifier: TE90440
2026-01-28 20:04:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f22194b-8131-53ec-b449-73c4599c1646 with identifier: NF03892
2026-01-28 20:04:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f22194b-8131-53ec-b449-73c4599c1646 with scrape type 2
2026-01-28 20:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0f22194b-8131-53ec-b449-73c4599c1646 with scrape type 2
2026-01-28 20:04:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0f22194b-8131-53ec-b449-73c4599c1646, identifier: NF03892
2026-01-28 20:04:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09d93d50>
2026-01-28 20:04:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47641bc6-87ee-5c7b-b578-bf967fb554f9/47641bc6-87ee-5c7b-b578-bf967fb554f9_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F6a%252F026a7fb3fb786a2a92e1dc0c289291c9%252Fpa%252FYX37505_5501874c4323db06dba35dc4088185d7.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/6a/026a7fb3fb786a2a92e1dc0c289291c9/pa/YX37505_5501874c4323db06dba35dc4088185d7.jpg saved to cache
2026-01-28 20:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 47641bc6-87ee-5c7b-b578-bf967fb554f9
2026-01-28 20:04:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a5b40882-2653-5b65-adc3-660731917271 with identifier: TE90440
2026-01-28 20:04:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a5b40882-2653-5b65-adc3-660731917271 with identifier: TE90440
2026-01-28 20:04:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a5b40882-2653-5b65-adc3-660731917271 with identifier: TE90440 to the API
2026-01-28 20:04:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:04:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:04:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TE90440>
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 80,
 'expiration_date': '2026-01-29T16:22:47Z',
 'fuel_type': 'diesel',
 'id': 'a5b40882-2653-5b65-adc3-660731917271',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TE90440',
 'listing': 'auction',
 'location': 'IT',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 131033,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-06-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Polo 1.6 TDI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2019}
2026-01-28 20:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TE90440%27 HTTP/1.1" 200 None
2026-01-28 20:04:42 [auto1.it] INFO: Saving data for TE90440: {'auction_closing_time': 1769703767.0, 'created_time': 1769457979.530254, 'last_price_update_time': 1769630682.5717}
2026-01-28 20:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TE90440') HTTP/1.1" 204 0
2026-01-28 20:04:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0f22194b-8131-53ec-b449-73c4599c1646 with identifier: NF03892
2026-01-28 20:04:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0f22194b-8131-53ec-b449-73c4599c1646 with identifier: NF03892
2026-01-28 20:04:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0f22194b-8131-53ec-b449-73c4599c1646 with identifier: NF03892 to the API
2026-01-28 20:04:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:04:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:04:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NF03892>
{'auction_title': '',
 'c_o_2_emission_value': 157,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:03:27Z',
 'fuel_type': 'petrol',
 'id': '0f22194b-8131-53ec-b449-73c4599c1646',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NF03892',
 'listing': 'auction',
 'location': 'IT, Roma',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 35354,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-04-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.5 TSI ACT R-Line',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2023}
2026-01-28 20:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NF03892%27 HTTP/1.1" 200 None
2026-01-28 20:04:43 [auto1.it] INFO: Saving data for NF03892: {'auction_closing_time': 1769702607.0, 'created_time': 1767039299.638576, 'last_price_update_time': 1769630683.005196}
2026-01-28 20:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NF03892') HTTP/1.1" 204 0
2026-01-28 20:04:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/ae/ceaec425c7106ce417963ef635dd8240/pa/UD73720_6429025b1abb14d29c13f0e9de47e63e.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F14%252Fdc144b424d7312fa7623fc855e117e76%252Fpa%252FUZ46554_808545ed0a26b3afbe09245091d80401.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/14/dc144b424d7312fa7623fc855e117e76/pa/UZ46554_808545ed0a26b3afbe09245091d80401.jpg not downloaded yet
2026-01-28 20:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F3a%252F683a30f2daff595c3446995e59787c8f%252Fpa%252FNP54569_283231f3d2cc97ba7e7ee78f9f8d0c1c.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/3a/683a30f2daff595c3446995e59787c8f/pa/NP54569_283231f3d2cc97ba7e7ee78f9f8d0c1c.jpg not downloaded yet
2026-01-28 20:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fcc%252Ff8cc2d967a2292b1434472d516494abd%252Fpa%252FHU90428_0f09a4f1d346de37b465febee0d8e064.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/cc/f8cc2d967a2292b1434472d516494abd/pa/HU90428_0f09a4f1d346de37b465febee0d8e064.jpg not downloaded yet
2026-01-28 20:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Fcc%252Fa8cc7587f9ff20c96ea881986acaf5a9%252Fpa%252FNJ76886_013409b06d40849ccf2267bf92812020.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/cc/a8cc7587f9ff20c96ea881986acaf5a9/pa/NJ76886_013409b06d40849ccf2267bf92812020.jpg not downloaded yet
2026-01-28 20:04:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b086e7910>
2026-01-28 20:04:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e38ee64-bcbd-59a3-8791-d7d1c58e212f/5e38ee64-bcbd-59a3-8791-d7d1c58e212f_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252Fae%252Fceaec425c7106ce417963ef635dd8240%252Fpa%252FUD73720_98f3dd0ef6fc5b0cfe64edd74b43ffbd.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/ae/ceaec425c7106ce417963ef635dd8240/pa/UD73720_98f3dd0ef6fc5b0cfe64edd74b43ffbd.jpg saved to cache
2026-01-28 20:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 5e38ee64-bcbd-59a3-8791-d7d1c58e212f
2026-01-28 20:04:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/ae/ceaec425c7106ce417963ef635dd8240/pa/UD73720_2c5439af85f60a962e6a1b5e26e3ca0a.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/6a/656a19187558a79bf41101eddfcd5ceb/pa/YG15382_dda43ebf79e41e450cc478d82439c685.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GZ60590> (referer: https://www.auto1.com/v1/car-details-view/GZ60590/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:04:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TJ68491> (referer: https://www.auto1.com/v1/car-details-view/TJ68491/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:04:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TK24342> (referer: https://www.auto1.com/v1/car-details-view/TK24342/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:04:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09d93dd0>
2026-01-28 20:04:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ed46455-96fb-531a-8c68-e48daae72e3a/8ed46455-96fb-531a-8c68-e48daae72e3a_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Ff2%252Fabf219bf7cd89b5581a33fe893870cc8%252Fpa%252FYE02110_94e1afa61b765c2f77aeb8ea826d1daa.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/f2/abf219bf7cd89b5581a33fe893870cc8/pa/YE02110_94e1afa61b765c2f77aeb8ea826d1daa.jpg saved to cache
2026-01-28 20:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 8ed46455-96fb-531a-8c68-e48daae72e3a
2026-01-28 20:04:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8fc31469-80fd-55ab-bdf0-bdcd15fb0516 with identifier: CY86412
2026-01-28 20:04:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8fc31469-80fd-55ab-bdf0-bdcd15fb0516 with scrape type 1
2026-01-28 20:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 8fc31469-80fd-55ab-bdf0-bdcd15fb0516
2026-01-28 20:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F20%252F4120810c32bcbcbb09bae2faf3cc7460%252Fpa%252FCY86412_a482228586e9a3a0b2953f6aef87075f.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/20/4120810c32bcbcbb09bae2faf3cc7460/pa/CY86412_a482228586e9a3a0b2953f6aef87075f.jpg not downloaded yet
2026-01-28 20:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F14%252Fdc144b424d7312fa7623fc855e117e76%252Fpa%252FUZ46554_fbf6bc4a863dd193f0a473fc552a0791.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/14/dc144b424d7312fa7623fc855e117e76/pa/UZ46554_fbf6bc4a863dd193f0a473fc552a0791.jpg not downloaded yet
2026-01-28 20:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F3a%252F683a30f2daff595c3446995e59787c8f%252Fpa%252FNP54569_9129fdea5a6e1388073e412a70d358b1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/3a/683a30f2daff595c3446995e59787c8f/pa/NP54569_9129fdea5a6e1388073e412a70d358b1.jpg not downloaded yet
2026-01-28 20:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fcc%252Ff8cc2d967a2292b1434472d516494abd%252Fpa%252FHU90428_203b767f1f9f1bc900e8c0d48884c2e5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/cc/f8cc2d967a2292b1434472d516494abd/pa/HU90428_203b767f1f9f1bc900e8c0d48884c2e5.jpg not downloaded yet
2026-01-28 20:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Fcc%252Fa8cc7587f9ff20c96ea881986acaf5a9%252Fpa%252FNJ76886_f32058808028270b9d155b1531730823.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/cc/a8cc7587f9ff20c96ea881986acaf5a9/pa/NJ76886_f32058808028270b9d155b1531730823.jpg not downloaded yet
2026-01-28 20:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F20%252F4120810c32bcbcbb09bae2faf3cc7460%252Fpa%252FCY86412_b6cf6922a87c23f7a59dc8076d875d2e.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/20/4120810c32bcbcbb09bae2faf3cc7460/pa/CY86412_b6cf6922a87c23f7a59dc8076d875d2e.jpg not downloaded yet
2026-01-28 20:04:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09d27210>
2026-01-28 20:04:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e38ee64-bcbd-59a3-8791-d7d1c58e212f/5e38ee64-bcbd-59a3-8791-d7d1c58e212f_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252Fae%252Fceaec425c7106ce417963ef635dd8240%252Fpa%252FUD73720_6429025b1abb14d29c13f0e9de47e63e.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/ae/ceaec425c7106ce417963ef635dd8240/pa/UD73720_6429025b1abb14d29c13f0e9de47e63e.jpg saved to cache
2026-01-28 20:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 5e38ee64-bcbd-59a3-8791-d7d1c58e212f
2026-01-28 20:04:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/cc/f8cc2d967a2292b1434472d516494abd/pa/HU90428_b2c9429e6b3fe825d63bb0f82edc4cfe.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F14%252Fdc144b424d7312fa7623fc855e117e76%252Fpa%252FUZ46554_4ab16910eccd5edb112c033aae4a87a5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/14/dc144b424d7312fa7623fc855e117e76/pa/UZ46554_4ab16910eccd5edb112c033aae4a87a5.jpg not downloaded yet
2026-01-28 20:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F3a%252F683a30f2daff595c3446995e59787c8f%252Fpa%252FNP54569_a490a82fa16925ede1622d028c30290f.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/3a/683a30f2daff595c3446995e59787c8f/pa/NP54569_a490a82fa16925ede1622d028c30290f.jpg not downloaded yet
2026-01-28 20:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fcc%252Ff8cc2d967a2292b1434472d516494abd%252Fpa%252FHU90428_52cee1b952d2761fce618bd5dcc878d4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/cc/f8cc2d967a2292b1434472d516494abd/pa/HU90428_52cee1b952d2761fce618bd5dcc878d4.jpg not downloaded yet
2026-01-28 20:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Fcc%252Fa8cc7587f9ff20c96ea881986acaf5a9%252Fpa%252FNJ76886_3d6e6c800ccf78e71ca5ee5daef3771c.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/cc/a8cc7587f9ff20c96ea881986acaf5a9/pa/NJ76886_3d6e6c800ccf78e71ca5ee5daef3771c.jpg not downloaded yet
2026-01-28 20:04:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08cbddd0>
2026-01-28 20:04:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e38ee64-bcbd-59a3-8791-d7d1c58e212f/5e38ee64-bcbd-59a3-8791-d7d1c58e212f_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252Fae%252Fceaec425c7106ce417963ef635dd8240%252Fpa%252FUD73720_2c5439af85f60a962e6a1b5e26e3ca0a.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/ae/ceaec425c7106ce417963ef635dd8240/pa/UD73720_2c5439af85f60a962e6a1b5e26e3ca0a.jpg saved to cache
2026-01-28 20:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 5e38ee64-bcbd-59a3-8791-d7d1c58e212f
2026-01-28 20:04:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09e7f550>
2026-01-28 20:04:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:04:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ba1af05-9c36-5ac8-8700-2bf5d36384e8/6ba1af05-9c36-5ac8-8700-2bf5d36384e8_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F6a%252F656a19187558a79bf41101eddfcd5ceb%252Fpa%252FYG15382_dda43ebf79e41e450cc478d82439c685.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/6a/656a19187558a79bf41101eddfcd5ceb/pa/YG15382_dda43ebf79e41e450cc478d82439c685.jpg saved to cache
2026-01-28 20:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 6ba1af05-9c36-5ac8-8700-2bf5d36384e8
2026-01-28 20:04:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 580f8fae-b4cd-5e33-a889-186e103a1d48 with identifier: GZ60590
2026-01-28 20:04:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 580f8fae-b4cd-5e33-a889-186e103a1d48 with scrape type 1
2026-01-28 20:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 580f8fae-b4cd-5e33-a889-186e103a1d48
2026-01-28 20:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252Fca%252F72ca817a7837f134ff5b1aa16de8c3a0%252Fpa%252FGZ60590_79ba820af946c958e0942672e4e79d38.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/ca/72ca817a7837f134ff5b1aa16de8c3a0/pa/GZ60590_79ba820af946c958e0942672e4e79d38.jpg already downloaded
2026-01-28 20:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252Fca%252F72ca817a7837f134ff5b1aa16de8c3a0%252Fpa%252FGZ60590_3602379f1881cfa71553a1bbfa51d4a9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/ca/72ca817a7837f134ff5b1aa16de8c3a0/pa/GZ60590_3602379f1881cfa71553a1bbfa51d4a9.jpg already downloaded
2026-01-28 20:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252Fca%252F72ca817a7837f134ff5b1aa16de8c3a0%252Fpa%252FGZ60590_144fd0cea624ff7d42bf6fee6733f11f.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/ca/72ca817a7837f134ff5b1aa16de8c3a0/pa/GZ60590_144fd0cea624ff7d42bf6fee6733f11f.jpg already downloaded
2026-01-28 20:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252Fca%252F72ca817a7837f134ff5b1aa16de8c3a0%252Fpa%252FGZ60590_a6fb496fc2c50a598362ecaeab1e2c55.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/ca/72ca817a7837f134ff5b1aa16de8c3a0/pa/GZ60590_a6fb496fc2c50a598362ecaeab1e2c55.jpg already downloaded
2026-01-28 20:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252Fca%252F72ca817a7837f134ff5b1aa16de8c3a0%252Fpa%252FGZ60590_0c069fc59676358ab9354ee9c2afb164.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/ca/72ca817a7837f134ff5b1aa16de8c3a0/pa/GZ60590_0c069fc59676358ab9354ee9c2afb164.jpg already downloaded
2026-01-28 20:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252Fca%252F72ca817a7837f134ff5b1aa16de8c3a0%252Fpa%252FGZ60590_5f55528b1d92524470965e8f16d9348f.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/ca/72ca817a7837f134ff5b1aa16de8c3a0/pa/GZ60590_5f55528b1d92524470965e8f16d9348f.jpg already downloaded
2026-01-28 20:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252Fca%252F72ca817a7837f134ff5b1aa16de8c3a0%252Fpa%252FGZ60590_31096f5f30562fab88fe534f1075643a.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/ca/72ca817a7837f134ff5b1aa16de8c3a0/pa/GZ60590_31096f5f30562fab88fe534f1075643a.jpg already downloaded
2026-01-28 20:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252Fca%252F72ca817a7837f134ff5b1aa16de8c3a0%252Fpa%252FGZ60590_3657a3a074a546ab60deb2f5704a10b5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/ca/72ca817a7837f134ff5b1aa16de8c3a0/pa/GZ60590_3657a3a074a546ab60deb2f5704a10b5.jpg already downloaded
2026-01-28 20:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252Fca%252F72ca817a7837f134ff5b1aa16de8c3a0%252Fpa%252FGZ60590_c75e9664c09ca21c719922251ea24318.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/ca/72ca817a7837f134ff5b1aa16de8c3a0/pa/GZ60590_c75e9664c09ca21c719922251ea24318.jpg already downloaded
2026-01-28 20:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252Fca%252F72ca817a7837f134ff5b1aa16de8c3a0%252Fpa%252FGZ60590_6c33eb342d2c83b52e63cf3726a2770a.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/ca/72ca817a7837f134ff5b1aa16de8c3a0/pa/GZ60590_6c33eb342d2c83b52e63cf3726a2770a.jpg already downloaded
2026-01-28 20:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252Fca%252F72ca817a7837f134ff5b1aa16de8c3a0%252Fpa%252FGZ60590_a9f5bf5de2a04715ae8c203af6265e69.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/ca/72ca817a7837f134ff5b1aa16de8c3a0/pa/GZ60590_a9f5bf5de2a04715ae8c203af6265e69.jpg already downloaded
2026-01-28 20:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252Fca%252F72ca817a7837f134ff5b1aa16de8c3a0%252Fpa%252FGZ60590_76b388791fceb728f7a581db516e2066.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/ca/72ca817a7837f134ff5b1aa16de8c3a0/pa/GZ60590_76b388791fceb728f7a581db516e2066.jpg already downloaded
2026-01-28 20:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252Fca%252F72ca817a7837f134ff5b1aa16de8c3a0%252Fpa%252FGZ60590_3563d6fdf4111166e78181127c99597d.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/ca/72ca817a7837f134ff5b1aa16de8c3a0/pa/GZ60590_3563d6fdf4111166e78181127c99597d.jpg already downloaded
2026-01-28 20:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252Fca%252F72ca817a7837f134ff5b1aa16de8c3a0%252Fpa%252FGZ60590_a41c19fdb0722e1d9a8ad2f23c0440c6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/ca/72ca817a7837f134ff5b1aa16de8c3a0/pa/GZ60590_a41c19fdb0722e1d9a8ad2f23c0440c6.jpg already downloaded
2026-01-28 20:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252Fca%252F72ca817a7837f134ff5b1aa16de8c3a0%252Fpa%252FGZ60590_bca2c6ae780ac89de1dd10ef44e89a79.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/ca/72ca817a7837f134ff5b1aa16de8c3a0/pa/GZ60590_bca2c6ae780ac89de1dd10ef44e89a79.jpg already downloaded
2026-01-28 20:04:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 580f8fae-b4cd-5e33-a889-186e103a1d48, identifier: GZ60590
2026-01-28 20:04:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e7bd886a-de47-5600-9993-bae4155c06ad with identifier: TJ68491
2026-01-28 20:04:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7bd886a-de47-5600-9993-bae4155c06ad with scrape type 1
2026-01-28 20:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 13 photos for item e7bd886a-de47-5600-9993-bae4155c06ad
2026-01-28 20:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F0a%252Fba0ab0a24aa682b660cebfaa994ed2f0%252Fpa%252FTJ68491_28057b5f13f78115c64219e4157f5787.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/0a/ba0ab0a24aa682b660cebfaa994ed2f0/pa/TJ68491_28057b5f13f78115c64219e4157f5787.jpg not downloaded yet
2026-01-28 20:04:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c3dc02e4-eb16-560a-b26a-1f3ea51aa2ba with identifier: TK24342
2026-01-28 20:04:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3dc02e4-eb16-560a-b26a-1f3ea51aa2ba with scrape type 1
2026-01-28 20:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item c3dc02e4-eb16-560a-b26a-1f3ea51aa2ba
2026-01-28 20:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F01%252F12016321ba3d3a429f0b6bea40a0f4e5%252Fpa%252FTK24342_1ab46ea6a718e99ee09fdb1906a62b9d.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/01/12016321ba3d3a429f0b6bea40a0f4e5/pa/TK24342_1ab46ea6a718e99ee09fdb1906a62b9d.jpg already downloaded
2026-01-28 20:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F01%252F12016321ba3d3a429f0b6bea40a0f4e5%252Fpa%252FTK24342_80fbb989c0a701a888868ee4844ca420.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/01/12016321ba3d3a429f0b6bea40a0f4e5/pa/TK24342_80fbb989c0a701a888868ee4844ca420.jpg already downloaded
2026-01-28 20:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F01%252F12016321ba3d3a429f0b6bea40a0f4e5%252Fpa%252FTK24342_15d2e949fe5310cdab8ecad89058c094.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/01/12016321ba3d3a429f0b6bea40a0f4e5/pa/TK24342_15d2e949fe5310cdab8ecad89058c094.jpg already downloaded
2026-01-28 20:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F01%252F12016321ba3d3a429f0b6bea40a0f4e5%252Fpa%252FTK24342_0db1ce7f0667e632e9d7cffe24ca9094.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/01/12016321ba3d3a429f0b6bea40a0f4e5/pa/TK24342_0db1ce7f0667e632e9d7cffe24ca9094.jpg already downloaded
2026-01-28 20:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F01%252F12016321ba3d3a429f0b6bea40a0f4e5%252Fpa%252FTK24342_e54a93b8167e61d2f9a18ebfc2acd9ff.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/01/12016321ba3d3a429f0b6bea40a0f4e5/pa/TK24342_e54a93b8167e61d2f9a18ebfc2acd9ff.jpg already downloaded
2026-01-28 20:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F01%252F12016321ba3d3a429f0b6bea40a0f4e5%252Fpa%252FTK24342_16836b3184f5b139d29ac4d4668e2830.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/01/12016321ba3d3a429f0b6bea40a0f4e5/pa/TK24342_16836b3184f5b139d29ac4d4668e2830.jpg already downloaded
2026-01-28 20:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F01%252F12016321ba3d3a429f0b6bea40a0f4e5%252Fpa%252FTK24342_0e79a860514bab4c90812858b33b09af.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/01/12016321ba3d3a429f0b6bea40a0f4e5/pa/TK24342_0e79a860514bab4c90812858b33b09af.jpg already downloaded
2026-01-28 20:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F01%252F12016321ba3d3a429f0b6bea40a0f4e5%252Fpa%252FTK24342_63b0af87716e78891502811b0b826c0d.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/01/12016321ba3d3a429f0b6bea40a0f4e5/pa/TK24342_63b0af87716e78891502811b0b826c0d.jpg already downloaded
2026-01-28 20:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F01%252F12016321ba3d3a429f0b6bea40a0f4e5%252Fpa%252FTK24342_5a5eeff5c9df8e929ad8494d595b018c.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/01/12016321ba3d3a429f0b6bea40a0f4e5/pa/TK24342_5a5eeff5c9df8e929ad8494d595b018c.jpg already downloaded
2026-01-28 20:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F01%252F12016321ba3d3a429f0b6bea40a0f4e5%252Fpa%252FTK24342_b45ac6da71f5b7a126199c38debf42b5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/01/12016321ba3d3a429f0b6bea40a0f4e5/pa/TK24342_b45ac6da71f5b7a126199c38debf42b5.jpg already downloaded
2026-01-28 20:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F01%252F12016321ba3d3a429f0b6bea40a0f4e5%252Fpa%252FTK24342_6ed542ba6dee8bf9809315f6f23ab766.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/01/12016321ba3d3a429f0b6bea40a0f4e5/pa/TK24342_6ed542ba6dee8bf9809315f6f23ab766.jpg already downloaded
2026-01-28 20:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F01%252F12016321ba3d3a429f0b6bea40a0f4e5%252Fpa%252FTK24342_1714f74f74c331e7452941790665260a.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/01/12016321ba3d3a429f0b6bea40a0f4e5/pa/TK24342_1714f74f74c331e7452941790665260a.jpg already downloaded
2026-01-28 20:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F01%252F12016321ba3d3a429f0b6bea40a0f4e5%252Fpa%252FTK24342_47481c2d549ac5dc4e7f289a3a53f231.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/01/12016321ba3d3a429f0b6bea40a0f4e5/pa/TK24342_47481c2d549ac5dc4e7f289a3a53f231.jpg already downloaded
2026-01-28 20:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F01%252F12016321ba3d3a429f0b6bea40a0f4e5%252Fpa%252FTK24342_685863a85789d1ff066ba8863b0e1c17.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/01/12016321ba3d3a429f0b6bea40a0f4e5/pa/TK24342_685863a85789d1ff066ba8863b0e1c17.jpg already downloaded
2026-01-28 20:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F01%252F12016321ba3d3a429f0b6bea40a0f4e5%252Fpa%252FTK24342_ab4dc782dbf169d5a7b8e8adb0faccbd.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/01/12016321ba3d3a429f0b6bea40a0f4e5/pa/TK24342_ab4dc782dbf169d5a7b8e8adb0faccbd.jpg already downloaded
2026-01-28 20:04:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c3dc02e4-eb16-560a-b26a-1f3ea51aa2ba, identifier: TK24342
2026-01-28 20:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F20%252F4120810c32bcbcbb09bae2faf3cc7460%252Fpa%252FCY86412_a729d8bccd76c04db9747dccb676baf2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/20/4120810c32bcbcbb09bae2faf3cc7460/pa/CY86412_a729d8bccd76c04db9747dccb676baf2.jpg not downloaded yet
2026-01-28 20:04:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 580f8fae-b4cd-5e33-a889-186e103a1d48 with identifier: GZ60590
2026-01-28 20:04:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 580f8fae-b4cd-5e33-a889-186e103a1d48 with identifier: GZ60590
2026-01-28 20:04:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 580f8fae-b4cd-5e33-a889-186e103a1d48 with identifier: GZ60590 to the API
2026-01-28 20:04:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:04:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:04:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GZ60590>
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:23:15Z',
 'fuel_type': 'diesel',
 'id': '580f8fae-b4cd-5e33-a889-186e103a1d48',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GZ60590',
 'listing': 'auction',
 'location': 'IT, Campobasso',
 'make': 'Audi',
 'model': 'Q3 Sportback',
 'odometer': 76948,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img72/ca/72ca817a7837f134ff5b1aa16de8c3a0/pa/GZ60590_79ba820af946c958e0942672e4e79d38.jpg',
                'https://img-pa.auto1.com/img72/ca/72ca817a7837f134ff5b1aa16de8c3a0/pa/GZ60590_3602379f1881cfa71553a1bbfa51d4a9.jpg',
                'https://img-pa.auto1.com/img72/ca/72ca817a7837f134ff5b1aa16de8c3a0/pa/GZ60590_144fd0cea624ff7d42bf6fee6733f11f.jpg',
                'https://img-pa.auto1.com/img72/ca/72ca817a7837f134ff5b1aa16de8c3a0/pa/GZ60590_a6fb496fc2c50a598362ecaeab1e2c55.jpg',
                'https://img-pa.auto1.com/img72/ca/72ca817a7837f134ff5b1aa16de8c3a0/pa/GZ60590_0c069fc59676358ab9354ee9c2afb164.jpg',
                'https://img-pa.auto1.com/img72/ca/72ca817a7837f134ff5b1aa16de8c3a0/pa/GZ60590_5f55528b1d92524470965e8f16d9348f.jpg',
                'https://img-pa.auto1.com/img72/ca/72ca817a7837f134ff5b1aa16de8c3a0/pa/GZ60590_31096f5f30562fab88fe534f1075643a.jpg',
                'https://img-pa.auto1.com/img72/ca/72ca817a7837f134ff5b1aa16de8c3a0/pa/GZ60590_3657a3a074a546ab60deb2f5704a10b5.jpg',
                'https://img-pa.auto1.com/img72/ca/72ca817a7837f134ff5b1aa16de8c3a0/pa/GZ60590_c75e9664c09ca21c719922251ea24318.jpg',
                'https://img-pa.auto1.com/img72/ca/72ca817a7837f134ff5b1aa16de8c3a0/pa/GZ60590_6c33eb342d2c83b52e63cf3726a2770a.jpg',
                'https://img-pa.auto1.com/img72/ca/72ca817a7837f134ff5b1aa16de8c3a0/pa/GZ60590_a9f5bf5de2a04715ae8c203af6265e69.jpg',
                'https://img-pa.auto1.com/img72/ca/72ca817a7837f134ff5b1aa16de8c3a0/pa/GZ60590_76b388791fceb728f7a581db516e2066.jpg',
                'https://img-pa.auto1.com/img72/ca/72ca817a7837f134ff5b1aa16de8c3a0/pa/GZ60590_3563d6fdf4111166e78181127c99597d.jpg',
                'https://img-pa.auto1.com/img72/ca/72ca817a7837f134ff5b1aa16de8c3a0/pa/GZ60590_a41c19fdb0722e1d9a8ad2f23c0440c6.jpg',
                'https://img-pa.auto1.com/img72/ca/72ca817a7837f134ff5b1aa16de8c3a0/pa/GZ60590_bca2c6ae780ac89de1dd10ef44e89a79.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_580f8fae-b4cd-5e33-a889-186e103a1d48/580f8fae-b4cd-5e33-a889-186e103a1d48_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104059,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img72/ca/72ca817a7837f134ff5b1aa16de8c3a0/pa/GZ60590_79ba820af946c958e0942672e4e79d38.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_580f8fae-b4cd-5e33-a889-186e103a1d48/580f8fae-b4cd-5e33-a889-186e103a1d48_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90561,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img72/ca/72ca817a7837f134ff5b1aa16de8c3a0/pa/GZ60590_3602379f1881cfa71553a1bbfa51d4a9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_580f8fae-b4cd-5e33-a889-186e103a1d48/580f8fae-b4cd-5e33-a889-186e103a1d48_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96244,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img72/ca/72ca817a7837f134ff5b1aa16de8c3a0/pa/GZ60590_144fd0cea624ff7d42bf6fee6733f11f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_580f8fae-b4cd-5e33-a889-186e103a1d48/580f8fae-b4cd-5e33-a889-186e103a1d48_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77595,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img72/ca/72ca817a7837f134ff5b1aa16de8c3a0/pa/GZ60590_a6fb496fc2c50a598362ecaeab1e2c55.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_580f8fae-b4cd-5e33-a889-186e103a1d48/580f8fae-b4cd-5e33-a889-186e103a1d48_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103896,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img72/ca/72ca817a7837f134ff5b1aa16de8c3a0/pa/GZ60590_0c069fc59676358ab9354ee9c2afb164.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_580f8fae-b4cd-5e33-a889-186e103a1d48/580f8fae-b4cd-5e33-a889-186e103a1d48_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87861,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img72/ca/72ca817a7837f134ff5b1aa16de8c3a0/pa/GZ60590_5f55528b1d92524470965e8f16d9348f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_580f8fae-b4cd-5e33-a889-186e103a1d48/580f8fae-b4cd-5e33-a889-186e103a1d48_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73188,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img72/ca/72ca817a7837f134ff5b1aa16de8c3a0/pa/GZ60590_31096f5f30562fab88fe534f1075643a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_580f8fae-b4cd-5e33-a889-186e103a1d48/580f8fae-b4cd-5e33-a889-186e103a1d48_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100349,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img72/ca/72ca817a7837f134ff5b1aa16de8c3a0/pa/GZ60590_3657a3a074a546ab60deb2f5704a10b5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_580f8fae-b4cd-5e33-a889-186e103a1d48/580f8fae-b4cd-5e33-a889-186e103a1d48_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101965,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img72/ca/72ca817a7837f134ff5b1aa16de8c3a0/pa/GZ60590_c75e9664c09ca21c719922251ea24318.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_580f8fae-b4cd-5e33-a889-186e103a1d48/580f8fae-b4cd-5e33-a889-186e103a1d48_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61652,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img72/ca/72ca817a7837f134ff5b1aa16de8c3a0/pa/GZ60590_6c33eb342d2c83b52e63cf3726a2770a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_580f8fae-b4cd-5e33-a889-186e103a1d48/580f8fae-b4cd-5e33-a889-186e103a1d48_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68506,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img72/ca/72ca817a7837f134ff5b1aa16de8c3a0/pa/GZ60590_a9f5bf5de2a04715ae8c203af6265e69.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_580f8fae-b4cd-5e33-a889-186e103a1d48/580f8fae-b4cd-5e33-a889-186e103a1d48_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71269,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img72/ca/72ca817a7837f134ff5b1aa16de8c3a0/pa/GZ60590_76b388791fceb728f7a581db516e2066.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_580f8fae-b4cd-5e33-a889-186e103a1d48/580f8fae-b4cd-5e33-a889-186e103a1d48_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64731,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img72/ca/72ca817a7837f134ff5b1aa16de8c3a0/pa/GZ60590_3563d6fdf4111166e78181127c99597d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_580f8fae-b4cd-5e33-a889-186e103a1d48/580f8fae-b4cd-5e33-a889-186e103a1d48_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56293,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img72/ca/72ca817a7837f134ff5b1aa16de8c3a0/pa/GZ60590_a41c19fdb0722e1d9a8ad2f23c0440c6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_580f8fae-b4cd-5e33-a889-186e103a1d48/580f8fae-b4cd-5e33-a889-186e103a1d48_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61562,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img72/ca/72ca817a7837f134ff5b1aa16de8c3a0/pa/GZ60590_bca2c6ae780ac89de1dd10ef44e89a79.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-03-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q3 Sportback 35 TDI S line',
 'transmission': 'automatic',
 'trim': 'S line',
 'year': 2023}
2026-01-28 20:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GZ60590%27 HTTP/1.1" 200 None
2026-01-28 20:04:45 [auto1.it] INFO: Saving data for GZ60590: {'created_time': 1769630685.872726, 'last_price_update_time': 1769630685.872735, 'auction_closing_time': 1769703795.0}
2026-01-28 20:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GZ60590') HTTP/1.1" 204 0
2026-01-28 20:04:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c3dc02e4-eb16-560a-b26a-1f3ea51aa2ba with identifier: TK24342
2026-01-28 20:04:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c3dc02e4-eb16-560a-b26a-1f3ea51aa2ba with identifier: TK24342
2026-01-28 20:04:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c3dc02e4-eb16-560a-b26a-1f3ea51aa2ba with identifier: TK24342 to the API
2026-01-28 20:04:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:04:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:04:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TK24342>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.2L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:34:03Z',
 'fuel_type': 'petrol',
 'id': 'c3dc02e4-eb16-560a-b26a-1f3ea51aa2ba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TK24342',
 'listing': 'auction',
 'location': 'IT, Roma',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 28985,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img12/01/12016321ba3d3a429f0b6bea40a0f4e5/pa/TK24342_1ab46ea6a718e99ee09fdb1906a62b9d.jpg',
                'https://img-pa.auto1.com/img12/01/12016321ba3d3a429f0b6bea40a0f4e5/pa/TK24342_80fbb989c0a701a888868ee4844ca420.jpg',
                'https://img-pa.auto1.com/img12/01/12016321ba3d3a429f0b6bea40a0f4e5/pa/TK24342_15d2e949fe5310cdab8ecad89058c094.jpg',
                'https://img-pa.auto1.com/img12/01/12016321ba3d3a429f0b6bea40a0f4e5/pa/TK24342_0db1ce7f0667e632e9d7cffe24ca9094.jpg',
                'https://img-pa.auto1.com/img12/01/12016321ba3d3a429f0b6bea40a0f4e5/pa/TK24342_e54a93b8167e61d2f9a18ebfc2acd9ff.jpg',
                'https://img-pa.auto1.com/img12/01/12016321ba3d3a429f0b6bea40a0f4e5/pa/TK24342_16836b3184f5b139d29ac4d4668e2830.jpg',
                'https://img-pa.auto1.com/img12/01/12016321ba3d3a429f0b6bea40a0f4e5/pa/TK24342_0e79a860514bab4c90812858b33b09af.jpg',
                'https://img-pa.auto1.com/img12/01/12016321ba3d3a429f0b6bea40a0f4e5/pa/TK24342_63b0af87716e78891502811b0b826c0d.jpg',
                'https://img-pa.auto1.com/img12/01/12016321ba3d3a429f0b6bea40a0f4e5/pa/TK24342_5a5eeff5c9df8e929ad8494d595b018c.jpg',
                'https://img-pa.auto1.com/img12/01/12016321ba3d3a429f0b6bea40a0f4e5/pa/TK24342_b45ac6da71f5b7a126199c38debf42b5.jpg',
                'https://img-pa.auto1.com/img12/01/12016321ba3d3a429f0b6bea40a0f4e5/pa/TK24342_6ed542ba6dee8bf9809315f6f23ab766.jpg',
                'https://img-pa.auto1.com/img12/01/12016321ba3d3a429f0b6bea40a0f4e5/pa/TK24342_1714f74f74c331e7452941790665260a.jpg',
                'https://img-pa.auto1.com/img12/01/12016321ba3d3a429f0b6bea40a0f4e5/pa/TK24342_47481c2d549ac5dc4e7f289a3a53f231.jpg',
                'https://img-pa.auto1.com/img12/01/12016321ba3d3a429f0b6bea40a0f4e5/pa/TK24342_685863a85789d1ff066ba8863b0e1c17.jpg',
                'https://img-pa.auto1.com/img12/01/12016321ba3d3a429f0b6bea40a0f4e5/pa/TK24342_ab4dc782dbf169d5a7b8e8adb0faccbd.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3dc02e4-eb16-560a-b26a-1f3ea51aa2ba/c3dc02e4-eb16-560a-b26a-1f3ea51aa2ba_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2621776,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img12/01/12016321ba3d3a429f0b6bea40a0f4e5/pa/TK24342_1ab46ea6a718e99ee09fdb1906a62b9d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3dc02e4-eb16-560a-b26a-1f3ea51aa2ba/c3dc02e4-eb16-560a-b26a-1f3ea51aa2ba_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2647337,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img12/01/12016321ba3d3a429f0b6bea40a0f4e5/pa/TK24342_80fbb989c0a701a888868ee4844ca420.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3dc02e4-eb16-560a-b26a-1f3ea51aa2ba/c3dc02e4-eb16-560a-b26a-1f3ea51aa2ba_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2470270,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img12/01/12016321ba3d3a429f0b6bea40a0f4e5/pa/TK24342_15d2e949fe5310cdab8ecad89058c094.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3dc02e4-eb16-560a-b26a-1f3ea51aa2ba/c3dc02e4-eb16-560a-b26a-1f3ea51aa2ba_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2485012,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img12/01/12016321ba3d3a429f0b6bea40a0f4e5/pa/TK24342_0db1ce7f0667e632e9d7cffe24ca9094.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3dc02e4-eb16-560a-b26a-1f3ea51aa2ba/c3dc02e4-eb16-560a-b26a-1f3ea51aa2ba_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2483478,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img12/01/12016321ba3d3a429f0b6bea40a0f4e5/pa/TK24342_e54a93b8167e61d2f9a18ebfc2acd9ff.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3dc02e4-eb16-560a-b26a-1f3ea51aa2ba/c3dc02e4-eb16-560a-b26a-1f3ea51aa2ba_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2543289,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img12/01/12016321ba3d3a429f0b6bea40a0f4e5/pa/TK24342_16836b3184f5b139d29ac4d4668e2830.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3dc02e4-eb16-560a-b26a-1f3ea51aa2ba/c3dc02e4-eb16-560a-b26a-1f3ea51aa2ba_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2460559,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img12/01/12016321ba3d3a429f0b6bea40a0f4e5/pa/TK24342_0e79a860514bab4c90812858b33b09af.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3dc02e4-eb16-560a-b26a-1f3ea51aa2ba/c3dc02e4-eb16-560a-b26a-1f3ea51aa2ba_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2656527,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img12/01/12016321ba3d3a429f0b6bea40a0f4e5/pa/TK24342_63b0af87716e78891502811b0b826c0d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3dc02e4-eb16-560a-b26a-1f3ea51aa2ba/c3dc02e4-eb16-560a-b26a-1f3ea51aa2ba_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2599702,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img12/01/12016321ba3d3a429f0b6bea40a0f4e5/pa/TK24342_5a5eeff5c9df8e929ad8494d595b018c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3dc02e4-eb16-560a-b26a-1f3ea51aa2ba/c3dc02e4-eb16-560a-b26a-1f3ea51aa2ba_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2438677,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img12/01/12016321ba3d3a429f0b6bea40a0f4e5/pa/TK24342_b45ac6da71f5b7a126199c38debf42b5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3dc02e4-eb16-560a-b26a-1f3ea51aa2ba/c3dc02e4-eb16-560a-b26a-1f3ea51aa2ba_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2372174,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img12/01/12016321ba3d3a429f0b6bea40a0f4e5/pa/TK24342_6ed542ba6dee8bf9809315f6f23ab766.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3dc02e4-eb16-560a-b26a-1f3ea51aa2ba/c3dc02e4-eb16-560a-b26a-1f3ea51aa2ba_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2325845,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img12/01/12016321ba3d3a429f0b6bea40a0f4e5/pa/TK24342_1714f74f74c331e7452941790665260a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3dc02e4-eb16-560a-b26a-1f3ea51aa2ba/c3dc02e4-eb16-560a-b26a-1f3ea51aa2ba_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49076,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/01/12016321ba3d3a429f0b6bea40a0f4e5/pa/TK24342_47481c2d549ac5dc4e7f289a3a53f231.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3dc02e4-eb16-560a-b26a-1f3ea51aa2ba/c3dc02e4-eb16-560a-b26a-1f3ea51aa2ba_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2321121,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img12/01/12016321ba3d3a429f0b6bea40a0f4e5/pa/TK24342_685863a85789d1ff066ba8863b0e1c17.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3dc02e4-eb16-560a-b26a-1f3ea51aa2ba/c3dc02e4-eb16-560a-b26a-1f3ea51aa2ba_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56964,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/01/12016321ba3d3a429f0b6bea40a0f4e5/pa/TK24342_ab4dc782dbf169d5a7b8e8adb0faccbd.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-02-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Turbo 40 Anniversary',
 'transmission': 'automatic',
 'trim': '40 Anniversary',
 'year': 2023}
2026-01-28 20:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TK24342%27 HTTP/1.1" 200 None
2026-01-28 20:04:46 [auto1.it] INFO: Saving data for TK24342: {'created_time': 1769630686.239856, 'last_price_update_time': 1769630686.239866, 'auction_closing_time': 1769704443.0}
2026-01-28 20:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TK24342') HTTP/1.1" 204 0
2026-01-28 20:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F14%252Fdc144b424d7312fa7623fc855e117e76%252Fpa%252FUZ46554_c004e0a396a93b380a006dbe60765dc6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/14/dc144b424d7312fa7623fc855e117e76/pa/UZ46554_c004e0a396a93b380a006dbe60765dc6.jpg not downloaded yet
2026-01-28 20:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F3a%252F683a30f2daff595c3446995e59787c8f%252Fpa%252FNP54569_cf02890ce5e2d562efb9514c1853cb5c.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/3a/683a30f2daff595c3446995e59787c8f/pa/NP54569_cf02890ce5e2d562efb9514c1853cb5c.jpg not downloaded yet
2026-01-28 20:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fcc%252Ff8cc2d967a2292b1434472d516494abd%252Fpa%252FHU90428_a59f12783ab07459475fe1699023cc8c.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/cc/f8cc2d967a2292b1434472d516494abd/pa/HU90428_a59f12783ab07459475fe1699023cc8c.jpg not downloaded yet
2026-01-28 20:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Fcc%252Fa8cc7587f9ff20c96ea881986acaf5a9%252Fpa%252FNJ76886_dfcfaacd2e5563e1bc489ca5602523c6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/cc/a8cc7587f9ff20c96ea881986acaf5a9/pa/NJ76886_dfcfaacd2e5563e1bc489ca5602523c6.jpg not downloaded yet
2026-01-28 20:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F0a%252Fba0ab0a24aa682b660cebfaa994ed2f0%252Fpa%252FTJ68491_f98b01535b54a13a9c4000d468663eb3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/0a/ba0ab0a24aa682b660cebfaa994ed2f0/pa/TJ68491_f98b01535b54a13a9c4000d468663eb3.jpg not downloaded yet
2026-01-28 20:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BU98469/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F20%252F4120810c32bcbcbb09bae2faf3cc7460%252Fpa%252FCY86412_1703d691da1c965065828033b1004f98.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/20/4120810c32bcbcbb09bae2faf3cc7460/pa/CY86412_1703d691da1c965065828033b1004f98.jpg not downloaded yet
2026-01-28 20:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BM83226> (referer: https://www.auto1.com/v1/car-details-view/BM83226/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PW84021> (referer: https://www.auto1.com/v1/car-details-view/PW84021/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PM77275/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:04:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08bc4990>
2026-01-28 20:04:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:04:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_938cfd71-b044-5a72-95cb-a6dd8b1465e3/938cfd71-b044-5a72-95cb-a6dd8b1465e3_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fcc%252Ff8cc2d967a2292b1434472d516494abd%252Fpa%252FHU90428_b2c9429e6b3fe825d63bb0f82edc4cfe.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/cc/f8cc2d967a2292b1434472d516494abd/pa/HU90428_b2c9429e6b3fe825d63bb0f82edc4cfe.jpg saved to cache
2026-01-28 20:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 938cfd71-b044-5a72-95cb-a6dd8b1465e3
2026-01-28 20:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/3a/683a30f2daff595c3446995e59787c8f/pa/NP54569_8dba787b053c28c69e19e00f4cfdabb2.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F14%252Fdc144b424d7312fa7623fc855e117e76%252Fpa%252FUZ46554_b56575fb94d46f48ac104977b7e269f7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/14/dc144b424d7312fa7623fc855e117e76/pa/UZ46554_b56575fb94d46f48ac104977b7e269f7.jpg not downloaded yet
2026-01-28 20:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F3a%252F683a30f2daff595c3446995e59787c8f%252Fpa%252FNP54569_7504b0bd15f9a400e2c3bc2111d4f1ef.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/3a/683a30f2daff595c3446995e59787c8f/pa/NP54569_7504b0bd15f9a400e2c3bc2111d4f1ef.jpg not downloaded yet
2026-01-28 20:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fcc%252Ff8cc2d967a2292b1434472d516494abd%252Fpa%252FHU90428_d8e109f9a8ddd01928d1ff71c957ec44.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/cc/f8cc2d967a2292b1434472d516494abd/pa/HU90428_d8e109f9a8ddd01928d1ff71c957ec44.jpg not downloaded yet
2026-01-28 20:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Fcc%252Fa8cc7587f9ff20c96ea881986acaf5a9%252Fpa%252FNJ76886_bae4b44a0a74f9fb385ae9730876184a.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/cc/a8cc7587f9ff20c96ea881986acaf5a9/pa/NJ76886_bae4b44a0a74f9fb385ae9730876184a.jpg not downloaded yet
2026-01-28 20:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F0a%252Fba0ab0a24aa682b660cebfaa994ed2f0%252Fpa%252FTJ68491_234377bc7860c69cda22c1fea73a5515.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/0a/ba0ab0a24aa682b660cebfaa994ed2f0/pa/TJ68491_234377bc7860c69cda22c1fea73a5515.jpg not downloaded yet
2026-01-28 20:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F20%252F4120810c32bcbcbb09bae2faf3cc7460%252Fpa%252FCY86412_556c9335d44510c23ad4af3336ca2af8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/20/4120810c32bcbcbb09bae2faf3cc7460/pa/CY86412_556c9335d44510c23ad4af3336ca2af8.jpg not downloaded yet
2026-01-28 20:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F3a%252F683a30f2daff595c3446995e59787c8f%252Fpa%252FNP54569_b6c7e700bf72834ba4afb8a76e5d2639.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/3a/683a30f2daff595c3446995e59787c8f/pa/NP54569_b6c7e700bf72834ba4afb8a76e5d2639.jpg not downloaded yet
2026-01-28 20:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fcc%252Ff8cc2d967a2292b1434472d516494abd%252Fpa%252FHU90428_5ba0d72f0ac9ad9e7f232fa58c84433d.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/cc/f8cc2d967a2292b1434472d516494abd/pa/HU90428_5ba0d72f0ac9ad9e7f232fa58c84433d.jpg not downloaded yet
2026-01-28 20:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Fcc%252Fa8cc7587f9ff20c96ea881986acaf5a9%252Fpa%252FNJ76886_112d46d7add9a979b5d104f28745c5fc.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/cc/a8cc7587f9ff20c96ea881986acaf5a9/pa/NJ76886_112d46d7add9a979b5d104f28745c5fc.jpg not downloaded yet
2026-01-28 20:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F0a%252Fba0ab0a24aa682b660cebfaa994ed2f0%252Fpa%252FTJ68491_ca028dc0ad8dc1e3c839e68f85b27bb1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/0a/ba0ab0a24aa682b660cebfaa994ed2f0/pa/TJ68491_ca028dc0ad8dc1e3c839e68f85b27bb1.jpg not downloaded yet
2026-01-28 20:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F20%252F4120810c32bcbcbb09bae2faf3cc7460%252Fpa%252FCY86412_c0c74370c1382ed66b0f096c4f1c2c43.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/20/4120810c32bcbcbb09bae2faf3cc7460/pa/CY86412_c0c74370c1382ed66b0f096c4f1c2c43.jpg not downloaded yet
2026-01-28 20:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F3a%252F683a30f2daff595c3446995e59787c8f%252Fpa%252FNP54569_c10f03e7ee3d335a6a8f32de4c57b3ac.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/3a/683a30f2daff595c3446995e59787c8f/pa/NP54569_c10f03e7ee3d335a6a8f32de4c57b3ac.jpg not downloaded yet
2026-01-28 20:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fcc%252Ff8cc2d967a2292b1434472d516494abd%252Fpa%252FHU90428_fd94a3643ee4f5d71d9f71fd0ae54628.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/cc/f8cc2d967a2292b1434472d516494abd/pa/HU90428_fd94a3643ee4f5d71d9f71fd0ae54628.jpg not downloaded yet
2026-01-28 20:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Fcc%252Fa8cc7587f9ff20c96ea881986acaf5a9%252Fpa%252FNJ76886_37bbf50e45228cdd5a9ee199e697cdb7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/cc/a8cc7587f9ff20c96ea881986acaf5a9/pa/NJ76886_37bbf50e45228cdd5a9ee199e697cdb7.jpg not downloaded yet
2026-01-28 20:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F0a%252Fba0ab0a24aa682b660cebfaa994ed2f0%252Fpa%252FTJ68491_bbea269657813c81cc6f8abaf04a657f.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/0a/ba0ab0a24aa682b660cebfaa994ed2f0/pa/TJ68491_bbea269657813c81cc6f8abaf04a657f.jpg not downloaded yet
2026-01-28 20:04:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee27dbea-1fbb-5f5e-add5-6fea10abbdbd with identifier: BM83226
2026-01-28 20:04:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee27dbea-1fbb-5f5e-add5-6fea10abbdbd with scrape type 2
2026-01-28 20:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ee27dbea-1fbb-5f5e-add5-6fea10abbdbd with scrape type 2
2026-01-28 20:04:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ee27dbea-1fbb-5f5e-add5-6fea10abbdbd, identifier: BM83226
2026-01-28 20:04:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: befc4e11-1098-596f-b53c-643fcc10628d with identifier: PW84021
2026-01-28 20:04:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item befc4e11-1098-596f-b53c-643fcc10628d with scrape type 1
2026-01-28 20:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 14 photos for item befc4e11-1098-596f-b53c-643fcc10628d
2026-01-28 20:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F07%252F08078ab44d0009f78386c44982f3bb8e%252Fpa%252FPW84021_fdab4ba9237f1ed08582396610d0c88f.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/07/08078ab44d0009f78386c44982f3bb8e/pa/PW84021_fdab4ba9237f1ed08582396610d0c88f.jpg not downloaded yet
2026-01-28 20:04:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08740ad0>
2026-01-28 20:04:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:04:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3542d180-bfa5-5f73-b34a-0e4239086fc5/3542d180-bfa5-5f73-b34a-0e4239086fc5_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F3a%252F683a30f2daff595c3446995e59787c8f%252Fpa%252FNP54569_8dba787b053c28c69e19e00f4cfdabb2.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/3a/683a30f2daff595c3446995e59787c8f/pa/NP54569_8dba787b053c28c69e19e00f4cfdabb2.jpg saved to cache
2026-01-28 20:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3542d180-bfa5-5f73-b34a-0e4239086fc5
2026-01-28 20:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F20%252F4120810c32bcbcbb09bae2faf3cc7460%252Fpa%252FCY86412_5bfa53df2a0df290806656558dcbf8e5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/20/4120810c32bcbcbb09bae2faf3cc7460/pa/CY86412_5bfa53df2a0df290806656558dcbf8e5.jpg not downloaded yet
2026-01-28 20:04:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ee27dbea-1fbb-5f5e-add5-6fea10abbdbd with identifier: BM83226
2026-01-28 20:04:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ee27dbea-1fbb-5f5e-add5-6fea10abbdbd with identifier: BM83226
2026-01-28 20:04:47 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 190839 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    190839
2026-01-28 20:04:47 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: ee27dbea-1fbb-5f5e-add5-6fea10abbdbd spider: auto1.it
2026-01-28 20:04:47 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: ee27dbea-1fbb-5f5e-add5-6fea10abbdbd due to rule: high_mileage_for_country.json, error: 190839 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    190839
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '2.0L',
 'engine_horse_power': 163,
 'expiration_date': '2026-01-29T16:27:24Z',
 'fuel_type': 'diesel',
 'id': 'ee27dbea-1fbb-5f5e-add5-6fea10abbdbd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BM83226',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 190839,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-06-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A6 35 TDI Mild-Hybrid design',
 'transmission': 'automatic',
 'trim': 'design',
 'year': 2020}
2026-01-28 20:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BM83226%27 HTTP/1.1" 200 None
2026-01-28 20:04:47 [auto1.it] INFO: Saving data for BM83226: {'auction_closing_time': 1769704044.0, 'created_time': 1767693741.939141, 'last_price_update_time': 1769630687.503558}
2026-01-28 20:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BM83226') HTTP/1.1" 204 0
2026-01-28 20:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F3a%252F683a30f2daff595c3446995e59787c8f%252Fpa%252FNP54569_bafae926ca660f6616b829da164167d0.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/3a/683a30f2daff595c3446995e59787c8f/pa/NP54569_bafae926ca660f6616b829da164167d0.jpg not downloaded yet
2026-01-28 20:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fcc%252Ff8cc2d967a2292b1434472d516494abd%252Fpa%252FHU90428_03949c1c7b5f6ae75534c29887d71c35.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/cc/f8cc2d967a2292b1434472d516494abd/pa/HU90428_03949c1c7b5f6ae75534c29887d71c35.jpg not downloaded yet
2026-01-28 20:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Fcc%252Fa8cc7587f9ff20c96ea881986acaf5a9%252Fpa%252FNJ76886_a1bcbfea6bd63ae3535f4d670b2f5b5f.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/cc/a8cc7587f9ff20c96ea881986acaf5a9/pa/NJ76886_a1bcbfea6bd63ae3535f4d670b2f5b5f.jpg not downloaded yet
2026-01-28 20:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F0a%252Fba0ab0a24aa682b660cebfaa994ed2f0%252Fpa%252FTJ68491_0938d4aeab6d69f183e325dd14a9b93c.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/0a/ba0ab0a24aa682b660cebfaa994ed2f0/pa/TJ68491_0938d4aeab6d69f183e325dd14a9b93c.jpg not downloaded yet
2026-01-28 20:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F07%252F08078ab44d0009f78386c44982f3bb8e%252Fpa%252FPW84021_abbc6bb3306c361ba3ab77d6698e75ac.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/07/08078ab44d0009f78386c44982f3bb8e/pa/PW84021_abbc6bb3306c361ba3ab77d6698e75ac.jpg not downloaded yet
2026-01-28 20:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F20%252F4120810c32bcbcbb09bae2faf3cc7460%252Fpa%252FCY86412_4de977f7fa9b335d5331c0f81afa470c.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/20/4120810c32bcbcbb09bae2faf3cc7460/pa/CY86412_4de977f7fa9b335d5331c0f81afa470c.jpg not downloaded yet
2026-01-28 20:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F3a%252F683a30f2daff595c3446995e59787c8f%252Fpa%252FNP54569_d553aae4011a8353c4d13c58c95304e8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/3a/683a30f2daff595c3446995e59787c8f/pa/NP54569_d553aae4011a8353c4d13c58c95304e8.jpg not downloaded yet
2026-01-28 20:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fcc%252Ff8cc2d967a2292b1434472d516494abd%252Fpa%252FHU90428_40cf4950f86ea0479ee671f22633dee8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/cc/f8cc2d967a2292b1434472d516494abd/pa/HU90428_40cf4950f86ea0479ee671f22633dee8.jpg not downloaded yet
2026-01-28 20:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Fcc%252Fa8cc7587f9ff20c96ea881986acaf5a9%252Fpa%252FNJ76886_71162460fc049b7cab14b9bda157302e.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/cc/a8cc7587f9ff20c96ea881986acaf5a9/pa/NJ76886_71162460fc049b7cab14b9bda157302e.jpg not downloaded yet
2026-01-28 20:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F0a%252Fba0ab0a24aa682b660cebfaa994ed2f0%252Fpa%252FTJ68491_6a9248bbb2db94a3dd89ca238b459b28.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/0a/ba0ab0a24aa682b660cebfaa994ed2f0/pa/TJ68491_6a9248bbb2db94a3dd89ca238b459b28.jpg not downloaded yet
2026-01-28 20:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F07%252F08078ab44d0009f78386c44982f3bb8e%252Fpa%252FPW84021_37dd24f62cf367230e5670d70237797c.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/07/08078ab44d0009f78386c44982f3bb8e/pa/PW84021_37dd24f62cf367230e5670d70237797c.jpg not downloaded yet
2026-01-28 20:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F20%252F4120810c32bcbcbb09bae2faf3cc7460%252Fpa%252FCY86412_074d2837be27e2d91e9e470e68647b82.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/20/4120810c32bcbcbb09bae2faf3cc7460/pa/CY86412_074d2837be27e2d91e9e470e68647b82.jpg not downloaded yet
2026-01-28 20:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F3a%252F683a30f2daff595c3446995e59787c8f%252Fpa%252FNP54569_019aabd37ecf84a2bfa5c178c5944526.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/3a/683a30f2daff595c3446995e59787c8f/pa/NP54569_019aabd37ecf84a2bfa5c178c5944526.jpg not downloaded yet
2026-01-28 20:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fcc%252Ff8cc2d967a2292b1434472d516494abd%252Fpa%252FHU90428_eed1e6bb988cf89ea9b5592b024ea207.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/cc/f8cc2d967a2292b1434472d516494abd/pa/HU90428_eed1e6bb988cf89ea9b5592b024ea207.jpg not downloaded yet
2026-01-28 20:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Fcc%252Fa8cc7587f9ff20c96ea881986acaf5a9%252Fpa%252FNJ76886_040610618d87d6b887015499c9acda3b.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/cc/a8cc7587f9ff20c96ea881986acaf5a9/pa/NJ76886_040610618d87d6b887015499c9acda3b.jpg not downloaded yet
2026-01-28 20:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F0a%252Fba0ab0a24aa682b660cebfaa994ed2f0%252Fpa%252FTJ68491_a3699d63d5d44b2dcd3d025ec848e4e5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/0a/ba0ab0a24aa682b660cebfaa994ed2f0/pa/TJ68491_a3699d63d5d44b2dcd3d025ec848e4e5.jpg not downloaded yet
2026-01-28 20:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F07%252F08078ab44d0009f78386c44982f3bb8e%252Fpa%252FPW84021_83a512d47d9a88281ed9aa509bff7129.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/07/08078ab44d0009f78386c44982f3bb8e/pa/PW84021_83a512d47d9a88281ed9aa509bff7129.jpg not downloaded yet
2026-01-28 20:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F20%252F4120810c32bcbcbb09bae2faf3cc7460%252Fpa%252FCY86412_f402da7808e1a34c881dbac7910177a2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/20/4120810c32bcbcbb09bae2faf3cc7460/pa/CY86412_f402da7808e1a34c881dbac7910177a2.jpg not downloaded yet
2026-01-28 20:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F3a%252F683a30f2daff595c3446995e59787c8f%252Fpa%252FNP54569_81f918136aff3d038eab9666c6cecfee.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/3a/683a30f2daff595c3446995e59787c8f/pa/NP54569_81f918136aff3d038eab9666c6cecfee.jpg not downloaded yet
2026-01-28 20:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fcc%252Ff8cc2d967a2292b1434472d516494abd%252Fpa%252FHU90428_1096c57dccf818b28213962bc1ef47d3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/cc/f8cc2d967a2292b1434472d516494abd/pa/HU90428_1096c57dccf818b28213962bc1ef47d3.jpg not downloaded yet
2026-01-28 20:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Fcc%252Fa8cc7587f9ff20c96ea881986acaf5a9%252Fpa%252FNJ76886_5fc5da425a15fec5cd8fcbd81013e119.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/cc/a8cc7587f9ff20c96ea881986acaf5a9/pa/NJ76886_5fc5da425a15fec5cd8fcbd81013e119.jpg not downloaded yet
2026-01-28 20:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F0a%252Fba0ab0a24aa682b660cebfaa994ed2f0%252Fpa%252FTJ68491_fdbc8cdace24e07b78d86a21f1c06433.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/0a/ba0ab0a24aa682b660cebfaa994ed2f0/pa/TJ68491_fdbc8cdace24e07b78d86a21f1c06433.jpg not downloaded yet
2026-01-28 20:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F07%252F08078ab44d0009f78386c44982f3bb8e%252Fpa%252FPW84021_aad3ea2a25c0ebaf0fccb4b3233c3485.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/07/08078ab44d0009f78386c44982f3bb8e/pa/PW84021_aad3ea2a25c0ebaf0fccb4b3233c3485.jpg not downloaded yet
2026-01-28 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F20%252F4120810c32bcbcbb09bae2faf3cc7460%252Fpa%252FCY86412_a4cad4fe8aea0212c87e67a3744993c4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/20/4120810c32bcbcbb09bae2faf3cc7460/pa/CY86412_a4cad4fe8aea0212c87e67a3744993c4.jpg not downloaded yet
2026-01-28 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F3a%252F683a30f2daff595c3446995e59787c8f%252Fpa%252FNP54569_7593997a754847a17b49de272a4d7beb.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/3a/683a30f2daff595c3446995e59787c8f/pa/NP54569_7593997a754847a17b49de272a4d7beb.jpg not downloaded yet
2026-01-28 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fcc%252Ff8cc2d967a2292b1434472d516494abd%252Fpa%252FHU90428_cca5f7a6acfd4a0662145866c0448e83.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/cc/f8cc2d967a2292b1434472d516494abd/pa/HU90428_cca5f7a6acfd4a0662145866c0448e83.jpg not downloaded yet
2026-01-28 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Fcc%252Fa8cc7587f9ff20c96ea881986acaf5a9%252Fpa%252FNJ76886_f3e0daf433e1c99e573a1115defa85f3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/cc/a8cc7587f9ff20c96ea881986acaf5a9/pa/NJ76886_f3e0daf433e1c99e573a1115defa85f3.jpg not downloaded yet
2026-01-28 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F0a%252Fba0ab0a24aa682b660cebfaa994ed2f0%252Fpa%252FTJ68491_591fb93d46074380b75500c5cad5a7b3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/0a/ba0ab0a24aa682b660cebfaa994ed2f0/pa/TJ68491_591fb93d46074380b75500c5cad5a7b3.jpg not downloaded yet
2026-01-28 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F07%252F08078ab44d0009f78386c44982f3bb8e%252Fpa%252FPW84021_07456fd8d6ef7a809f140619682a906e.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/07/08078ab44d0009f78386c44982f3bb8e/pa/PW84021_07456fd8d6ef7a809f140619682a906e.jpg not downloaded yet
2026-01-28 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F20%252F4120810c32bcbcbb09bae2faf3cc7460%252Fpa%252FCY86412_69537d2a514f73cc5ce88763704322bd.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/20/4120810c32bcbcbb09bae2faf3cc7460/pa/CY86412_69537d2a514f73cc5ce88763704322bd.jpg not downloaded yet
2026-01-28 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Fcc%252Fa8cc7587f9ff20c96ea881986acaf5a9%252Fpa%252FNJ76886_55a34a11add83fed00c5c5c296abd871.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/cc/a8cc7587f9ff20c96ea881986acaf5a9/pa/NJ76886_55a34a11add83fed00c5c5c296abd871.jpg not downloaded yet
2026-01-28 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F0a%252Fba0ab0a24aa682b660cebfaa994ed2f0%252Fpa%252FTJ68491_c43ebbb4a7299d868ebe74c37fa62c0a.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/0a/ba0ab0a24aa682b660cebfaa994ed2f0/pa/TJ68491_c43ebbb4a7299d868ebe74c37fa62c0a.jpg not downloaded yet
2026-01-28 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F07%252F08078ab44d0009f78386c44982f3bb8e%252Fpa%252FPW84021_42ccfa080b3c675c5e1d58f28d8ad6c4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/07/08078ab44d0009f78386c44982f3bb8e/pa/PW84021_42ccfa080b3c675c5e1d58f28d8ad6c4.jpg not downloaded yet
2026-01-28 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F20%252F4120810c32bcbcbb09bae2faf3cc7460%252Fpa%252FCY86412_c4e2faa946e91a37f18a741568a66353.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/20/4120810c32bcbcbb09bae2faf3cc7460/pa/CY86412_c4e2faa946e91a37f18a741568a66353.jpg not downloaded yet
2026-01-28 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Fcc%252Fa8cc7587f9ff20c96ea881986acaf5a9%252Fpa%252FNJ76886_a875ed78ae44c794f9d4f0e97f91a99b.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/cc/a8cc7587f9ff20c96ea881986acaf5a9/pa/NJ76886_a875ed78ae44c794f9d4f0e97f91a99b.jpg not downloaded yet
2026-01-28 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F0a%252Fba0ab0a24aa682b660cebfaa994ed2f0%252Fpa%252FTJ68491_d548d8360f7963efd879d509b6ecaa22.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/0a/ba0ab0a24aa682b660cebfaa994ed2f0/pa/TJ68491_d548d8360f7963efd879d509b6ecaa22.jpg not downloaded yet
2026-01-28 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F07%252F08078ab44d0009f78386c44982f3bb8e%252Fpa%252FPW84021_206296d333dcf660e494567575c479f7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/07/08078ab44d0009f78386c44982f3bb8e/pa/PW84021_206296d333dcf660e494567575c479f7.jpg not downloaded yet
2026-01-28 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F20%252F4120810c32bcbcbb09bae2faf3cc7460%252Fpa%252FCY86412_43763ed559587ac0adfa4bd8ff862f3a.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/20/4120810c32bcbcbb09bae2faf3cc7460/pa/CY86412_43763ed559587ac0adfa4bd8ff862f3a.jpg not downloaded yet
2026-01-28 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F0a%252Fba0ab0a24aa682b660cebfaa994ed2f0%252Fpa%252FTJ68491_8720344aab967f831ae7c420c4546970.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/0a/ba0ab0a24aa682b660cebfaa994ed2f0/pa/TJ68491_8720344aab967f831ae7c420c4546970.jpg not downloaded yet
2026-01-28 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F07%252F08078ab44d0009f78386c44982f3bb8e%252Fpa%252FPW84021_f22751d0fb77a2eba5790f8653dd61cc.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/07/08078ab44d0009f78386c44982f3bb8e/pa/PW84021_f22751d0fb77a2eba5790f8653dd61cc.jpg not downloaded yet
2026-01-28 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F20%252F4120810c32bcbcbb09bae2faf3cc7460%252Fpa%252FCY86412_e88acaea5438dffb3791d145ad1444f2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/20/4120810c32bcbcbb09bae2faf3cc7460/pa/CY86412_e88acaea5438dffb3791d145ad1444f2.jpg not downloaded yet
2026-01-28 20:04:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/14/dc144b424d7312fa7623fc855e117e76/pa/UZ46554_f58be382f38e45dbd5d41007ad71111f.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F07%252F08078ab44d0009f78386c44982f3bb8e%252Fpa%252FPW84021_7604e81e5b95d904d85424b75ddc712e.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/07/08078ab44d0009f78386c44982f3bb8e/pa/PW84021_7604e81e5b95d904d85424b75ddc712e.jpg not downloaded yet
2026-01-28 20:04:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/3a/683a30f2daff595c3446995e59787c8f/pa/NP54569_2e59dd006cf7bc5689ce1961ea64b023.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F07%252F08078ab44d0009f78386c44982f3bb8e%252Fpa%252FPW84021_a07a5905fe760f592fc952b71a012b67.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/07/08078ab44d0009f78386c44982f3bb8e/pa/PW84021_a07a5905fe760f592fc952b71a012b67.jpg not downloaded yet
2026-01-28 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F07%252F08078ab44d0009f78386c44982f3bb8e%252Fpa%252FPW84021_3e96135adac92a86563532af4d8ea337.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/07/08078ab44d0009f78386c44982f3bb8e/pa/PW84021_3e96135adac92a86563532af4d8ea337.jpg not downloaded yet
2026-01-28 20:04:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/14/dc144b424d7312fa7623fc855e117e76/pa/UZ46554_5ad90805b6d4883073934ad0313de975.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F07%252F08078ab44d0009f78386c44982f3bb8e%252Fpa%252FPW84021_7e337cc5f50fb741d52e24709aa428f4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/07/08078ab44d0009f78386c44982f3bb8e/pa/PW84021_7e337cc5f50fb741d52e24709aa428f4.jpg not downloaded yet
2026-01-28 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F07%252F08078ab44d0009f78386c44982f3bb8e%252Fpa%252FPW84021_2ee72e270ead48b69ef5b584cbcaa88c.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/07/08078ab44d0009f78386c44982f3bb8e/pa/PW84021_2ee72e270ead48b69ef5b584cbcaa88c.jpg not downloaded yet
2026-01-28 20:04:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:04:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09e0c990>
2026-01-28 20:04:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58076a85-30b9-5b3c-b271-24664f63fb14/58076a85-30b9-5b3c-b271-24664f63fb14_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F14%252Fdc144b424d7312fa7623fc855e117e76%252Fpa%252FUZ46554_f58be382f38e45dbd5d41007ad71111f.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/14/dc144b424d7312fa7623fc855e117e76/pa/UZ46554_f58be382f38e45dbd5d41007ad71111f.jpg saved to cache
2026-01-28 20:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 58076a85-30b9-5b3c-b271-24664f63fb14
2026-01-28 20:04:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/cc/a8cc7587f9ff20c96ea881986acaf5a9/pa/NJ76886_4a02303ad1da612dc17cbbac5366f4e4.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/14/dc144b424d7312fa7623fc855e117e76/pa/UZ46554_858530a047aff355f4084b1f1c130928.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/cc/a8cc7587f9ff20c96ea881986acaf5a9/pa/NJ76886_f32058808028270b9d155b1531730823.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:04:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09e342d0>
2026-01-28 20:04:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:04:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3542d180-bfa5-5f73-b34a-0e4239086fc5/3542d180-bfa5-5f73-b34a-0e4239086fc5_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F3a%252F683a30f2daff595c3446995e59787c8f%252Fpa%252FNP54569_2e59dd006cf7bc5689ce1961ea64b023.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/3a/683a30f2daff595c3446995e59787c8f/pa/NP54569_2e59dd006cf7bc5689ce1961ea64b023.jpg saved to cache
2026-01-28 20:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3542d180-bfa5-5f73-b34a-0e4239086fc5
2026-01-28 20:04:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:04:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0a02a790>
2026-01-28 20:04:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:04:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58076a85-30b9-5b3c-b271-24664f63fb14/58076a85-30b9-5b3c-b271-24664f63fb14_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F14%252Fdc144b424d7312fa7623fc855e117e76%252Fpa%252FUZ46554_5ad90805b6d4883073934ad0313de975.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/14/dc144b424d7312fa7623fc855e117e76/pa/UZ46554_5ad90805b6d4883073934ad0313de975.jpg saved to cache
2026-01-28 20:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 58076a85-30b9-5b3c-b271-24664f63fb14
2026-01-28 20:04:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:04:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08c3f790>
2026-01-28 20:04:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:04:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3507785-975f-501c-af87-ebe606a7d07e/b3507785-975f-501c-af87-ebe606a7d07e_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Fcc%252Fa8cc7587f9ff20c96ea881986acaf5a9%252Fpa%252FNJ76886_4a02303ad1da612dc17cbbac5366f4e4.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/cc/a8cc7587f9ff20c96ea881986acaf5a9/pa/NJ76886_4a02303ad1da612dc17cbbac5366f4e4.jpg saved to cache
2026-01-28 20:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b3507785-975f-501c-af87-ebe606a7d07e
2026-01-28 20:04:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:04:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08cf7bd0>
2026-01-28 20:04:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58076a85-30b9-5b3c-b271-24664f63fb14/58076a85-30b9-5b3c-b271-24664f63fb14_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F14%252Fdc144b424d7312fa7623fc855e117e76%252Fpa%252FUZ46554_858530a047aff355f4084b1f1c130928.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/14/dc144b424d7312fa7623fc855e117e76/pa/UZ46554_858530a047aff355f4084b1f1c130928.jpg saved to cache
2026-01-28 20:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 58076a85-30b9-5b3c-b271-24664f63fb14
2026-01-28 20:04:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0873fd10>
2026-01-28 20:04:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3507785-975f-501c-af87-ebe606a7d07e/b3507785-975f-501c-af87-ebe606a7d07e_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Fcc%252Fa8cc7587f9ff20c96ea881986acaf5a9%252Fpa%252FNJ76886_f32058808028270b9d155b1531730823.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/cc/a8cc7587f9ff20c96ea881986acaf5a9/pa/NJ76886_f32058808028270b9d155b1531730823.jpg saved to cache
2026-01-28 20:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b3507785-975f-501c-af87-ebe606a7d07e
2026-01-28 20:04:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/0a/ba0ab0a24aa682b660cebfaa994ed2f0/pa/TJ68491_f98b01535b54a13a9c4000d468663eb3.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img41/20/4120810c32bcbcbb09bae2faf3cc7460/pa/CY86412_a729d8bccd76c04db9747dccb676baf2.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/cc/f8cc2d967a2292b1434472d516494abd/pa/HU90428_2c030ed4c299d814f2a8db8cee120f8e.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/cc/a8cc7587f9ff20c96ea881986acaf5a9/pa/NJ76886_013409b06d40849ccf2267bf92812020.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/cc/f8cc2d967a2292b1434472d516494abd/pa/HU90428_7bf0ed507e7fc7b7ca6ada6f9124f7d2.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/cc/f8cc2d967a2292b1434472d516494abd/pa/HU90428_0f09a4f1d346de37b465febee0d8e064.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/3a/683a30f2daff595c3446995e59787c8f/pa/NP54569_283231f3d2cc97ba7e7ee78f9f8d0c1c.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/cc/a8cc7587f9ff20c96ea881986acaf5a9/pa/NJ76886_dfcfaacd2e5563e1bc489ca5602523c6.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img41/20/4120810c32bcbcbb09bae2faf3cc7460/pa/CY86412_e88acaea5438dffb3791d145ad1444f2.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/07/08078ab44d0009f78386c44982f3bb8e/pa/PW84021_2ee72e270ead48b69ef5b584cbcaa88c.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0a0dd410>
2026-01-28 20:04:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:04:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7bd886a-de47-5600-9993-bae4155c06ad/e7bd886a-de47-5600-9993-bae4155c06ad_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F0a%252Fba0ab0a24aa682b660cebfaa994ed2f0%252Fpa%252FTJ68491_f98b01535b54a13a9c4000d468663eb3.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/0a/ba0ab0a24aa682b660cebfaa994ed2f0/pa/TJ68491_f98b01535b54a13a9c4000d468663eb3.jpg saved to cache
2026-01-28 20:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e7bd886a-de47-5600-9993-bae4155c06ad
2026-01-28 20:04:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/07/08078ab44d0009f78386c44982f3bb8e/pa/PW84021_3e96135adac92a86563532af4d8ea337.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/0a/ba0ab0a24aa682b660cebfaa994ed2f0/pa/TJ68491_8720344aab967f831ae7c420c4546970.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0a07d250>
2026-01-28 20:04:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fc31469-80fd-55ab-bdf0-bdcd15fb0516/8fc31469-80fd-55ab-bdf0-bdcd15fb0516_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F20%252F4120810c32bcbcbb09bae2faf3cc7460%252Fpa%252FCY86412_a729d8bccd76c04db9747dccb676baf2.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/20/4120810c32bcbcbb09bae2faf3cc7460/pa/CY86412_a729d8bccd76c04db9747dccb676baf2.jpg saved to cache
2026-01-28 20:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8fc31469-80fd-55ab-bdf0-bdcd15fb0516
2026-01-28 20:04:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/07/08078ab44d0009f78386c44982f3bb8e/pa/PW84021_7e337cc5f50fb741d52e24709aa428f4.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/07/08078ab44d0009f78386c44982f3bb8e/pa/PW84021_f22751d0fb77a2eba5790f8653dd61cc.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/cc/f8cc2d967a2292b1434472d516494abd/pa/HU90428_a59f12783ab07459475fe1699023cc8c.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/07/08078ab44d0009f78386c44982f3bb8e/pa/PW84021_7604e81e5b95d904d85424b75ddc712e.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:04:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08cd6410>
2026-01-28 20:04:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_938cfd71-b044-5a72-95cb-a6dd8b1465e3/938cfd71-b044-5a72-95cb-a6dd8b1465e3_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fcc%252Ff8cc2d967a2292b1434472d516494abd%252Fpa%252FHU90428_2c030ed4c299d814f2a8db8cee120f8e.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/cc/f8cc2d967a2292b1434472d516494abd/pa/HU90428_2c030ed4c299d814f2a8db8cee120f8e.jpg saved to cache
2026-01-28 20:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 938cfd71-b044-5a72-95cb-a6dd8b1465e3
2026-01-28 20:04:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:04:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09d356d0>
2026-01-28 20:04:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3507785-975f-501c-af87-ebe606a7d07e/b3507785-975f-501c-af87-ebe606a7d07e_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Fcc%252Fa8cc7587f9ff20c96ea881986acaf5a9%252Fpa%252FNJ76886_013409b06d40849ccf2267bf92812020.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/cc/a8cc7587f9ff20c96ea881986acaf5a9/pa/NJ76886_013409b06d40849ccf2267bf92812020.jpg saved to cache
2026-01-28 20:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b3507785-975f-501c-af87-ebe606a7d07e
2026-01-28 20:04:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:04:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09fd2890>
2026-01-28 20:04:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:04:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_938cfd71-b044-5a72-95cb-a6dd8b1465e3/938cfd71-b044-5a72-95cb-a6dd8b1465e3_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fcc%252Ff8cc2d967a2292b1434472d516494abd%252Fpa%252FHU90428_7bf0ed507e7fc7b7ca6ada6f9124f7d2.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/cc/f8cc2d967a2292b1434472d516494abd/pa/HU90428_7bf0ed507e7fc7b7ca6ada6f9124f7d2.jpg saved to cache
2026-01-28 20:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 938cfd71-b044-5a72-95cb-a6dd8b1465e3
2026-01-28 20:04:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:04:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08cec4d0>
2026-01-28 20:04:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:04:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_938cfd71-b044-5a72-95cb-a6dd8b1465e3/938cfd71-b044-5a72-95cb-a6dd8b1465e3_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fcc%252Ff8cc2d967a2292b1434472d516494abd%252Fpa%252FHU90428_0f09a4f1d346de37b465febee0d8e064.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/cc/f8cc2d967a2292b1434472d516494abd/pa/HU90428_0f09a4f1d346de37b465febee0d8e064.jpg saved to cache
2026-01-28 20:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 938cfd71-b044-5a72-95cb-a6dd8b1465e3
2026-01-28 20:04:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:04:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09d35190>
2026-01-28 20:04:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:04:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3542d180-bfa5-5f73-b34a-0e4239086fc5/3542d180-bfa5-5f73-b34a-0e4239086fc5_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F3a%252F683a30f2daff595c3446995e59787c8f%252Fpa%252FNP54569_283231f3d2cc97ba7e7ee78f9f8d0c1c.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/3a/683a30f2daff595c3446995e59787c8f/pa/NP54569_283231f3d2cc97ba7e7ee78f9f8d0c1c.jpg saved to cache
2026-01-28 20:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3542d180-bfa5-5f73-b34a-0e4239086fc5
2026-01-28 20:04:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08c18c90>
2026-01-28 20:04:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:04:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3507785-975f-501c-af87-ebe606a7d07e/b3507785-975f-501c-af87-ebe606a7d07e_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Fcc%252Fa8cc7587f9ff20c96ea881986acaf5a9%252Fpa%252FNJ76886_dfcfaacd2e5563e1bc489ca5602523c6.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/cc/a8cc7587f9ff20c96ea881986acaf5a9/pa/NJ76886_dfcfaacd2e5563e1bc489ca5602523c6.jpg saved to cache
2026-01-28 20:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b3507785-975f-501c-af87-ebe606a7d07e
2026-01-28 20:04:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09d34c90>
2026-01-28 20:04:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:04:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fc31469-80fd-55ab-bdf0-bdcd15fb0516/8fc31469-80fd-55ab-bdf0-bdcd15fb0516_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F20%252F4120810c32bcbcbb09bae2faf3cc7460%252Fpa%252FCY86412_e88acaea5438dffb3791d145ad1444f2.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/20/4120810c32bcbcbb09bae2faf3cc7460/pa/CY86412_e88acaea5438dffb3791d145ad1444f2.jpg saved to cache
2026-01-28 20:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 8fc31469-80fd-55ab-bdf0-bdcd15fb0516
2026-01-28 20:04:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 22 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-01-28 20:04:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 34 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-01-28 20:04:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-01-28 20:04:53 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-01-28 20:04:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-01-28 20:04:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08bc63d0>
2026-01-28 20:04:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_befc4e11-1098-596f-b53c-643fcc10628d/befc4e11-1098-596f-b53c-643fcc10628d_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F07%252F08078ab44d0009f78386c44982f3bb8e%252Fpa%252FPW84021_2ee72e270ead48b69ef5b584cbcaa88c.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/07/08078ab44d0009f78386c44982f3bb8e/pa/PW84021_2ee72e270ead48b69ef5b584cbcaa88c.jpg saved to cache
2026-01-28 20:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item befc4e11-1098-596f-b53c-643fcc10628d
2026-01-28 20:04:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 22 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-01-28 20:04:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 34 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-01-28 20:04:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-01-28 20:04:53 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-01-28 20:04:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-01-28 20:04:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09d10450>
2026-01-28 20:04:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_befc4e11-1098-596f-b53c-643fcc10628d/befc4e11-1098-596f-b53c-643fcc10628d_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F07%252F08078ab44d0009f78386c44982f3bb8e%252Fpa%252FPW84021_3e96135adac92a86563532af4d8ea337.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/07/08078ab44d0009f78386c44982f3bb8e/pa/PW84021_3e96135adac92a86563532af4d8ea337.jpg saved to cache
2026-01-28 20:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item befc4e11-1098-596f-b53c-643fcc10628d
2026-01-28 20:04:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0871df50>
2026-01-28 20:04:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:04:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7bd886a-de47-5600-9993-bae4155c06ad/e7bd886a-de47-5600-9993-bae4155c06ad_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F0a%252Fba0ab0a24aa682b660cebfaa994ed2f0%252Fpa%252FTJ68491_8720344aab967f831ae7c420c4546970.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/0a/ba0ab0a24aa682b660cebfaa994ed2f0/pa/TJ68491_8720344aab967f831ae7c420c4546970.jpg saved to cache
2026-01-28 20:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item e7bd886a-de47-5600-9993-bae4155c06ad
2026-01-28 20:04:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/07/08078ab44d0009f78386c44982f3bb8e/pa/PW84021_a07a5905fe760f592fc952b71a012b67.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 22 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-01-28 20:04:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 34 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-01-28 20:04:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-01-28 20:04:54 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-01-28 20:04:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-01-28 20:04:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09ea0f90>
2026-01-28 20:04:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:04:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_befc4e11-1098-596f-b53c-643fcc10628d/befc4e11-1098-596f-b53c-643fcc10628d_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F07%252F08078ab44d0009f78386c44982f3bb8e%252Fpa%252FPW84021_7e337cc5f50fb741d52e24709aa428f4.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/07/08078ab44d0009f78386c44982f3bb8e/pa/PW84021_7e337cc5f50fb741d52e24709aa428f4.jpg saved to cache
2026-01-28 20:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item befc4e11-1098-596f-b53c-643fcc10628d
2026-01-28 20:04:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09d8f910>
2026-01-28 20:04:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_befc4e11-1098-596f-b53c-643fcc10628d/befc4e11-1098-596f-b53c-643fcc10628d_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F07%252F08078ab44d0009f78386c44982f3bb8e%252Fpa%252FPW84021_f22751d0fb77a2eba5790f8653dd61cc.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/07/08078ab44d0009f78386c44982f3bb8e/pa/PW84021_f22751d0fb77a2eba5790f8653dd61cc.jpg saved to cache
2026-01-28 20:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item befc4e11-1098-596f-b53c-643fcc10628d
2026-01-28 20:04:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09ea2290>
2026-01-28 20:04:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_938cfd71-b044-5a72-95cb-a6dd8b1465e3/938cfd71-b044-5a72-95cb-a6dd8b1465e3_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fcc%252Ff8cc2d967a2292b1434472d516494abd%252Fpa%252FHU90428_a59f12783ab07459475fe1699023cc8c.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/cc/f8cc2d967a2292b1434472d516494abd/pa/HU90428_a59f12783ab07459475fe1699023cc8c.jpg saved to cache
2026-01-28 20:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 938cfd71-b044-5a72-95cb-a6dd8b1465e3
2026-01-28 20:04:55 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 22 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-01-28 20:04:55 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 34 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-01-28 20:04:55 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-01-28 20:04:55 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-01-28 20:04:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-01-28 20:04:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09d8f650>
2026-01-28 20:04:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:04:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_befc4e11-1098-596f-b53c-643fcc10628d/befc4e11-1098-596f-b53c-643fcc10628d_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F07%252F08078ab44d0009f78386c44982f3bb8e%252Fpa%252FPW84021_7604e81e5b95d904d85424b75ddc712e.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/07/08078ab44d0009f78386c44982f3bb8e/pa/PW84021_7604e81e5b95d904d85424b75ddc712e.jpg saved to cache
2026-01-28 20:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item befc4e11-1098-596f-b53c-643fcc10628d
2026-01-28 20:04:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img41/20/4120810c32bcbcbb09bae2faf3cc7460/pa/CY86412_1703d691da1c965065828033b1004f98.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img41/20/4120810c32bcbcbb09bae2faf3cc7460/pa/CY86412_c4e2faa946e91a37f18a741568a66353.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/0a/ba0ab0a24aa682b660cebfaa994ed2f0/pa/TJ68491_d548d8360f7963efd879d509b6ecaa22.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/cc/a8cc7587f9ff20c96ea881986acaf5a9/pa/NJ76886_a875ed78ae44c794f9d4f0e97f91a99b.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/0a/ba0ab0a24aa682b660cebfaa994ed2f0/pa/TJ68491_c43ebbb4a7299d868ebe74c37fa62c0a.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0be04990>
2026-01-28 20:04:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_befc4e11-1098-596f-b53c-643fcc10628d/befc4e11-1098-596f-b53c-643fcc10628d_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F07%252F08078ab44d0009f78386c44982f3bb8e%252Fpa%252FPW84021_a07a5905fe760f592fc952b71a012b67.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/07/08078ab44d0009f78386c44982f3bb8e/pa/PW84021_a07a5905fe760f592fc952b71a012b67.jpg saved to cache
2026-01-28 20:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item befc4e11-1098-596f-b53c-643fcc10628d
2026-01-28 20:04:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/07/08078ab44d0009f78386c44982f3bb8e/pa/PW84021_206296d333dcf660e494567575c479f7.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img41/20/4120810c32bcbcbb09bae2faf3cc7460/pa/CY86412_69537d2a514f73cc5ce88763704322bd.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/0a/ba0ab0a24aa682b660cebfaa994ed2f0/pa/TJ68491_591fb93d46074380b75500c5cad5a7b3.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/cc/a8cc7587f9ff20c96ea881986acaf5a9/pa/NJ76886_55a34a11add83fed00c5c5c296abd871.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/cc/a8cc7587f9ff20c96ea881986acaf5a9/pa/NJ76886_f3e0daf433e1c99e573a1115defa85f3.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/07/08078ab44d0009f78386c44982f3bb8e/pa/PW84021_42ccfa080b3c675c5e1d58f28d8ad6c4.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:04:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09f0de10>
2026-01-28 20:04:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:04:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fc31469-80fd-55ab-bdf0-bdcd15fb0516/8fc31469-80fd-55ab-bdf0-bdcd15fb0516_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F20%252F4120810c32bcbcbb09bae2faf3cc7460%252Fpa%252FCY86412_1703d691da1c965065828033b1004f98.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/20/4120810c32bcbcbb09bae2faf3cc7460/pa/CY86412_1703d691da1c965065828033b1004f98.jpg saved to cache
2026-01-28 20:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8fc31469-80fd-55ab-bdf0-bdcd15fb0516
2026-01-28 20:04:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b086d7f90>
2026-01-28 20:04:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fc31469-80fd-55ab-bdf0-bdcd15fb0516/8fc31469-80fd-55ab-bdf0-bdcd15fb0516_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F20%252F4120810c32bcbcbb09bae2faf3cc7460%252Fpa%252FCY86412_c4e2faa946e91a37f18a741568a66353.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/20/4120810c32bcbcbb09bae2faf3cc7460/pa/CY86412_c4e2faa946e91a37f18a741568a66353.jpg saved to cache
2026-01-28 20:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 8fc31469-80fd-55ab-bdf0-bdcd15fb0516
2026-01-28 20:04:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08bda4d0>
2026-01-28 20:04:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:04:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7bd886a-de47-5600-9993-bae4155c06ad/e7bd886a-de47-5600-9993-bae4155c06ad_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F0a%252Fba0ab0a24aa682b660cebfaa994ed2f0%252Fpa%252FTJ68491_d548d8360f7963efd879d509b6ecaa22.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/0a/ba0ab0a24aa682b660cebfaa994ed2f0/pa/TJ68491_d548d8360f7963efd879d509b6ecaa22.jpg saved to cache
2026-01-28 20:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item e7bd886a-de47-5600-9993-bae4155c06ad
2026-01-28 20:04:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0a07cd10>
2026-01-28 20:04:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:04:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3507785-975f-501c-af87-ebe606a7d07e/b3507785-975f-501c-af87-ebe606a7d07e_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Fcc%252Fa8cc7587f9ff20c96ea881986acaf5a9%252Fpa%252FNJ76886_a875ed78ae44c794f9d4f0e97f91a99b.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/cc/a8cc7587f9ff20c96ea881986acaf5a9/pa/NJ76886_a875ed78ae44c794f9d4f0e97f91a99b.jpg saved to cache
2026-01-28 20:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item b3507785-975f-501c-af87-ebe606a7d07e
2026-01-28 20:04:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08c8d5d0>
2026-01-28 20:04:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7bd886a-de47-5600-9993-bae4155c06ad/e7bd886a-de47-5600-9993-bae4155c06ad_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F0a%252Fba0ab0a24aa682b660cebfaa994ed2f0%252Fpa%252FTJ68491_c43ebbb4a7299d868ebe74c37fa62c0a.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/0a/ba0ab0a24aa682b660cebfaa994ed2f0/pa/TJ68491_c43ebbb4a7299d868ebe74c37fa62c0a.jpg saved to cache
2026-01-28 20:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item e7bd886a-de47-5600-9993-bae4155c06ad
2026-01-28 20:04:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/3a/683a30f2daff595c3446995e59787c8f/pa/NP54569_7593997a754847a17b49de272a4d7beb.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/cc/f8cc2d967a2292b1434472d516494abd/pa/HU90428_cca5f7a6acfd4a0662145866c0448e83.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img41/20/4120810c32bcbcbb09bae2faf3cc7460/pa/CY86412_a4cad4fe8aea0212c87e67a3744993c4.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:57 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 22 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-01-28 20:04:57 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 34 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-01-28 20:04:57 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-01-28 20:04:57 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-01-28 20:04:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-01-28 20:04:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0ea8c990>
2026-01-28 20:04:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:04:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_befc4e11-1098-596f-b53c-643fcc10628d/befc4e11-1098-596f-b53c-643fcc10628d_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F07%252F08078ab44d0009f78386c44982f3bb8e%252Fpa%252FPW84021_206296d333dcf660e494567575c479f7.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/07/08078ab44d0009f78386c44982f3bb8e/pa/PW84021_206296d333dcf660e494567575c479f7.jpg saved to cache
2026-01-28 20:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item befc4e11-1098-596f-b53c-643fcc10628d
2026-01-28 20:04:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0a0ebe90>
2026-01-28 20:04:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fc31469-80fd-55ab-bdf0-bdcd15fb0516/8fc31469-80fd-55ab-bdf0-bdcd15fb0516_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F20%252F4120810c32bcbcbb09bae2faf3cc7460%252Fpa%252FCY86412_69537d2a514f73cc5ce88763704322bd.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/20/4120810c32bcbcbb09bae2faf3cc7460/pa/CY86412_69537d2a514f73cc5ce88763704322bd.jpg saved to cache
2026-01-28 20:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 8fc31469-80fd-55ab-bdf0-bdcd15fb0516
2026-01-28 20:04:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b086cd1d0>
2026-01-28 20:04:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:04:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7bd886a-de47-5600-9993-bae4155c06ad/e7bd886a-de47-5600-9993-bae4155c06ad_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F0a%252Fba0ab0a24aa682b660cebfaa994ed2f0%252Fpa%252FTJ68491_591fb93d46074380b75500c5cad5a7b3.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/0a/ba0ab0a24aa682b660cebfaa994ed2f0/pa/TJ68491_591fb93d46074380b75500c5cad5a7b3.jpg saved to cache
2026-01-28 20:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e7bd886a-de47-5600-9993-bae4155c06ad
2026-01-28 20:04:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0a0a5e10>
2026-01-28 20:04:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:04:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3507785-975f-501c-af87-ebe606a7d07e/b3507785-975f-501c-af87-ebe606a7d07e_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Fcc%252Fa8cc7587f9ff20c96ea881986acaf5a9%252Fpa%252FNJ76886_55a34a11add83fed00c5c5c296abd871.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/cc/a8cc7587f9ff20c96ea881986acaf5a9/pa/NJ76886_55a34a11add83fed00c5c5c296abd871.jpg saved to cache
2026-01-28 20:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item b3507785-975f-501c-af87-ebe606a7d07e
2026-01-28 20:04:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08b2d890>
2026-01-28 20:04:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3507785-975f-501c-af87-ebe606a7d07e/b3507785-975f-501c-af87-ebe606a7d07e_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Fcc%252Fa8cc7587f9ff20c96ea881986acaf5a9%252Fpa%252FNJ76886_f3e0daf433e1c99e573a1115defa85f3.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/cc/a8cc7587f9ff20c96ea881986acaf5a9/pa/NJ76886_f3e0daf433e1c99e573a1115defa85f3.jpg saved to cache
2026-01-28 20:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item b3507785-975f-501c-af87-ebe606a7d07e
2026-01-28 20:04:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0a0a6d90>
2026-01-28 20:04:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:04:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_befc4e11-1098-596f-b53c-643fcc10628d/befc4e11-1098-596f-b53c-643fcc10628d_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F07%252F08078ab44d0009f78386c44982f3bb8e%252Fpa%252FPW84021_42ccfa080b3c675c5e1d58f28d8ad6c4.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/07/08078ab44d0009f78386c44982f3bb8e/pa/PW84021_42ccfa080b3c675c5e1d58f28d8ad6c4.jpg saved to cache
2026-01-28 20:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item befc4e11-1098-596f-b53c-643fcc10628d
2026-01-28 20:04:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/0a/ba0ab0a24aa682b660cebfaa994ed2f0/pa/TJ68491_fdbc8cdace24e07b78d86a21f1c06433.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/07/08078ab44d0009f78386c44982f3bb8e/pa/PW84021_07456fd8d6ef7a809f140619682a906e.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/cc/f8cc2d967a2292b1434472d516494abd/pa/HU90428_1096c57dccf818b28213962bc1ef47d3.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/cc/a8cc7587f9ff20c96ea881986acaf5a9/pa/NJ76886_5fc5da425a15fec5cd8fcbd81013e119.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08ceb7d0>
2026-01-28 20:04:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3542d180-bfa5-5f73-b34a-0e4239086fc5/3542d180-bfa5-5f73-b34a-0e4239086fc5_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F3a%252F683a30f2daff595c3446995e59787c8f%252Fpa%252FNP54569_7593997a754847a17b49de272a4d7beb.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/3a/683a30f2daff595c3446995e59787c8f/pa/NP54569_7593997a754847a17b49de272a4d7beb.jpg saved to cache
2026-01-28 20:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 3542d180-bfa5-5f73-b34a-0e4239086fc5
2026-01-28 20:04:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08b25490>
2026-01-28 20:04:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_938cfd71-b044-5a72-95cb-a6dd8b1465e3/938cfd71-b044-5a72-95cb-a6dd8b1465e3_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fcc%252Ff8cc2d967a2292b1434472d516494abd%252Fpa%252FHU90428_cca5f7a6acfd4a0662145866c0448e83.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/cc/f8cc2d967a2292b1434472d516494abd/pa/HU90428_cca5f7a6acfd4a0662145866c0448e83.jpg saved to cache
2026-01-28 20:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 938cfd71-b044-5a72-95cb-a6dd8b1465e3
2026-01-28 20:04:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b086faf90>
2026-01-28 20:04:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:04:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fc31469-80fd-55ab-bdf0-bdcd15fb0516/8fc31469-80fd-55ab-bdf0-bdcd15fb0516_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F20%252F4120810c32bcbcbb09bae2faf3cc7460%252Fpa%252FCY86412_a4cad4fe8aea0212c87e67a3744993c4.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/20/4120810c32bcbcbb09bae2faf3cc7460/pa/CY86412_a4cad4fe8aea0212c87e67a3744993c4.jpg saved to cache
2026-01-28 20:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 8fc31469-80fd-55ab-bdf0-bdcd15fb0516
2026-01-28 20:04:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/07/08078ab44d0009f78386c44982f3bb8e/pa/PW84021_aad3ea2a25c0ebaf0fccb4b3233c3485.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/cc/f8cc2d967a2292b1434472d516494abd/pa/HU90428_eed1e6bb988cf89ea9b5592b024ea207.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img41/20/4120810c32bcbcbb09bae2faf3cc7460/pa/CY86412_f402da7808e1a34c881dbac7910177a2.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/0a/ba0ab0a24aa682b660cebfaa994ed2f0/pa/TJ68491_a3699d63d5d44b2dcd3d025ec848e4e5.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:04:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09f48dd0>
2026-01-28 20:04:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7bd886a-de47-5600-9993-bae4155c06ad/e7bd886a-de47-5600-9993-bae4155c06ad_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F0a%252Fba0ab0a24aa682b660cebfaa994ed2f0%252Fpa%252FTJ68491_fdbc8cdace24e07b78d86a21f1c06433.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/0a/ba0ab0a24aa682b660cebfaa994ed2f0/pa/TJ68491_fdbc8cdace24e07b78d86a21f1c06433.jpg saved to cache
2026-01-28 20:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e7bd886a-de47-5600-9993-bae4155c06ad
2026-01-28 20:05:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09e920d0>
2026-01-28 20:05:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:05:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_befc4e11-1098-596f-b53c-643fcc10628d/befc4e11-1098-596f-b53c-643fcc10628d_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F07%252F08078ab44d0009f78386c44982f3bb8e%252Fpa%252FPW84021_07456fd8d6ef7a809f140619682a906e.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/07/08078ab44d0009f78386c44982f3bb8e/pa/PW84021_07456fd8d6ef7a809f140619682a906e.jpg saved to cache
2026-01-28 20:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item befc4e11-1098-596f-b53c-643fcc10628d
2026-01-28 20:05:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09f63d10>
2026-01-28 20:05:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:05:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_938cfd71-b044-5a72-95cb-a6dd8b1465e3/938cfd71-b044-5a72-95cb-a6dd8b1465e3_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fcc%252Ff8cc2d967a2292b1434472d516494abd%252Fpa%252FHU90428_1096c57dccf818b28213962bc1ef47d3.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/cc/f8cc2d967a2292b1434472d516494abd/pa/HU90428_1096c57dccf818b28213962bc1ef47d3.jpg saved to cache
2026-01-28 20:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 938cfd71-b044-5a72-95cb-a6dd8b1465e3
2026-01-28 20:05:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09f4a390>
2026-01-28 20:05:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:05:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3507785-975f-501c-af87-ebe606a7d07e/b3507785-975f-501c-af87-ebe606a7d07e_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Fcc%252Fa8cc7587f9ff20c96ea881986acaf5a9%252Fpa%252FNJ76886_5fc5da425a15fec5cd8fcbd81013e119.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/cc/a8cc7587f9ff20c96ea881986acaf5a9/pa/NJ76886_5fc5da425a15fec5cd8fcbd81013e119.jpg saved to cache
2026-01-28 20:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item b3507785-975f-501c-af87-ebe606a7d07e
2026-01-28 20:05:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/07/08078ab44d0009f78386c44982f3bb8e/pa/PW84021_37dd24f62cf367230e5670d70237797c.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/07/08078ab44d0009f78386c44982f3bb8e/pa/PW84021_83a512d47d9a88281ed9aa509bff7129.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09f79790>
2026-01-28 20:05:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:05:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_befc4e11-1098-596f-b53c-643fcc10628d/befc4e11-1098-596f-b53c-643fcc10628d_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F07%252F08078ab44d0009f78386c44982f3bb8e%252Fpa%252FPW84021_aad3ea2a25c0ebaf0fccb4b3233c3485.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/07/08078ab44d0009f78386c44982f3bb8e/pa/PW84021_aad3ea2a25c0ebaf0fccb4b3233c3485.jpg saved to cache
2026-01-28 20:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item befc4e11-1098-596f-b53c-643fcc10628d
2026-01-28 20:05:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09ee2050>
2026-01-28 20:05:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_938cfd71-b044-5a72-95cb-a6dd8b1465e3/938cfd71-b044-5a72-95cb-a6dd8b1465e3_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fcc%252Ff8cc2d967a2292b1434472d516494abd%252Fpa%252FHU90428_eed1e6bb988cf89ea9b5592b024ea207.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/cc/f8cc2d967a2292b1434472d516494abd/pa/HU90428_eed1e6bb988cf89ea9b5592b024ea207.jpg saved to cache
2026-01-28 20:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 938cfd71-b044-5a72-95cb-a6dd8b1465e3
2026-01-28 20:05:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09e92e50>
2026-01-28 20:05:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:05:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fc31469-80fd-55ab-bdf0-bdcd15fb0516/8fc31469-80fd-55ab-bdf0-bdcd15fb0516_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F20%252F4120810c32bcbcbb09bae2faf3cc7460%252Fpa%252FCY86412_f402da7808e1a34c881dbac7910177a2.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/20/4120810c32bcbcbb09bae2faf3cc7460/pa/CY86412_f402da7808e1a34c881dbac7910177a2.jpg saved to cache
2026-01-28 20:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8fc31469-80fd-55ab-bdf0-bdcd15fb0516
2026-01-28 20:05:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08b0ba10>
2026-01-28 20:05:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7bd886a-de47-5600-9993-bae4155c06ad/e7bd886a-de47-5600-9993-bae4155c06ad_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F0a%252Fba0ab0a24aa682b660cebfaa994ed2f0%252Fpa%252FTJ68491_a3699d63d5d44b2dcd3d025ec848e4e5.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/0a/ba0ab0a24aa682b660cebfaa994ed2f0/pa/TJ68491_a3699d63d5d44b2dcd3d025ec848e4e5.jpg saved to cache
2026-01-28 20:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e7bd886a-de47-5600-9993-bae4155c06ad
2026-01-28 20:05:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/0a/ba0ab0a24aa682b660cebfaa994ed2f0/pa/TJ68491_6a9248bbb2db94a3dd89ca238b459b28.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:05:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09f73510>
2026-01-28 20:05:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_befc4e11-1098-596f-b53c-643fcc10628d/befc4e11-1098-596f-b53c-643fcc10628d_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F07%252F08078ab44d0009f78386c44982f3bb8e%252Fpa%252FPW84021_37dd24f62cf367230e5670d70237797c.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/07/08078ab44d0009f78386c44982f3bb8e/pa/PW84021_37dd24f62cf367230e5670d70237797c.jpg saved to cache
2026-01-28 20:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item befc4e11-1098-596f-b53c-643fcc10628d
2026-01-28 20:05:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b086e6f50>
2026-01-28 20:05:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:05:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_befc4e11-1098-596f-b53c-643fcc10628d/befc4e11-1098-596f-b53c-643fcc10628d_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F07%252F08078ab44d0009f78386c44982f3bb8e%252Fpa%252FPW84021_83a512d47d9a88281ed9aa509bff7129.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/07/08078ab44d0009f78386c44982f3bb8e/pa/PW84021_83a512d47d9a88281ed9aa509bff7129.jpg saved to cache
2026-01-28 20:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item befc4e11-1098-596f-b53c-643fcc10628d
2026-01-28 20:05:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0a0a1550>
2026-01-28 20:05:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7bd886a-de47-5600-9993-bae4155c06ad/e7bd886a-de47-5600-9993-bae4155c06ad_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F0a%252Fba0ab0a24aa682b660cebfaa994ed2f0%252Fpa%252FTJ68491_6a9248bbb2db94a3dd89ca238b459b28.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/0a/ba0ab0a24aa682b660cebfaa994ed2f0/pa/TJ68491_6a9248bbb2db94a3dd89ca238b459b28.jpg saved to cache
2026-01-28 20:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e7bd886a-de47-5600-9993-bae4155c06ad
2026-01-28 20:05:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/3a/683a30f2daff595c3446995e59787c8f/pa/NP54569_81f918136aff3d038eab9666c6cecfee.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img41/20/4120810c32bcbcbb09bae2faf3cc7460/pa/CY86412_43763ed559587ac0adfa4bd8ff862f3a.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/cc/a8cc7587f9ff20c96ea881986acaf5a9/pa/NJ76886_040610618d87d6b887015499c9acda3b.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/3a/683a30f2daff595c3446995e59787c8f/pa/NP54569_019aabd37ecf84a2bfa5c178c5944526.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/cc/a8cc7587f9ff20c96ea881986acaf5a9/pa/NJ76886_71162460fc049b7cab14b9bda157302e.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img41/20/4120810c32bcbcbb09bae2faf3cc7460/pa/CY86412_074d2837be27e2d91e9e470e68647b82.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/cc/f8cc2d967a2292b1434472d516494abd/pa/HU90428_40cf4950f86ea0479ee671f22633dee8.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/cc/a8cc7587f9ff20c96ea881986acaf5a9/pa/NJ76886_a1bcbfea6bd63ae3535f4d670b2f5b5f.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/3a/683a30f2daff595c3446995e59787c8f/pa/NP54569_d553aae4011a8353c4d13c58c95304e8.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/07/08078ab44d0009f78386c44982f3bb8e/pa/PW84021_abbc6bb3306c361ba3ab77d6698e75ac.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:05:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09ee13d0>
2026-01-28 20:05:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3542d180-bfa5-5f73-b34a-0e4239086fc5/3542d180-bfa5-5f73-b34a-0e4239086fc5_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F3a%252F683a30f2daff595c3446995e59787c8f%252Fpa%252FNP54569_81f918136aff3d038eab9666c6cecfee.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/3a/683a30f2daff595c3446995e59787c8f/pa/NP54569_81f918136aff3d038eab9666c6cecfee.jpg saved to cache
2026-01-28 20:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 3542d180-bfa5-5f73-b34a-0e4239086fc5
2026-01-28 20:05:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/cc/f8cc2d967a2292b1434472d516494abd/pa/HU90428_03949c1c7b5f6ae75534c29887d71c35.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:05:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08b2bd50>
2026-01-28 20:05:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fc31469-80fd-55ab-bdf0-bdcd15fb0516/8fc31469-80fd-55ab-bdf0-bdcd15fb0516_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F20%252F4120810c32bcbcbb09bae2faf3cc7460%252Fpa%252FCY86412_43763ed559587ac0adfa4bd8ff862f3a.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/20/4120810c32bcbcbb09bae2faf3cc7460/pa/CY86412_43763ed559587ac0adfa4bd8ff862f3a.jpg saved to cache
2026-01-28 20:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 8fc31469-80fd-55ab-bdf0-bdcd15fb0516
2026-01-28 20:05:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/0a/ba0ab0a24aa682b660cebfaa994ed2f0/pa/TJ68491_0938d4aeab6d69f183e325dd14a9b93c.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:05:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09ea13d0>
2026-01-28 20:05:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:05:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3507785-975f-501c-af87-ebe606a7d07e/b3507785-975f-501c-af87-ebe606a7d07e_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Fcc%252Fa8cc7587f9ff20c96ea881986acaf5a9%252Fpa%252FNJ76886_040610618d87d6b887015499c9acda3b.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/cc/a8cc7587f9ff20c96ea881986acaf5a9/pa/NJ76886_040610618d87d6b887015499c9acda3b.jpg saved to cache
2026-01-28 20:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item b3507785-975f-501c-af87-ebe606a7d07e
2026-01-28 20:05:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:05:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08bdff90>
2026-01-28 20:05:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3542d180-bfa5-5f73-b34a-0e4239086fc5/3542d180-bfa5-5f73-b34a-0e4239086fc5_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F3a%252F683a30f2daff595c3446995e59787c8f%252Fpa%252FNP54569_019aabd37ecf84a2bfa5c178c5944526.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/3a/683a30f2daff595c3446995e59787c8f/pa/NP54569_019aabd37ecf84a2bfa5c178c5944526.jpg saved to cache
2026-01-28 20:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 3542d180-bfa5-5f73-b34a-0e4239086fc5
2026-01-28 20:05:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:05:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08bdd690>
2026-01-28 20:05:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3507785-975f-501c-af87-ebe606a7d07e/b3507785-975f-501c-af87-ebe606a7d07e_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Fcc%252Fa8cc7587f9ff20c96ea881986acaf5a9%252Fpa%252FNJ76886_71162460fc049b7cab14b9bda157302e.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/cc/a8cc7587f9ff20c96ea881986acaf5a9/pa/NJ76886_71162460fc049b7cab14b9bda157302e.jpg saved to cache
2026-01-28 20:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b3507785-975f-501c-af87-ebe606a7d07e
2026-01-28 20:05:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:05:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b089a6c90>
2026-01-28 20:05:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:05:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fc31469-80fd-55ab-bdf0-bdcd15fb0516/8fc31469-80fd-55ab-bdf0-bdcd15fb0516_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F20%252F4120810c32bcbcbb09bae2faf3cc7460%252Fpa%252FCY86412_074d2837be27e2d91e9e470e68647b82.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/20/4120810c32bcbcbb09bae2faf3cc7460/pa/CY86412_074d2837be27e2d91e9e470e68647b82.jpg saved to cache
2026-01-28 20:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8fc31469-80fd-55ab-bdf0-bdcd15fb0516
2026-01-28 20:05:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:05:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08b0a550>
2026-01-28 20:05:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_938cfd71-b044-5a72-95cb-a6dd8b1465e3/938cfd71-b044-5a72-95cb-a6dd8b1465e3_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fcc%252Ff8cc2d967a2292b1434472d516494abd%252Fpa%252FHU90428_40cf4950f86ea0479ee671f22633dee8.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/cc/f8cc2d967a2292b1434472d516494abd/pa/HU90428_40cf4950f86ea0479ee671f22633dee8.jpg saved to cache
2026-01-28 20:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 938cfd71-b044-5a72-95cb-a6dd8b1465e3
2026-01-28 20:05:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08be4350>
2026-01-28 20:05:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:05:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3507785-975f-501c-af87-ebe606a7d07e/b3507785-975f-501c-af87-ebe606a7d07e_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Fcc%252Fa8cc7587f9ff20c96ea881986acaf5a9%252Fpa%252FNJ76886_a1bcbfea6bd63ae3535f4d670b2f5b5f.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/cc/a8cc7587f9ff20c96ea881986acaf5a9/pa/NJ76886_a1bcbfea6bd63ae3535f4d670b2f5b5f.jpg saved to cache
2026-01-28 20:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b3507785-975f-501c-af87-ebe606a7d07e
2026-01-28 20:05:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:05:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08b04b90>
2026-01-28 20:05:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:05:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3542d180-bfa5-5f73-b34a-0e4239086fc5/3542d180-bfa5-5f73-b34a-0e4239086fc5_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F3a%252F683a30f2daff595c3446995e59787c8f%252Fpa%252FNP54569_d553aae4011a8353c4d13c58c95304e8.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/3a/683a30f2daff595c3446995e59787c8f/pa/NP54569_d553aae4011a8353c4d13c58c95304e8.jpg saved to cache
2026-01-28 20:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 3542d180-bfa5-5f73-b34a-0e4239086fc5
2026-01-28 20:05:07 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 22 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-01-28 20:05:07 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 34 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-01-28 20:05:07 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-01-28 20:05:07 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-01-28 20:05:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-01-28 20:05:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08919290>
2026-01-28 20:05:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:05:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_befc4e11-1098-596f-b53c-643fcc10628d/befc4e11-1098-596f-b53c-643fcc10628d_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F07%252F08078ab44d0009f78386c44982f3bb8e%252Fpa%252FPW84021_abbc6bb3306c361ba3ab77d6698e75ac.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/07/08078ab44d0009f78386c44982f3bb8e/pa/PW84021_abbc6bb3306c361ba3ab77d6698e75ac.jpg saved to cache
2026-01-28 20:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item befc4e11-1098-596f-b53c-643fcc10628d
2026-01-28 20:05:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09d59890>
2026-01-28 20:05:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_938cfd71-b044-5a72-95cb-a6dd8b1465e3/938cfd71-b044-5a72-95cb-a6dd8b1465e3_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fcc%252Ff8cc2d967a2292b1434472d516494abd%252Fpa%252FHU90428_03949c1c7b5f6ae75534c29887d71c35.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/cc/f8cc2d967a2292b1434472d516494abd/pa/HU90428_03949c1c7b5f6ae75534c29887d71c35.jpg saved to cache
2026-01-28 20:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 938cfd71-b044-5a72-95cb-a6dd8b1465e3
2026-01-28 20:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PM77275> (referer: https://www.auto1.com/v1/car-details-view/PM77275/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:05:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:05:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09e0c750>
2026-01-28 20:05:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7bd886a-de47-5600-9993-bae4155c06ad/e7bd886a-de47-5600-9993-bae4155c06ad_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F0a%252Fba0ab0a24aa682b660cebfaa994ed2f0%252Fpa%252FTJ68491_0938d4aeab6d69f183e325dd14a9b93c.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/0a/ba0ab0a24aa682b660cebfaa994ed2f0/pa/TJ68491_0938d4aeab6d69f183e325dd14a9b93c.jpg saved to cache
2026-01-28 20:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e7bd886a-de47-5600-9993-bae4155c06ad
2026-01-28 20:05:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 05317f3c-d38a-5f74-8961-aae450b6756c with identifier: PM77275
2026-01-28 20:05:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05317f3c-d38a-5f74-8961-aae450b6756c with scrape type 2
2026-01-28 20:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 05317f3c-d38a-5f74-8961-aae450b6756c with scrape type 2
2026-01-28 20:05:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 05317f3c-d38a-5f74-8961-aae450b6756c, identifier: PM77275
2026-01-28 20:05:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 05317f3c-d38a-5f74-8961-aae450b6756c with identifier: PM77275
2026-01-28 20:05:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 05317f3c-d38a-5f74-8961-aae450b6756c with identifier: PM77275
2026-01-28 20:05:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 05317f3c-d38a-5f74-8961-aae450b6756c with identifier: PM77275 to the API
2026-01-28 20:05:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:05:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:05:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PM77275>
{'auction_title': '',
 'c_o_2_emission_value': 154,
 'category': 'Rental',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '2.0L',
 'engine_horse_power': 160,
 'expiration_date': '2026-01-29T16:07:29Z',
 'fuel_type': 'diesel',
 'id': '05317f3c-d38a-5f74-8961-aae450b6756c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PM77275',
 'listing': 'auction',
 'location': 'IT, Settimo Torinese',
 'make': 'Renault',
 'model': 'Talisman',
 'odometer': 112633,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-04-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Talisman 2.0 BLUE dCi Business',
 'transmission': 'automatic',
 'trim': 'Business',
 'year': 2021}
2026-01-28 20:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PM77275%27 HTTP/1.1" 200 None
2026-01-28 20:05:08 [auto1.it] INFO: Saving data for PM77275: {'auction_closing_time': 1769702849.0, 'created_time': 1767866653.546918, 'last_price_update_time': 1769630708.414984}
2026-01-28 20:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PM77275') HTTP/1.1" 204 0
2026-01-28 20:05:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/cc/a8cc7587f9ff20c96ea881986acaf5a9/pa/NJ76886_37bbf50e45228cdd5a9ee199e697cdb7.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/3a/683a30f2daff595c3446995e59787c8f/pa/NP54569_c10f03e7ee3d335a6a8f32de4c57b3ac.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/0a/ba0ab0a24aa682b660cebfaa994ed2f0/pa/TJ68491_bbea269657813c81cc6f8abaf04a657f.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/cc/f8cc2d967a2292b1434472d516494abd/pa/HU90428_fd94a3643ee4f5d71d9f71fd0ae54628.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/07/08078ab44d0009f78386c44982f3bb8e/pa/PW84021_fdab4ba9237f1ed08582396610d0c88f.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/3a/683a30f2daff595c3446995e59787c8f/pa/NP54569_bafae926ca660f6616b829da164167d0.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img41/20/4120810c32bcbcbb09bae2faf3cc7460/pa/CY86412_4de977f7fa9b335d5331c0f81afa470c.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img41/20/4120810c32bcbcbb09bae2faf3cc7460/pa/CY86412_5bfa53df2a0df290806656558dcbf8e5.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/cc/a8cc7587f9ff20c96ea881986acaf5a9/pa/NJ76886_112d46d7add9a979b5d104f28745c5fc.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/cc/a8cc7587f9ff20c96ea881986acaf5a9/pa/NJ76886_bae4b44a0a74f9fb385ae9730876184a.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/0a/ba0ab0a24aa682b660cebfaa994ed2f0/pa/TJ68491_234377bc7860c69cda22c1fea73a5515.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09e34090>
2026-01-28 20:05:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:05:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3507785-975f-501c-af87-ebe606a7d07e/b3507785-975f-501c-af87-ebe606a7d07e_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Fcc%252Fa8cc7587f9ff20c96ea881986acaf5a9%252Fpa%252FNJ76886_37bbf50e45228cdd5a9ee199e697cdb7.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/cc/a8cc7587f9ff20c96ea881986acaf5a9/pa/NJ76886_37bbf50e45228cdd5a9ee199e697cdb7.jpg saved to cache
2026-01-28 20:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b3507785-975f-501c-af87-ebe606a7d07e
2026-01-28 20:05:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/14/dc144b424d7312fa7623fc855e117e76/pa/UZ46554_b56575fb94d46f48ac104977b7e269f7.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0893afd0>
2026-01-28 20:05:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3542d180-bfa5-5f73-b34a-0e4239086fc5/3542d180-bfa5-5f73-b34a-0e4239086fc5_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F3a%252F683a30f2daff595c3446995e59787c8f%252Fpa%252FNP54569_c10f03e7ee3d335a6a8f32de4c57b3ac.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/3a/683a30f2daff595c3446995e59787c8f/pa/NP54569_c10f03e7ee3d335a6a8f32de4c57b3ac.jpg saved to cache
2026-01-28 20:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3542d180-bfa5-5f73-b34a-0e4239086fc5
2026-01-28 20:05:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0893a8d0>
2026-01-28 20:05:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:05:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7bd886a-de47-5600-9993-bae4155c06ad/e7bd886a-de47-5600-9993-bae4155c06ad_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F0a%252Fba0ab0a24aa682b660cebfaa994ed2f0%252Fpa%252FTJ68491_bbea269657813c81cc6f8abaf04a657f.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/0a/ba0ab0a24aa682b660cebfaa994ed2f0/pa/TJ68491_bbea269657813c81cc6f8abaf04a657f.jpg saved to cache
2026-01-28 20:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e7bd886a-de47-5600-9993-bae4155c06ad
2026-01-28 20:05:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08be2210>
2026-01-28 20:05:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:05:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_938cfd71-b044-5a72-95cb-a6dd8b1465e3/938cfd71-b044-5a72-95cb-a6dd8b1465e3_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fcc%252Ff8cc2d967a2292b1434472d516494abd%252Fpa%252FHU90428_fd94a3643ee4f5d71d9f71fd0ae54628.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/cc/f8cc2d967a2292b1434472d516494abd/pa/HU90428_fd94a3643ee4f5d71d9f71fd0ae54628.jpg saved to cache
2026-01-28 20:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 938cfd71-b044-5a72-95cb-a6dd8b1465e3
2026-01-28 20:05:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/cc/f8cc2d967a2292b1434472d516494abd/pa/HU90428_5ba0d72f0ac9ad9e7f232fa58c84433d.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/0a/ba0ab0a24aa682b660cebfaa994ed2f0/pa/TJ68491_ca028dc0ad8dc1e3c839e68f85b27bb1.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 22 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-01-28 20:05:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 34 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-01-28 20:05:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-01-28 20:05:09 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-01-28 20:05:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-01-28 20:05:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0a067550>
2026-01-28 20:05:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:05:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_befc4e11-1098-596f-b53c-643fcc10628d/befc4e11-1098-596f-b53c-643fcc10628d_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F07%252F08078ab44d0009f78386c44982f3bb8e%252Fpa%252FPW84021_fdab4ba9237f1ed08582396610d0c88f.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/07/08078ab44d0009f78386c44982f3bb8e/pa/PW84021_fdab4ba9237f1ed08582396610d0c88f.jpg saved to cache
2026-01-28 20:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item befc4e11-1098-596f-b53c-643fcc10628d
2026-01-28 20:05:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: befc4e11-1098-596f-b53c-643fcc10628d, skipping ID generation
2026-01-28 20:05:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item befc4e11-1098-596f-b53c-643fcc10628d with scrape type 1
2026-01-28 20:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Removing item befc4e11-1098-596f-b53c-643fcc10628d from tracking dictionaries
2026-01-28 20:05:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item befc4e11-1098-596f-b53c-643fcc10628d sending to next pipeline
2026-01-28 20:05:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: befc4e11-1098-596f-b53c-643fcc10628d, identifier: PW84021
2026-01-28 20:05:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:05:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08c3bbd0>
2026-01-28 20:05:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3542d180-bfa5-5f73-b34a-0e4239086fc5/3542d180-bfa5-5f73-b34a-0e4239086fc5_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F3a%252F683a30f2daff595c3446995e59787c8f%252Fpa%252FNP54569_bafae926ca660f6616b829da164167d0.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/3a/683a30f2daff595c3446995e59787c8f/pa/NP54569_bafae926ca660f6616b829da164167d0.jpg saved to cache
2026-01-28 20:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 3542d180-bfa5-5f73-b34a-0e4239086fc5
2026-01-28 20:05:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:05:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09d60f90>
2026-01-28 20:05:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:05:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fc31469-80fd-55ab-bdf0-bdcd15fb0516/8fc31469-80fd-55ab-bdf0-bdcd15fb0516_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F20%252F4120810c32bcbcbb09bae2faf3cc7460%252Fpa%252FCY86412_4de977f7fa9b335d5331c0f81afa470c.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/20/4120810c32bcbcbb09bae2faf3cc7460/pa/CY86412_4de977f7fa9b335d5331c0f81afa470c.jpg saved to cache
2026-01-28 20:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8fc31469-80fd-55ab-bdf0-bdcd15fb0516
2026-01-28 20:05:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:05:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09e56010>
2026-01-28 20:05:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:05:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fc31469-80fd-55ab-bdf0-bdcd15fb0516/8fc31469-80fd-55ab-bdf0-bdcd15fb0516_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F20%252F4120810c32bcbcbb09bae2faf3cc7460%252Fpa%252FCY86412_5bfa53df2a0df290806656558dcbf8e5.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/20/4120810c32bcbcbb09bae2faf3cc7460/pa/CY86412_5bfa53df2a0df290806656558dcbf8e5.jpg saved to cache
2026-01-28 20:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8fc31469-80fd-55ab-bdf0-bdcd15fb0516
2026-01-28 20:05:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09d30ed0>
2026-01-28 20:05:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3507785-975f-501c-af87-ebe606a7d07e/b3507785-975f-501c-af87-ebe606a7d07e_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Fcc%252Fa8cc7587f9ff20c96ea881986acaf5a9%252Fpa%252FNJ76886_112d46d7add9a979b5d104f28745c5fc.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/cc/a8cc7587f9ff20c96ea881986acaf5a9/pa/NJ76886_112d46d7add9a979b5d104f28745c5fc.jpg saved to cache
2026-01-28 20:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b3507785-975f-501c-af87-ebe606a7d07e
2026-01-28 20:05:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09dd8690>
2026-01-28 20:05:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:05:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3507785-975f-501c-af87-ebe606a7d07e/b3507785-975f-501c-af87-ebe606a7d07e_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Fcc%252Fa8cc7587f9ff20c96ea881986acaf5a9%252Fpa%252FNJ76886_bae4b44a0a74f9fb385ae9730876184a.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/cc/a8cc7587f9ff20c96ea881986acaf5a9/pa/NJ76886_bae4b44a0a74f9fb385ae9730876184a.jpg saved to cache
2026-01-28 20:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b3507785-975f-501c-af87-ebe606a7d07e
2026-01-28 20:05:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09d31cd0>
2026-01-28 20:05:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7bd886a-de47-5600-9993-bae4155c06ad/e7bd886a-de47-5600-9993-bae4155c06ad_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F0a%252Fba0ab0a24aa682b660cebfaa994ed2f0%252Fpa%252FTJ68491_234377bc7860c69cda22c1fea73a5515.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/0a/ba0ab0a24aa682b660cebfaa994ed2f0/pa/TJ68491_234377bc7860c69cda22c1fea73a5515.jpg saved to cache
2026-01-28 20:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e7bd886a-de47-5600-9993-bae4155c06ad
2026-01-28 20:05:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BU98469> (referer: https://www.auto1.com/v1/car-details-view/BU98469/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:05:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: befc4e11-1098-596f-b53c-643fcc10628d with identifier: PW84021
2026-01-28 20:05:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: befc4e11-1098-596f-b53c-643fcc10628d with identifier: PW84021
2026-01-28 20:05:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: befc4e11-1098-596f-b53c-643fcc10628d with identifier: PW84021 to the API
2026-01-28 20:05:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:05:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:05:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img08/07/08078ab44d0009f78386c44982f3bb8e/pa/PW84021_fdab4ba9237f1ed08582396610d0c88f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 220,
 'expiration_date': '2026-01-29T16:15:03Z',
 'fuel_type': 'diesel',
 'id': 'befc4e11-1098-596f-b53c-643fcc10628d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PW84021',
 'listing': 'auction',
 'location': 'IT',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 144448,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_befc4e11-1098-596f-b53c-643fcc10628d/befc4e11-1098-596f-b53c-643fcc10628d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 324022,
             'Height': 1200,
             'OriginUrl': 'https://img-pa.auto1.com/img08/07/08078ab44d0009f78386c44982f3bb8e/pa/PW84021_fdab4ba9237f1ed08582396610d0c88f.jpg',
             'Width': 1600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_befc4e11-1098-596f-b53c-643fcc10628d/befc4e11-1098-596f-b53c-643fcc10628d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 324022,
             'Height': 1200,
             'OriginUrl': 'https://img-pa.auto1.com/img08/07/08078ab44d0009f78386c44982f3bb8e/pa/PW84021_abbc6bb3306c361ba3ab77d6698e75ac.jpg',
             'Width': 1600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_befc4e11-1098-596f-b53c-643fcc10628d/befc4e11-1098-596f-b53c-643fcc10628d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 119510,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img08/07/08078ab44d0009f78386c44982f3bb8e/pa/PW84021_37dd24f62cf367230e5670d70237797c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_befc4e11-1098-596f-b53c-643fcc10628d/befc4e11-1098-596f-b53c-643fcc10628d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 512639,
             'Height': 1200,
             'OriginUrl': 'https://img-pa.auto1.com/img08/07/08078ab44d0009f78386c44982f3bb8e/pa/PW84021_83a512d47d9a88281ed9aa509bff7129.jpg',
             'Width': 1600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_befc4e11-1098-596f-b53c-643fcc10628d/befc4e11-1098-596f-b53c-643fcc10628d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 593022,
             'Height': 1200,
             'OriginUrl': 'https://img-pa.auto1.com/img08/07/08078ab44d0009f78386c44982f3bb8e/pa/PW84021_aad3ea2a25c0ebaf0fccb4b3233c3485.jpg',
             'Width': 1600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_befc4e11-1098-596f-b53c-643fcc10628d/befc4e11-1098-596f-b53c-643fcc10628d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 525481,
             'Height': 1200,
             'OriginUrl': 'https://img-pa.auto1.com/img08/07/08078ab44d0009f78386c44982f3bb8e/pa/PW84021_07456fd8d6ef7a809f140619682a906e.jpg',
             'Width': 1600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_befc4e11-1098-596f-b53c-643fcc10628d/befc4e11-1098-596f-b53c-643fcc10628d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 476352,
             'Height': 1200,
             'OriginUrl': 'https://img-pa.auto1.com/img08/07/08078ab44d0009f78386c44982f3bb8e/pa/PW84021_42ccfa080b3c675c5e1d58f28d8ad6c4.jpg',
             'Width': 1600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_befc4e11-1098-596f-b53c-643fcc10628d/befc4e11-1098-596f-b53c-643fcc10628d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 345169,
             'Height': 1200,
             'OriginUrl': 'https://img-pa.auto1.com/img08/07/08078ab44d0009f78386c44982f3bb8e/pa/PW84021_206296d333dcf660e494567575c479f7.jpg',
             'Width': 1600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_befc4e11-1098-596f-b53c-643fcc10628d/befc4e11-1098-596f-b53c-643fcc10628d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97193,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img08/07/08078ab44d0009f78386c44982f3bb8e/pa/PW84021_f22751d0fb77a2eba5790f8653dd61cc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_befc4e11-1098-596f-b53c-643fcc10628d/befc4e11-1098-596f-b53c-643fcc10628d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 234139,
             'Height': 1200,
             'OriginUrl': 'https://img-pa.auto1.com/img08/07/08078ab44d0009f78386c44982f3bb8e/pa/PW84021_7604e81e5b95d904d85424b75ddc712e.jpg',
             'Width': 1600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_befc4e11-1098-596f-b53c-643fcc10628d/befc4e11-1098-596f-b53c-643fcc10628d_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 503804,
             'Height': 1200,
             'OriginUrl': 'https://img-pa.auto1.com/img08/07/08078ab44d0009f78386c44982f3bb8e/pa/PW84021_a07a5905fe760f592fc952b71a012b67.jpg',
             'Width': 1600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_befc4e11-1098-596f-b53c-643fcc10628d/befc4e11-1098-596f-b53c-643fcc10628d_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 193282,
             'Height': 1200,
             'OriginUrl': 'https://img-pa.auto1.com/img08/07/08078ab44d0009f78386c44982f3bb8e/pa/PW84021_3e96135adac92a86563532af4d8ea337.jpg',
             'Width': 1600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_befc4e11-1098-596f-b53c-643fcc10628d/befc4e11-1098-596f-b53c-643fcc10628d_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 288097,
             'Height': 1600,
             'OriginUrl': 'https://img-pa.auto1.com/img08/07/08078ab44d0009f78386c44982f3bb8e/pa/PW84021_7e337cc5f50fb741d52e24709aa428f4.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_befc4e11-1098-596f-b53c-643fcc10628d/befc4e11-1098-596f-b53c-643fcc10628d_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 208189,
             'Height': 1200,
             'OriginUrl': 'https://img-pa.auto1.com/img08/07/08078ab44d0009f78386c44982f3bb8e/pa/PW84021_2ee72e270ead48b69ef5b584cbcaa88c.jpg',
             'Width': 1600}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-01-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 d Mild-Hybrid T AMG Line',
 'transmission': 'automatic',
 'trim': 'T AMG Line',
 'year': 2022}
2026-01-28 20:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PW84021%27 HTTP/1.1" 200 None
2026-01-28 20:05:14 [auto1.it] INFO: Saving data for PW84021: {'created_time': 1769630714.117742, 'last_price_update_time': 1769630714.117751, 'auction_closing_time': 1769703303.0}
2026-01-28 20:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PW84021') HTTP/1.1" 204 0
2026-01-28 20:05:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/14/dc144b424d7312fa7623fc855e117e76/pa/UZ46554_c004e0a396a93b380a006dbe60765dc6.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09f2a390>
2026-01-28 20:05:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:05:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58076a85-30b9-5b3c-b271-24664f63fb14/58076a85-30b9-5b3c-b271-24664f63fb14_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F14%252Fdc144b424d7312fa7623fc855e117e76%252Fpa%252FUZ46554_b56575fb94d46f48ac104977b7e269f7.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/14/dc144b424d7312fa7623fc855e117e76/pa/UZ46554_b56575fb94d46f48ac104977b7e269f7.jpg saved to cache
2026-01-28 20:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 58076a85-30b9-5b3c-b271-24664f63fb14
2026-01-28 20:05:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09d33590>
2026-01-28 20:05:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_938cfd71-b044-5a72-95cb-a6dd8b1465e3/938cfd71-b044-5a72-95cb-a6dd8b1465e3_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fcc%252Ff8cc2d967a2292b1434472d516494abd%252Fpa%252FHU90428_5ba0d72f0ac9ad9e7f232fa58c84433d.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/cc/f8cc2d967a2292b1434472d516494abd/pa/HU90428_5ba0d72f0ac9ad9e7f232fa58c84433d.jpg saved to cache
2026-01-28 20:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 938cfd71-b044-5a72-95cb-a6dd8b1465e3
2026-01-28 20:05:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09ef3a10>
2026-01-28 20:05:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:05:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7bd886a-de47-5600-9993-bae4155c06ad/e7bd886a-de47-5600-9993-bae4155c06ad_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F0a%252Fba0ab0a24aa682b660cebfaa994ed2f0%252Fpa%252FTJ68491_ca028dc0ad8dc1e3c839e68f85b27bb1.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/0a/ba0ab0a24aa682b660cebfaa994ed2f0/pa/TJ68491_ca028dc0ad8dc1e3c839e68f85b27bb1.jpg saved to cache
2026-01-28 20:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e7bd886a-de47-5600-9993-bae4155c06ad
2026-01-28 20:05:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e8314f0-95e9-51ed-982b-16f4f0699dda with identifier: BU98469
2026-01-28 20:05:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e8314f0-95e9-51ed-982b-16f4f0699dda with scrape type 1
2026-01-28 20:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 13 photos for item 0e8314f0-95e9-51ed-982b-16f4f0699dda
2026-01-28 20:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F67%252Fcd676e1a5dc88cfaab1fc93acc76fd3e%252Fpa%252FBU98469_4c849ffa86b326383e208cd203fd1d8b.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/67/cd676e1a5dc88cfaab1fc93acc76fd3e/pa/BU98469_4c849ffa86b326383e208cd203fd1d8b.jpg already downloaded
2026-01-28 20:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F67%252Fcd676e1a5dc88cfaab1fc93acc76fd3e%252Fpa%252FBU98469_72d19f9bbe3a79b7a95ff26498c77f5f.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/67/cd676e1a5dc88cfaab1fc93acc76fd3e/pa/BU98469_72d19f9bbe3a79b7a95ff26498c77f5f.jpg already downloaded
2026-01-28 20:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F67%252Fcd676e1a5dc88cfaab1fc93acc76fd3e%252Fpa%252FBU98469_715d5acbd7c68bf984e87602dfa490b5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/67/cd676e1a5dc88cfaab1fc93acc76fd3e/pa/BU98469_715d5acbd7c68bf984e87602dfa490b5.jpg already downloaded
2026-01-28 20:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F67%252Fcd676e1a5dc88cfaab1fc93acc76fd3e%252Fpa%252FBU98469_a1d2277236142bc63130a825eaa5c437.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/67/cd676e1a5dc88cfaab1fc93acc76fd3e/pa/BU98469_a1d2277236142bc63130a825eaa5c437.jpg already downloaded
2026-01-28 20:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F67%252Fcd676e1a5dc88cfaab1fc93acc76fd3e%252Fpa%252FBU98469_a744dedcb06744636308863b379449a6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/67/cd676e1a5dc88cfaab1fc93acc76fd3e/pa/BU98469_a744dedcb06744636308863b379449a6.jpg already downloaded
2026-01-28 20:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F67%252Fcd676e1a5dc88cfaab1fc93acc76fd3e%252Fpa%252FBU98469_fada1f5f5befde7f1eabd02f4c2636cd.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/67/cd676e1a5dc88cfaab1fc93acc76fd3e/pa/BU98469_fada1f5f5befde7f1eabd02f4c2636cd.jpg already downloaded
2026-01-28 20:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F67%252Fcd676e1a5dc88cfaab1fc93acc76fd3e%252Fpa%252FBU98469_cf690b85813dabcb72734037ee40992a.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/67/cd676e1a5dc88cfaab1fc93acc76fd3e/pa/BU98469_cf690b85813dabcb72734037ee40992a.jpg already downloaded
2026-01-28 20:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F67%252Fcd676e1a5dc88cfaab1fc93acc76fd3e%252Fpa%252FBU98469_f154f9a4a852011a0f63f234a92718b0.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/67/cd676e1a5dc88cfaab1fc93acc76fd3e/pa/BU98469_f154f9a4a852011a0f63f234a92718b0.jpg already downloaded
2026-01-28 20:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F67%252Fcd676e1a5dc88cfaab1fc93acc76fd3e%252Fpa%252FBU98469_ac10f5693c31638e29dc24e9692c2d30.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/67/cd676e1a5dc88cfaab1fc93acc76fd3e/pa/BU98469_ac10f5693c31638e29dc24e9692c2d30.jpg already downloaded
2026-01-28 20:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F67%252Fcd676e1a5dc88cfaab1fc93acc76fd3e%252Fpa%252FBU98469_79ab2f770072be3b8612c95fb3350d76.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/67/cd676e1a5dc88cfaab1fc93acc76fd3e/pa/BU98469_79ab2f770072be3b8612c95fb3350d76.jpg already downloaded
2026-01-28 20:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F67%252Fcd676e1a5dc88cfaab1fc93acc76fd3e%252Fpa%252FBU98469_1b30de77cf9ef8a834d05ccdb11e2e3d.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/67/cd676e1a5dc88cfaab1fc93acc76fd3e/pa/BU98469_1b30de77cf9ef8a834d05ccdb11e2e3d.jpg already downloaded
2026-01-28 20:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F67%252Fcd676e1a5dc88cfaab1fc93acc76fd3e%252Fpa%252FBU98469_52f5ac0d95acc728a47268e9a73b11e6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/67/cd676e1a5dc88cfaab1fc93acc76fd3e/pa/BU98469_52f5ac0d95acc728a47268e9a73b11e6.jpg already downloaded
2026-01-28 20:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F67%252Fcd676e1a5dc88cfaab1fc93acc76fd3e%252Fpa%252FBU98469_a5de6a7923b204a7d39d6abb4d3c7a03.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/67/cd676e1a5dc88cfaab1fc93acc76fd3e/pa/BU98469_a5de6a7923b204a7d39d6abb4d3c7a03.jpg already downloaded
2026-01-28 20:05:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0e8314f0-95e9-51ed-982b-16f4f0699dda, identifier: BU98469
2026-01-28 20:05:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0e8314f0-95e9-51ed-982b-16f4f0699dda with identifier: BU98469
2026-01-28 20:05:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0e8314f0-95e9-51ed-982b-16f4f0699dda with identifier: BU98469
2026-01-28 20:05:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0e8314f0-95e9-51ed-982b-16f4f0699dda with identifier: BU98469 to the API
2026-01-28 20:05:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:05:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:05:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BU98469>
{'auction_title': '',
 'c_o_2_emission_value': 185,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 163,
 'expiration_date': '2026-01-29T16:41:26Z',
 'fuel_type': 'diesel',
 'id': '0e8314f0-95e9-51ed-982b-16f4f0699dda',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BU98469',
 'listing': 'auction',
 'location': 'IT',
 'make': 'Land Rover',
 'model': 'Discovery Sport',
 'odometer': 110587,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 13,
 'photo_urls': ['https://img-pa.auto1.com/imgcd/67/cd676e1a5dc88cfaab1fc93acc76fd3e/pa/BU98469_4c849ffa86b326383e208cd203fd1d8b.jpg',
                'https://img-pa.auto1.com/imgcd/67/cd676e1a5dc88cfaab1fc93acc76fd3e/pa/BU98469_72d19f9bbe3a79b7a95ff26498c77f5f.jpg',
                'https://img-pa.auto1.com/imgcd/67/cd676e1a5dc88cfaab1fc93acc76fd3e/pa/BU98469_715d5acbd7c68bf984e87602dfa490b5.jpg',
                'https://img-pa.auto1.com/imgcd/67/cd676e1a5dc88cfaab1fc93acc76fd3e/pa/BU98469_a1d2277236142bc63130a825eaa5c437.jpg',
                'https://img-pa.auto1.com/imgcd/67/cd676e1a5dc88cfaab1fc93acc76fd3e/pa/BU98469_a744dedcb06744636308863b379449a6.jpg',
                'https://img-pa.auto1.com/imgcd/67/cd676e1a5dc88cfaab1fc93acc76fd3e/pa/BU98469_fada1f5f5befde7f1eabd02f4c2636cd.jpg',
                'https://img-pa.auto1.com/imgcd/67/cd676e1a5dc88cfaab1fc93acc76fd3e/pa/BU98469_cf690b85813dabcb72734037ee40992a.jpg',
                'https://img-pa.auto1.com/imgcd/67/cd676e1a5dc88cfaab1fc93acc76fd3e/pa/BU98469_f154f9a4a852011a0f63f234a92718b0.jpg',
                'https://img-pa.auto1.com/imgcd/67/cd676e1a5dc88cfaab1fc93acc76fd3e/pa/BU98469_ac10f5693c31638e29dc24e9692c2d30.jpg',
                'https://img-pa.auto1.com/imgcd/67/cd676e1a5dc88cfaab1fc93acc76fd3e/pa/BU98469_79ab2f770072be3b8612c95fb3350d76.jpg',
                'https://img-pa.auto1.com/imgcd/67/cd676e1a5dc88cfaab1fc93acc76fd3e/pa/BU98469_1b30de77cf9ef8a834d05ccdb11e2e3d.jpg',
                'https://img-pa.auto1.com/imgcd/67/cd676e1a5dc88cfaab1fc93acc76fd3e/pa/BU98469_52f5ac0d95acc728a47268e9a73b11e6.jpg',
                'https://img-pa.auto1.com/imgcd/67/cd676e1a5dc88cfaab1fc93acc76fd3e/pa/BU98469_a5de6a7923b204a7d39d6abb4d3c7a03.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e8314f0-95e9-51ed-982b-16f4f0699dda/0e8314f0-95e9-51ed-982b-16f4f0699dda_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 138861,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/67/cd676e1a5dc88cfaab1fc93acc76fd3e/pa/BU98469_4c849ffa86b326383e208cd203fd1d8b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e8314f0-95e9-51ed-982b-16f4f0699dda/0e8314f0-95e9-51ed-982b-16f4f0699dda_image_1.mpo',
             'Extension': 'mpo',
             'FileSizeInBytes': 569137,
             'Height': 960,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/67/cd676e1a5dc88cfaab1fc93acc76fd3e/pa/BU98469_72d19f9bbe3a79b7a95ff26498c77f5f.jpg',
             'Width': 1280},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e8314f0-95e9-51ed-982b-16f4f0699dda/0e8314f0-95e9-51ed-982b-16f4f0699dda_image_2.mpo',
             'Extension': 'mpo',
             'FileSizeInBytes': 585760,
             'Height': 960,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/67/cd676e1a5dc88cfaab1fc93acc76fd3e/pa/BU98469_715d5acbd7c68bf984e87602dfa490b5.jpg',
             'Width': 1280},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e8314f0-95e9-51ed-982b-16f4f0699dda/0e8314f0-95e9-51ed-982b-16f4f0699dda_image_3.mpo',
             'Extension': 'mpo',
             'FileSizeInBytes': 463789,
             'Height': 960,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/67/cd676e1a5dc88cfaab1fc93acc76fd3e/pa/BU98469_a1d2277236142bc63130a825eaa5c437.jpg',
             'Width': 1280},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e8314f0-95e9-51ed-982b-16f4f0699dda/0e8314f0-95e9-51ed-982b-16f4f0699dda_image_4.mpo',
             'Extension': 'mpo',
             'FileSizeInBytes': 553360,
             'Height': 960,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/67/cd676e1a5dc88cfaab1fc93acc76fd3e/pa/BU98469_a744dedcb06744636308863b379449a6.jpg',
             'Width': 1280},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e8314f0-95e9-51ed-982b-16f4f0699dda/0e8314f0-95e9-51ed-982b-16f4f0699dda_image_5.mpo',
             'Extension': 'mpo',
             'FileSizeInBytes': 622200,
             'Height': 960,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/67/cd676e1a5dc88cfaab1fc93acc76fd3e/pa/BU98469_fada1f5f5befde7f1eabd02f4c2636cd.jpg',
             'Width': 1280},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e8314f0-95e9-51ed-982b-16f4f0699dda/0e8314f0-95e9-51ed-982b-16f4f0699dda_image_6.mpo',
             'Extension': 'mpo',
             'FileSizeInBytes': 538418,
             'Height': 960,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/67/cd676e1a5dc88cfaab1fc93acc76fd3e/pa/BU98469_cf690b85813dabcb72734037ee40992a.jpg',
             'Width': 1280},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e8314f0-95e9-51ed-982b-16f4f0699dda/0e8314f0-95e9-51ed-982b-16f4f0699dda_image_7.mpo',
             'Extension': 'mpo',
             'FileSizeInBytes': 692253,
             'Height': 960,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/67/cd676e1a5dc88cfaab1fc93acc76fd3e/pa/BU98469_f154f9a4a852011a0f63f234a92718b0.jpg',
             'Width': 1280},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e8314f0-95e9-51ed-982b-16f4f0699dda/0e8314f0-95e9-51ed-982b-16f4f0699dda_image_8.mpo',
             'Extension': 'mpo',
             'FileSizeInBytes': 573346,
             'Height': 960,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/67/cd676e1a5dc88cfaab1fc93acc76fd3e/pa/BU98469_ac10f5693c31638e29dc24e9692c2d30.jpg',
             'Width': 1280},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e8314f0-95e9-51ed-982b-16f4f0699dda/0e8314f0-95e9-51ed-982b-16f4f0699dda_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 124568,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/67/cd676e1a5dc88cfaab1fc93acc76fd3e/pa/BU98469_79ab2f770072be3b8612c95fb3350d76.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e8314f0-95e9-51ed-982b-16f4f0699dda/0e8314f0-95e9-51ed-982b-16f4f0699dda_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76607,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/67/cd676e1a5dc88cfaab1fc93acc76fd3e/pa/BU98469_1b30de77cf9ef8a834d05ccdb11e2e3d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e8314f0-95e9-51ed-982b-16f4f0699dda/0e8314f0-95e9-51ed-982b-16f4f0699dda_image_11.mpo',
             'Extension': 'mpo',
             'FileSizeInBytes': 335114,
             'Height': 960,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/67/cd676e1a5dc88cfaab1fc93acc76fd3e/pa/BU98469_52f5ac0d95acc728a47268e9a73b11e6.jpg',
             'Width': 1280},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e8314f0-95e9-51ed-982b-16f4f0699dda/0e8314f0-95e9-51ed-982b-16f4f0699dda_image_12.mpo',
             'Extension': 'mpo',
             'FileSizeInBytes': 479071,
             'Height': 960,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/67/cd676e1a5dc88cfaab1fc93acc76fd3e/pa/BU98469_a5de6a7923b204a7d39d6abb4d3c7a03.jpg',
             'Width': 1280}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-05-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Discovery Sport D165 Mild-Hybrid R-Dynamic HSE AWD',
 'transmission': 'automatic',
 'trim': 'R-Dynamic HSE AWD',
 'year': 2021}
2026-01-28 20:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BU98469%27 HTTP/1.1" 200 None
2026-01-28 20:05:16 [auto1.it] INFO: Saving data for BU98469: {'created_time': 1769630716.068899, 'last_price_update_time': 1769630716.068909, 'auction_closing_time': 1769704886.0}
2026-01-28 20:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BU98469') HTTP/1.1" 204 0
2026-01-28 20:05:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b086fa290>
2026-01-28 20:05:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:05:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58076a85-30b9-5b3c-b271-24664f63fb14/58076a85-30b9-5b3c-b271-24664f63fb14_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F14%252Fdc144b424d7312fa7623fc855e117e76%252Fpa%252FUZ46554_c004e0a396a93b380a006dbe60765dc6.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/14/dc144b424d7312fa7623fc855e117e76/pa/UZ46554_c004e0a396a93b380a006dbe60765dc6.jpg saved to cache
2026-01-28 20:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 58076a85-30b9-5b3c-b271-24664f63fb14
2026-01-28 20:05:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/0a/ba0ab0a24aa682b660cebfaa994ed2f0/pa/TJ68491_28057b5f13f78115c64219e4157f5787.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/3a/683a30f2daff595c3446995e59787c8f/pa/NP54569_b6c7e700bf72834ba4afb8a76e5d2639.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/3a/683a30f2daff595c3446995e59787c8f/pa/NP54569_7504b0bd15f9a400e2c3bc2111d4f1ef.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/3a/683a30f2daff595c3446995e59787c8f/pa/NP54569_cf02890ce5e2d562efb9514c1853cb5c.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img41/20/4120810c32bcbcbb09bae2faf3cc7460/pa/CY86412_c0c74370c1382ed66b0f096c4f1c2c43.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/cc/f8cc2d967a2292b1434472d516494abd/pa/HU90428_d8e109f9a8ddd01928d1ff71c957ec44.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img41/20/4120810c32bcbcbb09bae2faf3cc7460/pa/CY86412_556c9335d44510c23ad4af3336ca2af8.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/cc/a8cc7587f9ff20c96ea881986acaf5a9/pa/NJ76886_3d6e6c800ccf78e71ca5ee5daef3771c.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09dc6610>
2026-01-28 20:05:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:05:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e7bd886a-de47-5600-9993-bae4155c06ad/e7bd886a-de47-5600-9993-bae4155c06ad_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F0a%252Fba0ab0a24aa682b660cebfaa994ed2f0%252Fpa%252FTJ68491_28057b5f13f78115c64219e4157f5787.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/0a/ba0ab0a24aa682b660cebfaa994ed2f0/pa/TJ68491_28057b5f13f78115c64219e4157f5787.jpg saved to cache
2026-01-28 20:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e7bd886a-de47-5600-9993-bae4155c06ad
2026-01-28 20:05:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e7bd886a-de47-5600-9993-bae4155c06ad, skipping ID generation
2026-01-28 20:05:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7bd886a-de47-5600-9993-bae4155c06ad with scrape type 1
2026-01-28 20:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Removing item e7bd886a-de47-5600-9993-bae4155c06ad from tracking dictionaries
2026-01-28 20:05:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e7bd886a-de47-5600-9993-bae4155c06ad sending to next pipeline
2026-01-28 20:05:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e7bd886a-de47-5600-9993-bae4155c06ad, identifier: TJ68491
2026-01-28 20:05:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img41/20/4120810c32bcbcbb09bae2faf3cc7460/pa/CY86412_a482228586e9a3a0b2953f6aef87075f.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e7bd886a-de47-5600-9993-bae4155c06ad with identifier: TJ68491
2026-01-28 20:05:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e7bd886a-de47-5600-9993-bae4155c06ad with identifier: TJ68491
2026-01-28 20:05:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e7bd886a-de47-5600-9993-bae4155c06ad with identifier: TJ68491 to the API
2026-01-28 20:05:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:05:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:05:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgba/0a/ba0ab0a24aa682b660cebfaa994ed2f0/pa/TJ68491_28057b5f13f78115c64219e4157f5787.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 194,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 431,
 'expiration_date': '2026-01-29T16:38:26Z',
 'fuel_type': 'petrol',
 'id': 'e7bd886a-de47-5600-9993-bae4155c06ad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TJ68491',
 'listing': 'auction',
 'location': 'IT',
 'make': 'BMW',
 'model': '4er',
 'odometer': 34932,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7bd886a-de47-5600-9993-bae4155c06ad/e7bd886a-de47-5600-9993-bae4155c06ad_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63513,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/0a/ba0ab0a24aa682b660cebfaa994ed2f0/pa/TJ68491_28057b5f13f78115c64219e4157f5787.jpg',
             'Width': 652},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7bd886a-de47-5600-9993-bae4155c06ad/e7bd886a-de47-5600-9993-bae4155c06ad_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75054,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/0a/ba0ab0a24aa682b660cebfaa994ed2f0/pa/TJ68491_f98b01535b54a13a9c4000d468663eb3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7bd886a-de47-5600-9993-bae4155c06ad/e7bd886a-de47-5600-9993-bae4155c06ad_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78027,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/0a/ba0ab0a24aa682b660cebfaa994ed2f0/pa/TJ68491_234377bc7860c69cda22c1fea73a5515.jpg',
             'Width': 782},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7bd886a-de47-5600-9993-bae4155c06ad/e7bd886a-de47-5600-9993-bae4155c06ad_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76700,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/0a/ba0ab0a24aa682b660cebfaa994ed2f0/pa/TJ68491_ca028dc0ad8dc1e3c839e68f85b27bb1.jpg',
             'Width': 653},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7bd886a-de47-5600-9993-bae4155c06ad/e7bd886a-de47-5600-9993-bae4155c06ad_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73553,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/0a/ba0ab0a24aa682b660cebfaa994ed2f0/pa/TJ68491_bbea269657813c81cc6f8abaf04a657f.jpg',
             'Width': 753},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7bd886a-de47-5600-9993-bae4155c06ad/e7bd886a-de47-5600-9993-bae4155c06ad_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71288,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/0a/ba0ab0a24aa682b660cebfaa994ed2f0/pa/TJ68491_0938d4aeab6d69f183e325dd14a9b93c.jpg',
             'Width': 729},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7bd886a-de47-5600-9993-bae4155c06ad/e7bd886a-de47-5600-9993-bae4155c06ad_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78266,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/0a/ba0ab0a24aa682b660cebfaa994ed2f0/pa/TJ68491_6a9248bbb2db94a3dd89ca238b459b28.jpg',
             'Width': 668},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7bd886a-de47-5600-9993-bae4155c06ad/e7bd886a-de47-5600-9993-bae4155c06ad_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 122740,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/0a/ba0ab0a24aa682b660cebfaa994ed2f0/pa/TJ68491_a3699d63d5d44b2dcd3d025ec848e4e5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7bd886a-de47-5600-9993-bae4155c06ad/e7bd886a-de47-5600-9993-bae4155c06ad_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41296,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/0a/ba0ab0a24aa682b660cebfaa994ed2f0/pa/TJ68491_fdbc8cdace24e07b78d86a21f1c06433.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7bd886a-de47-5600-9993-bae4155c06ad/e7bd886a-de47-5600-9993-bae4155c06ad_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32299,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/0a/ba0ab0a24aa682b660cebfaa994ed2f0/pa/TJ68491_591fb93d46074380b75500c5cad5a7b3.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7bd886a-de47-5600-9993-bae4155c06ad/e7bd886a-de47-5600-9993-bae4155c06ad_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77165,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/0a/ba0ab0a24aa682b660cebfaa994ed2f0/pa/TJ68491_c43ebbb4a7299d868ebe74c37fa62c0a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7bd886a-de47-5600-9993-bae4155c06ad/e7bd886a-de47-5600-9993-bae4155c06ad_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56195,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/0a/ba0ab0a24aa682b660cebfaa994ed2f0/pa/TJ68491_d548d8360f7963efd879d509b6ecaa22.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7bd886a-de47-5600-9993-bae4155c06ad/e7bd886a-de47-5600-9993-bae4155c06ad_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29618,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/0a/ba0ab0a24aa682b660cebfaa994ed2f0/pa/TJ68491_8720344aab967f831ae7c420c4546970.jpg',
             'Width': 450}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-04-26',
 'seats_number': 4,
 'seller_name': None,
 'title': 'BMW 4er M4',
 'transmission': 'automatic',
 'trim': '',
 'year': 2018}
2026-01-28 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TJ68491%27 HTTP/1.1" 200 None
2026-01-28 20:05:17 [auto1.it] INFO: Saving data for TJ68491: {'created_time': 1769630717.258364, 'last_price_update_time': 1769630717.258374, 'auction_closing_time': 1769704706.0}
2026-01-28 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TJ68491') HTTP/1.1" 204 0
2026-01-28 20:05:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/14/dc144b424d7312fa7623fc855e117e76/pa/UZ46554_fbf6bc4a863dd193f0a473fc552a0791.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/cc/f8cc2d967a2292b1434472d516494abd/pa/HU90428_52cee1b952d2761fce618bd5dcc878d4.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:05:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09e61310>
2026-01-28 20:05:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:05:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3542d180-bfa5-5f73-b34a-0e4239086fc5/3542d180-bfa5-5f73-b34a-0e4239086fc5_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F3a%252F683a30f2daff595c3446995e59787c8f%252Fpa%252FNP54569_b6c7e700bf72834ba4afb8a76e5d2639.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/3a/683a30f2daff595c3446995e59787c8f/pa/NP54569_b6c7e700bf72834ba4afb8a76e5d2639.jpg saved to cache
2026-01-28 20:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3542d180-bfa5-5f73-b34a-0e4239086fc5
2026-01-28 20:05:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:05:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08be81d0>
2026-01-28 20:05:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:05:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3542d180-bfa5-5f73-b34a-0e4239086fc5/3542d180-bfa5-5f73-b34a-0e4239086fc5_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F3a%252F683a30f2daff595c3446995e59787c8f%252Fpa%252FNP54569_7504b0bd15f9a400e2c3bc2111d4f1ef.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/3a/683a30f2daff595c3446995e59787c8f/pa/NP54569_7504b0bd15f9a400e2c3bc2111d4f1ef.jpg saved to cache
2026-01-28 20:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3542d180-bfa5-5f73-b34a-0e4239086fc5
2026-01-28 20:05:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:05:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09d773d0>
2026-01-28 20:05:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3542d180-bfa5-5f73-b34a-0e4239086fc5/3542d180-bfa5-5f73-b34a-0e4239086fc5_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F3a%252F683a30f2daff595c3446995e59787c8f%252Fpa%252FNP54569_cf02890ce5e2d562efb9514c1853cb5c.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/3a/683a30f2daff595c3446995e59787c8f/pa/NP54569_cf02890ce5e2d562efb9514c1853cb5c.jpg saved to cache
2026-01-28 20:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3542d180-bfa5-5f73-b34a-0e4239086fc5
2026-01-28 20:05:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:05:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09e5f2d0>
2026-01-28 20:05:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:05:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fc31469-80fd-55ab-bdf0-bdcd15fb0516/8fc31469-80fd-55ab-bdf0-bdcd15fb0516_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F20%252F4120810c32bcbcbb09bae2faf3cc7460%252Fpa%252FCY86412_c0c74370c1382ed66b0f096c4f1c2c43.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/20/4120810c32bcbcbb09bae2faf3cc7460/pa/CY86412_c0c74370c1382ed66b0f096c4f1c2c43.jpg saved to cache
2026-01-28 20:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8fc31469-80fd-55ab-bdf0-bdcd15fb0516
2026-01-28 20:05:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:05:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09e29e90>
2026-01-28 20:05:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:05:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_938cfd71-b044-5a72-95cb-a6dd8b1465e3/938cfd71-b044-5a72-95cb-a6dd8b1465e3_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fcc%252Ff8cc2d967a2292b1434472d516494abd%252Fpa%252FHU90428_d8e109f9a8ddd01928d1ff71c957ec44.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/cc/f8cc2d967a2292b1434472d516494abd/pa/HU90428_d8e109f9a8ddd01928d1ff71c957ec44.jpg saved to cache
2026-01-28 20:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 938cfd71-b044-5a72-95cb-a6dd8b1465e3
2026-01-28 20:05:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:05:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08938090>
2026-01-28 20:05:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:05:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fc31469-80fd-55ab-bdf0-bdcd15fb0516/8fc31469-80fd-55ab-bdf0-bdcd15fb0516_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F20%252F4120810c32bcbcbb09bae2faf3cc7460%252Fpa%252FCY86412_556c9335d44510c23ad4af3336ca2af8.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/20/4120810c32bcbcbb09bae2faf3cc7460/pa/CY86412_556c9335d44510c23ad4af3336ca2af8.jpg saved to cache
2026-01-28 20:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8fc31469-80fd-55ab-bdf0-bdcd15fb0516
2026-01-28 20:05:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:05:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0871ea90>
2026-01-28 20:05:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3507785-975f-501c-af87-ebe606a7d07e/b3507785-975f-501c-af87-ebe606a7d07e_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Fcc%252Fa8cc7587f9ff20c96ea881986acaf5a9%252Fpa%252FNJ76886_3d6e6c800ccf78e71ca5ee5daef3771c.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/cc/a8cc7587f9ff20c96ea881986acaf5a9/pa/NJ76886_3d6e6c800ccf78e71ca5ee5daef3771c.jpg saved to cache
2026-01-28 20:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b3507785-975f-501c-af87-ebe606a7d07e
2026-01-28 20:05:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b3507785-975f-501c-af87-ebe606a7d07e, skipping ID generation
2026-01-28 20:05:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3507785-975f-501c-af87-ebe606a7d07e with scrape type 1
2026-01-28 20:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Removing item b3507785-975f-501c-af87-ebe606a7d07e from tracking dictionaries
2026-01-28 20:05:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b3507785-975f-501c-af87-ebe606a7d07e sending to next pipeline
2026-01-28 20:05:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b3507785-975f-501c-af87-ebe606a7d07e, identifier: NJ76886
2026-01-28 20:05:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0c13ddd0>
2026-01-28 20:05:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:05:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fc31469-80fd-55ab-bdf0-bdcd15fb0516/8fc31469-80fd-55ab-bdf0-bdcd15fb0516_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F20%252F4120810c32bcbcbb09bae2faf3cc7460%252Fpa%252FCY86412_a482228586e9a3a0b2953f6aef87075f.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/20/4120810c32bcbcbb09bae2faf3cc7460/pa/CY86412_a482228586e9a3a0b2953f6aef87075f.jpg saved to cache
2026-01-28 20:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8fc31469-80fd-55ab-bdf0-bdcd15fb0516
2026-01-28 20:05:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b3507785-975f-501c-af87-ebe606a7d07e with identifier: NJ76886
2026-01-28 20:05:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b3507785-975f-501c-af87-ebe606a7d07e with identifier: NJ76886
2026-01-28 20:05:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b3507785-975f-501c-af87-ebe606a7d07e with identifier: NJ76886 to the API
2026-01-28 20:05:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:05:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:05:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga8/cc/a8cc7587f9ff20c96ea881986acaf5a9/pa/NJ76886_3d6e6c800ccf78e71ca5ee5daef3771c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 115,
 'expiration_date': '2026-01-29T16:21:15Z',
 'fuel_type': 'diesel',
 'id': 'b3507785-975f-501c-af87-ebe606a7d07e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NJ76886',
 'listing': 'auction',
 'location': 'IT, Corigliano-Rossano',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 78611,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3507785-975f-501c-af87-ebe606a7d07e/b3507785-975f-501c-af87-ebe606a7d07e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2411557,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/cc/a8cc7587f9ff20c96ea881986acaf5a9/pa/NJ76886_4a02303ad1da612dc17cbbac5366f4e4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3507785-975f-501c-af87-ebe606a7d07e/b3507785-975f-501c-af87-ebe606a7d07e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2401813,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/cc/a8cc7587f9ff20c96ea881986acaf5a9/pa/NJ76886_013409b06d40849ccf2267bf92812020.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3507785-975f-501c-af87-ebe606a7d07e/b3507785-975f-501c-af87-ebe606a7d07e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61567,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/cc/a8cc7587f9ff20c96ea881986acaf5a9/pa/NJ76886_f32058808028270b9d155b1531730823.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3507785-975f-501c-af87-ebe606a7d07e/b3507785-975f-501c-af87-ebe606a7d07e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2408085,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/cc/a8cc7587f9ff20c96ea881986acaf5a9/pa/NJ76886_3d6e6c800ccf78e71ca5ee5daef3771c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3507785-975f-501c-af87-ebe606a7d07e/b3507785-975f-501c-af87-ebe606a7d07e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53273,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/cc/a8cc7587f9ff20c96ea881986acaf5a9/pa/NJ76886_dfcfaacd2e5563e1bc489ca5602523c6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3507785-975f-501c-af87-ebe606a7d07e/b3507785-975f-501c-af87-ebe606a7d07e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61695,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/cc/a8cc7587f9ff20c96ea881986acaf5a9/pa/NJ76886_bae4b44a0a74f9fb385ae9730876184a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3507785-975f-501c-af87-ebe606a7d07e/b3507785-975f-501c-af87-ebe606a7d07e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54591,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/cc/a8cc7587f9ff20c96ea881986acaf5a9/pa/NJ76886_112d46d7add9a979b5d104f28745c5fc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3507785-975f-501c-af87-ebe606a7d07e/b3507785-975f-501c-af87-ebe606a7d07e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60568,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/cc/a8cc7587f9ff20c96ea881986acaf5a9/pa/NJ76886_37bbf50e45228cdd5a9ee199e697cdb7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3507785-975f-501c-af87-ebe606a7d07e/b3507785-975f-501c-af87-ebe606a7d07e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54473,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/cc/a8cc7587f9ff20c96ea881986acaf5a9/pa/NJ76886_a1bcbfea6bd63ae3535f4d670b2f5b5f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3507785-975f-501c-af87-ebe606a7d07e/b3507785-975f-501c-af87-ebe606a7d07e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2824713,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/cc/a8cc7587f9ff20c96ea881986acaf5a9/pa/NJ76886_71162460fc049b7cab14b9bda157302e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3507785-975f-501c-af87-ebe606a7d07e/b3507785-975f-501c-af87-ebe606a7d07e_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2275053,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/cc/a8cc7587f9ff20c96ea881986acaf5a9/pa/NJ76886_040610618d87d6b887015499c9acda3b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3507785-975f-501c-af87-ebe606a7d07e/b3507785-975f-501c-af87-ebe606a7d07e_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66204,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/cc/a8cc7587f9ff20c96ea881986acaf5a9/pa/NJ76886_5fc5da425a15fec5cd8fcbd81013e119.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3507785-975f-501c-af87-ebe606a7d07e/b3507785-975f-501c-af87-ebe606a7d07e_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72594,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/cc/a8cc7587f9ff20c96ea881986acaf5a9/pa/NJ76886_f3e0daf433e1c99e573a1115defa85f3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3507785-975f-501c-af87-ebe606a7d07e/b3507785-975f-501c-af87-ebe606a7d07e_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54449,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/cc/a8cc7587f9ff20c96ea881986acaf5a9/pa/NJ76886_55a34a11add83fed00c5c5c296abd871.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3507785-975f-501c-af87-ebe606a7d07e/b3507785-975f-501c-af87-ebe606a7d07e_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43845,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/cc/a8cc7587f9ff20c96ea881986acaf5a9/pa/NJ76886_a875ed78ae44c794f9d4f0e97f91a99b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-03-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Touran 1.6 TDI Comfortline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Comfortline BlueMotion',
 'year': 2018}
2026-01-28 20:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NJ76886%27 HTTP/1.1" 200 None
2026-01-28 20:05:20 [auto1.it] INFO: Saving data for NJ76886: {'created_time': 1769630720.726855, 'last_price_update_time': 1769630720.726866, 'auction_closing_time': 1769703675.0}
2026-01-28 20:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NJ76886') HTTP/1.1" 204 0
2026-01-28 20:05:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/14/dc144b424d7312fa7623fc855e117e76/pa/UZ46554_0418032ef193a057d5816c9fc4833813.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/14/dc144b424d7312fa7623fc855e117e76/pa/UZ46554_808545ed0a26b3afbe09245091d80401.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08b2c990>
2026-01-28 20:05:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:05:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58076a85-30b9-5b3c-b271-24664f63fb14/58076a85-30b9-5b3c-b271-24664f63fb14_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F14%252Fdc144b424d7312fa7623fc855e117e76%252Fpa%252FUZ46554_fbf6bc4a863dd193f0a473fc552a0791.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/14/dc144b424d7312fa7623fc855e117e76/pa/UZ46554_fbf6bc4a863dd193f0a473fc552a0791.jpg saved to cache
2026-01-28 20:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 58076a85-30b9-5b3c-b271-24664f63fb14
2026-01-28 20:05:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b086e1c90>
2026-01-28 20:05:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:05:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_938cfd71-b044-5a72-95cb-a6dd8b1465e3/938cfd71-b044-5a72-95cb-a6dd8b1465e3_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fcc%252Ff8cc2d967a2292b1434472d516494abd%252Fpa%252FHU90428_52cee1b952d2761fce618bd5dcc878d4.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/cc/f8cc2d967a2292b1434472d516494abd/pa/HU90428_52cee1b952d2761fce618bd5dcc878d4.jpg saved to cache
2026-01-28 20:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 938cfd71-b044-5a72-95cb-a6dd8b1465e3
2026-01-28 20:05:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/6a/656a19187558a79bf41101eddfcd5ceb/pa/YG15382_51454687462cc1e6b3692291e1ba9972.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08b55b50>
2026-01-28 20:05:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58076a85-30b9-5b3c-b271-24664f63fb14/58076a85-30b9-5b3c-b271-24664f63fb14_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F14%252Fdc144b424d7312fa7623fc855e117e76%252Fpa%252FUZ46554_0418032ef193a057d5816c9fc4833813.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/14/dc144b424d7312fa7623fc855e117e76/pa/UZ46554_0418032ef193a057d5816c9fc4833813.jpg saved to cache
2026-01-28 20:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 58076a85-30b9-5b3c-b271-24664f63fb14
2026-01-28 20:05:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0c2e0210>
2026-01-28 20:05:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:05:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58076a85-30b9-5b3c-b271-24664f63fb14/58076a85-30b9-5b3c-b271-24664f63fb14_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F14%252Fdc144b424d7312fa7623fc855e117e76%252Fpa%252FUZ46554_808545ed0a26b3afbe09245091d80401.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/14/dc144b424d7312fa7623fc855e117e76/pa/UZ46554_808545ed0a26b3afbe09245091d80401.jpg saved to cache
2026-01-28 20:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 58076a85-30b9-5b3c-b271-24664f63fb14
2026-01-28 20:05:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/6a/656a19187558a79bf41101eddfcd5ceb/pa/YG15382_9ba0a4b5403a4a0ec512cb1cdf3faea9.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/14/dc144b424d7312fa7623fc855e117e76/pa/UZ46554_db8eee083770447322d2a356b8dacaa4.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b089c7790>
2026-01-28 20:05:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:05:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ba1af05-9c36-5ac8-8700-2bf5d36384e8/6ba1af05-9c36-5ac8-8700-2bf5d36384e8_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F6a%252F656a19187558a79bf41101eddfcd5ceb%252Fpa%252FYG15382_51454687462cc1e6b3692291e1ba9972.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/6a/656a19187558a79bf41101eddfcd5ceb/pa/YG15382_51454687462cc1e6b3692291e1ba9972.jpg saved to cache
2026-01-28 20:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 6ba1af05-9c36-5ac8-8700-2bf5d36384e8
2026-01-28 20:05:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08932850>
2026-01-28 20:05:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ba1af05-9c36-5ac8-8700-2bf5d36384e8/6ba1af05-9c36-5ac8-8700-2bf5d36384e8_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F6a%252F656a19187558a79bf41101eddfcd5ceb%252Fpa%252FYG15382_9ba0a4b5403a4a0ec512cb1cdf3faea9.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/6a/656a19187558a79bf41101eddfcd5ceb/pa/YG15382_9ba0a4b5403a4a0ec512cb1cdf3faea9.jpg saved to cache
2026-01-28 20:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 6ba1af05-9c36-5ac8-8700-2bf5d36384e8
2026-01-28 20:05:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b086e0590>
2026-01-28 20:05:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:05:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58076a85-30b9-5b3c-b271-24664f63fb14/58076a85-30b9-5b3c-b271-24664f63fb14_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F14%252Fdc144b424d7312fa7623fc855e117e76%252Fpa%252FUZ46554_db8eee083770447322d2a356b8dacaa4.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/14/dc144b424d7312fa7623fc855e117e76/pa/UZ46554_db8eee083770447322d2a356b8dacaa4.jpg saved to cache
2026-01-28 20:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 58076a85-30b9-5b3c-b271-24664f63fb14
2026-01-28 20:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/6a/026a7fb3fb786a2a92e1dc0c289291c9/pa/YX37505_faa610ede2c643e9fdddf140934ac3d3.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/6a/026a7fb3fb786a2a92e1dc0c289291c9/pa/YX37505_7e3e9cfc81f0431f4f5122e3a06f415c.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/3a/683a30f2daff595c3446995e59787c8f/pa/NP54569_a490a82fa16925ede1622d028c30290f.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/3a/683a30f2daff595c3446995e59787c8f/pa/NP54569_9129fdea5a6e1388073e412a70d358b1.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/14/dc144b424d7312fa7623fc855e117e76/pa/UZ46554_4ab16910eccd5edb112c033aae4a87a5.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/3a/683a30f2daff595c3446995e59787c8f/pa/NP54569_41c876120c3c8be292578f3747a526da.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/cc/f8cc2d967a2292b1434472d516494abd/pa/HU90428_203b767f1f9f1bc900e8c0d48884c2e5.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img41/20/4120810c32bcbcbb09bae2faf3cc7460/pa/CY86412_b6cf6922a87c23f7a59dc8076d875d2e.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/ae/ceaec425c7106ce417963ef635dd8240/pa/UD73720_03eb7ab1bd5e93117fda90063cff132b.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0be04ed0>
2026-01-28 20:05:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:05:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47641bc6-87ee-5c7b-b578-bf967fb554f9/47641bc6-87ee-5c7b-b578-bf967fb554f9_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F6a%252F026a7fb3fb786a2a92e1dc0c289291c9%252Fpa%252FYX37505_faa610ede2c643e9fdddf140934ac3d3.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/6a/026a7fb3fb786a2a92e1dc0c289291c9/pa/YX37505_faa610ede2c643e9fdddf140934ac3d3.jpg saved to cache
2026-01-28 20:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 47641bc6-87ee-5c7b-b578-bf967fb554f9
2026-01-28 20:05:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/f2/abf219bf7cd89b5581a33fe893870cc8/pa/YE02110_a31d14b638a61115773301259dc3a26e.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/e4/a6e425f4947af594305d5000e9a05c30/pa/UP17064_92e715a012219ed83c914476c7ae455b.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/e4/a6e425f4947af594305d5000e9a05c30/pa/UP17064_5158424e15cebf47a3414227dab580f5.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/14/dc144b424d7312fa7623fc855e117e76/pa/UZ46554_4bf25b1e90f4cc6cfb2873bc3583b94d.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09fc4410>
2026-01-28 20:05:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47641bc6-87ee-5c7b-b578-bf967fb554f9/47641bc6-87ee-5c7b-b578-bf967fb554f9_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F6a%252F026a7fb3fb786a2a92e1dc0c289291c9%252Fpa%252FYX37505_7e3e9cfc81f0431f4f5122e3a06f415c.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/6a/026a7fb3fb786a2a92e1dc0c289291c9/pa/YX37505_7e3e9cfc81f0431f4f5122e3a06f415c.jpg saved to cache
2026-01-28 20:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 47641bc6-87ee-5c7b-b578-bf967fb554f9
2026-01-28 20:05:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:05:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08b08490>
2026-01-28 20:05:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3542d180-bfa5-5f73-b34a-0e4239086fc5/3542d180-bfa5-5f73-b34a-0e4239086fc5_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F3a%252F683a30f2daff595c3446995e59787c8f%252Fpa%252FNP54569_a490a82fa16925ede1622d028c30290f.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/3a/683a30f2daff595c3446995e59787c8f/pa/NP54569_a490a82fa16925ede1622d028c30290f.jpg saved to cache
2026-01-28 20:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3542d180-bfa5-5f73-b34a-0e4239086fc5
2026-01-28 20:05:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:05:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0be04fd0>
2026-01-28 20:05:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3542d180-bfa5-5f73-b34a-0e4239086fc5/3542d180-bfa5-5f73-b34a-0e4239086fc5_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F3a%252F683a30f2daff595c3446995e59787c8f%252Fpa%252FNP54569_9129fdea5a6e1388073e412a70d358b1.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/3a/683a30f2daff595c3446995e59787c8f/pa/NP54569_9129fdea5a6e1388073e412a70d358b1.jpg saved to cache
2026-01-28 20:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3542d180-bfa5-5f73-b34a-0e4239086fc5
2026-01-28 20:05:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:05:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08bdc950>
2026-01-28 20:05:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:05:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58076a85-30b9-5b3c-b271-24664f63fb14/58076a85-30b9-5b3c-b271-24664f63fb14_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F14%252Fdc144b424d7312fa7623fc855e117e76%252Fpa%252FUZ46554_4ab16910eccd5edb112c033aae4a87a5.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/14/dc144b424d7312fa7623fc855e117e76/pa/UZ46554_4ab16910eccd5edb112c033aae4a87a5.jpg saved to cache
2026-01-28 20:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 58076a85-30b9-5b3c-b271-24664f63fb14
2026-01-28 20:05:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:05:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09d6c110>
2026-01-28 20:05:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:05:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3542d180-bfa5-5f73-b34a-0e4239086fc5/3542d180-bfa5-5f73-b34a-0e4239086fc5_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F3a%252F683a30f2daff595c3446995e59787c8f%252Fpa%252FNP54569_41c876120c3c8be292578f3747a526da.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/3a/683a30f2daff595c3446995e59787c8f/pa/NP54569_41c876120c3c8be292578f3747a526da.jpg saved to cache
2026-01-28 20:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3542d180-bfa5-5f73-b34a-0e4239086fc5
2026-01-28 20:05:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3542d180-bfa5-5f73-b34a-0e4239086fc5, skipping ID generation
2026-01-28 20:05:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3542d180-bfa5-5f73-b34a-0e4239086fc5 with scrape type 1
2026-01-28 20:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 3542d180-bfa5-5f73-b34a-0e4239086fc5 from tracking dictionaries
2026-01-28 20:05:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3542d180-bfa5-5f73-b34a-0e4239086fc5 sending to next pipeline
2026-01-28 20:05:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3542d180-bfa5-5f73-b34a-0e4239086fc5, identifier: NP54569
2026-01-28 20:05:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:05:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09d83ad0>
2026-01-28 20:05:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:05:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_938cfd71-b044-5a72-95cb-a6dd8b1465e3/938cfd71-b044-5a72-95cb-a6dd8b1465e3_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252Fcc%252Ff8cc2d967a2292b1434472d516494abd%252Fpa%252FHU90428_203b767f1f9f1bc900e8c0d48884c2e5.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/cc/f8cc2d967a2292b1434472d516494abd/pa/HU90428_203b767f1f9f1bc900e8c0d48884c2e5.jpg saved to cache
2026-01-28 20:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 938cfd71-b044-5a72-95cb-a6dd8b1465e3
2026-01-28 20:05:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 938cfd71-b044-5a72-95cb-a6dd8b1465e3, skipping ID generation
2026-01-28 20:05:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 938cfd71-b044-5a72-95cb-a6dd8b1465e3 with scrape type 1
2026-01-28 20:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 938cfd71-b044-5a72-95cb-a6dd8b1465e3 from tracking dictionaries
2026-01-28 20:05:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 938cfd71-b044-5a72-95cb-a6dd8b1465e3 sending to next pipeline
2026-01-28 20:05:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 938cfd71-b044-5a72-95cb-a6dd8b1465e3, identifier: HU90428
2026-01-28 20:05:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:05:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b086e1650>
2026-01-28 20:05:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:05:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fc31469-80fd-55ab-bdf0-bdcd15fb0516/8fc31469-80fd-55ab-bdf0-bdcd15fb0516_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F20%252F4120810c32bcbcbb09bae2faf3cc7460%252Fpa%252FCY86412_b6cf6922a87c23f7a59dc8076d875d2e.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/20/4120810c32bcbcbb09bae2faf3cc7460/pa/CY86412_b6cf6922a87c23f7a59dc8076d875d2e.jpg saved to cache
2026-01-28 20:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8fc31469-80fd-55ab-bdf0-bdcd15fb0516
2026-01-28 20:05:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8fc31469-80fd-55ab-bdf0-bdcd15fb0516, skipping ID generation
2026-01-28 20:05:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8fc31469-80fd-55ab-bdf0-bdcd15fb0516 with scrape type 1
2026-01-28 20:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 8fc31469-80fd-55ab-bdf0-bdcd15fb0516 from tracking dictionaries
2026-01-28 20:05:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8fc31469-80fd-55ab-bdf0-bdcd15fb0516 sending to next pipeline
2026-01-28 20:05:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8fc31469-80fd-55ab-bdf0-bdcd15fb0516, identifier: CY86412
2026-01-28 20:05:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09d789d0>
2026-01-28 20:05:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e38ee64-bcbd-59a3-8791-d7d1c58e212f/5e38ee64-bcbd-59a3-8791-d7d1c58e212f_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252Fae%252Fceaec425c7106ce417963ef635dd8240%252Fpa%252FUD73720_03eb7ab1bd5e93117fda90063cff132b.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/ae/ceaec425c7106ce417963ef635dd8240/pa/UD73720_03eb7ab1bd5e93117fda90063cff132b.jpg saved to cache
2026-01-28 20:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 5e38ee64-bcbd-59a3-8791-d7d1c58e212f
2026-01-28 20:05:26 [scrapy.extensions.logstats] INFO: Crawled 302 pages (at 48 pages/min), scraped 88 items (at 19 items/min)
2026-01-28 20:05:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3542d180-bfa5-5f73-b34a-0e4239086fc5 with identifier: NP54569
2026-01-28 20:05:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3542d180-bfa5-5f73-b34a-0e4239086fc5 with identifier: NP54569
2026-01-28 20:05:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3542d180-bfa5-5f73-b34a-0e4239086fc5 with identifier: NP54569 to the API
2026-01-28 20:05:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:05:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:05:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img68/3a/683a30f2daff595c3446995e59787c8f/pa/NP54569_41c876120c3c8be292578f3747a526da.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 91,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'engine_horse_power': 116,
 'expiration_date': '2026-01-29T16:14:03Z',
 'fuel_type': 'hybrid',
 'id': '3542d180-bfa5-5f73-b34a-0e4239086fc5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NP54569',
 'listing': 'auction',
 'location': 'IT, Camerano (AN)',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 5591,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3542d180-bfa5-5f73-b34a-0e4239086fc5/3542d180-bfa5-5f73-b34a-0e4239086fc5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2090015,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img68/3a/683a30f2daff595c3446995e59787c8f/pa/NP54569_2e59dd006cf7bc5689ce1961ea64b023.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3542d180-bfa5-5f73-b34a-0e4239086fc5/3542d180-bfa5-5f73-b34a-0e4239086fc5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2164935,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img68/3a/683a30f2daff595c3446995e59787c8f/pa/NP54569_41c876120c3c8be292578f3747a526da.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3542d180-bfa5-5f73-b34a-0e4239086fc5/3542d180-bfa5-5f73-b34a-0e4239086fc5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67408,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img68/3a/683a30f2daff595c3446995e59787c8f/pa/NP54569_8dba787b053c28c69e19e00f4cfdabb2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3542d180-bfa5-5f73-b34a-0e4239086fc5/3542d180-bfa5-5f73-b34a-0e4239086fc5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2367703,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img68/3a/683a30f2daff595c3446995e59787c8f/pa/NP54569_283231f3d2cc97ba7e7ee78f9f8d0c1c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3542d180-bfa5-5f73-b34a-0e4239086fc5/3542d180-bfa5-5f73-b34a-0e4239086fc5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2208396,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img68/3a/683a30f2daff595c3446995e59787c8f/pa/NP54569_9129fdea5a6e1388073e412a70d358b1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3542d180-bfa5-5f73-b34a-0e4239086fc5/3542d180-bfa5-5f73-b34a-0e4239086fc5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2280071,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img68/3a/683a30f2daff595c3446995e59787c8f/pa/NP54569_a490a82fa16925ede1622d028c30290f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3542d180-bfa5-5f73-b34a-0e4239086fc5/3542d180-bfa5-5f73-b34a-0e4239086fc5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2153548,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img68/3a/683a30f2daff595c3446995e59787c8f/pa/NP54569_cf02890ce5e2d562efb9514c1853cb5c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3542d180-bfa5-5f73-b34a-0e4239086fc5/3542d180-bfa5-5f73-b34a-0e4239086fc5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2161912,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img68/3a/683a30f2daff595c3446995e59787c8f/pa/NP54569_7504b0bd15f9a400e2c3bc2111d4f1ef.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3542d180-bfa5-5f73-b34a-0e4239086fc5/3542d180-bfa5-5f73-b34a-0e4239086fc5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2102810,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img68/3a/683a30f2daff595c3446995e59787c8f/pa/NP54569_b6c7e700bf72834ba4afb8a76e5d2639.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3542d180-bfa5-5f73-b34a-0e4239086fc5/3542d180-bfa5-5f73-b34a-0e4239086fc5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64170,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img68/3a/683a30f2daff595c3446995e59787c8f/pa/NP54569_c10f03e7ee3d335a6a8f32de4c57b3ac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3542d180-bfa5-5f73-b34a-0e4239086fc5/3542d180-bfa5-5f73-b34a-0e4239086fc5_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2234556,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img68/3a/683a30f2daff595c3446995e59787c8f/pa/NP54569_bafae926ca660f6616b829da164167d0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3542d180-bfa5-5f73-b34a-0e4239086fc5/3542d180-bfa5-5f73-b34a-0e4239086fc5_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2258873,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img68/3a/683a30f2daff595c3446995e59787c8f/pa/NP54569_d553aae4011a8353c4d13c58c95304e8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3542d180-bfa5-5f73-b34a-0e4239086fc5/3542d180-bfa5-5f73-b34a-0e4239086fc5_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2750164,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img68/3a/683a30f2daff595c3446995e59787c8f/pa/NP54569_019aabd37ecf84a2bfa5c178c5944526.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3542d180-bfa5-5f73-b34a-0e4239086fc5/3542d180-bfa5-5f73-b34a-0e4239086fc5_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2087926,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img68/3a/683a30f2daff595c3446995e59787c8f/pa/NP54569_81f918136aff3d038eab9666c6cecfee.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3542d180-bfa5-5f73-b34a-0e4239086fc5/3542d180-bfa5-5f73-b34a-0e4239086fc5_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48217,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img68/3a/683a30f2daff595c3446995e59787c8f/pa/NP54569_7593997a754847a17b49de272a4d7beb.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2025-08-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota Yaris 1.5 Hybrid Trend',
 'transmission': 'automatic',
 'trim': 'Trend',
 'year': 2025}
2026-01-28 20:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NP54569%27 HTTP/1.1" 200 None
2026-01-28 20:05:26 [auto1.it] INFO: Saving data for NP54569: {'created_time': 1769630726.454815, 'last_price_update_time': 1769630726.454828, 'auction_closing_time': 1769703243.0}
2026-01-28 20:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NP54569') HTTP/1.1" 204 0
2026-01-28 20:05:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 938cfd71-b044-5a72-95cb-a6dd8b1465e3 with identifier: HU90428
2026-01-28 20:05:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 938cfd71-b044-5a72-95cb-a6dd8b1465e3 with identifier: HU90428
2026-01-28 20:05:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 938cfd71-b044-5a72-95cb-a6dd8b1465e3 with identifier: HU90428 to the API
2026-01-28 20:05:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:05:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:05:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf8/cc/f8cc2d967a2292b1434472d516494abd/pa/HU90428_203b767f1f9f1bc900e8c0d48884c2e5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.5L',
 'engine_horse_power': 129,
 'expiration_date': '2026-01-29T16:39:01Z',
 'fuel_type': 'petrol',
 'id': '938cfd71-b044-5a72-95cb-a6dd8b1465e3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HU90428',
 'listing': 'auction',
 'location': 'IT, Imola',
 'make': 'Volvo',
 'model': 'XC40',
 'odometer': 110756,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_938cfd71-b044-5a72-95cb-a6dd8b1465e3/938cfd71-b044-5a72-95cb-a6dd8b1465e3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3287688,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/cc/f8cc2d967a2292b1434472d516494abd/pa/HU90428_7bf0ed507e7fc7b7ca6ada6f9124f7d2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_938cfd71-b044-5a72-95cb-a6dd8b1465e3/938cfd71-b044-5a72-95cb-a6dd8b1465e3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89931,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/cc/f8cc2d967a2292b1434472d516494abd/pa/HU90428_b2c9429e6b3fe825d63bb0f82edc4cfe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_938cfd71-b044-5a72-95cb-a6dd8b1465e3/938cfd71-b044-5a72-95cb-a6dd8b1465e3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2908080,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/cc/f8cc2d967a2292b1434472d516494abd/pa/HU90428_2c030ed4c299d814f2a8db8cee120f8e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_938cfd71-b044-5a72-95cb-a6dd8b1465e3/938cfd71-b044-5a72-95cb-a6dd8b1465e3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2291406,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/cc/f8cc2d967a2292b1434472d516494abd/pa/HU90428_0f09a4f1d346de37b465febee0d8e064.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_938cfd71-b044-5a72-95cb-a6dd8b1465e3/938cfd71-b044-5a72-95cb-a6dd8b1465e3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3290762,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/cc/f8cc2d967a2292b1434472d516494abd/pa/HU90428_203b767f1f9f1bc900e8c0d48884c2e5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_938cfd71-b044-5a72-95cb-a6dd8b1465e3/938cfd71-b044-5a72-95cb-a6dd8b1465e3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87884,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/cc/f8cc2d967a2292b1434472d516494abd/pa/HU90428_52cee1b952d2761fce618bd5dcc878d4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_938cfd71-b044-5a72-95cb-a6dd8b1465e3/938cfd71-b044-5a72-95cb-a6dd8b1465e3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78392,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/cc/f8cc2d967a2292b1434472d516494abd/pa/HU90428_a59f12783ab07459475fe1699023cc8c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_938cfd71-b044-5a72-95cb-a6dd8b1465e3/938cfd71-b044-5a72-95cb-a6dd8b1465e3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2854049,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/cc/f8cc2d967a2292b1434472d516494abd/pa/HU90428_d8e109f9a8ddd01928d1ff71c957ec44.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_938cfd71-b044-5a72-95cb-a6dd8b1465e3/938cfd71-b044-5a72-95cb-a6dd8b1465e3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86898,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/cc/f8cc2d967a2292b1434472d516494abd/pa/HU90428_5ba0d72f0ac9ad9e7f232fa58c84433d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_938cfd71-b044-5a72-95cb-a6dd8b1465e3/938cfd71-b044-5a72-95cb-a6dd8b1465e3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102789,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/cc/f8cc2d967a2292b1434472d516494abd/pa/HU90428_fd94a3643ee4f5d71d9f71fd0ae54628.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_938cfd71-b044-5a72-95cb-a6dd8b1465e3/938cfd71-b044-5a72-95cb-a6dd8b1465e3_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62074,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/cc/f8cc2d967a2292b1434472d516494abd/pa/HU90428_03949c1c7b5f6ae75534c29887d71c35.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_938cfd71-b044-5a72-95cb-a6dd8b1465e3/938cfd71-b044-5a72-95cb-a6dd8b1465e3_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2613807,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/cc/f8cc2d967a2292b1434472d516494abd/pa/HU90428_40cf4950f86ea0479ee671f22633dee8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_938cfd71-b044-5a72-95cb-a6dd8b1465e3/938cfd71-b044-5a72-95cb-a6dd8b1465e3_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56189,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/cc/f8cc2d967a2292b1434472d516494abd/pa/HU90428_eed1e6bb988cf89ea9b5592b024ea207.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_938cfd71-b044-5a72-95cb-a6dd8b1465e3/938cfd71-b044-5a72-95cb-a6dd8b1465e3_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47211,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/cc/f8cc2d967a2292b1434472d516494abd/pa/HU90428_1096c57dccf818b28213962bc1ef47d3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_938cfd71-b044-5a72-95cb-a6dd8b1465e3/938cfd71-b044-5a72-95cb-a6dd8b1465e3_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57829,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/cc/f8cc2d967a2292b1434472d516494abd/pa/HU90428_cca5f7a6acfd4a0662145866c0448e83.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-10-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo XC40 1.5 T2 Momentum Core 2WD',
 'transmission': 'manual',
 'trim': 'Momentum Core 2WD',
 'year': 2020}
2026-01-28 20:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HU90428%27 HTTP/1.1" 200 None
2026-01-28 20:05:26 [auto1.it] INFO: Saving data for HU90428: {'created_time': 1769630726.895592, 'last_price_update_time': 1769630726.895605, 'auction_closing_time': 1769704741.0}
2026-01-28 20:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HU90428') HTTP/1.1" 204 0
2026-01-28 20:05:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8fc31469-80fd-55ab-bdf0-bdcd15fb0516 with identifier: CY86412
2026-01-28 20:05:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-28 20:05:27 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=brown HTTP/1.1" 200 None
2026-01-28 20:05:27 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-28 20:05:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8fc31469-80fd-55ab-bdf0-bdcd15fb0516 with identifier: CY86412
2026-01-28 20:05:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8fc31469-80fd-55ab-bdf0-bdcd15fb0516 with identifier: CY86412 to the API
2026-01-28 20:05:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:05:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:05:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img41/20/4120810c32bcbcbb09bae2faf3cc7460/pa/CY86412_b6cf6922a87c23f7a59dc8076d875d2e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 152,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '2.0L',
 'engine_horse_power': 177,
 'expiration_date': '2026-01-29T16:00:47Z',
 'fuel_type': 'diesel',
 'id': '8fc31469-80fd-55ab-bdf0-bdcd15fb0516',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CY86412',
 'listing': 'auction',
 'location': 'IT, Pontedassio',
 'make': 'Nissan',
 'model': 'X-Trail',
 'odometer': 41395,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fc31469-80fd-55ab-bdf0-bdcd15fb0516/8fc31469-80fd-55ab-bdf0-bdcd15fb0516_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78828,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/20/4120810c32bcbcbb09bae2faf3cc7460/pa/CY86412_a482228586e9a3a0b2953f6aef87075f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fc31469-80fd-55ab-bdf0-bdcd15fb0516/8fc31469-80fd-55ab-bdf0-bdcd15fb0516_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3296086,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img41/20/4120810c32bcbcbb09bae2faf3cc7460/pa/CY86412_b6cf6922a87c23f7a59dc8076d875d2e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fc31469-80fd-55ab-bdf0-bdcd15fb0516/8fc31469-80fd-55ab-bdf0-bdcd15fb0516_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69978,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/20/4120810c32bcbcbb09bae2faf3cc7460/pa/CY86412_a729d8bccd76c04db9747dccb676baf2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fc31469-80fd-55ab-bdf0-bdcd15fb0516/8fc31469-80fd-55ab-bdf0-bdcd15fb0516_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3309651,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img41/20/4120810c32bcbcbb09bae2faf3cc7460/pa/CY86412_1703d691da1c965065828033b1004f98.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fc31469-80fd-55ab-bdf0-bdcd15fb0516/8fc31469-80fd-55ab-bdf0-bdcd15fb0516_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3168877,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img41/20/4120810c32bcbcbb09bae2faf3cc7460/pa/CY86412_556c9335d44510c23ad4af3336ca2af8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fc31469-80fd-55ab-bdf0-bdcd15fb0516/8fc31469-80fd-55ab-bdf0-bdcd15fb0516_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3182842,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img41/20/4120810c32bcbcbb09bae2faf3cc7460/pa/CY86412_c0c74370c1382ed66b0f096c4f1c2c43.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fc31469-80fd-55ab-bdf0-bdcd15fb0516/8fc31469-80fd-55ab-bdf0-bdcd15fb0516_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3141250,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img41/20/4120810c32bcbcbb09bae2faf3cc7460/pa/CY86412_5bfa53df2a0df290806656558dcbf8e5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fc31469-80fd-55ab-bdf0-bdcd15fb0516/8fc31469-80fd-55ab-bdf0-bdcd15fb0516_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3231561,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img41/20/4120810c32bcbcbb09bae2faf3cc7460/pa/CY86412_4de977f7fa9b335d5331c0f81afa470c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fc31469-80fd-55ab-bdf0-bdcd15fb0516/8fc31469-80fd-55ab-bdf0-bdcd15fb0516_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3223168,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img41/20/4120810c32bcbcbb09bae2faf3cc7460/pa/CY86412_074d2837be27e2d91e9e470e68647b82.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fc31469-80fd-55ab-bdf0-bdcd15fb0516/8fc31469-80fd-55ab-bdf0-bdcd15fb0516_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57692,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/20/4120810c32bcbcbb09bae2faf3cc7460/pa/CY86412_f402da7808e1a34c881dbac7910177a2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fc31469-80fd-55ab-bdf0-bdcd15fb0516/8fc31469-80fd-55ab-bdf0-bdcd15fb0516_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68908,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/20/4120810c32bcbcbb09bae2faf3cc7460/pa/CY86412_a4cad4fe8aea0212c87e67a3744993c4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fc31469-80fd-55ab-bdf0-bdcd15fb0516/8fc31469-80fd-55ab-bdf0-bdcd15fb0516_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60554,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/20/4120810c32bcbcbb09bae2faf3cc7460/pa/CY86412_69537d2a514f73cc5ce88763704322bd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fc31469-80fd-55ab-bdf0-bdcd15fb0516/8fc31469-80fd-55ab-bdf0-bdcd15fb0516_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57411,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/20/4120810c32bcbcbb09bae2faf3cc7460/pa/CY86412_c4e2faa946e91a37f18a741568a66353.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fc31469-80fd-55ab-bdf0-bdcd15fb0516/8fc31469-80fd-55ab-bdf0-bdcd15fb0516_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2979912,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img41/20/4120810c32bcbcbb09bae2faf3cc7460/pa/CY86412_43763ed559587ac0adfa4bd8ff862f3a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8fc31469-80fd-55ab-bdf0-bdcd15fb0516/8fc31469-80fd-55ab-bdf0-bdcd15fb0516_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64054,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/20/4120810c32bcbcbb09bae2faf3cc7460/pa/CY86412_e88acaea5438dffb3791d145ad1444f2.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-05-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan X-Trail 2.0 dCi Tekna',
 'transmission': 'automatic',
 'trim': 'Tekna',
 'year': 2019}
2026-01-28 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CY86412%27 HTTP/1.1" 200 None
2026-01-28 20:05:27 [auto1.it] INFO: Saving data for CY86412: {'created_time': 1769630727.49863, 'last_price_update_time': 1769630727.498641, 'auction_closing_time': 1769702447.0}
2026-01-28 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CY86412') HTTP/1.1" 204 0
2026-01-28 20:05:27 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 22 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-01-28 20:05:27 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 34 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-01-28 20:05:27 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-01-28 20:05:27 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-01-28 20:05:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-01-28 20:05:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09eb6390>
2026-01-28 20:05:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:05:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ed46455-96fb-531a-8c68-e48daae72e3a/8ed46455-96fb-531a-8c68-e48daae72e3a_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Ff2%252Fabf219bf7cd89b5581a33fe893870cc8%252Fpa%252FYE02110_a31d14b638a61115773301259dc3a26e.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/f2/abf219bf7cd89b5581a33fe893870cc8/pa/YE02110_a31d14b638a61115773301259dc3a26e.jpg saved to cache
2026-01-28 20:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 8ed46455-96fb-531a-8c68-e48daae72e3a
2026-01-28 20:05:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08cba710>
2026-01-28 20:05:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_352e36d3-8cf1-51d6-9eae-3613362bc3e4/352e36d3-8cf1-51d6-9eae-3613362bc3e4_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252Fe4%252Fa6e425f4947af594305d5000e9a05c30%252Fpa%252FUP17064_92e715a012219ed83c914476c7ae455b.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/e4/a6e425f4947af594305d5000e9a05c30/pa/UP17064_92e715a012219ed83c914476c7ae455b.jpg saved to cache
2026-01-28 20:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 352e36d3-8cf1-51d6-9eae-3613362bc3e4
2026-01-28 20:05:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09d9e250>
2026-01-28 20:05:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_352e36d3-8cf1-51d6-9eae-3613362bc3e4/352e36d3-8cf1-51d6-9eae-3613362bc3e4_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252Fe4%252Fa6e425f4947af594305d5000e9a05c30%252Fpa%252FUP17064_5158424e15cebf47a3414227dab580f5.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/e4/a6e425f4947af594305d5000e9a05c30/pa/UP17064_5158424e15cebf47a3414227dab580f5.jpg saved to cache
2026-01-28 20:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 352e36d3-8cf1-51d6-9eae-3613362bc3e4
2026-01-28 20:05:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09e59990>
2026-01-28 20:05:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:05:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58076a85-30b9-5b3c-b271-24664f63fb14/58076a85-30b9-5b3c-b271-24664f63fb14_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F14%252Fdc144b424d7312fa7623fc855e117e76%252Fpa%252FUZ46554_4bf25b1e90f4cc6cfb2873bc3583b94d.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/14/dc144b424d7312fa7623fc855e117e76/pa/UZ46554_4bf25b1e90f4cc6cfb2873bc3583b94d.jpg saved to cache
2026-01-28 20:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 58076a85-30b9-5b3c-b271-24664f63fb14
2026-01-28 20:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/6a/656a19187558a79bf41101eddfcd5ceb/pa/YG15382_fc84da3d516115015f3c1477cccf7960.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/6a/656a19187558a79bf41101eddfcd5ceb/pa/YG15382_ca00e2f40c0e7717b89b65d81371dece.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/e4/a6e425f4947af594305d5000e9a05c30/pa/UP17064_160adf79d7a2a81248ee2d3810b04c20.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/14/dc144b424d7312fa7623fc855e117e76/pa/UZ46554_4d54f67e3def655fc78f876f618a3a2d.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/6a/026a7fb3fb786a2a92e1dc0c289291c9/pa/YX37505_b54b91cd52a539eabc9dc0a566e7700d.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/6a/656a19187558a79bf41101eddfcd5ceb/pa/YG15382_a76a2abdd92e2b011252958d307d7f80.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/ae/ceaec425c7106ce417963ef635dd8240/pa/UD73720_5a7044615579736e1771750674824aaf.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/6a/026a7fb3fb786a2a92e1dc0c289291c9/pa/YX37505_29476fcb52a4b8bed17d89b38e02511b.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:05:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0ea8c990>
2026-01-28 20:05:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:05:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ba1af05-9c36-5ac8-8700-2bf5d36384e8/6ba1af05-9c36-5ac8-8700-2bf5d36384e8_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F6a%252F656a19187558a79bf41101eddfcd5ceb%252Fpa%252FYG15382_fc84da3d516115015f3c1477cccf7960.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/6a/656a19187558a79bf41101eddfcd5ceb/pa/YG15382_fc84da3d516115015f3c1477cccf7960.jpg saved to cache
2026-01-28 20:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 6ba1af05-9c36-5ac8-8700-2bf5d36384e8
2026-01-28 20:05:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/f2/abf219bf7cd89b5581a33fe893870cc8/pa/YE02110_1fb8ad44dd96de23a175b475ae1f3743.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/6a/026a7fb3fb786a2a92e1dc0c289291c9/pa/YX37505_0d36028b7486243f13ed40d05b5a93e7.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/ae/ceaec425c7106ce417963ef635dd8240/pa/UD73720_24d1ea428f17f9650cdfcb83227830ac.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/f2/abf219bf7cd89b5581a33fe893870cc8/pa/YE02110_7bfb1d85a15ffa0ed545fd0d2d13b5b2.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:05:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0a03ae50>
2026-01-28 20:05:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:05:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ba1af05-9c36-5ac8-8700-2bf5d36384e8/6ba1af05-9c36-5ac8-8700-2bf5d36384e8_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F6a%252F656a19187558a79bf41101eddfcd5ceb%252Fpa%252FYG15382_ca00e2f40c0e7717b89b65d81371dece.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/6a/656a19187558a79bf41101eddfcd5ceb/pa/YG15382_ca00e2f40c0e7717b89b65d81371dece.jpg saved to cache
2026-01-28 20:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 6ba1af05-9c36-5ac8-8700-2bf5d36384e8
2026-01-28 20:05:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:05:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0a0a65d0>
2026-01-28 20:05:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_352e36d3-8cf1-51d6-9eae-3613362bc3e4/352e36d3-8cf1-51d6-9eae-3613362bc3e4_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252Fe4%252Fa6e425f4947af594305d5000e9a05c30%252Fpa%252FUP17064_160adf79d7a2a81248ee2d3810b04c20.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/e4/a6e425f4947af594305d5000e9a05c30/pa/UP17064_160adf79d7a2a81248ee2d3810b04c20.jpg saved to cache
2026-01-28 20:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 352e36d3-8cf1-51d6-9eae-3613362bc3e4
2026-01-28 20:05:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:05:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08b645d0>
2026-01-28 20:05:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58076a85-30b9-5b3c-b271-24664f63fb14/58076a85-30b9-5b3c-b271-24664f63fb14_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F14%252Fdc144b424d7312fa7623fc855e117e76%252Fpa%252FUZ46554_4d54f67e3def655fc78f876f618a3a2d.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/14/dc144b424d7312fa7623fc855e117e76/pa/UZ46554_4d54f67e3def655fc78f876f618a3a2d.jpg saved to cache
2026-01-28 20:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 58076a85-30b9-5b3c-b271-24664f63fb14
2026-01-28 20:05:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:05:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08c5dfd0>
2026-01-28 20:05:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47641bc6-87ee-5c7b-b578-bf967fb554f9/47641bc6-87ee-5c7b-b578-bf967fb554f9_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F6a%252F026a7fb3fb786a2a92e1dc0c289291c9%252Fpa%252FYX37505_b54b91cd52a539eabc9dc0a566e7700d.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/6a/026a7fb3fb786a2a92e1dc0c289291c9/pa/YX37505_b54b91cd52a539eabc9dc0a566e7700d.jpg saved to cache
2026-01-28 20:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 47641bc6-87ee-5c7b-b578-bf967fb554f9
2026-01-28 20:05:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08c4fcd0>
2026-01-28 20:05:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:05:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ba1af05-9c36-5ac8-8700-2bf5d36384e8/6ba1af05-9c36-5ac8-8700-2bf5d36384e8_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F6a%252F656a19187558a79bf41101eddfcd5ceb%252Fpa%252FYG15382_a76a2abdd92e2b011252958d307d7f80.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/6a/656a19187558a79bf41101eddfcd5ceb/pa/YG15382_a76a2abdd92e2b011252958d307d7f80.jpg saved to cache
2026-01-28 20:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6ba1af05-9c36-5ac8-8700-2bf5d36384e8
2026-01-28 20:05:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08721290>
2026-01-28 20:05:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e38ee64-bcbd-59a3-8791-d7d1c58e212f/5e38ee64-bcbd-59a3-8791-d7d1c58e212f_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252Fae%252Fceaec425c7106ce417963ef635dd8240%252Fpa%252FUD73720_5a7044615579736e1771750674824aaf.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/ae/ceaec425c7106ce417963ef635dd8240/pa/UD73720_5a7044615579736e1771750674824aaf.jpg saved to cache
2026-01-28 20:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5e38ee64-bcbd-59a3-8791-d7d1c58e212f
2026-01-28 20:05:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b086fcb50>
2026-01-28 20:05:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47641bc6-87ee-5c7b-b578-bf967fb554f9/47641bc6-87ee-5c7b-b578-bf967fb554f9_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F6a%252F026a7fb3fb786a2a92e1dc0c289291c9%252Fpa%252FYX37505_29476fcb52a4b8bed17d89b38e02511b.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/6a/026a7fb3fb786a2a92e1dc0c289291c9/pa/YX37505_29476fcb52a4b8bed17d89b38e02511b.jpg saved to cache
2026-01-28 20:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 47641bc6-87ee-5c7b-b578-bf967fb554f9
2026-01-28 20:05:31 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 22 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-01-28 20:05:31 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 34 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-01-28 20:05:31 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-01-28 20:05:31 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-01-28 20:05:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-01-28 20:05:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09fd9450>
2026-01-28 20:05:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:05:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ed46455-96fb-531a-8c68-e48daae72e3a/8ed46455-96fb-531a-8c68-e48daae72e3a_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Ff2%252Fabf219bf7cd89b5581a33fe893870cc8%252Fpa%252FYE02110_1fb8ad44dd96de23a175b475ae1f3743.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/f2/abf219bf7cd89b5581a33fe893870cc8/pa/YE02110_1fb8ad44dd96de23a175b475ae1f3743.jpg saved to cache
2026-01-28 20:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8ed46455-96fb-531a-8c68-e48daae72e3a
2026-01-28 20:05:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08be0290>
2026-01-28 20:05:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:05:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47641bc6-87ee-5c7b-b578-bf967fb554f9/47641bc6-87ee-5c7b-b578-bf967fb554f9_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F6a%252F026a7fb3fb786a2a92e1dc0c289291c9%252Fpa%252FYX37505_0d36028b7486243f13ed40d05b5a93e7.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/6a/026a7fb3fb786a2a92e1dc0c289291c9/pa/YX37505_0d36028b7486243f13ed40d05b5a93e7.jpg saved to cache
2026-01-28 20:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 47641bc6-87ee-5c7b-b578-bf967fb554f9
2026-01-28 20:05:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09ea3fd0>
2026-01-28 20:05:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:05:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e38ee64-bcbd-59a3-8791-d7d1c58e212f/5e38ee64-bcbd-59a3-8791-d7d1c58e212f_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252Fae%252Fceaec425c7106ce417963ef635dd8240%252Fpa%252FUD73720_24d1ea428f17f9650cdfcb83227830ac.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/ae/ceaec425c7106ce417963ef635dd8240/pa/UD73720_24d1ea428f17f9650cdfcb83227830ac.jpg saved to cache
2026-01-28 20:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 5e38ee64-bcbd-59a3-8791-d7d1c58e212f
2026-01-28 20:05:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08c295d0>
2026-01-28 20:05:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:05:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ed46455-96fb-531a-8c68-e48daae72e3a/8ed46455-96fb-531a-8c68-e48daae72e3a_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Ff2%252Fabf219bf7cd89b5581a33fe893870cc8%252Fpa%252FYE02110_7bfb1d85a15ffa0ed545fd0d2d13b5b2.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/f2/abf219bf7cd89b5581a33fe893870cc8/pa/YE02110_7bfb1d85a15ffa0ed545fd0d2d13b5b2.jpg saved to cache
2026-01-28 20:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 8ed46455-96fb-531a-8c68-e48daae72e3a
2026-01-28 20:05:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/f2/abf219bf7cd89b5581a33fe893870cc8/pa/YE02110_f591cbee3676eeebe0f1dbd21223befd.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/6a/656a19187558a79bf41101eddfcd5ceb/pa/YG15382_70b3551bc5784fe1816c454a4030f350.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/14/dc144b424d7312fa7623fc855e117e76/pa/UZ46554_2ee36005693e75f7b170d62dc91de480.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/e4/a6e425f4947af594305d5000e9a05c30/pa/UP17064_ba8f597b98ca848bbec1c75a3f441471.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/6a/656a19187558a79bf41101eddfcd5ceb/pa/YG15382_f9f642b3509ecf551626286137bb50d6.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/e4/a6e425f4947af594305d5000e9a05c30/pa/UP17064_e100f7dc4878ac7040644243863a14c8.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/6a/026a7fb3fb786a2a92e1dc0c289291c9/pa/YX37505_d2a39009533a1447027d536b94f5bc8e.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/ae/ceaec425c7106ce417963ef635dd8240/pa/UD73720_2f22d4f3e6353f8bcba88db4f27e84d1.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:32 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 22 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-01-28 20:05:32 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 34 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-01-28 20:05:32 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-01-28 20:05:32 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-01-28 20:05:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-01-28 20:05:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09eeff10>
2026-01-28 20:05:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ed46455-96fb-531a-8c68-e48daae72e3a/8ed46455-96fb-531a-8c68-e48daae72e3a_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Ff2%252Fabf219bf7cd89b5581a33fe893870cc8%252Fpa%252FYE02110_f591cbee3676eeebe0f1dbd21223befd.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/f2/abf219bf7cd89b5581a33fe893870cc8/pa/YE02110_f591cbee3676eeebe0f1dbd21223befd.jpg saved to cache
2026-01-28 20:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8ed46455-96fb-531a-8c68-e48daae72e3a
2026-01-28 20:05:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/ae/ceaec425c7106ce417963ef635dd8240/pa/UD73720_9eaa7328cc842cb5e38d8ad7858c8d1b.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/6a/026a7fb3fb786a2a92e1dc0c289291c9/pa/YX37505_47c3a3f61d1d29c80c43fc9094357bf0.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/f2/abf219bf7cd89b5581a33fe893870cc8/pa/YE02110_a2d6c3d3294880b5b2e417883912354c.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:05:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0a0eb810>
2026-01-28 20:05:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ba1af05-9c36-5ac8-8700-2bf5d36384e8/6ba1af05-9c36-5ac8-8700-2bf5d36384e8_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F6a%252F656a19187558a79bf41101eddfcd5ceb%252Fpa%252FYG15382_70b3551bc5784fe1816c454a4030f350.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/6a/656a19187558a79bf41101eddfcd5ceb/pa/YG15382_70b3551bc5784fe1816c454a4030f350.jpg saved to cache
2026-01-28 20:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6ba1af05-9c36-5ac8-8700-2bf5d36384e8
2026-01-28 20:05:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:05:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0c108b10>
2026-01-28 20:05:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:05:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58076a85-30b9-5b3c-b271-24664f63fb14/58076a85-30b9-5b3c-b271-24664f63fb14_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F14%252Fdc144b424d7312fa7623fc855e117e76%252Fpa%252FUZ46554_2ee36005693e75f7b170d62dc91de480.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/14/dc144b424d7312fa7623fc855e117e76/pa/UZ46554_2ee36005693e75f7b170d62dc91de480.jpg saved to cache
2026-01-28 20:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 58076a85-30b9-5b3c-b271-24664f63fb14
2026-01-28 20:05:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:05:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08745e50>
2026-01-28 20:05:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:05:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_352e36d3-8cf1-51d6-9eae-3613362bc3e4/352e36d3-8cf1-51d6-9eae-3613362bc3e4_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252Fe4%252Fa6e425f4947af594305d5000e9a05c30%252Fpa%252FUP17064_ba8f597b98ca848bbec1c75a3f441471.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/e4/a6e425f4947af594305d5000e9a05c30/pa/UP17064_ba8f597b98ca848bbec1c75a3f441471.jpg saved to cache
2026-01-28 20:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 352e36d3-8cf1-51d6-9eae-3613362bc3e4
2026-01-28 20:05:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:05:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08721190>
2026-01-28 20:05:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:05:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ba1af05-9c36-5ac8-8700-2bf5d36384e8/6ba1af05-9c36-5ac8-8700-2bf5d36384e8_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F6a%252F656a19187558a79bf41101eddfcd5ceb%252Fpa%252FYG15382_f9f642b3509ecf551626286137bb50d6.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/6a/656a19187558a79bf41101eddfcd5ceb/pa/YG15382_f9f642b3509ecf551626286137bb50d6.jpg saved to cache
2026-01-28 20:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6ba1af05-9c36-5ac8-8700-2bf5d36384e8
2026-01-28 20:05:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:05:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08be69d0>
2026-01-28 20:05:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:05:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_352e36d3-8cf1-51d6-9eae-3613362bc3e4/352e36d3-8cf1-51d6-9eae-3613362bc3e4_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252Fe4%252Fa6e425f4947af594305d5000e9a05c30%252Fpa%252FUP17064_e100f7dc4878ac7040644243863a14c8.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/e4/a6e425f4947af594305d5000e9a05c30/pa/UP17064_e100f7dc4878ac7040644243863a14c8.jpg saved to cache
2026-01-28 20:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 352e36d3-8cf1-51d6-9eae-3613362bc3e4
2026-01-28 20:05:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b087443d0>
2026-01-28 20:05:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:05:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47641bc6-87ee-5c7b-b578-bf967fb554f9/47641bc6-87ee-5c7b-b578-bf967fb554f9_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F6a%252F026a7fb3fb786a2a92e1dc0c289291c9%252Fpa%252FYX37505_d2a39009533a1447027d536b94f5bc8e.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/6a/026a7fb3fb786a2a92e1dc0c289291c9/pa/YX37505_d2a39009533a1447027d536b94f5bc8e.jpg saved to cache
2026-01-28 20:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 47641bc6-87ee-5c7b-b578-bf967fb554f9
2026-01-28 20:05:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08c4ced0>
2026-01-28 20:05:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:05:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e38ee64-bcbd-59a3-8791-d7d1c58e212f/5e38ee64-bcbd-59a3-8791-d7d1c58e212f_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252Fae%252Fceaec425c7106ce417963ef635dd8240%252Fpa%252FUD73720_2f22d4f3e6353f8bcba88db4f27e84d1.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/ae/ceaec425c7106ce417963ef635dd8240/pa/UD73720_2f22d4f3e6353f8bcba88db4f27e84d1.jpg saved to cache
2026-01-28 20:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5e38ee64-bcbd-59a3-8791-d7d1c58e212f
2026-01-28 20:05:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/6a/656a19187558a79bf41101eddfcd5ceb/pa/YG15382_106c8b2e7f2f56cf88963b4d0e0c9b31.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08a0a690>
2026-01-28 20:05:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:05:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e38ee64-bcbd-59a3-8791-d7d1c58e212f/5e38ee64-bcbd-59a3-8791-d7d1c58e212f_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252Fae%252Fceaec425c7106ce417963ef635dd8240%252Fpa%252FUD73720_9eaa7328cc842cb5e38d8ad7858c8d1b.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/ae/ceaec425c7106ce417963ef635dd8240/pa/UD73720_9eaa7328cc842cb5e38d8ad7858c8d1b.jpg saved to cache
2026-01-28 20:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5e38ee64-bcbd-59a3-8791-d7d1c58e212f
2026-01-28 20:05:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b089aeb10>
2026-01-28 20:05:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47641bc6-87ee-5c7b-b578-bf967fb554f9/47641bc6-87ee-5c7b-b578-bf967fb554f9_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F6a%252F026a7fb3fb786a2a92e1dc0c289291c9%252Fpa%252FYX37505_47c3a3f61d1d29c80c43fc9094357bf0.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/6a/026a7fb3fb786a2a92e1dc0c289291c9/pa/YX37505_47c3a3f61d1d29c80c43fc9094357bf0.jpg saved to cache
2026-01-28 20:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 47641bc6-87ee-5c7b-b578-bf967fb554f9
2026-01-28 20:05:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 22 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-01-28 20:05:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 34 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-01-28 20:05:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-01-28 20:05:35 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-01-28 20:05:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-01-28 20:05:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b089523d0>
2026-01-28 20:05:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:05:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ed46455-96fb-531a-8c68-e48daae72e3a/8ed46455-96fb-531a-8c68-e48daae72e3a_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Ff2%252Fabf219bf7cd89b5581a33fe893870cc8%252Fpa%252FYE02110_a2d6c3d3294880b5b2e417883912354c.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/f2/abf219bf7cd89b5581a33fe893870cc8/pa/YE02110_a2d6c3d3294880b5b2e417883912354c.jpg saved to cache
2026-01-28 20:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8ed46455-96fb-531a-8c68-e48daae72e3a
2026-01-28 20:05:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/ae/ceaec425c7106ce417963ef635dd8240/pa/UD73720_f28349facff6c8052a3b25c14c338bb8.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/f2/abf219bf7cd89b5581a33fe893870cc8/pa/YE02110_b0f95c201f6b26f09e2d380a699180cf.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09e5ba50>
2026-01-28 20:05:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:05:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ba1af05-9c36-5ac8-8700-2bf5d36384e8/6ba1af05-9c36-5ac8-8700-2bf5d36384e8_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F6a%252F656a19187558a79bf41101eddfcd5ceb%252Fpa%252FYG15382_106c8b2e7f2f56cf88963b4d0e0c9b31.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/6a/656a19187558a79bf41101eddfcd5ceb/pa/YG15382_106c8b2e7f2f56cf88963b4d0e0c9b31.jpg saved to cache
2026-01-28 20:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6ba1af05-9c36-5ac8-8700-2bf5d36384e8
2026-01-28 20:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/6a/026a7fb3fb786a2a92e1dc0c289291c9/pa/YX37505_562d9f0d18a91a8d5d1a2b3d3cc72d41.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/6a/656a19187558a79bf41101eddfcd5ceb/pa/YG15382_7fa38e1d7d2b9c57cecaaf49d4a4b181.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0cc99490>
2026-01-28 20:05:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:05:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e38ee64-bcbd-59a3-8791-d7d1c58e212f/5e38ee64-bcbd-59a3-8791-d7d1c58e212f_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252Fae%252Fceaec425c7106ce417963ef635dd8240%252Fpa%252FUD73720_f28349facff6c8052a3b25c14c338bb8.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/ae/ceaec425c7106ce417963ef635dd8240/pa/UD73720_f28349facff6c8052a3b25c14c338bb8.jpg saved to cache
2026-01-28 20:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5e38ee64-bcbd-59a3-8791-d7d1c58e212f
2026-01-28 20:05:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08b06410>
2026-01-28 20:05:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ed46455-96fb-531a-8c68-e48daae72e3a/8ed46455-96fb-531a-8c68-e48daae72e3a_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Ff2%252Fabf219bf7cd89b5581a33fe893870cc8%252Fpa%252FYE02110_b0f95c201f6b26f09e2d380a699180cf.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/f2/abf219bf7cd89b5581a33fe893870cc8/pa/YE02110_b0f95c201f6b26f09e2d380a699180cf.jpg saved to cache
2026-01-28 20:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8ed46455-96fb-531a-8c68-e48daae72e3a
2026-01-28 20:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/ae/ceaec425c7106ce417963ef635dd8240/pa/UD73720_dd470b36f276d0f033cb3bb1c5321290.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/f2/abf219bf7cd89b5581a33fe893870cc8/pa/YE02110_b8a3d988c14f85cc2016741b54ab296f.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08b05490>
2026-01-28 20:05:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47641bc6-87ee-5c7b-b578-bf967fb554f9/47641bc6-87ee-5c7b-b578-bf967fb554f9_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F6a%252F026a7fb3fb786a2a92e1dc0c289291c9%252Fpa%252FYX37505_562d9f0d18a91a8d5d1a2b3d3cc72d41.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/6a/026a7fb3fb786a2a92e1dc0c289291c9/pa/YX37505_562d9f0d18a91a8d5d1a2b3d3cc72d41.jpg saved to cache
2026-01-28 20:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 47641bc6-87ee-5c7b-b578-bf967fb554f9
2026-01-28 20:05:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b089adf90>
2026-01-28 20:05:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ba1af05-9c36-5ac8-8700-2bf5d36384e8/6ba1af05-9c36-5ac8-8700-2bf5d36384e8_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F6a%252F656a19187558a79bf41101eddfcd5ceb%252Fpa%252FYG15382_7fa38e1d7d2b9c57cecaaf49d4a4b181.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/6a/656a19187558a79bf41101eddfcd5ceb/pa/YG15382_7fa38e1d7d2b9c57cecaaf49d4a4b181.jpg saved to cache
2026-01-28 20:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6ba1af05-9c36-5ac8-8700-2bf5d36384e8
2026-01-28 20:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/e4/a6e425f4947af594305d5000e9a05c30/pa/UP17064_38aa8a3cb7409bfff6c0bfdc3177bf07.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/6a/026a7fb3fb786a2a92e1dc0c289291c9/pa/YX37505_747db23ee751a6e9e51204749fdcb380.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08b57210>
2026-01-28 20:05:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e38ee64-bcbd-59a3-8791-d7d1c58e212f/5e38ee64-bcbd-59a3-8791-d7d1c58e212f_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252Fae%252Fceaec425c7106ce417963ef635dd8240%252Fpa%252FUD73720_dd470b36f276d0f033cb3bb1c5321290.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/ae/ceaec425c7106ce417963ef635dd8240/pa/UD73720_dd470b36f276d0f033cb3bb1c5321290.jpg saved to cache
2026-01-28 20:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5e38ee64-bcbd-59a3-8791-d7d1c58e212f
2026-01-28 20:05:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08b2bf10>
2026-01-28 20:05:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ed46455-96fb-531a-8c68-e48daae72e3a/8ed46455-96fb-531a-8c68-e48daae72e3a_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Ff2%252Fabf219bf7cd89b5581a33fe893870cc8%252Fpa%252FYE02110_b8a3d988c14f85cc2016741b54ab296f.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/f2/abf219bf7cd89b5581a33fe893870cc8/pa/YE02110_b8a3d988c14f85cc2016741b54ab296f.jpg saved to cache
2026-01-28 20:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8ed46455-96fb-531a-8c68-e48daae72e3a
2026-01-28 20:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/6a/656a19187558a79bf41101eddfcd5ceb/pa/YG15382_d3eeee5e66d25cb67a9d1a100e5b3991.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/6a/656a19187558a79bf41101eddfcd5ceb/pa/YG15382_34c1ff8652e601c079955168d9e5b0e3.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08a0a1d0>
2026-01-28 20:05:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_352e36d3-8cf1-51d6-9eae-3613362bc3e4/352e36d3-8cf1-51d6-9eae-3613362bc3e4_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252Fe4%252Fa6e425f4947af594305d5000e9a05c30%252Fpa%252FUP17064_38aa8a3cb7409bfff6c0bfdc3177bf07.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/e4/a6e425f4947af594305d5000e9a05c30/pa/UP17064_38aa8a3cb7409bfff6c0bfdc3177bf07.jpg saved to cache
2026-01-28 20:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 352e36d3-8cf1-51d6-9eae-3613362bc3e4
2026-01-28 20:05:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08c78110>
2026-01-28 20:05:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47641bc6-87ee-5c7b-b578-bf967fb554f9/47641bc6-87ee-5c7b-b578-bf967fb554f9_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F6a%252F026a7fb3fb786a2a92e1dc0c289291c9%252Fpa%252FYX37505_747db23ee751a6e9e51204749fdcb380.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/6a/026a7fb3fb786a2a92e1dc0c289291c9/pa/YX37505_747db23ee751a6e9e51204749fdcb380.jpg saved to cache
2026-01-28 20:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 47641bc6-87ee-5c7b-b578-bf967fb554f9
2026-01-28 20:05:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/ae/ceaec425c7106ce417963ef635dd8240/pa/UD73720_409b5a5276225566b200900d6722d164.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/e4/a6e425f4947af594305d5000e9a05c30/pa/UP17064_4c8dbb06c62efefff261ccf1f3193ae6.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/f2/abf219bf7cd89b5581a33fe893870cc8/pa/YE02110_f1130811d4ba4753c8e54738d97bb037.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09da1110>
2026-01-28 20:05:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:05:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ba1af05-9c36-5ac8-8700-2bf5d36384e8/6ba1af05-9c36-5ac8-8700-2bf5d36384e8_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F6a%252F656a19187558a79bf41101eddfcd5ceb%252Fpa%252FYG15382_d3eeee5e66d25cb67a9d1a100e5b3991.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/6a/656a19187558a79bf41101eddfcd5ceb/pa/YG15382_d3eeee5e66d25cb67a9d1a100e5b3991.jpg saved to cache
2026-01-28 20:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6ba1af05-9c36-5ac8-8700-2bf5d36384e8
2026-01-28 20:05:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:05:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08c18110>
2026-01-28 20:05:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:05:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ba1af05-9c36-5ac8-8700-2bf5d36384e8/6ba1af05-9c36-5ac8-8700-2bf5d36384e8_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F6a%252F656a19187558a79bf41101eddfcd5ceb%252Fpa%252FYG15382_34c1ff8652e601c079955168d9e5b0e3.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/6a/656a19187558a79bf41101eddfcd5ceb/pa/YG15382_34c1ff8652e601c079955168d9e5b0e3.jpg saved to cache
2026-01-28 20:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6ba1af05-9c36-5ac8-8700-2bf5d36384e8
2026-01-28 20:05:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/14/dc144b424d7312fa7623fc855e117e76/pa/UZ46554_ff4fba21f76ec4862408d52b455d4737.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/e4/a6e425f4947af594305d5000e9a05c30/pa/UP17064_64e7af4f2a8999bbacb5b321f13d0365.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/6a/026a7fb3fb786a2a92e1dc0c289291c9/pa/YX37505_8458917ba2f685b3efece060178b12bd.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/e4/a6e425f4947af594305d5000e9a05c30/pa/UP17064_d6b360b4e01c728432adec5e845474a7.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09ef1790>
2026-01-28 20:05:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:05:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e38ee64-bcbd-59a3-8791-d7d1c58e212f/5e38ee64-bcbd-59a3-8791-d7d1c58e212f_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252Fae%252Fceaec425c7106ce417963ef635dd8240%252Fpa%252FUD73720_409b5a5276225566b200900d6722d164.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/ae/ceaec425c7106ce417963ef635dd8240/pa/UD73720_409b5a5276225566b200900d6722d164.jpg saved to cache
2026-01-28 20:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5e38ee64-bcbd-59a3-8791-d7d1c58e212f
2026-01-28 20:05:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:05:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b086e5f50>
2026-01-28 20:05:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:05:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_352e36d3-8cf1-51d6-9eae-3613362bc3e4/352e36d3-8cf1-51d6-9eae-3613362bc3e4_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252Fe4%252Fa6e425f4947af594305d5000e9a05c30%252Fpa%252FUP17064_4c8dbb06c62efefff261ccf1f3193ae6.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/e4/a6e425f4947af594305d5000e9a05c30/pa/UP17064_4c8dbb06c62efefff261ccf1f3193ae6.jpg saved to cache
2026-01-28 20:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 352e36d3-8cf1-51d6-9eae-3613362bc3e4
2026-01-28 20:05:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b088e2710>
2026-01-28 20:05:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:05:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ed46455-96fb-531a-8c68-e48daae72e3a/8ed46455-96fb-531a-8c68-e48daae72e3a_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Ff2%252Fabf219bf7cd89b5581a33fe893870cc8%252Fpa%252FYE02110_f1130811d4ba4753c8e54738d97bb037.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/f2/abf219bf7cd89b5581a33fe893870cc8/pa/YE02110_f1130811d4ba4753c8e54738d97bb037.jpg saved to cache
2026-01-28 20:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8ed46455-96fb-531a-8c68-e48daae72e3a
2026-01-28 20:05:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/14/dc144b424d7312fa7623fc855e117e76/pa/UZ46554_f2350bfd5c8c0e065fc7207632956861.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/e4/a6e425f4947af594305d5000e9a05c30/pa/UP17064_384cfc22f44dee025095c047fed9ea5c.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/ae/ceaec425c7106ce417963ef635dd8240/pa/UD73720_d346890b5c4ca321644520d16986fd84.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/6a/026a7fb3fb786a2a92e1dc0c289291c9/pa/YX37505_28dcc7fe0d1bc7831acd54ec3a1176a7.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:05:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09d13f90>
2026-01-28 20:05:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:05:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58076a85-30b9-5b3c-b271-24664f63fb14/58076a85-30b9-5b3c-b271-24664f63fb14_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F14%252Fdc144b424d7312fa7623fc855e117e76%252Fpa%252FUZ46554_ff4fba21f76ec4862408d52b455d4737.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/14/dc144b424d7312fa7623fc855e117e76/pa/UZ46554_ff4fba21f76ec4862408d52b455d4737.jpg saved to cache
2026-01-28 20:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 58076a85-30b9-5b3c-b271-24664f63fb14
2026-01-28 20:05:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b089b8810>
2026-01-28 20:05:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:05:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_352e36d3-8cf1-51d6-9eae-3613362bc3e4/352e36d3-8cf1-51d6-9eae-3613362bc3e4_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252Fe4%252Fa6e425f4947af594305d5000e9a05c30%252Fpa%252FUP17064_64e7af4f2a8999bbacb5b321f13d0365.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/e4/a6e425f4947af594305d5000e9a05c30/pa/UP17064_64e7af4f2a8999bbacb5b321f13d0365.jpg saved to cache
2026-01-28 20:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 352e36d3-8cf1-51d6-9eae-3613362bc3e4
2026-01-28 20:05:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0a07d150>
2026-01-28 20:05:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:05:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47641bc6-87ee-5c7b-b578-bf967fb554f9/47641bc6-87ee-5c7b-b578-bf967fb554f9_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F6a%252F026a7fb3fb786a2a92e1dc0c289291c9%252Fpa%252FYX37505_8458917ba2f685b3efece060178b12bd.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/6a/026a7fb3fb786a2a92e1dc0c289291c9/pa/YX37505_8458917ba2f685b3efece060178b12bd.jpg saved to cache
2026-01-28 20:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 47641bc6-87ee-5c7b-b578-bf967fb554f9
2026-01-28 20:05:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:05:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09d8c310>
2026-01-28 20:05:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:05:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_352e36d3-8cf1-51d6-9eae-3613362bc3e4/352e36d3-8cf1-51d6-9eae-3613362bc3e4_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252Fe4%252Fa6e425f4947af594305d5000e9a05c30%252Fpa%252FUP17064_d6b360b4e01c728432adec5e845474a7.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/e4/a6e425f4947af594305d5000e9a05c30/pa/UP17064_d6b360b4e01c728432adec5e845474a7.jpg saved to cache
2026-01-28 20:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 352e36d3-8cf1-51d6-9eae-3613362bc3e4
2026-01-28 20:05:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/ae/ceaec425c7106ce417963ef635dd8240/pa/UD73720_7d81424286745d22360f4465ef0c1470.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/6a/026a7fb3fb786a2a92e1dc0c289291c9/pa/YX37505_3aa8d503aa2ed101e104959147297d12.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:05:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:05:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0a07fa50>
2026-01-28 20:05:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58076a85-30b9-5b3c-b271-24664f63fb14/58076a85-30b9-5b3c-b271-24664f63fb14_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F14%252Fdc144b424d7312fa7623fc855e117e76%252Fpa%252FUZ46554_f2350bfd5c8c0e065fc7207632956861.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/14/dc144b424d7312fa7623fc855e117e76/pa/UZ46554_f2350bfd5c8c0e065fc7207632956861.jpg saved to cache
2026-01-28 20:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 58076a85-30b9-5b3c-b271-24664f63fb14
2026-01-28 20:05:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 58076a85-30b9-5b3c-b271-24664f63fb14, skipping ID generation
2026-01-28 20:05:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58076a85-30b9-5b3c-b271-24664f63fb14 with scrape type 1
2026-01-28 20:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 58076a85-30b9-5b3c-b271-24664f63fb14 from tracking dictionaries
2026-01-28 20:05:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 58076a85-30b9-5b3c-b271-24664f63fb14 sending to next pipeline
2026-01-28 20:05:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 58076a85-30b9-5b3c-b271-24664f63fb14, identifier: UZ46554
2026-01-28 20:05:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0c036850>
2026-01-28 20:05:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:05:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_352e36d3-8cf1-51d6-9eae-3613362bc3e4/352e36d3-8cf1-51d6-9eae-3613362bc3e4_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252Fe4%252Fa6e425f4947af594305d5000e9a05c30%252Fpa%252FUP17064_384cfc22f44dee025095c047fed9ea5c.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/e4/a6e425f4947af594305d5000e9a05c30/pa/UP17064_384cfc22f44dee025095c047fed9ea5c.jpg saved to cache
2026-01-28 20:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 352e36d3-8cf1-51d6-9eae-3613362bc3e4
2026-01-28 20:05:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08c28150>
2026-01-28 20:05:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:05:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e38ee64-bcbd-59a3-8791-d7d1c58e212f/5e38ee64-bcbd-59a3-8791-d7d1c58e212f_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252Fae%252Fceaec425c7106ce417963ef635dd8240%252Fpa%252FUD73720_d346890b5c4ca321644520d16986fd84.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/ae/ceaec425c7106ce417963ef635dd8240/pa/UD73720_d346890b5c4ca321644520d16986fd84.jpg saved to cache
2026-01-28 20:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5e38ee64-bcbd-59a3-8791-d7d1c58e212f
2026-01-28 20:05:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08c2aed0>
2026-01-28 20:05:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:05:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47641bc6-87ee-5c7b-b578-bf967fb554f9/47641bc6-87ee-5c7b-b578-bf967fb554f9_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F6a%252F026a7fb3fb786a2a92e1dc0c289291c9%252Fpa%252FYX37505_28dcc7fe0d1bc7831acd54ec3a1176a7.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/6a/026a7fb3fb786a2a92e1dc0c289291c9/pa/YX37505_28dcc7fe0d1bc7831acd54ec3a1176a7.jpg saved to cache
2026-01-28 20:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 47641bc6-87ee-5c7b-b578-bf967fb554f9
2026-01-28 20:05:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 58076a85-30b9-5b3c-b271-24664f63fb14 with identifier: UZ46554
2026-01-28 20:05:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 58076a85-30b9-5b3c-b271-24664f63fb14 with identifier: UZ46554
2026-01-28 20:05:42 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 181159 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    181159
2026-01-28 20:05:42 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 58076a85-30b9-5b3c-b271-24664f63fb14 spider: auto1.it
2026-01-28 20:05:42 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 58076a85-30b9-5b3c-b271-24664f63fb14 due to rule: high_mileage_for_country.json, error: 181159 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    181159
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:39:17Z',
 'fuel_type': 'diesel',
 'id': '58076a85-30b9-5b3c-b271-24664f63fb14',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UZ46554',
 'listing': 'auction',
 'location': 'IT, Catania',
 'make': 'Skoda',
 'model': 'Kodiaq',
 'odometer': 181159,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58076a85-30b9-5b3c-b271-24664f63fb14/58076a85-30b9-5b3c-b271-24664f63fb14_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2599205,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/14/dc144b424d7312fa7623fc855e117e76/pa/UZ46554_f2350bfd5c8c0e065fc7207632956861.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58076a85-30b9-5b3c-b271-24664f63fb14/58076a85-30b9-5b3c-b271-24664f63fb14_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2585815,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/14/dc144b424d7312fa7623fc855e117e76/pa/UZ46554_ff4fba21f76ec4862408d52b455d4737.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58076a85-30b9-5b3c-b271-24664f63fb14/58076a85-30b9-5b3c-b271-24664f63fb14_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2606918,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/14/dc144b424d7312fa7623fc855e117e76/pa/UZ46554_f58be382f38e45dbd5d41007ad71111f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58076a85-30b9-5b3c-b271-24664f63fb14/58076a85-30b9-5b3c-b271-24664f63fb14_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2574504,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/14/dc144b424d7312fa7623fc855e117e76/pa/UZ46554_2ee36005693e75f7b170d62dc91de480.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58076a85-30b9-5b3c-b271-24664f63fb14/58076a85-30b9-5b3c-b271-24664f63fb14_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2615248,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/14/dc144b424d7312fa7623fc855e117e76/pa/UZ46554_4d54f67e3def655fc78f876f618a3a2d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58076a85-30b9-5b3c-b271-24664f63fb14/58076a85-30b9-5b3c-b271-24664f63fb14_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2652542,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/14/dc144b424d7312fa7623fc855e117e76/pa/UZ46554_5ad90805b6d4883073934ad0313de975.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58076a85-30b9-5b3c-b271-24664f63fb14/58076a85-30b9-5b3c-b271-24664f63fb14_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58871,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/14/dc144b424d7312fa7623fc855e117e76/pa/UZ46554_4bf25b1e90f4cc6cfb2873bc3583b94d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58076a85-30b9-5b3c-b271-24664f63fb14/58076a85-30b9-5b3c-b271-24664f63fb14_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2745393,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/14/dc144b424d7312fa7623fc855e117e76/pa/UZ46554_858530a047aff355f4084b1f1c130928.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58076a85-30b9-5b3c-b271-24664f63fb14/58076a85-30b9-5b3c-b271-24664f63fb14_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79670,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/14/dc144b424d7312fa7623fc855e117e76/pa/UZ46554_db8eee083770447322d2a356b8dacaa4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58076a85-30b9-5b3c-b271-24664f63fb14/58076a85-30b9-5b3c-b271-24664f63fb14_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79285,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/14/dc144b424d7312fa7623fc855e117e76/pa/UZ46554_0418032ef193a057d5816c9fc4833813.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58076a85-30b9-5b3c-b271-24664f63fb14/58076a85-30b9-5b3c-b271-24664f63fb14_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68626,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/14/dc144b424d7312fa7623fc855e117e76/pa/UZ46554_808545ed0a26b3afbe09245091d80401.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58076a85-30b9-5b3c-b271-24664f63fb14/58076a85-30b9-5b3c-b271-24664f63fb14_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81125,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/14/dc144b424d7312fa7623fc855e117e76/pa/UZ46554_fbf6bc4a863dd193f0a473fc552a0791.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58076a85-30b9-5b3c-b271-24664f63fb14/58076a85-30b9-5b3c-b271-24664f63fb14_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2448708,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/14/dc144b424d7312fa7623fc855e117e76/pa/UZ46554_4ab16910eccd5edb112c033aae4a87a5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58076a85-30b9-5b3c-b271-24664f63fb14/58076a85-30b9-5b3c-b271-24664f63fb14_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60571,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/14/dc144b424d7312fa7623fc855e117e76/pa/UZ46554_c004e0a396a93b380a006dbe60765dc6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58076a85-30b9-5b3c-b271-24664f63fb14/58076a85-30b9-5b3c-b271-24664f63fb14_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49151,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/14/dc144b424d7312fa7623fc855e117e76/pa/UZ46554_b56575fb94d46f48ac104977b7e269f7.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-03-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Kodiaq 2.0 TDI Executive 4x4',
 'transmission': 'automatic',
 'trim': 'Executive 4x4',
 'year': 2018}
2026-01-28 20:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UZ46554%27 HTTP/1.1" 200 None
2026-01-28 20:05:42 [auto1.it] INFO: Saving data for UZ46554: {'created_time': 1769630742.789104, 'last_price_update_time': 1769630742.789115, 'auction_closing_time': 1769704757.0}
2026-01-28 20:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UZ46554') HTTP/1.1" 204 0
2026-01-28 20:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/f2/abf219bf7cd89b5581a33fe893870cc8/pa/YE02110_3aa8bb2b5ca5adb82196452038c2ec2c.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/ae/ceaec425c7106ce417963ef635dd8240/pa/UD73720_9b3b12b974fb70b38fa870633dad44aa.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/e4/a6e425f4947af594305d5000e9a05c30/pa/UP17064_728896be30e6aa28e194e908fb1172d3.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:05:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:05:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b086fa7d0>
2026-01-28 20:05:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e38ee64-bcbd-59a3-8791-d7d1c58e212f/5e38ee64-bcbd-59a3-8791-d7d1c58e212f_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252Fae%252Fceaec425c7106ce417963ef635dd8240%252Fpa%252FUD73720_7d81424286745d22360f4465ef0c1470.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/ae/ceaec425c7106ce417963ef635dd8240/pa/UD73720_7d81424286745d22360f4465ef0c1470.jpg saved to cache
2026-01-28 20:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5e38ee64-bcbd-59a3-8791-d7d1c58e212f
2026-01-28 20:05:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09ef0d10>
2026-01-28 20:05:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:05:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47641bc6-87ee-5c7b-b578-bf967fb554f9/47641bc6-87ee-5c7b-b578-bf967fb554f9_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F6a%252F026a7fb3fb786a2a92e1dc0c289291c9%252Fpa%252FYX37505_3aa8d503aa2ed101e104959147297d12.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/6a/026a7fb3fb786a2a92e1dc0c289291c9/pa/YX37505_3aa8d503aa2ed101e104959147297d12.jpg saved to cache
2026-01-28 20:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 47641bc6-87ee-5c7b-b578-bf967fb554f9
2026-01-28 20:05:43 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 22 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-01-28 20:05:43 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 34 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-01-28 20:05:43 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-01-28 20:05:43 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-01-28 20:05:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-01-28 20:05:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09ef1b90>
2026-01-28 20:05:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ed46455-96fb-531a-8c68-e48daae72e3a/8ed46455-96fb-531a-8c68-e48daae72e3a_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Ff2%252Fabf219bf7cd89b5581a33fe893870cc8%252Fpa%252FYE02110_3aa8bb2b5ca5adb82196452038c2ec2c.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/f2/abf219bf7cd89b5581a33fe893870cc8/pa/YE02110_3aa8bb2b5ca5adb82196452038c2ec2c.jpg saved to cache
2026-01-28 20:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8ed46455-96fb-531a-8c68-e48daae72e3a
2026-01-28 20:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/e4/a6e425f4947af594305d5000e9a05c30/pa/UP17064_898d76f3f3a583d0a2aee1bde080e09f.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/6a/026a7fb3fb786a2a92e1dc0c289291c9/pa/YX37505_51440dda166027a42c2282331549be98.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/e4/a6e425f4947af594305d5000e9a05c30/pa/UP17064_48a28b2eac41d51029e38d0e35b4a95a.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/f2/abf219bf7cd89b5581a33fe893870cc8/pa/YE02110_3edc5046274e9eab7c42407a480a7c4e.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:05:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:05:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:05:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08732450>
2026-01-28 20:05:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:05:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e38ee64-bcbd-59a3-8791-d7d1c58e212f/5e38ee64-bcbd-59a3-8791-d7d1c58e212f_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252Fae%252Fceaec425c7106ce417963ef635dd8240%252Fpa%252FUD73720_9b3b12b974fb70b38fa870633dad44aa.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/ae/ceaec425c7106ce417963ef635dd8240/pa/UD73720_9b3b12b974fb70b38fa870633dad44aa.jpg saved to cache
2026-01-28 20:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5e38ee64-bcbd-59a3-8791-d7d1c58e212f
2026-01-28 20:05:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08951b90>
2026-01-28 20:05:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:05:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_352e36d3-8cf1-51d6-9eae-3613362bc3e4/352e36d3-8cf1-51d6-9eae-3613362bc3e4_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252Fe4%252Fa6e425f4947af594305d5000e9a05c30%252Fpa%252FUP17064_728896be30e6aa28e194e908fb1172d3.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/e4/a6e425f4947af594305d5000e9a05c30/pa/UP17064_728896be30e6aa28e194e908fb1172d3.jpg saved to cache
2026-01-28 20:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 352e36d3-8cf1-51d6-9eae-3613362bc3e4
2026-01-28 20:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/f2/abf219bf7cd89b5581a33fe893870cc8/pa/YE02110_806ec9cee76524ae0f693b18e0540310.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08bf2610>
2026-01-28 20:05:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_352e36d3-8cf1-51d6-9eae-3613362bc3e4/352e36d3-8cf1-51d6-9eae-3613362bc3e4_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252Fe4%252Fa6e425f4947af594305d5000e9a05c30%252Fpa%252FUP17064_898d76f3f3a583d0a2aee1bde080e09f.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/e4/a6e425f4947af594305d5000e9a05c30/pa/UP17064_898d76f3f3a583d0a2aee1bde080e09f.jpg saved to cache
2026-01-28 20:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 352e36d3-8cf1-51d6-9eae-3613362bc3e4
2026-01-28 20:05:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09e63710>
2026-01-28 20:05:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47641bc6-87ee-5c7b-b578-bf967fb554f9/47641bc6-87ee-5c7b-b578-bf967fb554f9_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F6a%252F026a7fb3fb786a2a92e1dc0c289291c9%252Fpa%252FYX37505_51440dda166027a42c2282331549be98.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/6a/026a7fb3fb786a2a92e1dc0c289291c9/pa/YX37505_51440dda166027a42c2282331549be98.jpg saved to cache
2026-01-28 20:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 47641bc6-87ee-5c7b-b578-bf967fb554f9
2026-01-28 20:05:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:05:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b089a04d0>
2026-01-28 20:05:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:05:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_352e36d3-8cf1-51d6-9eae-3613362bc3e4/352e36d3-8cf1-51d6-9eae-3613362bc3e4_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252Fe4%252Fa6e425f4947af594305d5000e9a05c30%252Fpa%252FUP17064_48a28b2eac41d51029e38d0e35b4a95a.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/e4/a6e425f4947af594305d5000e9a05c30/pa/UP17064_48a28b2eac41d51029e38d0e35b4a95a.jpg saved to cache
2026-01-28 20:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 352e36d3-8cf1-51d6-9eae-3613362bc3e4
2026-01-28 20:05:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b088e2e50>
2026-01-28 20:05:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ed46455-96fb-531a-8c68-e48daae72e3a/8ed46455-96fb-531a-8c68-e48daae72e3a_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Ff2%252Fabf219bf7cd89b5581a33fe893870cc8%252Fpa%252FYE02110_3edc5046274e9eab7c42407a480a7c4e.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/f2/abf219bf7cd89b5581a33fe893870cc8/pa/YE02110_3edc5046274e9eab7c42407a480a7c4e.jpg saved to cache
2026-01-28 20:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8ed46455-96fb-531a-8c68-e48daae72e3a
2026-01-28 20:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/ae/ceaec425c7106ce417963ef635dd8240/pa/UD73720_e6c83456610b25219d5011aa15843819.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/e4/a6e425f4947af594305d5000e9a05c30/pa/UP17064_de9fe6afadbf914a08b0e625150fbc6b.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/6a/026a7fb3fb786a2a92e1dc0c289291c9/pa/YX37505_3a01401f70fea0200a04398e4d729b88.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VS47380/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BE15819/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JW94842> (referer: https://www.auto1.com/v1/car-details-view/JW94842/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XR19887> (referer: https://www.auto1.com/v1/car-details-view/XR19887/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:05:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:05:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:05:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08cf7350>
2026-01-28 20:05:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ed46455-96fb-531a-8c68-e48daae72e3a/8ed46455-96fb-531a-8c68-e48daae72e3a_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Ff2%252Fabf219bf7cd89b5581a33fe893870cc8%252Fpa%252FYE02110_806ec9cee76524ae0f693b18e0540310.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/f2/abf219bf7cd89b5581a33fe893870cc8/pa/YE02110_806ec9cee76524ae0f693b18e0540310.jpg saved to cache
2026-01-28 20:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8ed46455-96fb-531a-8c68-e48daae72e3a
2026-01-28 20:05:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8ed46455-96fb-531a-8c68-e48daae72e3a, skipping ID generation
2026-01-28 20:05:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ed46455-96fb-531a-8c68-e48daae72e3a with scrape type 1
2026-01-28 20:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 8ed46455-96fb-531a-8c68-e48daae72e3a from tracking dictionaries
2026-01-28 20:05:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8ed46455-96fb-531a-8c68-e48daae72e3a sending to next pipeline
2026-01-28 20:05:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8ed46455-96fb-531a-8c68-e48daae72e3a, identifier: YE02110
2026-01-28 20:05:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8ed46455-96fb-531a-8c68-e48daae72e3a with identifier: YE02110
2026-01-28 20:05:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8ed46455-96fb-531a-8c68-e48daae72e3a with identifier: YE02110
2026-01-28 20:05:46 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'opel' containing 'opel' and model 'vivaro' containing 'vivaro'
2026-01-28 20:05:46 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 8ed46455-96fb-531a-8c68-e48daae72e3a spider: auto1.it
2026-01-28 20:05:46 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 8ed46455-96fb-531a-8c68-e48daae72e3a due to rule: makes_models_not_allowed.json, error: Rejected due to make 'opel' containing 'opel' and model 'vivaro' containing 'vivaro'
{'auction_title': '',
 'c_o_2_emission_value': 174,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 102,
 'expiration_date': '2026-01-29T16:10:47Z',
 'fuel_type': 'diesel',
 'id': '8ed46455-96fb-531a-8c68-e48daae72e3a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YE02110',
 'listing': 'auction',
 'location': 'IT',
 'make': 'Opel',
 'model': 'Vivaro',
 'odometer': 195732,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ed46455-96fb-531a-8c68-e48daae72e3a/8ed46455-96fb-531a-8c68-e48daae72e3a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110778,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/f2/abf219bf7cd89b5581a33fe893870cc8/pa/YE02110_3edc5046274e9eab7c42407a480a7c4e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ed46455-96fb-531a-8c68-e48daae72e3a/8ed46455-96fb-531a-8c68-e48daae72e3a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 639727,
             'Height': 1200,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/f2/abf219bf7cd89b5581a33fe893870cc8/pa/YE02110_806ec9cee76524ae0f693b18e0540310.jpg',
             'Width': 1600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ed46455-96fb-531a-8c68-e48daae72e3a/8ed46455-96fb-531a-8c68-e48daae72e3a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 295696,
             'Height': 1200,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/f2/abf219bf7cd89b5581a33fe893870cc8/pa/YE02110_3aa8bb2b5ca5adb82196452038c2ec2c.jpg',
             'Width': 1600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ed46455-96fb-531a-8c68-e48daae72e3a/8ed46455-96fb-531a-8c68-e48daae72e3a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 482228,
             'Height': 1200,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/f2/abf219bf7cd89b5581a33fe893870cc8/pa/YE02110_e19097f5f1127bba679ad43a9fb1b4d0.jpg',
             'Width': 1600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ed46455-96fb-531a-8c68-e48daae72e3a/8ed46455-96fb-531a-8c68-e48daae72e3a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96033,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/f2/abf219bf7cd89b5581a33fe893870cc8/pa/YE02110_f1130811d4ba4753c8e54738d97bb037.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ed46455-96fb-531a-8c68-e48daae72e3a/8ed46455-96fb-531a-8c68-e48daae72e3a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 116559,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/f2/abf219bf7cd89b5581a33fe893870cc8/pa/YE02110_b8a3d988c14f85cc2016741b54ab296f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ed46455-96fb-531a-8c68-e48daae72e3a/8ed46455-96fb-531a-8c68-e48daae72e3a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112259,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/f2/abf219bf7cd89b5581a33fe893870cc8/pa/YE02110_b0f95c201f6b26f09e2d380a699180cf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ed46455-96fb-531a-8c68-e48daae72e3a/8ed46455-96fb-531a-8c68-e48daae72e3a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 261311,
             'Height': 1200,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/f2/abf219bf7cd89b5581a33fe893870cc8/pa/YE02110_a2d6c3d3294880b5b2e417883912354c.jpg',
             'Width': 1600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ed46455-96fb-531a-8c68-e48daae72e3a/8ed46455-96fb-531a-8c68-e48daae72e3a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 257472,
             'Height': 1200,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/f2/abf219bf7cd89b5581a33fe893870cc8/pa/YE02110_f591cbee3676eeebe0f1dbd21223befd.jpg',
             'Width': 1600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ed46455-96fb-531a-8c68-e48daae72e3a/8ed46455-96fb-531a-8c68-e48daae72e3a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 239426,
             'Height': 1200,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/f2/abf219bf7cd89b5581a33fe893870cc8/pa/YE02110_1fb8ad44dd96de23a175b475ae1f3743.jpg',
             'Width': 1600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ed46455-96fb-531a-8c68-e48daae72e3a/8ed46455-96fb-531a-8c68-e48daae72e3a_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81595,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/f2/abf219bf7cd89b5581a33fe893870cc8/pa/YE02110_7bfb1d85a15ffa0ed545fd0d2d13b5b2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ed46455-96fb-531a-8c68-e48daae72e3a/8ed46455-96fb-531a-8c68-e48daae72e3a_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84853,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/f2/abf219bf7cd89b5581a33fe893870cc8/pa/YE02110_94e1afa61b765c2f77aeb8ea826d1daa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ed46455-96fb-531a-8c68-e48daae72e3a/8ed46455-96fb-531a-8c68-e48daae72e3a_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 216240,
             'Height': 1200,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/f2/abf219bf7cd89b5581a33fe893870cc8/pa/YE02110_a31d14b638a61115773301259dc3a26e.jpg',
             'Width': 1600}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-01-20',
 'seats_number': 9,
 'seller_name': None,
 'title': 'Opel Vivaro 1.5 CDTI M L2',
 'transmission': 'manual',
 'trim': 'M L2',
 'year': 2020}
2026-01-28 20:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YE02110%27 HTTP/1.1" 200 None
2026-01-28 20:05:46 [auto1.it] INFO: Saving data for YE02110: {'created_time': 1769630746.255199, 'last_price_update_time': 1769630746.255212, 'auction_closing_time': 1769703047.0}
2026-01-28 20:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YE02110') HTTP/1.1" 204 0
2026-01-28 20:05:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/05/ed0515a90d6efed767e4defc5c867fde/pa/UH29837_746d90a28f42e3b455fe04e859982adc.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09d8ce50>
2026-01-28 20:05:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e38ee64-bcbd-59a3-8791-d7d1c58e212f/5e38ee64-bcbd-59a3-8791-d7d1c58e212f_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252Fae%252Fceaec425c7106ce417963ef635dd8240%252Fpa%252FUD73720_e6c83456610b25219d5011aa15843819.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/ae/ceaec425c7106ce417963ef635dd8240/pa/UD73720_e6c83456610b25219d5011aa15843819.jpg saved to cache
2026-01-28 20:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5e38ee64-bcbd-59a3-8791-d7d1c58e212f
2026-01-28 20:05:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5e38ee64-bcbd-59a3-8791-d7d1c58e212f, skipping ID generation
2026-01-28 20:05:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e38ee64-bcbd-59a3-8791-d7d1c58e212f with scrape type 1
2026-01-28 20:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 5e38ee64-bcbd-59a3-8791-d7d1c58e212f from tracking dictionaries
2026-01-28 20:05:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5e38ee64-bcbd-59a3-8791-d7d1c58e212f sending to next pipeline
2026-01-28 20:05:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5e38ee64-bcbd-59a3-8791-d7d1c58e212f, identifier: UD73720
2026-01-28 20:05:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09e35450>
2026-01-28 20:05:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:05:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_352e36d3-8cf1-51d6-9eae-3613362bc3e4/352e36d3-8cf1-51d6-9eae-3613362bc3e4_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252Fe4%252Fa6e425f4947af594305d5000e9a05c30%252Fpa%252FUP17064_de9fe6afadbf914a08b0e625150fbc6b.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/e4/a6e425f4947af594305d5000e9a05c30/pa/UP17064_de9fe6afadbf914a08b0e625150fbc6b.jpg saved to cache
2026-01-28 20:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 352e36d3-8cf1-51d6-9eae-3613362bc3e4
2026-01-28 20:05:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09d9cb10>
2026-01-28 20:05:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47641bc6-87ee-5c7b-b578-bf967fb554f9/47641bc6-87ee-5c7b-b578-bf967fb554f9_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F6a%252F026a7fb3fb786a2a92e1dc0c289291c9%252Fpa%252FYX37505_3a01401f70fea0200a04398e4d729b88.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/6a/026a7fb3fb786a2a92e1dc0c289291c9/pa/YX37505_3a01401f70fea0200a04398e4d729b88.jpg saved to cache
2026-01-28 20:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 47641bc6-87ee-5c7b-b578-bf967fb554f9
2026-01-28 20:05:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 47641bc6-87ee-5c7b-b578-bf967fb554f9, skipping ID generation
2026-01-28 20:05:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47641bc6-87ee-5c7b-b578-bf967fb554f9 with scrape type 1
2026-01-28 20:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 47641bc6-87ee-5c7b-b578-bf967fb554f9 from tracking dictionaries
2026-01-28 20:05:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 47641bc6-87ee-5c7b-b578-bf967fb554f9 sending to next pipeline
2026-01-28 20:05:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 47641bc6-87ee-5c7b-b578-bf967fb554f9, identifier: YX37505
2026-01-28 20:05:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e242008f-6be1-5bd6-8f4a-9d89d0be7973 with identifier: JW94842
2026-01-28 20:05:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e242008f-6be1-5bd6-8f4a-9d89d0be7973 with scrape type 2
2026-01-28 20:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e242008f-6be1-5bd6-8f4a-9d89d0be7973 with scrape type 2
2026-01-28 20:05:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e242008f-6be1-5bd6-8f4a-9d89d0be7973, identifier: JW94842
2026-01-28 20:05:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 27016423-0db4-5467-9db7-f2fc89293910 with identifier: XR19887
2026-01-28 20:05:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27016423-0db4-5467-9db7-f2fc89293910 with scrape type 2
2026-01-28 20:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 27016423-0db4-5467-9db7-f2fc89293910 with scrape type 2
2026-01-28 20:05:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 27016423-0db4-5467-9db7-f2fc89293910, identifier: XR19887
2026-01-28 20:05:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5e38ee64-bcbd-59a3-8791-d7d1c58e212f with identifier: UD73720
2026-01-28 20:05:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5e38ee64-bcbd-59a3-8791-d7d1c58e212f with identifier: UD73720
2026-01-28 20:05:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5e38ee64-bcbd-59a3-8791-d7d1c58e212f with identifier: UD73720 to the API
2026-01-28 20:05:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:05:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:05:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgce/ae/ceaec425c7106ce417963ef635dd8240/pa/UD73720_e6c83456610b25219d5011aa15843819.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 179,
 'expiration_date': '2026-01-29T16:21:52Z',
 'fuel_type': 'petrol',
 'id': '5e38ee64-bcbd-59a3-8791-d7d1c58e212f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UD73720',
 'listing': 'auction',
 'location': 'IT, Pavia',
 'make': 'Mazda',
 'model': 'CX-30',
 'odometer': 126612,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e38ee64-bcbd-59a3-8791-d7d1c58e212f/5e38ee64-bcbd-59a3-8791-d7d1c58e212f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63400,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/ae/ceaec425c7106ce417963ef635dd8240/pa/UD73720_e6c83456610b25219d5011aa15843819.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e38ee64-bcbd-59a3-8791-d7d1c58e212f/5e38ee64-bcbd-59a3-8791-d7d1c58e212f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61817,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/ae/ceaec425c7106ce417963ef635dd8240/pa/UD73720_9b3b12b974fb70b38fa870633dad44aa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e38ee64-bcbd-59a3-8791-d7d1c58e212f/5e38ee64-bcbd-59a3-8791-d7d1c58e212f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68656,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/ae/ceaec425c7106ce417963ef635dd8240/pa/UD73720_7d81424286745d22360f4465ef0c1470.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e38ee64-bcbd-59a3-8791-d7d1c58e212f/5e38ee64-bcbd-59a3-8791-d7d1c58e212f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53042,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/ae/ceaec425c7106ce417963ef635dd8240/pa/UD73720_d346890b5c4ca321644520d16986fd84.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e38ee64-bcbd-59a3-8791-d7d1c58e212f/5e38ee64-bcbd-59a3-8791-d7d1c58e212f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63984,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/ae/ceaec425c7106ce417963ef635dd8240/pa/UD73720_409b5a5276225566b200900d6722d164.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e38ee64-bcbd-59a3-8791-d7d1c58e212f/5e38ee64-bcbd-59a3-8791-d7d1c58e212f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71335,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/ae/ceaec425c7106ce417963ef635dd8240/pa/UD73720_dd470b36f276d0f033cb3bb1c5321290.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e38ee64-bcbd-59a3-8791-d7d1c58e212f/5e38ee64-bcbd-59a3-8791-d7d1c58e212f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59380,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/ae/ceaec425c7106ce417963ef635dd8240/pa/UD73720_f28349facff6c8052a3b25c14c338bb8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e38ee64-bcbd-59a3-8791-d7d1c58e212f/5e38ee64-bcbd-59a3-8791-d7d1c58e212f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77561,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/ae/ceaec425c7106ce417963ef635dd8240/pa/UD73720_2f22d4f3e6353f8bcba88db4f27e84d1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e38ee64-bcbd-59a3-8791-d7d1c58e212f/5e38ee64-bcbd-59a3-8791-d7d1c58e212f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62456,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/ae/ceaec425c7106ce417963ef635dd8240/pa/UD73720_9eaa7328cc842cb5e38d8ad7858c8d1b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e38ee64-bcbd-59a3-8791-d7d1c58e212f/5e38ee64-bcbd-59a3-8791-d7d1c58e212f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56166,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/ae/ceaec425c7106ce417963ef635dd8240/pa/UD73720_5a7044615579736e1771750674824aaf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e38ee64-bcbd-59a3-8791-d7d1c58e212f/5e38ee64-bcbd-59a3-8791-d7d1c58e212f_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65901,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/ae/ceaec425c7106ce417963ef635dd8240/pa/UD73720_24d1ea428f17f9650cdfcb83227830ac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e38ee64-bcbd-59a3-8791-d7d1c58e212f/5e38ee64-bcbd-59a3-8791-d7d1c58e212f_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60836,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/ae/ceaec425c7106ce417963ef635dd8240/pa/UD73720_98f3dd0ef6fc5b0cfe64edd74b43ffbd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e38ee64-bcbd-59a3-8791-d7d1c58e212f/5e38ee64-bcbd-59a3-8791-d7d1c58e212f_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64998,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/ae/ceaec425c7106ce417963ef635dd8240/pa/UD73720_03eb7ab1bd5e93117fda90063cff132b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e38ee64-bcbd-59a3-8791-d7d1c58e212f/5e38ee64-bcbd-59a3-8791-d7d1c58e212f_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42499,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/ae/ceaec425c7106ce417963ef635dd8240/pa/UD73720_6429025b1abb14d29c13f0e9de47e63e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e38ee64-bcbd-59a3-8791-d7d1c58e212f/5e38ee64-bcbd-59a3-8791-d7d1c58e212f_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31206,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/ae/ceaec425c7106ce417963ef635dd8240/pa/UD73720_2c5439af85f60a962e6a1b5e26e3ca0a.jpg',
             'Width': 450}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-12-02',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Mazda CX-30 2.0 Mild-Hybrid Exclusive AWD',
 'transmission': 'manual',
 'trim': 'Exclusive AWD',
 'year': 2019}
2026-01-28 20:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UD73720%27 HTTP/1.1" 200 None
2026-01-28 20:05:47 [auto1.it] INFO: Saving data for UD73720: {'created_time': 1769630747.880122, 'last_price_update_time': 1769630747.880132, 'auction_closing_time': 1769703712.0}
2026-01-28 20:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UD73720') HTTP/1.1" 204 0
2026-01-28 20:05:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 47641bc6-87ee-5c7b-b578-bf967fb554f9 with identifier: YX37505
2026-01-28 20:05:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 47641bc6-87ee-5c7b-b578-bf967fb554f9 with identifier: YX37505
2026-01-28 20:05:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 47641bc6-87ee-5c7b-b578-bf967fb554f9 with identifier: YX37505 to the API
2026-01-28 20:05:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:05:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:05:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img02/6a/026a7fb3fb786a2a92e1dc0c289291c9/pa/YX37505_3a01401f70fea0200a04398e4d729b88.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:45:21Z',
 'fuel_type': 'diesel',
 'id': '47641bc6-87ee-5c7b-b578-bf967fb554f9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YX37505',
 'listing': 'auction',
 'location': 'IT, Napoli',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 52193,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47641bc6-87ee-5c7b-b578-bf967fb554f9/47641bc6-87ee-5c7b-b578-bf967fb554f9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79583,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/6a/026a7fb3fb786a2a92e1dc0c289291c9/pa/YX37505_3a01401f70fea0200a04398e4d729b88.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47641bc6-87ee-5c7b-b578-bf967fb554f9/47641bc6-87ee-5c7b-b578-bf967fb554f9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81240,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/6a/026a7fb3fb786a2a92e1dc0c289291c9/pa/YX37505_51440dda166027a42c2282331549be98.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47641bc6-87ee-5c7b-b578-bf967fb554f9/47641bc6-87ee-5c7b-b578-bf967fb554f9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76782,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/6a/026a7fb3fb786a2a92e1dc0c289291c9/pa/YX37505_3aa8d503aa2ed101e104959147297d12.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47641bc6-87ee-5c7b-b578-bf967fb554f9/47641bc6-87ee-5c7b-b578-bf967fb554f9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74034,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/6a/026a7fb3fb786a2a92e1dc0c289291c9/pa/YX37505_28dcc7fe0d1bc7831acd54ec3a1176a7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47641bc6-87ee-5c7b-b578-bf967fb554f9/47641bc6-87ee-5c7b-b578-bf967fb554f9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67803,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/6a/026a7fb3fb786a2a92e1dc0c289291c9/pa/YX37505_8458917ba2f685b3efece060178b12bd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47641bc6-87ee-5c7b-b578-bf967fb554f9/47641bc6-87ee-5c7b-b578-bf967fb554f9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74620,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/6a/026a7fb3fb786a2a92e1dc0c289291c9/pa/YX37505_747db23ee751a6e9e51204749fdcb380.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47641bc6-87ee-5c7b-b578-bf967fb554f9/47641bc6-87ee-5c7b-b578-bf967fb554f9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68326,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/6a/026a7fb3fb786a2a92e1dc0c289291c9/pa/YX37505_562d9f0d18a91a8d5d1a2b3d3cc72d41.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47641bc6-87ee-5c7b-b578-bf967fb554f9/47641bc6-87ee-5c7b-b578-bf967fb554f9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80463,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/6a/026a7fb3fb786a2a92e1dc0c289291c9/pa/YX37505_d2a39009533a1447027d536b94f5bc8e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47641bc6-87ee-5c7b-b578-bf967fb554f9/47641bc6-87ee-5c7b-b578-bf967fb554f9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79163,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/6a/026a7fb3fb786a2a92e1dc0c289291c9/pa/YX37505_47c3a3f61d1d29c80c43fc9094357bf0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47641bc6-87ee-5c7b-b578-bf967fb554f9/47641bc6-87ee-5c7b-b578-bf967fb554f9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66527,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/6a/026a7fb3fb786a2a92e1dc0c289291c9/pa/YX37505_0d36028b7486243f13ed40d05b5a93e7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47641bc6-87ee-5c7b-b578-bf967fb554f9/47641bc6-87ee-5c7b-b578-bf967fb554f9_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68321,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/6a/026a7fb3fb786a2a92e1dc0c289291c9/pa/YX37505_29476fcb52a4b8bed17d89b38e02511b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47641bc6-87ee-5c7b-b578-bf967fb554f9/47641bc6-87ee-5c7b-b578-bf967fb554f9_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59583,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/6a/026a7fb3fb786a2a92e1dc0c289291c9/pa/YX37505_5501874c4323db06dba35dc4088185d7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47641bc6-87ee-5c7b-b578-bf967fb554f9/47641bc6-87ee-5c7b-b578-bf967fb554f9_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3252432,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img02/6a/026a7fb3fb786a2a92e1dc0c289291c9/pa/YX37505_b54b91cd52a539eabc9dc0a566e7700d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47641bc6-87ee-5c7b-b578-bf967fb554f9/47641bc6-87ee-5c7b-b578-bf967fb554f9_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60366,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/6a/026a7fb3fb786a2a92e1dc0c289291c9/pa/YX37505_faa610ede2c643e9fdddf140934ac3d3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47641bc6-87ee-5c7b-b578-bf967fb554f9/47641bc6-87ee-5c7b-b578-bf967fb554f9_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93293,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/6a/026a7fb3fb786a2a92e1dc0c289291c9/pa/YX37505_7e3e9cfc81f0431f4f5122e3a06f415c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-01-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TDI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2022}
2026-01-28 20:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YX37505%27 HTTP/1.1" 200 None
2026-01-28 20:05:48 [auto1.it] INFO: Saving data for YX37505: {'created_time': 1769630748.284254, 'last_price_update_time': 1769630748.284264, 'auction_closing_time': 1769705121.0}
2026-01-28 20:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YX37505') HTTP/1.1" 204 0
2026-01-28 20:05:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e242008f-6be1-5bd6-8f4a-9d89d0be7973 with identifier: JW94842
2026-01-28 20:05:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e242008f-6be1-5bd6-8f4a-9d89d0be7973 with identifier: JW94842
2026-01-28 20:05:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e242008f-6be1-5bd6-8f4a-9d89d0be7973 with identifier: JW94842 to the API
2026-01-28 20:05:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:05:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:05:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JW94842>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.6L',
 'engine_horse_power': 143,
 'expiration_date': '2026-01-29T16:02:02Z',
 'fuel_type': 'hybrid',
 'id': 'e242008f-6be1-5bd6-8f4a-9d89d0be7973',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JW94842',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 28704,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-06-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Captur 1.6 Hybrid E-Tech Techno',
 'transmission': 'automatic',
 'trim': 'Techno',
 'year': 2023}
2026-01-28 20:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JW94842%27 HTTP/1.1" 200 None
2026-01-28 20:05:48 [auto1.it] INFO: Saving data for JW94842: {'auction_closing_time': 1769702522.0, 'created_time': 1768385024.51915, 'last_price_update_time': 1769630748.684064}
2026-01-28 20:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='JW94842') HTTP/1.1" 204 0
2026-01-28 20:05:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 27016423-0db4-5467-9db7-f2fc89293910 with identifier: XR19887
2026-01-28 20:05:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 27016423-0db4-5467-9db7-f2fc89293910 with identifier: XR19887
2026-01-28 20:05:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 27016423-0db4-5467-9db7-f2fc89293910 with identifier: XR19887 to the API
2026-01-28 20:05:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:05:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:05:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XR19887>
{'auction_title': '',
 'c_o_2_emission_value': 176,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 300,
 'expiration_date': '2026-01-29T16:33:10Z',
 'fuel_type': 'petrol',
 'id': '27016423-0db4-5467-9db7-f2fc89293910',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XR19887',
 'listing': 'auction',
 'location': 'IT, Milano',
 'make': 'Audi',
 'model': 'SQ2',
 'odometer': 19947,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-08-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi SQ2 2.0 TFSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2023}
2026-01-28 20:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XR19887%27 HTTP/1.1" 200 None
2026-01-28 20:05:49 [auto1.it] INFO: Saving data for XR19887: {'auction_closing_time': 1769704390.0, 'created_time': 1765829150.437312, 'last_price_update_time': 1769630749.044842}
2026-01-28 20:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XR19887') HTTP/1.1" 204 0
2026-01-28 20:05:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/0b/2c0bb7ccc201057468358464a15bb096/pa/KX95898_9c5d2845c10c9c353e76abff916ed6d3.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:05:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/05/ed0515a90d6efed767e4defc5c867fde/pa/UH29837_e95760a474364e6c10ef3f142cbdccad.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:05:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GK81526> (referer: https://www.auto1.com/v1/car-details-view/GK81526/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:05:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TS20335/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:05:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:05:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/6a/656a19187558a79bf41101eddfcd5ceb/pa/YG15382_24a8fa3bc20d1c0f4ebd325173929816.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0a0eae50>
2026-01-28 20:05:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_587e2dac-1d94-5964-96a9-a84650f493b1/587e2dac-1d94-5964-96a9-a84650f493b1_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F05%252Fed0515a90d6efed767e4defc5c867fde%252Fpa%252FUH29837_746d90a28f42e3b455fe04e859982adc.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/05/ed0515a90d6efed767e4defc5c867fde/pa/UH29837_746d90a28f42e3b455fe04e859982adc.jpg saved to cache
2026-01-28 20:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 587e2dac-1d94-5964-96a9-a84650f493b1
2026-01-28 20:05:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/05/ed0515a90d6efed767e4defc5c867fde/pa/UH29837_15909f3e64080a68eac2adc1e6796c07.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b089c5dd0>
2026-01-28 20:05:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:05:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8f04c0b-f98d-50df-a365-6ef5b27ef7fc/d8f04c0b-f98d-50df-a365-6ef5b27ef7fc_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F0b%252F2c0bb7ccc201057468358464a15bb096%252Fpa%252FKX95898_9c5d2845c10c9c353e76abff916ed6d3.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/0b/2c0bb7ccc201057468358464a15bb096/pa/KX95898_9c5d2845c10c9c353e76abff916ed6d3.jpg saved to cache
2026-01-28 20:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item d8f04c0b-f98d-50df-a365-6ef5b27ef7fc
2026-01-28 20:05:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08952b10>
2026-01-28 20:05:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_587e2dac-1d94-5964-96a9-a84650f493b1/587e2dac-1d94-5964-96a9-a84650f493b1_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F05%252Fed0515a90d6efed767e4defc5c867fde%252Fpa%252FUH29837_e95760a474364e6c10ef3f142cbdccad.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/05/ed0515a90d6efed767e4defc5c867fde/pa/UH29837_e95760a474364e6c10ef3f142cbdccad.jpg saved to cache
2026-01-28 20:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 587e2dac-1d94-5964-96a9-a84650f493b1
2026-01-28 20:05:49 [auto1.it] INFO: Parsing search results for channel: 24h
2026-01-28 20:05:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f35a8808-c117-50e7-b108-48cfc0170134 with identifier: GK81526
2026-01-28 20:05:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f35a8808-c117-50e7-b108-48cfc0170134 with scrape type 2
2026-01-28 20:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f35a8808-c117-50e7-b108-48cfc0170134 with scrape type 2
2026-01-28 20:05:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f35a8808-c117-50e7-b108-48cfc0170134, identifier: GK81526
2026-01-28 20:05:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:05:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b089bbc10>
2026-01-28 20:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:05:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ba1af05-9c36-5ac8-8700-2bf5d36384e8/6ba1af05-9c36-5ac8-8700-2bf5d36384e8_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F6a%252F656a19187558a79bf41101eddfcd5ceb%252Fpa%252FYG15382_24a8fa3bc20d1c0f4ebd325173929816.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/6a/656a19187558a79bf41101eddfcd5ceb/pa/YG15382_24a8fa3bc20d1c0f4ebd325173929816.jpg saved to cache
2026-01-28 20:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6ba1af05-9c36-5ac8-8700-2bf5d36384e8
2026-01-28 20:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/1c/e21cfb98a73e65a314352c3a1ce5c145/pa/BM05081_56f9c15ea78a889aaec8b9d0d226f3c8.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f35a8808-c117-50e7-b108-48cfc0170134 with identifier: GK81526
2026-01-28 20:05:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f35a8808-c117-50e7-b108-48cfc0170134 with identifier: GK81526
2026-01-28 20:05:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f35a8808-c117-50e7-b108-48cfc0170134 with identifier: GK81526 to the API
2026-01-28 20:05:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:05:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:05:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GK81526>
{'auction_title': '',
 'c_o_2_emission_value': 162,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '2.0L',
 'engine_horse_power': 180,
 'expiration_date': '2026-01-29T16:01:40Z',
 'fuel_type': 'diesel',
 'id': 'f35a8808-c117-50e7-b108-48cfc0170134',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GK81526',
 'listing': 'auction',
 'location': 'IT, Milano',
 'make': 'Jaguar',
 'model': 'E-Pace',
 'odometer': 79119,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-06-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jaguar E-Pace D180 R-Dynamic HSE AWD',
 'transmission': 'automatic',
 'trim': 'R-Dynamic HSE AWD',
 'year': 2019}
2026-01-28 20:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GK81526%27 HTTP/1.1" 200 None
2026-01-28 20:05:50 [auto1.it] INFO: Saving data for GK81526: {'auction_closing_time': 1769702500.0, 'created_time': 1767349032.81118, 'last_price_update_time': 1769630750.710311}
2026-01-28 20:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GK81526') HTTP/1.1" 204 0
2026-01-28 20:05:50 [auto1.it] INFO: Found listing with ID: DL09487
2026-01-28 20:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DL09487%27 HTTP/1.1" 200 None
2026-01-28 20:05:50 [auto1.it] INFO: Scrape type for DL09487: 2
2026-01-28 20:05:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/6a/656a19187558a79bf41101eddfcd5ceb/pa/YG15382_308fe0e5812791767fa9bd7fddbbed70.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/0b/2c0bb7ccc201057468358464a15bb096/pa/KX95898_e27dcb0e34f9fa92bf4ae0097b35941f.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TC56605/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TP74360/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:05:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:05:50 [auto1.it] INFO: Found listing with ID: YF03043
2026-01-28 20:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YF03043%27 HTTP/1.1" 200 None
2026-01-28 20:05:50 [auto1.it] INFO: Scrape type for YF03043: 1
2026-01-28 20:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EC80373> (referer: https://www.auto1.com/v1/car-details-view/EC80373/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:05:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:05:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09d9b1d0>
2026-01-28 20:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:05:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_587e2dac-1d94-5964-96a9-a84650f493b1/587e2dac-1d94-5964-96a9-a84650f493b1_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F05%252Fed0515a90d6efed767e4defc5c867fde%252Fpa%252FUH29837_15909f3e64080a68eac2adc1e6796c07.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/05/ed0515a90d6efed767e4defc5c867fde/pa/UH29837_15909f3e64080a68eac2adc1e6796c07.jpg saved to cache
2026-01-28 20:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 587e2dac-1d94-5964-96a9-a84650f493b1
2026-01-28 20:05:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0871ccd0>
2026-01-28 20:05:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:05:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_952ac053-e29b-5def-9dce-861a2bf03e69/952ac053-e29b-5def-9dce-861a2bf03e69_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F1c%252Fe21cfb98a73e65a314352c3a1ce5c145%252Fpa%252FBM05081_56f9c15ea78a889aaec8b9d0d226f3c8.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/1c/e21cfb98a73e65a314352c3a1ce5c145/pa/BM05081_56f9c15ea78a889aaec8b9d0d226f3c8.jpg saved to cache
2026-01-28 20:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 952ac053-e29b-5def-9dce-861a2bf03e69
2026-01-28 20:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/1c/e21cfb98a73e65a314352c3a1ce5c145/pa/BM05081_1afa7bc2808a2d4410faefd424b5ef67.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:51 [auto1.it] INFO: Found listing with ID: FC65085
2026-01-28 20:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FC65085%27 HTTP/1.1" 200 None
2026-01-28 20:05:51 [auto1.it] INFO: Scrape type for FC65085: 2
2026-01-28 20:05:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/0b/2c0bb7ccc201057468358464a15bb096/pa/KX95898_e7f8313fdbcee20d116121faba963a48.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/05/ed0515a90d6efed767e4defc5c867fde/pa/UH29837_1eae31bbb273cbddc33513ec25c751df.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:51 [auto1.it] INFO: Found listing with ID: EF46876
2026-01-28 20:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EF46876%27 HTTP/1.1" 200 None
2026-01-28 20:05:51 [auto1.it] INFO: Scrape type for EF46876: 1
2026-01-28 20:05:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:05:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:05:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08701590>
2026-01-28 20:05:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:05:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ba1af05-9c36-5ac8-8700-2bf5d36384e8/6ba1af05-9c36-5ac8-8700-2bf5d36384e8_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F6a%252F656a19187558a79bf41101eddfcd5ceb%252Fpa%252FYG15382_308fe0e5812791767fa9bd7fddbbed70.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/6a/656a19187558a79bf41101eddfcd5ceb/pa/YG15382_308fe0e5812791767fa9bd7fddbbed70.jpg saved to cache
2026-01-28 20:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6ba1af05-9c36-5ac8-8700-2bf5d36384e8
2026-01-28 20:05:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09d13810>
2026-01-28 20:05:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:05:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8f04c0b-f98d-50df-a365-6ef5b27ef7fc/d8f04c0b-f98d-50df-a365-6ef5b27ef7fc_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F0b%252F2c0bb7ccc201057468358464a15bb096%252Fpa%252FKX95898_e27dcb0e34f9fa92bf4ae0097b35941f.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/0b/2c0bb7ccc201057468358464a15bb096/pa/KX95898_e27dcb0e34f9fa92bf4ae0097b35941f.jpg saved to cache
2026-01-28 20:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d8f04c0b-f98d-50df-a365-6ef5b27ef7fc
2026-01-28 20:05:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 660db4ec-1851-533d-88e7-57fa64aadcd4 with identifier: EC80373
2026-01-28 20:05:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 660db4ec-1851-533d-88e7-57fa64aadcd4 with scrape type 1
2026-01-28 20:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 660db4ec-1851-533d-88e7-57fa64aadcd4
2026-01-28 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252Fa2%252F10a205abade4d20dd3170720748957ad%252Fpa%252FEC80373_c08b026d03a2d5e97ff464e2b36d2ed3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/a2/10a205abade4d20dd3170720748957ad/pa/EC80373_c08b026d03a2d5e97ff464e2b36d2ed3.jpg already downloaded
2026-01-28 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252Fa2%252F10a205abade4d20dd3170720748957ad%252Fpa%252FEC80373_e3052b4d7a8abcff7cd8ca876675ce7d.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/a2/10a205abade4d20dd3170720748957ad/pa/EC80373_e3052b4d7a8abcff7cd8ca876675ce7d.jpg already downloaded
2026-01-28 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252Fa2%252F10a205abade4d20dd3170720748957ad%252Fpa%252FEC80373_8580ef72172c14d12b0e7ee27d0bf458.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/a2/10a205abade4d20dd3170720748957ad/pa/EC80373_8580ef72172c14d12b0e7ee27d0bf458.jpg already downloaded
2026-01-28 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252Fa2%252F10a205abade4d20dd3170720748957ad%252Fpa%252FEC80373_2fcfb705ee650ddbb590778f2986a707.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/a2/10a205abade4d20dd3170720748957ad/pa/EC80373_2fcfb705ee650ddbb590778f2986a707.jpg already downloaded
2026-01-28 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252Fa2%252F10a205abade4d20dd3170720748957ad%252Fpa%252FEC80373_9c34f1b6c6aeae42411b5b9b16c1459b.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/a2/10a205abade4d20dd3170720748957ad/pa/EC80373_9c34f1b6c6aeae42411b5b9b16c1459b.jpg already downloaded
2026-01-28 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252Fa2%252F10a205abade4d20dd3170720748957ad%252Fpa%252FEC80373_243c433ba15ae82d43242771fc23e478.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/a2/10a205abade4d20dd3170720748957ad/pa/EC80373_243c433ba15ae82d43242771fc23e478.jpg already downloaded
2026-01-28 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252Fa2%252F10a205abade4d20dd3170720748957ad%252Fpa%252FEC80373_b5c72701b445339bfcd5d8a60160a4b9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/a2/10a205abade4d20dd3170720748957ad/pa/EC80373_b5c72701b445339bfcd5d8a60160a4b9.jpg already downloaded
2026-01-28 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252Fa2%252F10a205abade4d20dd3170720748957ad%252Fpa%252FEC80373_0b22b0454bf0e78b34543d03af2cb004.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/a2/10a205abade4d20dd3170720748957ad/pa/EC80373_0b22b0454bf0e78b34543d03af2cb004.jpg already downloaded
2026-01-28 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252Fa2%252F10a205abade4d20dd3170720748957ad%252Fpa%252FEC80373_2cf9d31699bf63dc5efc6216340781ad.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/a2/10a205abade4d20dd3170720748957ad/pa/EC80373_2cf9d31699bf63dc5efc6216340781ad.jpg already downloaded
2026-01-28 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252Fa2%252F10a205abade4d20dd3170720748957ad%252Fpa%252FEC80373_c48e715aeed9c82da36ce7a8f29b3780.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/a2/10a205abade4d20dd3170720748957ad/pa/EC80373_c48e715aeed9c82da36ce7a8f29b3780.jpg already downloaded
2026-01-28 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252Fa2%252F10a205abade4d20dd3170720748957ad%252Fpa%252FEC80373_5151695238c118f9fa5c71fee165861c.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/a2/10a205abade4d20dd3170720748957ad/pa/EC80373_5151695238c118f9fa5c71fee165861c.jpg already downloaded
2026-01-28 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252Fa2%252F10a205abade4d20dd3170720748957ad%252Fpa%252FEC80373_b8b7da3ab5879c3e3d69424b6ddd8994.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/a2/10a205abade4d20dd3170720748957ad/pa/EC80373_b8b7da3ab5879c3e3d69424b6ddd8994.jpg already downloaded
2026-01-28 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252Fa2%252F10a205abade4d20dd3170720748957ad%252Fpa%252FEC80373_224e70f3d01edb6b00ed3eba8992192e.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/a2/10a205abade4d20dd3170720748957ad/pa/EC80373_224e70f3d01edb6b00ed3eba8992192e.jpg already downloaded
2026-01-28 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252Fa2%252F10a205abade4d20dd3170720748957ad%252Fpa%252FEC80373_48e0be87f968a61e2b69243b96c5a850.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/a2/10a205abade4d20dd3170720748957ad/pa/EC80373_48e0be87f968a61e2b69243b96c5a850.jpg already downloaded
2026-01-28 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252Fa2%252F10a205abade4d20dd3170720748957ad%252Fpa%252FEC80373_e7a6be3ef052fa9cabfff464b89a4f7f.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/a2/10a205abade4d20dd3170720748957ad/pa/EC80373_e7a6be3ef052fa9cabfff464b89a4f7f.jpg already downloaded
2026-01-28 20:05:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 660db4ec-1851-533d-88e7-57fa64aadcd4, identifier: EC80373
2026-01-28 20:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/6a/656a19187558a79bf41101eddfcd5ceb/pa/YG15382_0ad8db538f381a6b91a62babd991dac5.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 660db4ec-1851-533d-88e7-57fa64aadcd4 with identifier: EC80373
2026-01-28 20:05:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 660db4ec-1851-533d-88e7-57fa64aadcd4 with identifier: EC80373
2026-01-28 20:05:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 660db4ec-1851-533d-88e7-57fa64aadcd4 with identifier: EC80373 to the API
2026-01-28 20:05:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:05:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:05:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EC80373>
{'auction_title': '',
 'c_o_2_emission_value': 172,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 306,
 'expiration_date': '2026-01-29T16:10:15Z',
 'fuel_type': 'petrol',
 'id': '660db4ec-1851-533d-88e7-57fa64aadcd4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EC80373',
 'listing': 'auction',
 'location': 'IT, Padova',
 'make': 'BMW',
 'model': '1er',
 'odometer': 26774,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img10/a2/10a205abade4d20dd3170720748957ad/pa/EC80373_c08b026d03a2d5e97ff464e2b36d2ed3.jpg',
                'https://img-pa.auto1.com/img10/a2/10a205abade4d20dd3170720748957ad/pa/EC80373_e3052b4d7a8abcff7cd8ca876675ce7d.jpg',
                'https://img-pa.auto1.com/img10/a2/10a205abade4d20dd3170720748957ad/pa/EC80373_8580ef72172c14d12b0e7ee27d0bf458.jpg',
                'https://img-pa.auto1.com/img10/a2/10a205abade4d20dd3170720748957ad/pa/EC80373_2fcfb705ee650ddbb590778f2986a707.jpg',
                'https://img-pa.auto1.com/img10/a2/10a205abade4d20dd3170720748957ad/pa/EC80373_9c34f1b6c6aeae42411b5b9b16c1459b.jpg',
                'https://img-pa.auto1.com/img10/a2/10a205abade4d20dd3170720748957ad/pa/EC80373_243c433ba15ae82d43242771fc23e478.jpg',
                'https://img-pa.auto1.com/img10/a2/10a205abade4d20dd3170720748957ad/pa/EC80373_b5c72701b445339bfcd5d8a60160a4b9.jpg',
                'https://img-pa.auto1.com/img10/a2/10a205abade4d20dd3170720748957ad/pa/EC80373_0b22b0454bf0e78b34543d03af2cb004.jpg',
                'https://img-pa.auto1.com/img10/a2/10a205abade4d20dd3170720748957ad/pa/EC80373_2cf9d31699bf63dc5efc6216340781ad.jpg',
                'https://img-pa.auto1.com/img10/a2/10a205abade4d20dd3170720748957ad/pa/EC80373_c48e715aeed9c82da36ce7a8f29b3780.jpg',
                'https://img-pa.auto1.com/img10/a2/10a205abade4d20dd3170720748957ad/pa/EC80373_5151695238c118f9fa5c71fee165861c.jpg',
                'https://img-pa.auto1.com/img10/a2/10a205abade4d20dd3170720748957ad/pa/EC80373_b8b7da3ab5879c3e3d69424b6ddd8994.jpg',
                'https://img-pa.auto1.com/img10/a2/10a205abade4d20dd3170720748957ad/pa/EC80373_224e70f3d01edb6b00ed3eba8992192e.jpg',
                'https://img-pa.auto1.com/img10/a2/10a205abade4d20dd3170720748957ad/pa/EC80373_48e0be87f968a61e2b69243b96c5a850.jpg',
                'https://img-pa.auto1.com/img10/a2/10a205abade4d20dd3170720748957ad/pa/EC80373_e7a6be3ef052fa9cabfff464b89a4f7f.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_660db4ec-1851-533d-88e7-57fa64aadcd4/660db4ec-1851-533d-88e7-57fa64aadcd4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70329,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/a2/10a205abade4d20dd3170720748957ad/pa/EC80373_c08b026d03a2d5e97ff464e2b36d2ed3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_660db4ec-1851-533d-88e7-57fa64aadcd4/660db4ec-1851-533d-88e7-57fa64aadcd4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64332,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/a2/10a205abade4d20dd3170720748957ad/pa/EC80373_e3052b4d7a8abcff7cd8ca876675ce7d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_660db4ec-1851-533d-88e7-57fa64aadcd4/660db4ec-1851-533d-88e7-57fa64aadcd4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2734410,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img10/a2/10a205abade4d20dd3170720748957ad/pa/EC80373_8580ef72172c14d12b0e7ee27d0bf458.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_660db4ec-1851-533d-88e7-57fa64aadcd4/660db4ec-1851-533d-88e7-57fa64aadcd4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2827370,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img10/a2/10a205abade4d20dd3170720748957ad/pa/EC80373_2fcfb705ee650ddbb590778f2986a707.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_660db4ec-1851-533d-88e7-57fa64aadcd4/660db4ec-1851-533d-88e7-57fa64aadcd4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2645531,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img10/a2/10a205abade4d20dd3170720748957ad/pa/EC80373_9c34f1b6c6aeae42411b5b9b16c1459b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_660db4ec-1851-533d-88e7-57fa64aadcd4/660db4ec-1851-533d-88e7-57fa64aadcd4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2836253,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img10/a2/10a205abade4d20dd3170720748957ad/pa/EC80373_243c433ba15ae82d43242771fc23e478.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_660db4ec-1851-533d-88e7-57fa64aadcd4/660db4ec-1851-533d-88e7-57fa64aadcd4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2962877,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img10/a2/10a205abade4d20dd3170720748957ad/pa/EC80373_b5c72701b445339bfcd5d8a60160a4b9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_660db4ec-1851-533d-88e7-57fa64aadcd4/660db4ec-1851-533d-88e7-57fa64aadcd4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69107,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/a2/10a205abade4d20dd3170720748957ad/pa/EC80373_0b22b0454bf0e78b34543d03af2cb004.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_660db4ec-1851-533d-88e7-57fa64aadcd4/660db4ec-1851-533d-88e7-57fa64aadcd4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2860544,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img10/a2/10a205abade4d20dd3170720748957ad/pa/EC80373_2cf9d31699bf63dc5efc6216340781ad.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_660db4ec-1851-533d-88e7-57fa64aadcd4/660db4ec-1851-533d-88e7-57fa64aadcd4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2953984,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img10/a2/10a205abade4d20dd3170720748957ad/pa/EC80373_c48e715aeed9c82da36ce7a8f29b3780.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_660db4ec-1851-533d-88e7-57fa64aadcd4/660db4ec-1851-533d-88e7-57fa64aadcd4_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62511,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/a2/10a205abade4d20dd3170720748957ad/pa/EC80373_5151695238c118f9fa5c71fee165861c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_660db4ec-1851-533d-88e7-57fa64aadcd4/660db4ec-1851-533d-88e7-57fa64aadcd4_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64793,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/a2/10a205abade4d20dd3170720748957ad/pa/EC80373_b8b7da3ab5879c3e3d69424b6ddd8994.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_660db4ec-1851-533d-88e7-57fa64aadcd4/660db4ec-1851-533d-88e7-57fa64aadcd4_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53968,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/a2/10a205abade4d20dd3170720748957ad/pa/EC80373_224e70f3d01edb6b00ed3eba8992192e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_660db4ec-1851-533d-88e7-57fa64aadcd4/660db4ec-1851-533d-88e7-57fa64aadcd4_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2700217,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img10/a2/10a205abade4d20dd3170720748957ad/pa/EC80373_48e0be87f968a61e2b69243b96c5a850.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_660db4ec-1851-533d-88e7-57fa64aadcd4/660db4ec-1851-533d-88e7-57fa64aadcd4_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80681,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/a2/10a205abade4d20dd3170720748957ad/pa/EC80373_e7a6be3ef052fa9cabfff464b89a4f7f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-04-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1er M135i xDrive Color Vision',
 'transmission': 'automatic',
 'trim': 'xDrive Color Vision',
 'year': 2023}
2026-01-28 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EC80373%27 HTTP/1.1" 200 None
2026-01-28 20:05:52 [auto1.it] INFO: Saving data for EC80373: {'created_time': 1769630752.783901, 'last_price_update_time': 1769630752.783915, 'auction_closing_time': 1769703015.0}
2026-01-28 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EC80373') HTTP/1.1" 204 0
2026-01-28 20:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/05/ed0515a90d6efed767e4defc5c867fde/pa/UH29837_defbe6bc4fb4c38991a2947c39a72aab.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:52 [auto1.it] INFO: Found listing with ID: BS31038
2026-01-28 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BS31038%27 HTTP/1.1" 200 None
2026-01-28 20:05:52 [auto1.it] INFO: Scrape type for BS31038: 2
2026-01-28 20:05:52 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 22 - Data Location: 110 - value: b'SONY\x00'
2026-01-28 20:05:52 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 34 - Data Location: 116 - value: b'ILCE-7M3\x00'
2026-01-28 20:05:52 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 126 - value: b',\x01\x00\x00\x01\x00\x00\x00'
2026-01-28 20:05:52 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 134 - value: b',\x01\x00\x00\x01\x00\x00\x00'
2026-01-28 20:05:52 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-01-28 20:05:52 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 82 - Data Location: 142 - value: <table: 42 bytes>
2026-01-28 20:05:52 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 94 - Data Location: 184 - value: b'2026:01:28 11:03:32\x00'
2026-01-28 20:05:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\xcc\x00\x00\x00'
2026-01-28 20:05:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b086da290>
2026-01-28 20:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:05:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_952ac053-e29b-5def-9dce-861a2bf03e69/952ac053-e29b-5def-9dce-861a2bf03e69_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F1c%252Fe21cfb98a73e65a314352c3a1ce5c145%252Fpa%252FBM05081_1afa7bc2808a2d4410faefd424b5ef67.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/1c/e21cfb98a73e65a314352c3a1ce5c145/pa/BM05081_1afa7bc2808a2d4410faefd424b5ef67.jpg saved to cache
2026-01-28 20:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 952ac053-e29b-5def-9dce-861a2bf03e69
2026-01-28 20:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VS47380> (referer: https://www.auto1.com/v1/car-details-view/VS47380/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BE15819> (referer: https://www.auto1.com/v1/car-details-view/BE15819/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:05:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/05/ed0515a90d6efed767e4defc5c867fde/pa/UH29837_8c3015c4691806b62fe433aec1339f6c.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:53 [auto1.it] INFO: Found listing with ID: FP59077
2026-01-28 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FP59077%27 HTTP/1.1" 200 None
2026-01-28 20:05:53 [auto1.it] INFO: Scrape type for FP59077: 2
2026-01-28 20:05:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:05:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:05:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09e63b10>
2026-01-28 20:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:05:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8f04c0b-f98d-50df-a365-6ef5b27ef7fc/d8f04c0b-f98d-50df-a365-6ef5b27ef7fc_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F0b%252F2c0bb7ccc201057468358464a15bb096%252Fpa%252FKX95898_e7f8313fdbcee20d116121faba963a48.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/0b/2c0bb7ccc201057468358464a15bb096/pa/KX95898_e7f8313fdbcee20d116121faba963a48.jpg saved to cache
2026-01-28 20:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d8f04c0b-f98d-50df-a365-6ef5b27ef7fc
2026-01-28 20:05:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09f0df90>
2026-01-28 20:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:05:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_587e2dac-1d94-5964-96a9-a84650f493b1/587e2dac-1d94-5964-96a9-a84650f493b1_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F05%252Fed0515a90d6efed767e4defc5c867fde%252Fpa%252FUH29837_1eae31bbb273cbddc33513ec25c751df.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/05/ed0515a90d6efed767e4defc5c867fde/pa/UH29837_1eae31bbb273cbddc33513ec25c751df.jpg saved to cache
2026-01-28 20:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 587e2dac-1d94-5964-96a9-a84650f493b1
2026-01-28 20:05:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:05:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09d375d0>
2026-01-28 20:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:05:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ba1af05-9c36-5ac8-8700-2bf5d36384e8/6ba1af05-9c36-5ac8-8700-2bf5d36384e8_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F6a%252F656a19187558a79bf41101eddfcd5ceb%252Fpa%252FYG15382_0ad8db538f381a6b91a62babd991dac5.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/6a/656a19187558a79bf41101eddfcd5ceb/pa/YG15382_0ad8db538f381a6b91a62babd991dac5.jpg saved to cache
2026-01-28 20:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6ba1af05-9c36-5ac8-8700-2bf5d36384e8
2026-01-28 20:05:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6ba1af05-9c36-5ac8-8700-2bf5d36384e8, skipping ID generation
2026-01-28 20:05:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ba1af05-9c36-5ac8-8700-2bf5d36384e8 with scrape type 1
2026-01-28 20:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 6ba1af05-9c36-5ac8-8700-2bf5d36384e8 from tracking dictionaries
2026-01-28 20:05:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6ba1af05-9c36-5ac8-8700-2bf5d36384e8 sending to next pipeline
2026-01-28 20:05:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6ba1af05-9c36-5ac8-8700-2bf5d36384e8, identifier: YG15382
2026-01-28 20:05:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0bef4f50>
2026-01-28 20:05:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:05:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_587e2dac-1d94-5964-96a9-a84650f493b1/587e2dac-1d94-5964-96a9-a84650f493b1_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F05%252Fed0515a90d6efed767e4defc5c867fde%252Fpa%252FUH29837_defbe6bc4fb4c38991a2947c39a72aab.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/05/ed0515a90d6efed767e4defc5c867fde/pa/UH29837_defbe6bc4fb4c38991a2947c39a72aab.jpg saved to cache
2026-01-28 20:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 587e2dac-1d94-5964-96a9-a84650f493b1
2026-01-28 20:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/1c/e21cfb98a73e65a314352c3a1ce5c145/pa/BM05081_5128151f31bb0cac1936d377a8cbfc19.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/0b/2c0bb7ccc201057468358464a15bb096/pa/KX95898_051b8a398b6a93e55f7e4112919efb41.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:54 [auto1.it] INFO: Found listing with ID: XV25208
2026-01-28 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XV25208%27 HTTP/1.1" 200 None
2026-01-28 20:05:54 [auto1.it] INFO: Scrape type for XV25208: 2
2026-01-28 20:05:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6ba1af05-9c36-5ac8-8700-2bf5d36384e8 with identifier: YG15382
2026-01-28 20:05:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6ba1af05-9c36-5ac8-8700-2bf5d36384e8 with identifier: YG15382
2026-01-28 20:05:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6ba1af05-9c36-5ac8-8700-2bf5d36384e8 with identifier: YG15382 to the API
2026-01-28 20:05:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:05:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:05:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img65/6a/656a19187558a79bf41101eddfcd5ceb/pa/YG15382_0ad8db538f381a6b91a62babd991dac5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 43,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 220,
 'expiration_date': '2026-01-29T16:40:37Z',
 'fuel_type': 'hybrid',
 'id': '6ba1af05-9c36-5ac8-8700-2bf5d36384e8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YG15382',
 'listing': 'auction',
 'location': 'IT, Salerno',
 'make': 'BMW',
 'model': 'X2',
 'odometer': 89684,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ba1af05-9c36-5ac8-8700-2bf5d36384e8/6ba1af05-9c36-5ac8-8700-2bf5d36384e8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2239776,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img65/6a/656a19187558a79bf41101eddfcd5ceb/pa/YG15382_0ad8db538f381a6b91a62babd991dac5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ba1af05-9c36-5ac8-8700-2bf5d36384e8/6ba1af05-9c36-5ac8-8700-2bf5d36384e8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2206600,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img65/6a/656a19187558a79bf41101eddfcd5ceb/pa/YG15382_308fe0e5812791767fa9bd7fddbbed70.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ba1af05-9c36-5ac8-8700-2bf5d36384e8/6ba1af05-9c36-5ac8-8700-2bf5d36384e8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2152741,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img65/6a/656a19187558a79bf41101eddfcd5ceb/pa/YG15382_24a8fa3bc20d1c0f4ebd325173929816.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ba1af05-9c36-5ac8-8700-2bf5d36384e8/6ba1af05-9c36-5ac8-8700-2bf5d36384e8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58381,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/6a/656a19187558a79bf41101eddfcd5ceb/pa/YG15382_d3eeee5e66d25cb67a9d1a100e5b3991.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ba1af05-9c36-5ac8-8700-2bf5d36384e8/6ba1af05-9c36-5ac8-8700-2bf5d36384e8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73334,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/6a/656a19187558a79bf41101eddfcd5ceb/pa/YG15382_7fa38e1d7d2b9c57cecaaf49d4a4b181.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ba1af05-9c36-5ac8-8700-2bf5d36384e8/6ba1af05-9c36-5ac8-8700-2bf5d36384e8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77753,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/6a/656a19187558a79bf41101eddfcd5ceb/pa/YG15382_106c8b2e7f2f56cf88963b4d0e0c9b31.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ba1af05-9c36-5ac8-8700-2bf5d36384e8/6ba1af05-9c36-5ac8-8700-2bf5d36384e8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2082132,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img65/6a/656a19187558a79bf41101eddfcd5ceb/pa/YG15382_34c1ff8652e601c079955168d9e5b0e3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ba1af05-9c36-5ac8-8700-2bf5d36384e8/6ba1af05-9c36-5ac8-8700-2bf5d36384e8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2169617,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img65/6a/656a19187558a79bf41101eddfcd5ceb/pa/YG15382_f9f642b3509ecf551626286137bb50d6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ba1af05-9c36-5ac8-8700-2bf5d36384e8/6ba1af05-9c36-5ac8-8700-2bf5d36384e8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2003324,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img65/6a/656a19187558a79bf41101eddfcd5ceb/pa/YG15382_70b3551bc5784fe1816c454a4030f350.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ba1af05-9c36-5ac8-8700-2bf5d36384e8/6ba1af05-9c36-5ac8-8700-2bf5d36384e8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85257,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/6a/656a19187558a79bf41101eddfcd5ceb/pa/YG15382_a76a2abdd92e2b011252958d307d7f80.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ba1af05-9c36-5ac8-8700-2bf5d36384e8/6ba1af05-9c36-5ac8-8700-2bf5d36384e8_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2386062,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img65/6a/656a19187558a79bf41101eddfcd5ceb/pa/YG15382_fc84da3d516115015f3c1477cccf7960.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ba1af05-9c36-5ac8-8700-2bf5d36384e8/6ba1af05-9c36-5ac8-8700-2bf5d36384e8_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2487687,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img65/6a/656a19187558a79bf41101eddfcd5ceb/pa/YG15382_ca00e2f40c0e7717b89b65d81371dece.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ba1af05-9c36-5ac8-8700-2bf5d36384e8/6ba1af05-9c36-5ac8-8700-2bf5d36384e8_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82391,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/6a/656a19187558a79bf41101eddfcd5ceb/pa/YG15382_dda43ebf79e41e450cc478d82439c685.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ba1af05-9c36-5ac8-8700-2bf5d36384e8/6ba1af05-9c36-5ac8-8700-2bf5d36384e8_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52735,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/6a/656a19187558a79bf41101eddfcd5ceb/pa/YG15382_9ba0a4b5403a4a0ec512cb1cdf3faea9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ba1af05-9c36-5ac8-8700-2bf5d36384e8/6ba1af05-9c36-5ac8-8700-2bf5d36384e8_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67966,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/6a/656a19187558a79bf41101eddfcd5ceb/pa/YG15382_51454687462cc1e6b3692291e1ba9972.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-09-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X2 xDrive 25e Advantage',
 'transmission': 'automatic',
 'trim': 'Advantage',
 'year': 2022}
2026-01-28 20:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YG15382%27 HTTP/1.1" 200 None
2026-01-28 20:05:55 [auto1.it] INFO: Saving data for YG15382: {'created_time': 1769630755.38171, 'last_price_update_time': 1769630755.381725, 'auction_closing_time': 1769704837.0}
2026-01-28 20:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YG15382') HTTP/1.1" 204 0
2026-01-28 20:05:55 [auto1.it] INFO: Found listing with ID: ZZ39223
2026-01-28 20:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZZ39223%27 HTTP/1.1" 200 None
2026-01-28 20:05:55 [auto1.it] INFO: Scrape type for ZZ39223: 1
2026-01-28 20:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DL09487/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TS20335> (referer: https://www.auto1.com/v1/car-details-view/TS20335/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:05:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 731dc6d8-5578-546b-b6d7-c35eaaefd334 with identifier: VS47380
2026-01-28 20:05:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 731dc6d8-5578-546b-b6d7-c35eaaefd334 with scrape type 1
2026-01-28 20:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 731dc6d8-5578-546b-b6d7-c35eaaefd334
2026-01-28 20:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F8f%252F428fdcda2f6010a1cb0535f4531fee7e%252Fpa%252FVS47380_20d0c254bc0d4d0c8305961c978e13aa.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/8f/428fdcda2f6010a1cb0535f4531fee7e/pa/VS47380_20d0c254bc0d4d0c8305961c978e13aa.jpg already downloaded
2026-01-28 20:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F8f%252F428fdcda2f6010a1cb0535f4531fee7e%252Fpa%252FVS47380_2fadc59e49506e5d5fe0ef0f4abe02db.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/8f/428fdcda2f6010a1cb0535f4531fee7e/pa/VS47380_2fadc59e49506e5d5fe0ef0f4abe02db.jpg already downloaded
2026-01-28 20:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F8f%252F428fdcda2f6010a1cb0535f4531fee7e%252Fpa%252FVS47380_ff8379808d815554ae2101f0dc04e05a.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/8f/428fdcda2f6010a1cb0535f4531fee7e/pa/VS47380_ff8379808d815554ae2101f0dc04e05a.jpg already downloaded
2026-01-28 20:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F8f%252F428fdcda2f6010a1cb0535f4531fee7e%252Fpa%252FVS47380_e78b847b46361748a4c3ef1aa40781ac.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/8f/428fdcda2f6010a1cb0535f4531fee7e/pa/VS47380_e78b847b46361748a4c3ef1aa40781ac.jpg already downloaded
2026-01-28 20:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F8f%252F428fdcda2f6010a1cb0535f4531fee7e%252Fpa%252FVS47380_e1c985e808471df7aa78193f167015e5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/8f/428fdcda2f6010a1cb0535f4531fee7e/pa/VS47380_e1c985e808471df7aa78193f167015e5.jpg already downloaded
2026-01-28 20:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F8f%252F428fdcda2f6010a1cb0535f4531fee7e%252Fpa%252FVS47380_2fd662aa4ae6b2a5dadd2641bb576b31.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/8f/428fdcda2f6010a1cb0535f4531fee7e/pa/VS47380_2fd662aa4ae6b2a5dadd2641bb576b31.jpg already downloaded
2026-01-28 20:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F8f%252F428fdcda2f6010a1cb0535f4531fee7e%252Fpa%252FVS47380_4f9273f04fe648bdbc761ecb8498f8b0.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/8f/428fdcda2f6010a1cb0535f4531fee7e/pa/VS47380_4f9273f04fe648bdbc761ecb8498f8b0.jpg already downloaded
2026-01-28 20:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F8f%252F428fdcda2f6010a1cb0535f4531fee7e%252Fpa%252FVS47380_c019e448472b63a35b38a0066a81dcc3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/8f/428fdcda2f6010a1cb0535f4531fee7e/pa/VS47380_c019e448472b63a35b38a0066a81dcc3.jpg already downloaded
2026-01-28 20:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F8f%252F428fdcda2f6010a1cb0535f4531fee7e%252Fpa%252FVS47380_597316b0d1a853f018c416ab6dfe96b5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/8f/428fdcda2f6010a1cb0535f4531fee7e/pa/VS47380_597316b0d1a853f018c416ab6dfe96b5.jpg already downloaded
2026-01-28 20:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F8f%252F428fdcda2f6010a1cb0535f4531fee7e%252Fpa%252FVS47380_f415aa2aefb364bdf35136bef6ce9247.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/8f/428fdcda2f6010a1cb0535f4531fee7e/pa/VS47380_f415aa2aefb364bdf35136bef6ce9247.jpg already downloaded
2026-01-28 20:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F8f%252F428fdcda2f6010a1cb0535f4531fee7e%252Fpa%252FVS47380_23c7af03e63b6e743883de83a0faa140.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/8f/428fdcda2f6010a1cb0535f4531fee7e/pa/VS47380_23c7af03e63b6e743883de83a0faa140.jpg already downloaded
2026-01-28 20:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F8f%252F428fdcda2f6010a1cb0535f4531fee7e%252Fpa%252FVS47380_40d7197614e407b8032fa013111fa54d.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/8f/428fdcda2f6010a1cb0535f4531fee7e/pa/VS47380_40d7197614e407b8032fa013111fa54d.jpg already downloaded
2026-01-28 20:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F8f%252F428fdcda2f6010a1cb0535f4531fee7e%252Fpa%252FVS47380_277010ce5997badbe481edfb2fcba5b5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/8f/428fdcda2f6010a1cb0535f4531fee7e/pa/VS47380_277010ce5997badbe481edfb2fcba5b5.jpg already downloaded
2026-01-28 20:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F8f%252F428fdcda2f6010a1cb0535f4531fee7e%252Fpa%252FVS47380_3a55f13a64d412eff74d447ac1cbc702.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/8f/428fdcda2f6010a1cb0535f4531fee7e/pa/VS47380_3a55f13a64d412eff74d447ac1cbc702.jpg already downloaded
2026-01-28 20:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F8f%252F428fdcda2f6010a1cb0535f4531fee7e%252Fpa%252FVS47380_288b70e4030c5b2c6260a3fb1750f321.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/8f/428fdcda2f6010a1cb0535f4531fee7e/pa/VS47380_288b70e4030c5b2c6260a3fb1750f321.jpg already downloaded
2026-01-28 20:05:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 731dc6d8-5578-546b-b6d7-c35eaaefd334, identifier: VS47380
2026-01-28 20:05:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a23c743d-1f5c-5ce1-98dd-2048bdcb6fb9 with identifier: BE15819
2026-01-28 20:05:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a23c743d-1f5c-5ce1-98dd-2048bdcb6fb9 with scrape type 1
2026-01-28 20:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item a23c743d-1f5c-5ce1-98dd-2048bdcb6fb9
2026-01-28 20:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252Fb4%252F4fb4ec31496439d2846b55a99cd2b5ae%252Fpa%252FBE15819_59eb8de837cbf319dec7c8a7ac0611a1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/b4/4fb4ec31496439d2846b55a99cd2b5ae/pa/BE15819_59eb8de837cbf319dec7c8a7ac0611a1.jpg not downloaded yet
2026-01-28 20:05:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08be6c10>
2026-01-28 20:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:05:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_587e2dac-1d94-5964-96a9-a84650f493b1/587e2dac-1d94-5964-96a9-a84650f493b1_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F05%252Fed0515a90d6efed767e4defc5c867fde%252Fpa%252FUH29837_8c3015c4691806b62fe433aec1339f6c.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/05/ed0515a90d6efed767e4defc5c867fde/pa/UH29837_8c3015c4691806b62fe433aec1339f6c.jpg saved to cache
2026-01-28 20:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 587e2dac-1d94-5964-96a9-a84650f493b1
2026-01-28 20:05:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:05:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:05:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:05:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 731dc6d8-5578-546b-b6d7-c35eaaefd334 with identifier: VS47380
2026-01-28 20:05:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 731dc6d8-5578-546b-b6d7-c35eaaefd334 with identifier: VS47380
2026-01-28 20:05:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 731dc6d8-5578-546b-b6d7-c35eaaefd334 with identifier: VS47380 to the API
2026-01-28 20:05:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:05:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:05:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VS47380>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:35:02Z',
 'fuel_type': 'petrol',
 'id': '731dc6d8-5578-546b-b6d7-c35eaaefd334',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VS47380',
 'listing': 'auction',
 'location': 'IT, Roma',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 35121,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img42/8f/428fdcda2f6010a1cb0535f4531fee7e/pa/VS47380_20d0c254bc0d4d0c8305961c978e13aa.jpg',
                'https://img-pa.auto1.com/img42/8f/428fdcda2f6010a1cb0535f4531fee7e/pa/VS47380_2fadc59e49506e5d5fe0ef0f4abe02db.jpg',
                'https://img-pa.auto1.com/img42/8f/428fdcda2f6010a1cb0535f4531fee7e/pa/VS47380_ff8379808d815554ae2101f0dc04e05a.jpg',
                'https://img-pa.auto1.com/img42/8f/428fdcda2f6010a1cb0535f4531fee7e/pa/VS47380_e78b847b46361748a4c3ef1aa40781ac.jpg',
                'https://img-pa.auto1.com/img42/8f/428fdcda2f6010a1cb0535f4531fee7e/pa/VS47380_e1c985e808471df7aa78193f167015e5.jpg',
                'https://img-pa.auto1.com/img42/8f/428fdcda2f6010a1cb0535f4531fee7e/pa/VS47380_2fd662aa4ae6b2a5dadd2641bb576b31.jpg',
                'https://img-pa.auto1.com/img42/8f/428fdcda2f6010a1cb0535f4531fee7e/pa/VS47380_4f9273f04fe648bdbc761ecb8498f8b0.jpg',
                'https://img-pa.auto1.com/img42/8f/428fdcda2f6010a1cb0535f4531fee7e/pa/VS47380_c019e448472b63a35b38a0066a81dcc3.jpg',
                'https://img-pa.auto1.com/img42/8f/428fdcda2f6010a1cb0535f4531fee7e/pa/VS47380_597316b0d1a853f018c416ab6dfe96b5.jpg',
                'https://img-pa.auto1.com/img42/8f/428fdcda2f6010a1cb0535f4531fee7e/pa/VS47380_f415aa2aefb364bdf35136bef6ce9247.jpg',
                'https://img-pa.auto1.com/img42/8f/428fdcda2f6010a1cb0535f4531fee7e/pa/VS47380_23c7af03e63b6e743883de83a0faa140.jpg',
                'https://img-pa.auto1.com/img42/8f/428fdcda2f6010a1cb0535f4531fee7e/pa/VS47380_40d7197614e407b8032fa013111fa54d.jpg',
                'https://img-pa.auto1.com/img42/8f/428fdcda2f6010a1cb0535f4531fee7e/pa/VS47380_277010ce5997badbe481edfb2fcba5b5.jpg',
                'https://img-pa.auto1.com/img42/8f/428fdcda2f6010a1cb0535f4531fee7e/pa/VS47380_3a55f13a64d412eff74d447ac1cbc702.jpg',
                'https://img-pa.auto1.com/img42/8f/428fdcda2f6010a1cb0535f4531fee7e/pa/VS47380_288b70e4030c5b2c6260a3fb1750f321.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_731dc6d8-5578-546b-b6d7-c35eaaefd334/731dc6d8-5578-546b-b6d7-c35eaaefd334_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75781,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/8f/428fdcda2f6010a1cb0535f4531fee7e/pa/VS47380_20d0c254bc0d4d0c8305961c978e13aa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_731dc6d8-5578-546b-b6d7-c35eaaefd334/731dc6d8-5578-546b-b6d7-c35eaaefd334_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66669,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/8f/428fdcda2f6010a1cb0535f4531fee7e/pa/VS47380_2fadc59e49506e5d5fe0ef0f4abe02db.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_731dc6d8-5578-546b-b6d7-c35eaaefd334/731dc6d8-5578-546b-b6d7-c35eaaefd334_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75165,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/8f/428fdcda2f6010a1cb0535f4531fee7e/pa/VS47380_ff8379808d815554ae2101f0dc04e05a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_731dc6d8-5578-546b-b6d7-c35eaaefd334/731dc6d8-5578-546b-b6d7-c35eaaefd334_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56746,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/8f/428fdcda2f6010a1cb0535f4531fee7e/pa/VS47380_e78b847b46361748a4c3ef1aa40781ac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_731dc6d8-5578-546b-b6d7-c35eaaefd334/731dc6d8-5578-546b-b6d7-c35eaaefd334_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75899,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/8f/428fdcda2f6010a1cb0535f4531fee7e/pa/VS47380_e1c985e808471df7aa78193f167015e5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_731dc6d8-5578-546b-b6d7-c35eaaefd334/731dc6d8-5578-546b-b6d7-c35eaaefd334_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64426,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/8f/428fdcda2f6010a1cb0535f4531fee7e/pa/VS47380_2fd662aa4ae6b2a5dadd2641bb576b31.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_731dc6d8-5578-546b-b6d7-c35eaaefd334/731dc6d8-5578-546b-b6d7-c35eaaefd334_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52252,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/8f/428fdcda2f6010a1cb0535f4531fee7e/pa/VS47380_4f9273f04fe648bdbc761ecb8498f8b0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_731dc6d8-5578-546b-b6d7-c35eaaefd334/731dc6d8-5578-546b-b6d7-c35eaaefd334_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62426,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/8f/428fdcda2f6010a1cb0535f4531fee7e/pa/VS47380_c019e448472b63a35b38a0066a81dcc3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_731dc6d8-5578-546b-b6d7-c35eaaefd334/731dc6d8-5578-546b-b6d7-c35eaaefd334_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76994,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/8f/428fdcda2f6010a1cb0535f4531fee7e/pa/VS47380_597316b0d1a853f018c416ab6dfe96b5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_731dc6d8-5578-546b-b6d7-c35eaaefd334/731dc6d8-5578-546b-b6d7-c35eaaefd334_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76753,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/8f/428fdcda2f6010a1cb0535f4531fee7e/pa/VS47380_f415aa2aefb364bdf35136bef6ce9247.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_731dc6d8-5578-546b-b6d7-c35eaaefd334/731dc6d8-5578-546b-b6d7-c35eaaefd334_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2498718,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img42/8f/428fdcda2f6010a1cb0535f4531fee7e/pa/VS47380_23c7af03e63b6e743883de83a0faa140.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_731dc6d8-5578-546b-b6d7-c35eaaefd334/731dc6d8-5578-546b-b6d7-c35eaaefd334_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63938,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/8f/428fdcda2f6010a1cb0535f4531fee7e/pa/VS47380_40d7197614e407b8032fa013111fa54d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_731dc6d8-5578-546b-b6d7-c35eaaefd334/731dc6d8-5578-546b-b6d7-c35eaaefd334_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60772,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/8f/428fdcda2f6010a1cb0535f4531fee7e/pa/VS47380_277010ce5997badbe481edfb2fcba5b5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_731dc6d8-5578-546b-b6d7-c35eaaefd334/731dc6d8-5578-546b-b6d7-c35eaaefd334_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65099,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/8f/428fdcda2f6010a1cb0535f4531fee7e/pa/VS47380_3a55f13a64d412eff74d447ac1cbc702.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_731dc6d8-5578-546b-b6d7-c35eaaefd334/731dc6d8-5578-546b-b6d7-c35eaaefd334_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38367,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/8f/428fdcda2f6010a1cb0535f4531fee7e/pa/VS47380_288b70e4030c5b2c6260a3fb1750f321.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-04-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.5 TSI ACT Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2022}
2026-01-28 20:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VS47380%27 HTTP/1.1" 200 None
2026-01-28 20:05:56 [auto1.it] INFO: Saving data for VS47380: {'created_time': 1769630756.517522, 'last_price_update_time': 1769630756.517532, 'auction_closing_time': 1769704502.0}
2026-01-28 20:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VS47380') HTTP/1.1" 204 0
2026-01-28 20:05:56 [auto1.it] INFO: Found listing with ID: VH73112
2026-01-28 20:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VH73112%27 HTTP/1.1" 200 None
2026-01-28 20:05:56 [auto1.it] INFO: Scrape type for VH73112: 1
2026-01-28 20:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252Fb4%252F4fb4ec31496439d2846b55a99cd2b5ae%252Fpa%252FBE15819_4f58f7f7c15de9dbf0dd6f6cd81ea337.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/b4/4fb4ec31496439d2846b55a99cd2b5ae/pa/BE15819_4f58f7f7c15de9dbf0dd6f6cd81ea337.jpg not downloaded yet
2026-01-28 20:05:56 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 22 - Data Location: 110 - value: b'SONY\x00'
2026-01-28 20:05:56 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 34 - Data Location: 116 - value: b'ILCE-7M3\x00'
2026-01-28 20:05:56 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 126 - value: b',\x01\x00\x00\x01\x00\x00\x00'
2026-01-28 20:05:56 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 134 - value: b',\x01\x00\x00\x01\x00\x00\x00'
2026-01-28 20:05:56 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-01-28 20:05:56 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 82 - Data Location: 142 - value: <table: 42 bytes>
2026-01-28 20:05:56 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 94 - Data Location: 184 - value: b'2026:01:28 11:03:41\x00'
2026-01-28 20:05:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\xcc\x00\x00\x00'
2026-01-28 20:05:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08bf2890>
2026-01-28 20:05:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:05:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_952ac053-e29b-5def-9dce-861a2bf03e69/952ac053-e29b-5def-9dce-861a2bf03e69_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F1c%252Fe21cfb98a73e65a314352c3a1ce5c145%252Fpa%252FBM05081_5128151f31bb0cac1936d377a8cbfc19.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/1c/e21cfb98a73e65a314352c3a1ce5c145/pa/BM05081_5128151f31bb0cac1936d377a8cbfc19.jpg saved to cache
2026-01-28 20:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 952ac053-e29b-5def-9dce-861a2bf03e69
2026-01-28 20:05:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09f45110>
2026-01-28 20:05:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8f04c0b-f98d-50df-a365-6ef5b27ef7fc/d8f04c0b-f98d-50df-a365-6ef5b27ef7fc_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F0b%252F2c0bb7ccc201057468358464a15bb096%252Fpa%252FKX95898_051b8a398b6a93e55f7e4112919efb41.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/0b/2c0bb7ccc201057468358464a15bb096/pa/KX95898_051b8a398b6a93e55f7e4112919efb41.jpg saved to cache
2026-01-28 20:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d8f04c0b-f98d-50df-a365-6ef5b27ef7fc
2026-01-28 20:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/1c/e21cfb98a73e65a314352c3a1ce5c145/pa/BM05081_c78f7541bb3996d8ba9be7f4cb21956b.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YF03043/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:05:57 [auto1.it] INFO: Found listing with ID: ML31196
2026-01-28 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ML31196%27 HTTP/1.1" 200 None
2026-01-28 20:05:57 [auto1.it] INFO: Scrape type for ML31196: 1
2026-01-28 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252Fb4%252F4fb4ec31496439d2846b55a99cd2b5ae%252Fpa%252FBE15819_244230afa795f363493e992b66a3577e.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/b4/4fb4ec31496439d2846b55a99cd2b5ae/pa/BE15819_244230afa795f363493e992b66a3577e.jpg not downloaded yet
2026-01-28 20:05:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:05:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4705594a-c8b1-54a6-9864-d4413697f710 with identifier: TS20335
2026-01-28 20:05:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4705594a-c8b1-54a6-9864-d4413697f710 with scrape type 2
2026-01-28 20:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4705594a-c8b1-54a6-9864-d4413697f710 with scrape type 2
2026-01-28 20:05:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4705594a-c8b1-54a6-9864-d4413697f710, identifier: TS20335
2026-01-28 20:05:57 [auto1.it] INFO: Parsing search results for channel: 24h
2026-01-28 20:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FC65085/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:05:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4705594a-c8b1-54a6-9864-d4413697f710 with identifier: TS20335
2026-01-28 20:05:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4705594a-c8b1-54a6-9864-d4413697f710 with identifier: TS20335
2026-01-28 20:05:57 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'ssangyong korando 1.5 t-gdi dream 4x2', 'price': 0, 'currency': 'eur', 'make': 'ssangyong', 'model': 'korando', 'transmission': 'automatic', 'odometer': 42738, 'odometer_reading_unit': 'km', 'registration_date': '2020-02-27', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ts20335', 'expiration_date': '2026-01-29t16:59:30z', 'origin_country_code': 'it', 'trim': 'dream 4x2', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 163, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.5l', 'location': 'it, settimo torinese', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6d-temp', 'c_o_2_emission_value': 162, 'id': '4705594a-c8b1-54a6-9864-d4413697f710', 'current_year_diff': 6, 'age_in_months': 71, 'make_model': 'ssangyong korando', 'sanitized_make': 'ssangyong', 'odometer_in_km': 42738}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 71,
     'auction_title': '',
     'c_o_2_emission_value': 162,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 5,
     'emission_standard': 'euro 6d-temp',
     'engine': '1.5l',
     'engine_horse_power': 163,
     'expiration_date': '2026-01-29t16:59:30z',
     'fuel_type': 'petrol',
     'id': '4705594a-c8b1-54a6-9864-d4413697f710',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ts20335',
     'listing': 'auction',
     'location': 'it, settimo torinese',
     'make': 'ssangyong',
     'make_model': 'ssangyong korando',
     'model': 'korando',
     'odometer': 42738,
     'odometer_in_km': 42738,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'it',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2020-02-27',
     'sanitized_make': 'ssangyong',
     'seats_number': 5,
     'seller_name': None,
     'title': 'ssangyong korando 1.5 t-gdi dream 4x2',
     'transmission': 'automatic',
     'trim': 'dream 4x2',
     'year': 2020}
2026-01-28 20:05:57 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_NOT_ALLOWED failed for item: 4705594a-c8b1-54a6-9864-d4413697f710 spider: auto1.it
2026-01-28 20:05:57 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 4705594a-c8b1-54a6-9864-d4413697f710 due to rule: makes_not_allowed.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'ssangyong korando 1.5 t-gdi dream 4x2', 'price': 0, 'currency': 'eur', 'make': 'ssangyong', 'model': 'korando', 'transmission': 'automatic', 'odometer': 42738, 'odometer_reading_unit': 'km', 'registration_date': '2020-02-27', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ts20335', 'expiration_date': '2026-01-29t16:59:30z', 'origin_country_code': 'it', 'trim': 'dream 4x2', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 163, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.5l', 'location': 'it, settimo torinese', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6d-temp', 'c_o_2_emission_value': 162, 'id': '4705594a-c8b1-54a6-9864-d4413697f710', 'current_year_diff': 6, 'age_in_months': 71, 'make_model': 'ssangyong korando', 'sanitized_make': 'ssangyong', 'odometer_in_km': 42738}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 71,
     'auction_title': '',
     'c_o_2_emission_value': 162,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 5,
     'emission_standard': 'euro 6d-temp',
     'engine': '1.5l',
     'engine_horse_power': 163,
     'expiration_date': '2026-01-29t16:59:30z',
     'fuel_type': 'petrol',
     'id': '4705594a-c8b1-54a6-9864-d4413697f710',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ts20335',
     'listing': 'auction',
     'location': 'it, settimo torinese',
     'make': 'ssangyong',
     'make_model': 'ssangyong korando',
     'model': 'korando',
     'odometer': 42738,
     'odometer_in_km': 42738,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'it',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2020-02-27',
     'sanitized_make': 'ssangyong',
     'seats_number': 5,
     'seller_name': None,
     'title': 'ssangyong korando 1.5 t-gdi dream 4x2',
     'transmission': 'automatic',
     'trim': 'dream 4x2',
     'year': 2020}
{'auction_title': '',
 'c_o_2_emission_value': 162,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.5L',
 'engine_horse_power': 163,
 'expiration_date': '2026-01-29T16:59:30Z',
 'fuel_type': 'petrol',
 'id': '4705594a-c8b1-54a6-9864-d4413697f710',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TS20335',
 'listing': 'auction',
 'location': 'IT, Settimo Torinese',
 'make': 'Ssangyong',
 'model': 'Korando',
 'odometer': 42738,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-02-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ssangyong Korando 1.5 T-GDI Dream 4x2',
 'transmission': 'automatic',
 'trim': 'Dream 4x2',
 'year': 2020}
2026-01-28 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TS20335%27 HTTP/1.1" 200 None
2026-01-28 20:05:57 [auto1.it] INFO: Saving data for TS20335: {'auction_closing_time': 1769705970.0, 'created_time': 1767866618.917163, 'last_price_update_time': 1769630757.56457}
2026-01-28 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TS20335') HTTP/1.1" 204 0
2026-01-28 20:05:57 [auto1.it] INFO: Found listing with ID: SB13925
2026-01-28 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SB13925%27 HTTP/1.1" 200 None
2026-01-28 20:05:57 [auto1.it] INFO: Scrape type for SB13925: 2
2026-01-28 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252Fb4%252F4fb4ec31496439d2846b55a99cd2b5ae%252Fpa%252FBE15819_c257bb48ed284977fc9aebf5abba72c6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/b4/4fb4ec31496439d2846b55a99cd2b5ae/pa/BE15819_c257bb48ed284977fc9aebf5abba72c6.jpg not downloaded yet
2026-01-28 20:05:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:05:57 [auto1.it] INFO: Found listing with ID: CZ85123
2026-01-28 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CZ85123%27 HTTP/1.1" 200 None
2026-01-28 20:05:57 [auto1.it] INFO: Scrape type for CZ85123: 1
2026-01-28 20:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/0b/2c0bb7ccc201057468358464a15bb096/pa/KX95898_ba4ca12f41951c737780ca6c2582e63e.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/b4/4fb4ec31496439d2846b55a99cd2b5ae/pa/BE15819_59eb8de837cbf319dec7c8a7ac0611a1.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:57 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 22 - Data Location: 110 - value: b'SONY\x00'
2026-01-28 20:05:57 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 34 - Data Location: 116 - value: b'ILCE-7M3\x00'
2026-01-28 20:05:57 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 126 - value: b',\x01\x00\x00\x01\x00\x00\x00'
2026-01-28 20:05:57 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 134 - value: b',\x01\x00\x00\x01\x00\x00\x00'
2026-01-28 20:05:57 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-01-28 20:05:57 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 82 - Data Location: 142 - value: <table: 42 bytes>
2026-01-28 20:05:57 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 94 - Data Location: 184 - value: b'2026:01:28 11:04:09\x00'
2026-01-28 20:05:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\xcc\x00\x00\x00'
2026-01-28 20:05:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09d5b550>
2026-01-28 20:05:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_952ac053-e29b-5def-9dce-861a2bf03e69/952ac053-e29b-5def-9dce-861a2bf03e69_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F1c%252Fe21cfb98a73e65a314352c3a1ce5c145%252Fpa%252FBM05081_c78f7541bb3996d8ba9be7f4cb21956b.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/1c/e21cfb98a73e65a314352c3a1ce5c145/pa/BM05081_c78f7541bb3996d8ba9be7f4cb21956b.jpg saved to cache
2026-01-28 20:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 952ac053-e29b-5def-9dce-861a2bf03e69
2026-01-28 20:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/1c/e21cfb98a73e65a314352c3a1ce5c145/pa/BM05081_e7be5509c9c3b09ad5ce3e27add3e301.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:57 [auto1.it] INFO: Found listing with ID: HV34244
2026-01-28 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HV34244%27 HTTP/1.1" 200 None
2026-01-28 20:05:57 [auto1.it] INFO: Scrape type for HV34244: 1
2026-01-28 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252Fb4%252F4fb4ec31496439d2846b55a99cd2b5ae%252Fpa%252FBE15819_3512aa337dc92436a9edb8d87cc5d0a7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/b4/4fb4ec31496439d2846b55a99cd2b5ae/pa/BE15819_3512aa337dc92436a9edb8d87cc5d0a7.jpg not downloaded yet
2026-01-28 20:05:57 [auto1.it] INFO: Found listing with ID: GV88147
2026-01-28 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GV88147%27 HTTP/1.1" 200 None
2026-01-28 20:05:57 [auto1.it] INFO: Scrape type for GV88147: 1
2026-01-28 20:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/b4/4fb4ec31496439d2846b55a99cd2b5ae/pa/BE15819_4f58f7f7c15de9dbf0dd6f6cd81ea337.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:58 [auto1.it] INFO: Found listing with ID: ME44881
2026-01-28 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ME44881%27 HTTP/1.1" 200 None
2026-01-28 20:05:58 [auto1.it] INFO: Scrape type for ME44881: 2
2026-01-28 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252Fb4%252F4fb4ec31496439d2846b55a99cd2b5ae%252Fpa%252FBE15819_9f52c5f1b814a840724aafede9f5f1b9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/b4/4fb4ec31496439d2846b55a99cd2b5ae/pa/BE15819_9f52c5f1b814a840724aafede9f5f1b9.jpg not downloaded yet
2026-01-28 20:05:58 [auto1.it] INFO: Found listing with ID: VF71012
2026-01-28 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VF71012%27 HTTP/1.1" 200 None
2026-01-28 20:05:58 [auto1.it] INFO: Scrape type for VF71012: 1
2026-01-28 20:05:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08cd5290>
2026-01-28 20:05:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:05:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8f04c0b-f98d-50df-a365-6ef5b27ef7fc/d8f04c0b-f98d-50df-a365-6ef5b27ef7fc_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F0b%252F2c0bb7ccc201057468358464a15bb096%252Fpa%252FKX95898_ba4ca12f41951c737780ca6c2582e63e.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/0b/2c0bb7ccc201057468358464a15bb096/pa/KX95898_ba4ca12f41951c737780ca6c2582e63e.jpg saved to cache
2026-01-28 20:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d8f04c0b-f98d-50df-a365-6ef5b27ef7fc
2026-01-28 20:05:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09e0ead0>
2026-01-28 20:05:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:05:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a23c743d-1f5c-5ce1-98dd-2048bdcb6fb9/a23c743d-1f5c-5ce1-98dd-2048bdcb6fb9_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252Fb4%252F4fb4ec31496439d2846b55a99cd2b5ae%252Fpa%252FBE15819_59eb8de837cbf319dec7c8a7ac0611a1.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/b4/4fb4ec31496439d2846b55a99cd2b5ae/pa/BE15819_59eb8de837cbf319dec7c8a7ac0611a1.jpg saved to cache
2026-01-28 20:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a23c743d-1f5c-5ce1-98dd-2048bdcb6fb9
2026-01-28 20:05:58 [auto1.it] INFO: Found listing with ID: BN63900
2026-01-28 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BN63900%27 HTTP/1.1" 200 None
2026-01-28 20:05:58 [auto1.it] INFO: Scrape type for BN63900: 1
2026-01-28 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252Fb4%252F4fb4ec31496439d2846b55a99cd2b5ae%252Fpa%252FBE15819_e9dc8af0208814639555b8b5b059319e.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/b4/4fb4ec31496439d2846b55a99cd2b5ae/pa/BE15819_e9dc8af0208814639555b8b5b059319e.jpg not downloaded yet
2026-01-28 20:05:58 [auto1.it] INFO: Found listing with ID: UR17754
2026-01-28 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UR17754%27 HTTP/1.1" 200 None
2026-01-28 20:05:58 [auto1.it] INFO: Scrape type for UR17754: 1
2026-01-28 20:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/b4/4fb4ec31496439d2846b55a99cd2b5ae/pa/BE15819_244230afa795f363493e992b66a3577e.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EF46876/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SF52848/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TP74360> (referer: https://www.auto1.com/v1/car-details-view/TP74360/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/0b/2c0bb7ccc201057468358464a15bb096/pa/KX95898_79ee016fd542190eba35fae78069f4c5.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:58 [auto1.it] INFO: Found listing with ID: SU23914
2026-01-28 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SU23914%27 HTTP/1.1" 200 None
2026-01-28 20:05:58 [auto1.it] INFO: Scrape type for SU23914: 1
2026-01-28 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252Fb4%252F4fb4ec31496439d2846b55a99cd2b5ae%252Fpa%252FBE15819_69c5116208e3fb39c0ced18172b315f1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/b4/4fb4ec31496439d2846b55a99cd2b5ae/pa/BE15819_69c5116208e3fb39c0ced18172b315f1.jpg not downloaded yet
2026-01-28 20:05:58 [auto1.it] INFO: Found listing with ID: GX99899
2026-01-28 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GX99899%27 HTTP/1.1" 200 None
2026-01-28 20:05:58 [auto1.it] INFO: Scrape type for GX99899: 1
2026-01-28 20:05:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:05:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:05:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:05:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08746950>
2026-01-28 20:05:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:05:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_952ac053-e29b-5def-9dce-861a2bf03e69/952ac053-e29b-5def-9dce-861a2bf03e69_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F1c%252Fe21cfb98a73e65a314352c3a1ce5c145%252Fpa%252FBM05081_e7be5509c9c3b09ad5ce3e27add3e301.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/1c/e21cfb98a73e65a314352c3a1ce5c145/pa/BM05081_e7be5509c9c3b09ad5ce3e27add3e301.jpg saved to cache
2026-01-28 20:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 952ac053-e29b-5def-9dce-861a2bf03e69
2026-01-28 20:05:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09ddcd50>
2026-01-28 20:05:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:05:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a23c743d-1f5c-5ce1-98dd-2048bdcb6fb9/a23c743d-1f5c-5ce1-98dd-2048bdcb6fb9_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252Fb4%252F4fb4ec31496439d2846b55a99cd2b5ae%252Fpa%252FBE15819_4f58f7f7c15de9dbf0dd6f6cd81ea337.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/b4/4fb4ec31496439d2846b55a99cd2b5ae/pa/BE15819_4f58f7f7c15de9dbf0dd6f6cd81ea337.jpg saved to cache
2026-01-28 20:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a23c743d-1f5c-5ce1-98dd-2048bdcb6fb9
2026-01-28 20:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/e4/a6e425f4947af594305d5000e9a05c30/pa/UP17064_aae8f384fbc61b11ba3bd86c95db8cac.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/1c/e21cfb98a73e65a314352c3a1ce5c145/pa/BM05081_9a876060d7a98b7390eabfe9169d810c.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:59 [auto1.it] INFO: Found listing with ID: SA98616
2026-01-28 20:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SA98616%27 HTTP/1.1" 200 None
2026-01-28 20:05:59 [auto1.it] INFO: Scrape type for SA98616: 2
2026-01-28 20:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252Fb4%252F4fb4ec31496439d2846b55a99cd2b5ae%252Fpa%252FBE15819_344f87d95611ae59a13a7b60362d32cb.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/b4/4fb4ec31496439d2846b55a99cd2b5ae/pa/BE15819_344f87d95611ae59a13a7b60362d32cb.jpg not downloaded yet
2026-01-28 20:05:59 [auto1.it] INFO: Found listing with ID: PX44496
2026-01-28 20:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PX44496%27 HTTP/1.1" 200 None
2026-01-28 20:05:59 [auto1.it] INFO: Scrape type for PX44496: 1
2026-01-28 20:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BS31038/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FP59077/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZZ39223/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TC56605> (referer: https://www.auto1.com/v1/car-details-view/TC56605/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:05:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09d44990>
2026-01-28 20:05:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a23c743d-1f5c-5ce1-98dd-2048bdcb6fb9/a23c743d-1f5c-5ce1-98dd-2048bdcb6fb9_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252Fb4%252F4fb4ec31496439d2846b55a99cd2b5ae%252Fpa%252FBE15819_244230afa795f363493e992b66a3577e.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/b4/4fb4ec31496439d2846b55a99cd2b5ae/pa/BE15819_244230afa795f363493e992b66a3577e.jpg saved to cache
2026-01-28 20:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a23c743d-1f5c-5ce1-98dd-2048bdcb6fb9
2026-01-28 20:05:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 148ebbb0-d3a8-5268-8317-4a18056ffd9d with identifier: TP74360
2026-01-28 20:05:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 148ebbb0-d3a8-5268-8317-4a18056ffd9d with scrape type 2
2026-01-28 20:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 148ebbb0-d3a8-5268-8317-4a18056ffd9d with scrape type 2
2026-01-28 20:05:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 148ebbb0-d3a8-5268-8317-4a18056ffd9d, identifier: TP74360
2026-01-28 20:05:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:05:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0873c6d0>
2026-01-28 20:05:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:05:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8f04c0b-f98d-50df-a365-6ef5b27ef7fc/d8f04c0b-f98d-50df-a365-6ef5b27ef7fc_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F0b%252F2c0bb7ccc201057468358464a15bb096%252Fpa%252FKX95898_79ee016fd542190eba35fae78069f4c5.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/0b/2c0bb7ccc201057468358464a15bb096/pa/KX95898_79ee016fd542190eba35fae78069f4c5.jpg saved to cache
2026-01-28 20:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item d8f04c0b-f98d-50df-a365-6ef5b27ef7fc
2026-01-28 20:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/b4/4fb4ec31496439d2846b55a99cd2b5ae/pa/BE15819_e9dc8af0208814639555b8b5b059319e.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:05:59 [auto1.it] INFO: Found listing with ID: WL72741
2026-01-28 20:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WL72741%27 HTTP/1.1" 200 None
2026-01-28 20:05:59 [auto1.it] INFO: Scrape type for WL72741: 1
2026-01-28 20:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252Fb4%252F4fb4ec31496439d2846b55a99cd2b5ae%252Fpa%252FBE15819_421f3eb3482e93c3d9a62f004d7ea8e0.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/b4/4fb4ec31496439d2846b55a99cd2b5ae/pa/BE15819_421f3eb3482e93c3d9a62f004d7ea8e0.jpg not downloaded yet
2026-01-28 20:05:59 [auto1.it] INFO: Found listing with ID: DP52947
2026-01-28 20:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DP52947%27 HTTP/1.1" 200 None
2026-01-28 20:05:59 [auto1.it] INFO: Scrape type for DP52947: 2
2026-01-28 20:05:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:05:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:05:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:05:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:05:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 148ebbb0-d3a8-5268-8317-4a18056ffd9d with identifier: TP74360
2026-01-28 20:05:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 148ebbb0-d3a8-5268-8317-4a18056ffd9d with identifier: TP74360
2026-01-28 20:05:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 148ebbb0-d3a8-5268-8317-4a18056ffd9d with identifier: TP74360 to the API
2026-01-28 20:05:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:06:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:06:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TP74360>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.6L',
 'engine_horse_power': 116,
 'expiration_date': '2026-01-29T16:37:11Z',
 'fuel_type': 'diesel',
 'id': '148ebbb0-d3a8-5268-8317-4a18056ffd9d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TP74360',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'Hyundai',
 'model': 'Kona',
 'odometer': 85315,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-05-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai Kona 1.6 CRDi XPrime 2WD',
 'transmission': 'manual',
 'trim': 'XPrime 2WD',
 'year': 2020}
2026-01-28 20:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TP74360%27 HTTP/1.1" 200 None
2026-01-28 20:06:00 [auto1.it] INFO: Saving data for TP74360: {'auction_closing_time': 1769704631.0, 'created_time': 1767729671.279182, 'last_price_update_time': 1769630760.681246}
2026-01-28 20:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TP74360') HTTP/1.1" 204 0
2026-01-28 20:06:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/b4/4fb4ec31496439d2846b55a99cd2b5ae/pa/BE15819_9f52c5f1b814a840724aafede9f5f1b9.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:06:00 [auto1.it] INFO: Found listing with ID: XP38725
2026-01-28 20:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XP38725%27 HTTP/1.1" 200 None
2026-01-28 20:06:00 [auto1.it] INFO: Scrape type for XP38725: 2
2026-01-28 20:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252Fb4%252F4fb4ec31496439d2846b55a99cd2b5ae%252Fpa%252FBE15819_7ff478b67a231fd772dd64d08feb7f3a.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/b4/4fb4ec31496439d2846b55a99cd2b5ae/pa/BE15819_7ff478b67a231fd772dd64d08feb7f3a.jpg not downloaded yet
2026-01-28 20:06:00 [auto1.it] INFO: Found listing with ID: NS14568
2026-01-28 20:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NS14568%27 HTTP/1.1" 200 None
2026-01-28 20:06:00 [auto1.it] INFO: Scrape type for NS14568: 2
2026-01-28 20:06:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XV25208/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:06:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:06:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0a0a7990>
2026-01-28 20:06:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_352e36d3-8cf1-51d6-9eae-3613362bc3e4/352e36d3-8cf1-51d6-9eae-3613362bc3e4_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252Fe4%252Fa6e425f4947af594305d5000e9a05c30%252Fpa%252FUP17064_aae8f384fbc61b11ba3bd86c95db8cac.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/e4/a6e425f4947af594305d5000e9a05c30/pa/UP17064_aae8f384fbc61b11ba3bd86c95db8cac.jpg saved to cache
2026-01-28 20:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 352e36d3-8cf1-51d6-9eae-3613362bc3e4
2026-01-28 20:06:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 352e36d3-8cf1-51d6-9eae-3613362bc3e4, skipping ID generation
2026-01-28 20:06:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 352e36d3-8cf1-51d6-9eae-3613362bc3e4 with scrape type 1
2026-01-28 20:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 352e36d3-8cf1-51d6-9eae-3613362bc3e4 from tracking dictionaries
2026-01-28 20:06:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 352e36d3-8cf1-51d6-9eae-3613362bc3e4 sending to next pipeline
2026-01-28 20:06:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 352e36d3-8cf1-51d6-9eae-3613362bc3e4, identifier: UP17064
2026-01-28 20:06:01 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 22 - Data Location: 110 - value: b'SONY\x00'
2026-01-28 20:06:01 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 34 - Data Location: 116 - value: b'ILCE-7M3\x00'
2026-01-28 20:06:01 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 126 - value: b',\x01\x00\x00\x01\x00\x00\x00'
2026-01-28 20:06:01 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 134 - value: b',\x01\x00\x00\x01\x00\x00\x00'
2026-01-28 20:06:01 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-01-28 20:06:01 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 82 - Data Location: 142 - value: <table: 42 bytes>
2026-01-28 20:06:01 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 94 - Data Location: 184 - value: b'2026:01:28 11:04:17\x00'
2026-01-28 20:06:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\xcc\x00\x00\x00'
2026-01-28 20:06:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b086e1010>
2026-01-28 20:06:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:06:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_952ac053-e29b-5def-9dce-861a2bf03e69/952ac053-e29b-5def-9dce-861a2bf03e69_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F1c%252Fe21cfb98a73e65a314352c3a1ce5c145%252Fpa%252FBM05081_9a876060d7a98b7390eabfe9169d810c.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/1c/e21cfb98a73e65a314352c3a1ce5c145/pa/BM05081_9a876060d7a98b7390eabfe9169d810c.jpg saved to cache
2026-01-28 20:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 952ac053-e29b-5def-9dce-861a2bf03e69
2026-01-28 20:06:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 253d57e6-a640-5b9f-8371-692cd56b9a44 with identifier: TC56605
2026-01-28 20:06:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 253d57e6-a640-5b9f-8371-692cd56b9a44 with scrape type 2
2026-01-28 20:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 253d57e6-a640-5b9f-8371-692cd56b9a44 with scrape type 2
2026-01-28 20:06:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 253d57e6-a640-5b9f-8371-692cd56b9a44, identifier: TC56605
2026-01-28 20:06:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 352e36d3-8cf1-51d6-9eae-3613362bc3e4 with identifier: UP17064
2026-01-28 20:06:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 352e36d3-8cf1-51d6-9eae-3613362bc3e4 with identifier: UP17064
2026-01-28 20:06:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 352e36d3-8cf1-51d6-9eae-3613362bc3e4 with identifier: UP17064 to the API
2026-01-28 20:06:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:06:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:06:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga6/e4/a6e425f4947af594305d5000e9a05c30/pa/UP17064_aae8f384fbc61b11ba3bd86c95db8cac.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 183,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 204,
 'expiration_date': '2026-01-29T16:37:15Z',
 'fuel_type': 'diesel',
 'id': '352e36d3-8cf1-51d6-9eae-3613362bc3e4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UP17064',
 'listing': 'auction',
 'location': 'IT, Asti',
 'make': 'Land Rover',
 'model': 'Discovery Sport',
 'odometer': 78316,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_352e36d3-8cf1-51d6-9eae-3613362bc3e4/352e36d3-8cf1-51d6-9eae-3613362bc3e4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65992,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/e4/a6e425f4947af594305d5000e9a05c30/pa/UP17064_de9fe6afadbf914a08b0e625150fbc6b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_352e36d3-8cf1-51d6-9eae-3613362bc3e4/352e36d3-8cf1-51d6-9eae-3613362bc3e4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2911242,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/e4/a6e425f4947af594305d5000e9a05c30/pa/UP17064_aae8f384fbc61b11ba3bd86c95db8cac.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_352e36d3-8cf1-51d6-9eae-3613362bc3e4/352e36d3-8cf1-51d6-9eae-3613362bc3e4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62398,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/e4/a6e425f4947af594305d5000e9a05c30/pa/UP17064_898d76f3f3a583d0a2aee1bde080e09f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_352e36d3-8cf1-51d6-9eae-3613362bc3e4/352e36d3-8cf1-51d6-9eae-3613362bc3e4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55480,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/e4/a6e425f4947af594305d5000e9a05c30/pa/UP17064_728896be30e6aa28e194e908fb1172d3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_352e36d3-8cf1-51d6-9eae-3613362bc3e4/352e36d3-8cf1-51d6-9eae-3613362bc3e4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56612,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/e4/a6e425f4947af594305d5000e9a05c30/pa/UP17064_384cfc22f44dee025095c047fed9ea5c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_352e36d3-8cf1-51d6-9eae-3613362bc3e4/352e36d3-8cf1-51d6-9eae-3613362bc3e4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64392,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/e4/a6e425f4947af594305d5000e9a05c30/pa/UP17064_64e7af4f2a8999bbacb5b321f13d0365.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_352e36d3-8cf1-51d6-9eae-3613362bc3e4/352e36d3-8cf1-51d6-9eae-3613362bc3e4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55788,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/e4/a6e425f4947af594305d5000e9a05c30/pa/UP17064_38aa8a3cb7409bfff6c0bfdc3177bf07.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_352e36d3-8cf1-51d6-9eae-3613362bc3e4/352e36d3-8cf1-51d6-9eae-3613362bc3e4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2773639,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/e4/a6e425f4947af594305d5000e9a05c30/pa/UP17064_48a28b2eac41d51029e38d0e35b4a95a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_352e36d3-8cf1-51d6-9eae-3613362bc3e4/352e36d3-8cf1-51d6-9eae-3613362bc3e4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2514608,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/e4/a6e425f4947af594305d5000e9a05c30/pa/UP17064_d6b360b4e01c728432adec5e845474a7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_352e36d3-8cf1-51d6-9eae-3613362bc3e4/352e36d3-8cf1-51d6-9eae-3613362bc3e4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2815394,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/e4/a6e425f4947af594305d5000e9a05c30/pa/UP17064_4c8dbb06c62efefff261ccf1f3193ae6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_352e36d3-8cf1-51d6-9eae-3613362bc3e4/352e36d3-8cf1-51d6-9eae-3613362bc3e4_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2776794,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/e4/a6e425f4947af594305d5000e9a05c30/pa/UP17064_e100f7dc4878ac7040644243863a14c8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_352e36d3-8cf1-51d6-9eae-3613362bc3e4/352e36d3-8cf1-51d6-9eae-3613362bc3e4_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2652368,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/e4/a6e425f4947af594305d5000e9a05c30/pa/UP17064_ba8f597b98ca848bbec1c75a3f441471.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_352e36d3-8cf1-51d6-9eae-3613362bc3e4/352e36d3-8cf1-51d6-9eae-3613362bc3e4_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57312,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/e4/a6e425f4947af594305d5000e9a05c30/pa/UP17064_92e715a012219ed83c914476c7ae455b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_352e36d3-8cf1-51d6-9eae-3613362bc3e4/352e36d3-8cf1-51d6-9eae-3613362bc3e4_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2788634,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/e4/a6e425f4947af594305d5000e9a05c30/pa/UP17064_160adf79d7a2a81248ee2d3810b04c20.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_352e36d3-8cf1-51d6-9eae-3613362bc3e4/352e36d3-8cf1-51d6-9eae-3613362bc3e4_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41509,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/e4/a6e425f4947af594305d5000e9a05c30/pa/UP17064_5158424e15cebf47a3414227dab580f5.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-03-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Discovery Sport D200 Mild-Hybrid S AWD',
 'transmission': 'automatic',
 'trim': 'S AWD',
 'year': 2021}
2026-01-28 20:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UP17064%27 HTTP/1.1" 200 None
2026-01-28 20:06:02 [auto1.it] INFO: Saving data for UP17064: {'created_time': 1769630762.113142, 'last_price_update_time': 1769630762.113154, 'auction_closing_time': 1769704635.0}
2026-01-28 20:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UP17064') HTTP/1.1" 204 0
2026-01-28 20:06:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 253d57e6-a640-5b9f-8371-692cd56b9a44 with identifier: TC56605
2026-01-28 20:06:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 253d57e6-a640-5b9f-8371-692cd56b9a44 with identifier: TC56605
2026-01-28 20:06:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 253d57e6-a640-5b9f-8371-692cd56b9a44 with identifier: TC56605 to the API
2026-01-28 20:06:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:06:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:06:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TC56605>
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.5L',
 'engine_horse_power': 190,
 'expiration_date': '2026-01-29T16:31:27Z',
 'fuel_type': 'hybrid',
 'id': '253d57e6-a640-5b9f-8371-692cd56b9a44',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TC56605',
 'listing': 'auction',
 'location': 'IT, Milazzo',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 39428,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-10-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Kuga 2.5 Hybrid ST-Line X',
 'transmission': 'automatic',
 'trim': 'ST-Line X',
 'year': 2022}
2026-01-28 20:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TC56605%27 HTTP/1.1" 200 None
2026-01-28 20:06:02 [auto1.it] INFO: Saving data for TC56605: {'auction_closing_time': 1769704287.0, 'created_time': 1766088412.243166, 'last_price_update_time': 1769630762.48648}
2026-01-28 20:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TC56605') HTTP/1.1" 204 0
2026-01-28 20:06:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:06:02 [auto1.it] INFO: Found listing with ID: BK51963
2026-01-28 20:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BK51963%27 HTTP/1.1" 200 None
2026-01-28 20:06:02 [auto1.it] INFO: Scrape type for BK51963: 1
2026-01-28 20:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252Fb4%252F4fb4ec31496439d2846b55a99cd2b5ae%252Fpa%252FBE15819_eae4b54ae1b528cea4d9b8c787e0d1b3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/b4/4fb4ec31496439d2846b55a99cd2b5ae/pa/BE15819_eae4b54ae1b528cea4d9b8c787e0d1b3.jpg not downloaded yet
2026-01-28 20:06:02 [auto1.it] INFO: Found listing with ID: WA30602
2026-01-28 20:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WA30602%27 HTTP/1.1" 200 None
2026-01-28 20:06:02 [auto1.it] INFO: Scrape type for WA30602: 2
2026-01-28 20:06:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08c05890>
2026-01-28 20:06:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:06:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a23c743d-1f5c-5ce1-98dd-2048bdcb6fb9/a23c743d-1f5c-5ce1-98dd-2048bdcb6fb9_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252Fb4%252F4fb4ec31496439d2846b55a99cd2b5ae%252Fpa%252FBE15819_e9dc8af0208814639555b8b5b059319e.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/b4/4fb4ec31496439d2846b55a99cd2b5ae/pa/BE15819_e9dc8af0208814639555b8b5b059319e.jpg saved to cache
2026-01-28 20:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a23c743d-1f5c-5ce1-98dd-2048bdcb6fb9
2026-01-28 20:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DL09487> (referer: https://www.auto1.com/v1/car-details-view/DL09487/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CZ85123/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:06:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b088e2e90>
2026-01-28 20:06:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a23c743d-1f5c-5ce1-98dd-2048bdcb6fb9/a23c743d-1f5c-5ce1-98dd-2048bdcb6fb9_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252Fb4%252F4fb4ec31496439d2846b55a99cd2b5ae%252Fpa%252FBE15819_9f52c5f1b814a840724aafede9f5f1b9.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/b4/4fb4ec31496439d2846b55a99cd2b5ae/pa/BE15819_9f52c5f1b814a840724aafede9f5f1b9.jpg saved to cache
2026-01-28 20:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a23c743d-1f5c-5ce1-98dd-2048bdcb6fb9
2026-01-28 20:06:03 [auto1.it] INFO: Found listing with ID: KY70746
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KY70746%27 HTTP/1.1" 200 None
2026-01-28 20:06:03 [auto1.it] INFO: Scrape type for KY70746: 1
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252Fb4%252F4fb4ec31496439d2846b55a99cd2b5ae%252Fpa%252FBE15819_6320bfb5ec93c7c93f1f20ad6c9e74f7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/b4/4fb4ec31496439d2846b55a99cd2b5ae/pa/BE15819_6320bfb5ec93c7c93f1f20ad6c9e74f7.jpg not downloaded yet
2026-01-28 20:06:03 [auto1.it] INFO: Found listing with ID: RG29856
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RG29856%27 HTTP/1.1" 200 None
2026-01-28 20:06:03 [auto1.it] INFO: Scrape type for RG29856: 1
2026-01-28 20:06:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:06:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:06:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:06:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/b4/4fb4ec31496439d2846b55a99cd2b5ae/pa/BE15819_344f87d95611ae59a13a7b60362d32cb.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:06:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/b4/4fb4ec31496439d2846b55a99cd2b5ae/pa/BE15819_421f3eb3482e93c3d9a62f004d7ea8e0.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:06:03 [auto1.it] INFO: Found listing with ID: RU07739
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RU07739%27 HTTP/1.1" 200 None
2026-01-28 20:06:03 [auto1.it] INFO: Scrape type for RU07739: 2
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252Fb4%252F4fb4ec31496439d2846b55a99cd2b5ae%252Fpa%252FBE15819_6c97cf553940b9a502bae0c051788d13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/b4/4fb4ec31496439d2846b55a99cd2b5ae/pa/BE15819_6c97cf553940b9a502bae0c051788d13.jpg not downloaded yet
2026-01-28 20:06:03 [auto1.it] INFO: Found listing with ID: JH70368
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JH70368%27 HTTP/1.1" 200 None
2026-01-28 20:06:03 [auto1.it] INFO: Scrape type for JH70368: 0
2026-01-28 20:06:03 [auto1.it] INFO: Found listing with ID: YY00281
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YY00281%27 HTTP/1.1" 200 None
2026-01-28 20:06:03 [auto1.it] INFO: Scrape type for YY00281: 0
2026-01-28 20:06:03 [auto1.it] INFO: Found listing with ID: NV22132
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NV22132%27 HTTP/1.1" 200 None
2026-01-28 20:06:03 [auto1.it] INFO: Scrape type for NV22132: 0
2026-01-28 20:06:03 [auto1.it] INFO: Found listing with ID: LB37983
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LB37983%27 HTTP/1.1" 200 None
2026-01-28 20:06:03 [auto1.it] INFO: Scrape type for LB37983: 0
2026-01-28 20:06:03 [auto1.it] INFO: Found listing with ID: KX23576
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KX23576%27 HTTP/1.1" 200 None
2026-01-28 20:06:03 [auto1.it] INFO: Scrape type for KX23576: 0
2026-01-28 20:06:03 [auto1.it] INFO: Found listing with ID: WG22278
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WG22278%27 HTTP/1.1" 200 None
2026-01-28 20:06:03 [auto1.it] INFO: Scrape type for WG22278: 0
2026-01-28 20:06:03 [auto1.it] INFO: Found listing with ID: KP25474
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KP25474%27 HTTP/1.1" 200 None
2026-01-28 20:06:03 [auto1.it] INFO: Scrape type for KP25474: 0
2026-01-28 20:06:03 [auto1.it] INFO: Found listing with ID: WT70784
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WT70784%27 HTTP/1.1" 200 None
2026-01-28 20:06:03 [auto1.it] INFO: Scrape type for WT70784: 0
2026-01-28 20:06:03 [auto1.it] INFO: Found listing with ID: XM98126
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XM98126%27 HTTP/1.1" 200 None
2026-01-28 20:06:03 [auto1.it] INFO: Scrape type for XM98126: 0
2026-01-28 20:06:03 [auto1.it] INFO: Found listing with ID: GV70344
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GV70344%27 HTTP/1.1" 200 None
2026-01-28 20:06:03 [auto1.it] INFO: Scrape type for GV70344: 0
2026-01-28 20:06:03 [auto1.it] INFO: Found listing with ID: WP79549
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WP79549%27 HTTP/1.1" 200 None
2026-01-28 20:06:03 [auto1.it] INFO: Scrape type for WP79549: 0
2026-01-28 20:06:03 [auto1.it] INFO: Found listing with ID: NX34632
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NX34632%27 HTTP/1.1" 200 None
2026-01-28 20:06:03 [auto1.it] INFO: Scrape type for NX34632: 0
2026-01-28 20:06:03 [auto1.it] INFO: Found listing with ID: LV69875
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LV69875%27 HTTP/1.1" 200 None
2026-01-28 20:06:03 [auto1.it] INFO: Scrape type for LV69875: 0
2026-01-28 20:06:03 [auto1.it] INFO: Found listing with ID: PE10297
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PE10297%27 HTTP/1.1" 200 None
2026-01-28 20:06:03 [auto1.it] INFO: Scrape type for PE10297: 0
2026-01-28 20:06:03 [auto1.it] INFO: Found listing with ID: TU81293
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TU81293%27 HTTP/1.1" 200 None
2026-01-28 20:06:03 [auto1.it] INFO: Scrape type for TU81293: 0
2026-01-28 20:06:03 [auto1.it] INFO: Found listing with ID: AK19049
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AK19049%27 HTTP/1.1" 200 None
2026-01-28 20:06:03 [auto1.it] INFO: Scrape type for AK19049: 0
2026-01-28 20:06:03 [auto1.it] INFO: Found listing with ID: VK07610
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VK07610%27 HTTP/1.1" 200 None
2026-01-28 20:06:03 [auto1.it] INFO: Scrape type for VK07610: 0
2026-01-28 20:06:03 [auto1.it] INFO: Found listing with ID: AW83792
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AW83792%27 HTTP/1.1" 200 None
2026-01-28 20:06:03 [auto1.it] INFO: Scrape type for AW83792: 0
2026-01-28 20:06:03 [auto1.it] INFO: Found listing with ID: SC19366
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SC19366%27 HTTP/1.1" 200 None
2026-01-28 20:06:03 [auto1.it] INFO: Scrape type for SC19366: 0
2026-01-28 20:06:03 [auto1.it] INFO: Found listing with ID: TH81920
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TH81920%27 HTTP/1.1" 200 None
2026-01-28 20:06:03 [auto1.it] INFO: Scrape type for TH81920: 0
2026-01-28 20:06:03 [auto1.it] INFO: Found listing with ID: UW96841
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UW96841%27 HTTP/1.1" 200 None
2026-01-28 20:06:03 [auto1.it] INFO: Scrape type for UW96841: 0
2026-01-28 20:06:03 [auto1.it] INFO: Found listing with ID: MP68527
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MP68527%27 HTTP/1.1" 200 None
2026-01-28 20:06:03 [auto1.it] INFO: Scrape type for MP68527: 0
2026-01-28 20:06:03 [auto1.it] INFO: Found listing with ID: RE03903
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RE03903%27 HTTP/1.1" 200 None
2026-01-28 20:06:03 [auto1.it] INFO: Scrape type for RE03903: 0
2026-01-28 20:06:03 [auto1.it] INFO: Found listing with ID: DZ55749
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DZ55749%27 HTTP/1.1" 200 None
2026-01-28 20:06:03 [auto1.it] INFO: Scrape type for DZ55749: 0
2026-01-28 20:06:03 [auto1.it] INFO: Found listing with ID: FR07363
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FR07363%27 HTTP/1.1" 200 None
2026-01-28 20:06:03 [auto1.it] INFO: Scrape type for FR07363: 0
2026-01-28 20:06:03 [auto1.it] INFO: Found listing with ID: YU94462
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YU94462%27 HTTP/1.1" 200 None
2026-01-28 20:06:03 [auto1.it] INFO: Scrape type for YU94462: 0
2026-01-28 20:06:03 [auto1.it] INFO: Found listing with ID: VP15604
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VP15604%27 HTTP/1.1" 200 None
2026-01-28 20:06:03 [auto1.it] INFO: Scrape type for VP15604: 0
2026-01-28 20:06:03 [auto1.it] INFO: Found listing with ID: UV42227
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UV42227%27 HTTP/1.1" 200 None
2026-01-28 20:06:03 [auto1.it] INFO: Scrape type for UV42227: 0
2026-01-28 20:06:03 [auto1.it] INFO: Found listing with ID: CK01527
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CK01527%27 HTTP/1.1" 200 None
2026-01-28 20:06:03 [auto1.it] INFO: Scrape type for CK01527: 0
2026-01-28 20:06:03 [auto1.it] INFO: Found listing with ID: UU45503
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UU45503%27 HTTP/1.1" 200 None
2026-01-28 20:06:03 [auto1.it] INFO: Scrape type for UU45503: 0
2026-01-28 20:06:03 [auto1.it] INFO: Found listing with ID: BR27248
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BR27248%27 HTTP/1.1" 200 None
2026-01-28 20:06:03 [auto1.it] INFO: Scrape type for BR27248: 1
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252Fb4%252F4fb4ec31496439d2846b55a99cd2b5ae%252Fpa%252FBE15819_7a2b4f6b172c42d477e793a82e1bcfc1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/b4/4fb4ec31496439d2846b55a99cd2b5ae/pa/BE15819_7a2b4f6b172c42d477e793a82e1bcfc1.jpg not downloaded yet
2026-01-28 20:06:03 [auto1.it] INFO: Parsing search results for channel: 24h
2026-01-28 20:06:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f02e8c9b-2d2c-5042-a9d1-bb12cd2bd982 with identifier: DL09487
2026-01-28 20:06:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f02e8c9b-2d2c-5042-a9d1-bb12cd2bd982 with scrape type 2
2026-01-28 20:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f02e8c9b-2d2c-5042-a9d1-bb12cd2bd982 with scrape type 2
2026-01-28 20:06:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f02e8c9b-2d2c-5042-a9d1-bb12cd2bd982, identifier: DL09487
2026-01-28 20:06:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UR17754/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:06:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f02e8c9b-2d2c-5042-a9d1-bb12cd2bd982 with identifier: DL09487
2026-01-28 20:06:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f02e8c9b-2d2c-5042-a9d1-bb12cd2bd982 with identifier: DL09487
2026-01-28 20:06:04 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 169744 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    169744
2026-01-28 20:06:04 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: f02e8c9b-2d2c-5042-a9d1-bb12cd2bd982 spider: auto1.it
2026-01-28 20:06:04 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: f02e8c9b-2d2c-5042-a9d1-bb12cd2bd982 due to rule: high_mileage_for_country.json, error: 169744 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    169744
{'auction_title': '',
 'c_o_2_emission_value': 107,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.2L',
 'engine_horse_power': 95,
 'expiration_date': '2026-01-29T16:53:54Z',
 'fuel_type': 'diesel',
 'id': 'f02e8c9b-2d2c-5042-a9d1-bb12cd2bd982',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DL09487',
 'listing': 'auction',
 'location': 'IT, Varedo (MB)',
 'make': 'Fiat',
 'model': '500X',
 'odometer': 169744,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-10-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat 500X 1.3 M-Jet S-Design City Look',
 'transmission': 'manual',
 'trim': 'S-Design City Look',
 'year': 2018}
2026-01-28 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DL09487%27 HTTP/1.1" 200 None
2026-01-28 20:06:04 [auto1.it] INFO: Saving data for DL09487: {'auction_closing_time': 1769705634.0, 'created_time': 1768817037.436867, 'last_price_update_time': 1769630764.225398}
2026-01-28 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DL09487') HTTP/1.1" 204 0
2026-01-28 20:06:04 [auto1.it] INFO: Found listing with ID: RL30055
2026-01-28 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RL30055%27 HTTP/1.1" 200 None
2026-01-28 20:06:04 [auto1.it] INFO: Scrape type for RL30055: 2
2026-01-28 20:06:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:06:04 [auto1.it] INFO: Found listing with ID: YS60698
2026-01-28 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YS60698%27 HTTP/1.1" 200 None
2026-01-28 20:06:04 [auto1.it] INFO: Scrape type for YS60698: 0
2026-01-28 20:06:04 [auto1.it] INFO: Found listing with ID: MA63889
2026-01-28 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MA63889%27 HTTP/1.1" 200 None
2026-01-28 20:06:04 [auto1.it] INFO: Scrape type for MA63889: 0
2026-01-28 20:06:04 [auto1.it] INFO: Found listing with ID: PA09787
2026-01-28 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PA09787%27 HTTP/1.1" 200 None
2026-01-28 20:06:04 [auto1.it] INFO: Scrape type for PA09787: 0
2026-01-28 20:06:04 [auto1.it] INFO: Found listing with ID: EM48651
2026-01-28 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EM48651%27 HTTP/1.1" 200 None
2026-01-28 20:06:04 [auto1.it] INFO: Scrape type for EM48651: 0
2026-01-28 20:06:04 [auto1.it] INFO: Found listing with ID: US18527
2026-01-28 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27US18527%27 HTTP/1.1" 200 None
2026-01-28 20:06:04 [auto1.it] INFO: Scrape type for US18527: 0
2026-01-28 20:06:04 [auto1.it] INFO: Found listing with ID: LG07242
2026-01-28 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LG07242%27 HTTP/1.1" 200 None
2026-01-28 20:06:04 [auto1.it] INFO: Scrape type for LG07242: 0
2026-01-28 20:06:04 [auto1.it] INFO: Found listing with ID: UV47695
2026-01-28 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UV47695%27 HTTP/1.1" 200 None
2026-01-28 20:06:04 [auto1.it] INFO: Scrape type for UV47695: 0
2026-01-28 20:06:04 [auto1.it] INFO: Found listing with ID: MX11198
2026-01-28 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MX11198%27 HTTP/1.1" 200 None
2026-01-28 20:06:04 [auto1.it] INFO: Scrape type for MX11198: 0
2026-01-28 20:06:04 [auto1.it] INFO: Found listing with ID: YR64297
2026-01-28 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YR64297%27 HTTP/1.1" 200 None
2026-01-28 20:06:04 [auto1.it] INFO: Scrape type for YR64297: 0
2026-01-28 20:06:04 [auto1.it] INFO: Found listing with ID: NC16771
2026-01-28 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NC16771%27 HTTP/1.1" 200 None
2026-01-28 20:06:04 [auto1.it] INFO: Scrape type for NC16771: 0
2026-01-28 20:06:04 [auto1.it] INFO: Found listing with ID: KF48878
2026-01-28 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KF48878%27 HTTP/1.1" 200 None
2026-01-28 20:06:04 [auto1.it] INFO: Scrape type for KF48878: 0
2026-01-28 20:06:04 [auto1.it] INFO: Found listing with ID: ES44570
2026-01-28 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ES44570%27 HTTP/1.1" 200 None
2026-01-28 20:06:04 [auto1.it] INFO: Scrape type for ES44570: 0
2026-01-28 20:06:04 [auto1.it] INFO: Found listing with ID: LN71462
2026-01-28 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LN71462%27 HTTP/1.1" 200 None
2026-01-28 20:06:04 [auto1.it] INFO: Scrape type for LN71462: 0
2026-01-28 20:06:04 [auto1.it] INFO: Found listing with ID: MM11522
2026-01-28 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MM11522%27 HTTP/1.1" 200 None
2026-01-28 20:06:04 [auto1.it] INFO: Scrape type for MM11522: 0
2026-01-28 20:06:04 [auto1.it] INFO: Found listing with ID: KC58138
2026-01-28 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KC58138%27 HTTP/1.1" 200 None
2026-01-28 20:06:04 [auto1.it] INFO: Scrape type for KC58138: 0
2026-01-28 20:06:04 [auto1.it] INFO: Found listing with ID: FZ17961
2026-01-28 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FZ17961%27 HTTP/1.1" 200 None
2026-01-28 20:06:04 [auto1.it] INFO: Scrape type for FZ17961: 0
2026-01-28 20:06:04 [auto1.it] INFO: Found listing with ID: KG20319
2026-01-28 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KG20319%27 HTTP/1.1" 200 None
2026-01-28 20:06:04 [auto1.it] INFO: Scrape type for KG20319: 0
2026-01-28 20:06:04 [auto1.it] INFO: Found listing with ID: YL40875
2026-01-28 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YL40875%27 HTTP/1.1" 200 None
2026-01-28 20:06:04 [auto1.it] INFO: Scrape type for YL40875: 0
2026-01-28 20:06:04 [auto1.it] INFO: Found listing with ID: JF20294
2026-01-28 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JF20294%27 HTTP/1.1" 200 None
2026-01-28 20:06:04 [auto1.it] INFO: Scrape type for JF20294: 0
2026-01-28 20:06:04 [auto1.it] INFO: Found listing with ID: XR31937
2026-01-28 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XR31937%27 HTTP/1.1" 200 None
2026-01-28 20:06:04 [auto1.it] INFO: Scrape type for XR31937: 0
2026-01-28 20:06:04 [auto1.it] INFO: Found listing with ID: MR06591
2026-01-28 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MR06591%27 HTTP/1.1" 200 None
2026-01-28 20:06:04 [auto1.it] INFO: Scrape type for MR06591: 0
2026-01-28 20:06:04 [auto1.it] INFO: Found listing with ID: UZ25178
2026-01-28 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UZ25178%27 HTTP/1.1" 200 None
2026-01-28 20:06:04 [auto1.it] INFO: Scrape type for UZ25178: 0
2026-01-28 20:06:04 [auto1.it] INFO: Found listing with ID: WY20430
2026-01-28 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WY20430%27 HTTP/1.1" 200 None
2026-01-28 20:06:04 [auto1.it] INFO: Scrape type for WY20430: 0
2026-01-28 20:06:04 [auto1.it] INFO: Found listing with ID: RT85289
2026-01-28 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RT85289%27 HTTP/1.1" 200 None
2026-01-28 20:06:04 [auto1.it] INFO: Scrape type for RT85289: 0
2026-01-28 20:06:04 [auto1.it] INFO: Found listing with ID: HJ72806
2026-01-28 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HJ72806%27 HTTP/1.1" 200 None
2026-01-28 20:06:04 [auto1.it] INFO: Scrape type for HJ72806: 0
2026-01-28 20:06:04 [auto1.it] INFO: Found listing with ID: WL71449
2026-01-28 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WL71449%27 HTTP/1.1" 200 None
2026-01-28 20:06:04 [auto1.it] INFO: Scrape type for WL71449: 0
2026-01-28 20:06:04 [auto1.it] INFO: Found listing with ID: MB91559
2026-01-28 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MB91559%27 HTTP/1.1" 200 None
2026-01-28 20:06:04 [auto1.it] INFO: Scrape type for MB91559: 0
2026-01-28 20:06:04 [auto1.it] INFO: Found listing with ID: VU61741
2026-01-28 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VU61741%27 HTTP/1.1" 200 None
2026-01-28 20:06:04 [auto1.it] INFO: Scrape type for VU61741: 0
2026-01-28 20:06:04 [auto1.it] INFO: Found listing with ID: LB74870
2026-01-28 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LB74870%27 HTTP/1.1" 200 None
2026-01-28 20:06:04 [auto1.it] INFO: Scrape type for LB74870: 0
2026-01-28 20:06:04 [auto1.it] INFO: Found listing with ID: EA80460
2026-01-28 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EA80460%27 HTTP/1.1" 200 None
2026-01-28 20:06:04 [auto1.it] INFO: Scrape type for EA80460: 0
2026-01-28 20:06:04 [auto1.it] INFO: Found listing with ID: WC27393
2026-01-28 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WC27393%27 HTTP/1.1" 200 None
2026-01-28 20:06:04 [auto1.it] INFO: Scrape type for WC27393: 0
2026-01-28 20:06:04 [auto1.it] INFO: Found listing with ID: ZR94610
2026-01-28 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZR94610%27 HTTP/1.1" 200 None
2026-01-28 20:06:04 [auto1.it] INFO: Scrape type for ZR94610: 0
2026-01-28 20:06:04 [auto1.it] INFO: Found listing with ID: DC36763
2026-01-28 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DC36763%27 HTTP/1.1" 200 None
2026-01-28 20:06:04 [auto1.it] INFO: Scrape type for DC36763: 0
2026-01-28 20:06:04 [auto1.it] INFO: Found listing with ID: HL82578
2026-01-28 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HL82578%27 HTTP/1.1" 200 None
2026-01-28 20:06:04 [auto1.it] INFO: Scrape type for HL82578: 0
2026-01-28 20:06:04 [auto1.it] INFO: Found listing with ID: LR66968
2026-01-28 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LR66968%27 HTTP/1.1" 200 None
2026-01-28 20:06:04 [auto1.it] INFO: Scrape type for LR66968: 0
2026-01-28 20:06:04 [auto1.it] INFO: Found listing with ID: CB23984
2026-01-28 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CB23984%27 HTTP/1.1" 200 None
2026-01-28 20:06:04 [auto1.it] INFO: Scrape type for CB23984: 0
2026-01-28 20:06:04 [auto1.it] INFO: Found listing with ID: LA37582
2026-01-28 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LA37582%27 HTTP/1.1" 200 None
2026-01-28 20:06:04 [auto1.it] INFO: Scrape type for LA37582: 0
2026-01-28 20:06:04 [auto1.it] INFO: Found listing with ID: UH74677
2026-01-28 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UH74677%27 HTTP/1.1" 200 None
2026-01-28 20:06:05 [auto1.it] INFO: Scrape type for UH74677: 0
2026-01-28 20:06:05 [auto1.it] INFO: Found listing with ID: XZ42851
2026-01-28 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XZ42851%27 HTTP/1.1" 200 None
2026-01-28 20:06:05 [auto1.it] INFO: Scrape type for XZ42851: 0
2026-01-28 20:06:05 [auto1.it] INFO: Found listing with ID: TJ69567
2026-01-28 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TJ69567%27 HTTP/1.1" 200 None
2026-01-28 20:06:05 [auto1.it] INFO: Scrape type for TJ69567: 0
2026-01-28 20:06:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/b4/4fb4ec31496439d2846b55a99cd2b5ae/pa/BE15819_eae4b54ae1b528cea4d9b8c787e0d1b3.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:06:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08b8b9d0>
2026-01-28 20:06:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a23c743d-1f5c-5ce1-98dd-2048bdcb6fb9/a23c743d-1f5c-5ce1-98dd-2048bdcb6fb9_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252Fb4%252F4fb4ec31496439d2846b55a99cd2b5ae%252Fpa%252FBE15819_344f87d95611ae59a13a7b60362d32cb.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/b4/4fb4ec31496439d2846b55a99cd2b5ae/pa/BE15819_344f87d95611ae59a13a7b60362d32cb.jpg saved to cache
2026-01-28 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a23c743d-1f5c-5ce1-98dd-2048bdcb6fb9
2026-01-28 20:06:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0a0a0f90>
2026-01-28 20:06:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a23c743d-1f5c-5ce1-98dd-2048bdcb6fb9/a23c743d-1f5c-5ce1-98dd-2048bdcb6fb9_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252Fb4%252F4fb4ec31496439d2846b55a99cd2b5ae%252Fpa%252FBE15819_421f3eb3482e93c3d9a62f004d7ea8e0.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/b4/4fb4ec31496439d2846b55a99cd2b5ae/pa/BE15819_421f3eb3482e93c3d9a62f004d7ea8e0.jpg saved to cache
2026-01-28 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a23c743d-1f5c-5ce1-98dd-2048bdcb6fb9
2026-01-28 20:06:05 [auto1.it] INFO: Found listing with ID: UZ57933
2026-01-28 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UZ57933%27 HTTP/1.1" 200 None
2026-01-28 20:06:05 [auto1.it] INFO: Scrape type for UZ57933: 2
2026-01-28 20:06:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YF03043> (referer: https://www.auto1.com/v1/car-details-view/YF03043/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:06:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:06:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BN63900/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:06:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VF71012/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:06:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DP52947/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:06:05 [auto1.it] INFO: Found listing with ID: NZ23957
2026-01-28 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NZ23957%27 HTTP/1.1" 200 None
2026-01-28 20:06:05 [auto1.it] INFO: Scrape type for NZ23957: 2
2026-01-28 20:06:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:06:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:06:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:06:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09fe0250>
2026-01-28 20:06:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a23c743d-1f5c-5ce1-98dd-2048bdcb6fb9/a23c743d-1f5c-5ce1-98dd-2048bdcb6fb9_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252Fb4%252F4fb4ec31496439d2846b55a99cd2b5ae%252Fpa%252FBE15819_eae4b54ae1b528cea4d9b8c787e0d1b3.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/b4/4fb4ec31496439d2846b55a99cd2b5ae/pa/BE15819_eae4b54ae1b528cea4d9b8c787e0d1b3.jpg saved to cache
2026-01-28 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item a23c743d-1f5c-5ce1-98dd-2048bdcb6fb9
2026-01-28 20:06:05 [auto1.it] INFO: Found listing with ID: MW21403
2026-01-28 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MW21403%27 HTTP/1.1" 200 None
2026-01-28 20:06:05 [auto1.it] INFO: Scrape type for MW21403: 2
2026-01-28 20:06:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8213894a-9920-5f26-b111-e73a97a50c72 with identifier: YF03043
2026-01-28 20:06:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8213894a-9920-5f26-b111-e73a97a50c72 with scrape type 1
2026-01-28 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 8213894a-9920-5f26-b111-e73a97a50c72
2026-01-28 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F68%252Fa468c3ca40e89822d051926d13d57bee%252Fpa%252FYF03043_cd2c6c688cf9dc14ca157b1259072290.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/68/a468c3ca40e89822d051926d13d57bee/pa/YF03043_cd2c6c688cf9dc14ca157b1259072290.jpg already downloaded
2026-01-28 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F68%252Fa468c3ca40e89822d051926d13d57bee%252Fpa%252FYF03043_35461f3664c0b4cfbab4e74b1d24e0d0.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/68/a468c3ca40e89822d051926d13d57bee/pa/YF03043_35461f3664c0b4cfbab4e74b1d24e0d0.jpg already downloaded
2026-01-28 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F68%252Fa468c3ca40e89822d051926d13d57bee%252Fpa%252FYF03043_982e6825950a0476bf9844a7fe7ab248.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/68/a468c3ca40e89822d051926d13d57bee/pa/YF03043_982e6825950a0476bf9844a7fe7ab248.jpg already downloaded
2026-01-28 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F68%252Fa468c3ca40e89822d051926d13d57bee%252Fpa%252FYF03043_aba2d57792c1d1d25edd7bd858510458.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/68/a468c3ca40e89822d051926d13d57bee/pa/YF03043_aba2d57792c1d1d25edd7bd858510458.jpg already downloaded
2026-01-28 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F68%252Fa468c3ca40e89822d051926d13d57bee%252Fpa%252FYF03043_347ab28d5fbaa34ed7cc4cd1f496b660.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/68/a468c3ca40e89822d051926d13d57bee/pa/YF03043_347ab28d5fbaa34ed7cc4cd1f496b660.jpg already downloaded
2026-01-28 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F68%252Fa468c3ca40e89822d051926d13d57bee%252Fpa%252FYF03043_37b4e14085ac7f0348ee823b830125df.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/68/a468c3ca40e89822d051926d13d57bee/pa/YF03043_37b4e14085ac7f0348ee823b830125df.jpg already downloaded
2026-01-28 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F68%252Fa468c3ca40e89822d051926d13d57bee%252Fpa%252FYF03043_7f34ac44ed6a1dbf886fe18a83471348.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/68/a468c3ca40e89822d051926d13d57bee/pa/YF03043_7f34ac44ed6a1dbf886fe18a83471348.jpg already downloaded
2026-01-28 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F68%252Fa468c3ca40e89822d051926d13d57bee%252Fpa%252FYF03043_acf273996f7ba722cc362d0df5ea8917.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/68/a468c3ca40e89822d051926d13d57bee/pa/YF03043_acf273996f7ba722cc362d0df5ea8917.jpg already downloaded
2026-01-28 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F68%252Fa468c3ca40e89822d051926d13d57bee%252Fpa%252FYF03043_e0dec6c1cd8b3f458d3952a7e7d768d4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/68/a468c3ca40e89822d051926d13d57bee/pa/YF03043_e0dec6c1cd8b3f458d3952a7e7d768d4.jpg already downloaded
2026-01-28 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F68%252Fa468c3ca40e89822d051926d13d57bee%252Fpa%252FYF03043_83b5ba95cb91296d1a81c6cca0847216.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/68/a468c3ca40e89822d051926d13d57bee/pa/YF03043_83b5ba95cb91296d1a81c6cca0847216.jpg already downloaded
2026-01-28 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F68%252Fa468c3ca40e89822d051926d13d57bee%252Fpa%252FYF03043_a3c57f812e89bca9a771a10e29acc864.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/68/a468c3ca40e89822d051926d13d57bee/pa/YF03043_a3c57f812e89bca9a771a10e29acc864.jpg already downloaded
2026-01-28 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F68%252Fa468c3ca40e89822d051926d13d57bee%252Fpa%252FYF03043_ad859f44dbf466b57330cc1aa78ae886.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/68/a468c3ca40e89822d051926d13d57bee/pa/YF03043_ad859f44dbf466b57330cc1aa78ae886.jpg already downloaded
2026-01-28 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F68%252Fa468c3ca40e89822d051926d13d57bee%252Fpa%252FYF03043_82111ab642cd8b8185f05f0e9759a6f2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/68/a468c3ca40e89822d051926d13d57bee/pa/YF03043_82111ab642cd8b8185f05f0e9759a6f2.jpg already downloaded
2026-01-28 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F68%252Fa468c3ca40e89822d051926d13d57bee%252Fpa%252FYF03043_6fcd4126005d0261452ccf79976c0c6a.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/68/a468c3ca40e89822d051926d13d57bee/pa/YF03043_6fcd4126005d0261452ccf79976c0c6a.jpg already downloaded
2026-01-28 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252F68%252Fa468c3ca40e89822d051926d13d57bee%252Fpa%252FYF03043_7b1467cf58c21c32dda22a1ba6f9f42c.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/68/a468c3ca40e89822d051926d13d57bee/pa/YF03043_7b1467cf58c21c32dda22a1ba6f9f42c.jpg already downloaded
2026-01-28 20:06:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8213894a-9920-5f26-b111-e73a97a50c72, identifier: YF03043
2026-01-28 20:06:06 [auto1.it] INFO: Found listing with ID: YM94819
2026-01-28 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YM94819%27 HTTP/1.1" 200 None
2026-01-28 20:06:06 [auto1.it] INFO: Scrape type for YM94819: 2
2026-01-28 20:06:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8213894a-9920-5f26-b111-e73a97a50c72 with identifier: YF03043
2026-01-28 20:06:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8213894a-9920-5f26-b111-e73a97a50c72 with identifier: YF03043
2026-01-28 20:06:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8213894a-9920-5f26-b111-e73a97a50c72 with identifier: YF03043 to the API
2026-01-28 20:06:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:06:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:06:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YF03043>
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.5L',
 'engine_horse_power': 105,
 'expiration_date': '2026-01-29T16:15:13Z',
 'fuel_type': 'diesel',
 'id': '8213894a-9920-5f26-b111-e73a97a50c72',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YF03043',
 'listing': 'auction',
 'location': 'IT, Senago (MI)',
 'make': 'Mazda',
 'model': 'CX-3',
 'odometer': 128277,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imga4/68/a468c3ca40e89822d051926d13d57bee/pa/YF03043_cd2c6c688cf9dc14ca157b1259072290.jpg',
                'https://img-pa.auto1.com/imga4/68/a468c3ca40e89822d051926d13d57bee/pa/YF03043_35461f3664c0b4cfbab4e74b1d24e0d0.jpg',
                'https://img-pa.auto1.com/imga4/68/a468c3ca40e89822d051926d13d57bee/pa/YF03043_982e6825950a0476bf9844a7fe7ab248.jpg',
                'https://img-pa.auto1.com/imga4/68/a468c3ca40e89822d051926d13d57bee/pa/YF03043_aba2d57792c1d1d25edd7bd858510458.jpg',
                'https://img-pa.auto1.com/imga4/68/a468c3ca40e89822d051926d13d57bee/pa/YF03043_347ab28d5fbaa34ed7cc4cd1f496b660.jpg',
                'https://img-pa.auto1.com/imga4/68/a468c3ca40e89822d051926d13d57bee/pa/YF03043_37b4e14085ac7f0348ee823b830125df.jpg',
                'https://img-pa.auto1.com/imga4/68/a468c3ca40e89822d051926d13d57bee/pa/YF03043_7f34ac44ed6a1dbf886fe18a83471348.jpg',
                'https://img-pa.auto1.com/imga4/68/a468c3ca40e89822d051926d13d57bee/pa/YF03043_acf273996f7ba722cc362d0df5ea8917.jpg',
                'https://img-pa.auto1.com/imga4/68/a468c3ca40e89822d051926d13d57bee/pa/YF03043_e0dec6c1cd8b3f458d3952a7e7d768d4.jpg',
                'https://img-pa.auto1.com/imga4/68/a468c3ca40e89822d051926d13d57bee/pa/YF03043_83b5ba95cb91296d1a81c6cca0847216.jpg',
                'https://img-pa.auto1.com/imga4/68/a468c3ca40e89822d051926d13d57bee/pa/YF03043_a3c57f812e89bca9a771a10e29acc864.jpg',
                'https://img-pa.auto1.com/imga4/68/a468c3ca40e89822d051926d13d57bee/pa/YF03043_ad859f44dbf466b57330cc1aa78ae886.jpg',
                'https://img-pa.auto1.com/imga4/68/a468c3ca40e89822d051926d13d57bee/pa/YF03043_82111ab642cd8b8185f05f0e9759a6f2.jpg',
                'https://img-pa.auto1.com/imga4/68/a468c3ca40e89822d051926d13d57bee/pa/YF03043_6fcd4126005d0261452ccf79976c0c6a.jpg',
                'https://img-pa.auto1.com/imga4/68/a468c3ca40e89822d051926d13d57bee/pa/YF03043_7b1467cf58c21c32dda22a1ba6f9f42c.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8213894a-9920-5f26-b111-e73a97a50c72/8213894a-9920-5f26-b111-e73a97a50c72_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63719,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/68/a468c3ca40e89822d051926d13d57bee/pa/YF03043_cd2c6c688cf9dc14ca157b1259072290.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8213894a-9920-5f26-b111-e73a97a50c72/8213894a-9920-5f26-b111-e73a97a50c72_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57566,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/68/a468c3ca40e89822d051926d13d57bee/pa/YF03043_35461f3664c0b4cfbab4e74b1d24e0d0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8213894a-9920-5f26-b111-e73a97a50c72/8213894a-9920-5f26-b111-e73a97a50c72_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56637,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/68/a468c3ca40e89822d051926d13d57bee/pa/YF03043_982e6825950a0476bf9844a7fe7ab248.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8213894a-9920-5f26-b111-e73a97a50c72/8213894a-9920-5f26-b111-e73a97a50c72_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55468,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/68/a468c3ca40e89822d051926d13d57bee/pa/YF03043_aba2d57792c1d1d25edd7bd858510458.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8213894a-9920-5f26-b111-e73a97a50c72/8213894a-9920-5f26-b111-e73a97a50c72_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57311,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/68/a468c3ca40e89822d051926d13d57bee/pa/YF03043_347ab28d5fbaa34ed7cc4cd1f496b660.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8213894a-9920-5f26-b111-e73a97a50c72/8213894a-9920-5f26-b111-e73a97a50c72_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60761,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/68/a468c3ca40e89822d051926d13d57bee/pa/YF03043_37b4e14085ac7f0348ee823b830125df.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8213894a-9920-5f26-b111-e73a97a50c72/8213894a-9920-5f26-b111-e73a97a50c72_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47108,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/68/a468c3ca40e89822d051926d13d57bee/pa/YF03043_7f34ac44ed6a1dbf886fe18a83471348.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8213894a-9920-5f26-b111-e73a97a50c72/8213894a-9920-5f26-b111-e73a97a50c72_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66542,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/68/a468c3ca40e89822d051926d13d57bee/pa/YF03043_acf273996f7ba722cc362d0df5ea8917.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8213894a-9920-5f26-b111-e73a97a50c72/8213894a-9920-5f26-b111-e73a97a50c72_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57129,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/68/a468c3ca40e89822d051926d13d57bee/pa/YF03043_e0dec6c1cd8b3f458d3952a7e7d768d4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8213894a-9920-5f26-b111-e73a97a50c72/8213894a-9920-5f26-b111-e73a97a50c72_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46747,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/68/a468c3ca40e89822d051926d13d57bee/pa/YF03043_83b5ba95cb91296d1a81c6cca0847216.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8213894a-9920-5f26-b111-e73a97a50c72/8213894a-9920-5f26-b111-e73a97a50c72_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52640,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/68/a468c3ca40e89822d051926d13d57bee/pa/YF03043_a3c57f812e89bca9a771a10e29acc864.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8213894a-9920-5f26-b111-e73a97a50c72/8213894a-9920-5f26-b111-e73a97a50c72_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58787,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/68/a468c3ca40e89822d051926d13d57bee/pa/YF03043_ad859f44dbf466b57330cc1aa78ae886.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8213894a-9920-5f26-b111-e73a97a50c72/8213894a-9920-5f26-b111-e73a97a50c72_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57538,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/68/a468c3ca40e89822d051926d13d57bee/pa/YF03043_82111ab642cd8b8185f05f0e9759a6f2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8213894a-9920-5f26-b111-e73a97a50c72/8213894a-9920-5f26-b111-e73a97a50c72_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35041,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/68/a468c3ca40e89822d051926d13d57bee/pa/YF03043_6fcd4126005d0261452ccf79976c0c6a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8213894a-9920-5f26-b111-e73a97a50c72/8213894a-9920-5f26-b111-e73a97a50c72_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72001,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga4/68/a468c3ca40e89822d051926d13d57bee/pa/YF03043_7b1467cf58c21c32dda22a1ba6f9f42c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-04-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mazda CX-3 1.5 Diesel Evolve',
 'transmission': 'manual',
 'trim': 'Evolve',
 'year': 2018}
2026-01-28 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YF03043%27 HTTP/1.1" 200 None
2026-01-28 20:06:06 [auto1.it] INFO: Saving data for YF03043: {'created_time': 1769630766.707231, 'last_price_update_time': 1769630766.707244, 'auction_closing_time': 1769703313.0}
2026-01-28 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YF03043') HTTP/1.1" 204 0
2026-01-28 20:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/b4/4fb4ec31496439d2846b55a99cd2b5ae/pa/BE15819_7a2b4f6b172c42d477e793a82e1bcfc1.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:06:06 [auto1.it] INFO: Found listing with ID: ZT06764
2026-01-28 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZT06764%27 HTTP/1.1" 200 None
2026-01-28 20:06:06 [auto1.it] INFO: Scrape type for ZT06764: 1
2026-01-28 20:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PX44496/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SF52848> (referer: https://www.auto1.com/v1/car-details-view/SF52848/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WL72741/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EF46876> (referer: https://www.auto1.com/v1/car-details-view/EF46876/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:06:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:06:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:06:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:06:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:06:06 [auto1.it] INFO: Found listing with ID: KT18742
2026-01-28 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KT18742%27 HTTP/1.1" 200 None
2026-01-28 20:06:06 [auto1.it] INFO: Scrape type for KT18742: 2
2026-01-28 20:06:06 [auto1.it] INFO: Found listing with ID: ZS31369
2026-01-28 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZS31369%27 HTTP/1.1" 200 None
2026-01-28 20:06:06 [auto1.it] INFO: Scrape type for ZS31369: 2
2026-01-28 20:06:06 [auto1.it] INFO: Found listing with ID: GA26401
2026-01-28 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GA26401%27 HTTP/1.1" 200 None
2026-01-28 20:06:06 [auto1.it] INFO: Scrape type for GA26401: 1
2026-01-28 20:06:06 [auto1.it] INFO: Found listing with ID: VV63858
2026-01-28 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VV63858%27 HTTP/1.1" 200 None
2026-01-28 20:06:06 [auto1.it] INFO: Scrape type for VV63858: 1
2026-01-28 20:06:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b086b8ed0>
2026-01-28 20:06:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a23c743d-1f5c-5ce1-98dd-2048bdcb6fb9/a23c743d-1f5c-5ce1-98dd-2048bdcb6fb9_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252Fb4%252F4fb4ec31496439d2846b55a99cd2b5ae%252Fpa%252FBE15819_7a2b4f6b172c42d477e793a82e1bcfc1.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/b4/4fb4ec31496439d2846b55a99cd2b5ae/pa/BE15819_7a2b4f6b172c42d477e793a82e1bcfc1.jpg saved to cache
2026-01-28 20:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item a23c743d-1f5c-5ce1-98dd-2048bdcb6fb9
2026-01-28 20:06:07 [auto1.it] INFO: Found listing with ID: NF45221
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NF45221%27 HTTP/1.1" 200 None
2026-01-28 20:06:07 [auto1.it] INFO: Scrape type for NF45221: 2
2026-01-28 20:06:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec1e9b01-9341-542b-8c7d-9d81540fab2f with identifier: SF52848
2026-01-28 20:06:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec1e9b01-9341-542b-8c7d-9d81540fab2f with scrape type 1
2026-01-28 20:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item ec1e9b01-9341-542b-8c7d-9d81540fab2f
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F89%252F4d898d04bfa64fb7d837029682541bad%252Fpa%252FSF52848_b12d7315afa65e4ffd68e18f01e6efb9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/89/4d898d04bfa64fb7d837029682541bad/pa/SF52848_b12d7315afa65e4ffd68e18f01e6efb9.jpg already downloaded
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F89%252F4d898d04bfa64fb7d837029682541bad%252Fpa%252FSF52848_53385f3451f38b969c1235369153df17.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/89/4d898d04bfa64fb7d837029682541bad/pa/SF52848_53385f3451f38b969c1235369153df17.jpg already downloaded
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F89%252F4d898d04bfa64fb7d837029682541bad%252Fpa%252FSF52848_eb99a70ffb224f956c3f465bf3d1c217.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/89/4d898d04bfa64fb7d837029682541bad/pa/SF52848_eb99a70ffb224f956c3f465bf3d1c217.jpg already downloaded
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F89%252F4d898d04bfa64fb7d837029682541bad%252Fpa%252FSF52848_ddc532a5cff3139446705c3422e3f564.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/89/4d898d04bfa64fb7d837029682541bad/pa/SF52848_ddc532a5cff3139446705c3422e3f564.jpg already downloaded
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F89%252F4d898d04bfa64fb7d837029682541bad%252Fpa%252FSF52848_44ea0e92ac98e81daf9c06a086eb260f.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/89/4d898d04bfa64fb7d837029682541bad/pa/SF52848_44ea0e92ac98e81daf9c06a086eb260f.jpg already downloaded
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F89%252F4d898d04bfa64fb7d837029682541bad%252Fpa%252FSF52848_db8da7df33829d46b1e372f00e70b407.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/89/4d898d04bfa64fb7d837029682541bad/pa/SF52848_db8da7df33829d46b1e372f00e70b407.jpg already downloaded
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F89%252F4d898d04bfa64fb7d837029682541bad%252Fpa%252FSF52848_39112b50ec06d06de912a5d6d4c74b7d.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/89/4d898d04bfa64fb7d837029682541bad/pa/SF52848_39112b50ec06d06de912a5d6d4c74b7d.jpg already downloaded
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F89%252F4d898d04bfa64fb7d837029682541bad%252Fpa%252FSF52848_c23cad7c79b36fc690d5cce5e0ec8a0f.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/89/4d898d04bfa64fb7d837029682541bad/pa/SF52848_c23cad7c79b36fc690d5cce5e0ec8a0f.jpg already downloaded
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F89%252F4d898d04bfa64fb7d837029682541bad%252Fpa%252FSF52848_3800dd86eb95ff9a0e80f74dcfd2c472.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/89/4d898d04bfa64fb7d837029682541bad/pa/SF52848_3800dd86eb95ff9a0e80f74dcfd2c472.jpg already downloaded
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F89%252F4d898d04bfa64fb7d837029682541bad%252Fpa%252FSF52848_47ed59082fa0bb95b34a2ac83074bfe3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/89/4d898d04bfa64fb7d837029682541bad/pa/SF52848_47ed59082fa0bb95b34a2ac83074bfe3.jpg already downloaded
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F89%252F4d898d04bfa64fb7d837029682541bad%252Fpa%252FSF52848_eaf7a550a5059d38858f7e9a40f204f4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/89/4d898d04bfa64fb7d837029682541bad/pa/SF52848_eaf7a550a5059d38858f7e9a40f204f4.jpg already downloaded
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F89%252F4d898d04bfa64fb7d837029682541bad%252Fpa%252FSF52848_24ac7c8c77d704cafec9a19f5fbd6210.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/89/4d898d04bfa64fb7d837029682541bad/pa/SF52848_24ac7c8c77d704cafec9a19f5fbd6210.jpg already downloaded
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F89%252F4d898d04bfa64fb7d837029682541bad%252Fpa%252FSF52848_ac820e238ee76a99ff5d1ec18ecf0d9b.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/89/4d898d04bfa64fb7d837029682541bad/pa/SF52848_ac820e238ee76a99ff5d1ec18ecf0d9b.jpg already downloaded
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F89%252F4d898d04bfa64fb7d837029682541bad%252Fpa%252FSF52848_fc65223703ff4cdfef8dc390bf3d5170.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/89/4d898d04bfa64fb7d837029682541bad/pa/SF52848_fc65223703ff4cdfef8dc390bf3d5170.jpg already downloaded
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F89%252F4d898d04bfa64fb7d837029682541bad%252Fpa%252FSF52848_59ae569b376a3af057e1d4a1af4d4f32.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/89/4d898d04bfa64fb7d837029682541bad/pa/SF52848_59ae569b376a3af057e1d4a1af4d4f32.jpg already downloaded
2026-01-28 20:06:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ec1e9b01-9341-542b-8c7d-9d81540fab2f, identifier: SF52848
2026-01-28 20:06:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4b022d89-a16f-5acb-9356-e8222705ed2c with identifier: EF46876
2026-01-28 20:06:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b022d89-a16f-5acb-9356-e8222705ed2c with scrape type 1
2026-01-28 20:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 4b022d89-a16f-5acb-9356-e8222705ed2c
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F09%252Fd30937806f4ba02d9b16b9f6b1f6c489%252Fpa%252FEF46876_bb94a14b4d002426133158eaba102ac6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/09/d30937806f4ba02d9b16b9f6b1f6c489/pa/EF46876_bb94a14b4d002426133158eaba102ac6.jpg already downloaded
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F09%252Fd30937806f4ba02d9b16b9f6b1f6c489%252Fpa%252FEF46876_da5943ec69e92a602789644f24f06b9c.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/09/d30937806f4ba02d9b16b9f6b1f6c489/pa/EF46876_da5943ec69e92a602789644f24f06b9c.jpg already downloaded
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F09%252Fd30937806f4ba02d9b16b9f6b1f6c489%252Fpa%252FEF46876_7503f2c361d9557e7f43040cde1c9ebe.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/09/d30937806f4ba02d9b16b9f6b1f6c489/pa/EF46876_7503f2c361d9557e7f43040cde1c9ebe.jpg already downloaded
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F09%252Fd30937806f4ba02d9b16b9f6b1f6c489%252Fpa%252FEF46876_7978e8154ba66dbb5e9f26867a173d0f.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/09/d30937806f4ba02d9b16b9f6b1f6c489/pa/EF46876_7978e8154ba66dbb5e9f26867a173d0f.jpg already downloaded
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F09%252Fd30937806f4ba02d9b16b9f6b1f6c489%252Fpa%252FEF46876_32a88994c945b2eb29ccee8ffa5230af.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/09/d30937806f4ba02d9b16b9f6b1f6c489/pa/EF46876_32a88994c945b2eb29ccee8ffa5230af.jpg already downloaded
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F09%252Fd30937806f4ba02d9b16b9f6b1f6c489%252Fpa%252FEF46876_52b79928bb59ea4c7fc5666658d9d8fa.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/09/d30937806f4ba02d9b16b9f6b1f6c489/pa/EF46876_52b79928bb59ea4c7fc5666658d9d8fa.jpg already downloaded
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F09%252Fd30937806f4ba02d9b16b9f6b1f6c489%252Fpa%252FEF46876_a8e11ce04e39cf08bc4605f715063f21.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/09/d30937806f4ba02d9b16b9f6b1f6c489/pa/EF46876_a8e11ce04e39cf08bc4605f715063f21.jpg already downloaded
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F09%252Fd30937806f4ba02d9b16b9f6b1f6c489%252Fpa%252FEF46876_7c0fa8f99d677be2ad214e801b03370d.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/09/d30937806f4ba02d9b16b9f6b1f6c489/pa/EF46876_7c0fa8f99d677be2ad214e801b03370d.jpg already downloaded
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F09%252Fd30937806f4ba02d9b16b9f6b1f6c489%252Fpa%252FEF46876_7a35097a6dc635c3935b5b70f07a93f4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/09/d30937806f4ba02d9b16b9f6b1f6c489/pa/EF46876_7a35097a6dc635c3935b5b70f07a93f4.jpg already downloaded
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F09%252Fd30937806f4ba02d9b16b9f6b1f6c489%252Fpa%252FEF46876_272b260894e3451d4e87c1341200fdb4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/09/d30937806f4ba02d9b16b9f6b1f6c489/pa/EF46876_272b260894e3451d4e87c1341200fdb4.jpg already downloaded
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F09%252Fd30937806f4ba02d9b16b9f6b1f6c489%252Fpa%252FEF46876_069e943339fa4492d19d26d5250b5704.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/09/d30937806f4ba02d9b16b9f6b1f6c489/pa/EF46876_069e943339fa4492d19d26d5250b5704.jpg already downloaded
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F09%252Fd30937806f4ba02d9b16b9f6b1f6c489%252Fpa%252FEF46876_fbf0582015ae5b3474bad84da1b8c445.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/09/d30937806f4ba02d9b16b9f6b1f6c489/pa/EF46876_fbf0582015ae5b3474bad84da1b8c445.jpg already downloaded
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F09%252Fd30937806f4ba02d9b16b9f6b1f6c489%252Fpa%252FEF46876_df00ac94f8c7378f3ee04a93f5e9cd73.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/09/d30937806f4ba02d9b16b9f6b1f6c489/pa/EF46876_df00ac94f8c7378f3ee04a93f5e9cd73.jpg already downloaded
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F09%252Fd30937806f4ba02d9b16b9f6b1f6c489%252Fpa%252FEF46876_3bb46c8e03a62ba0015c713b0ecb2f00.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/09/d30937806f4ba02d9b16b9f6b1f6c489/pa/EF46876_3bb46c8e03a62ba0015c713b0ecb2f00.jpg already downloaded
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F09%252Fd30937806f4ba02d9b16b9f6b1f6c489%252Fpa%252FEF46876_4f0d2b461dfa2ddff8cc7c12c5c3bfb2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/09/d30937806f4ba02d9b16b9f6b1f6c489/pa/EF46876_4f0d2b461dfa2ddff8cc7c12c5c3bfb2.jpg already downloaded
2026-01-28 20:06:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4b022d89-a16f-5acb-9356-e8222705ed2c, identifier: EF46876
2026-01-28 20:06:08 [auto1.it] INFO: Found listing with ID: WV62374
2026-01-28 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WV62374%27 HTTP/1.1" 200 None
2026-01-28 20:06:08 [auto1.it] INFO: Scrape type for WV62374: 2
2026-01-28 20:06:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ec1e9b01-9341-542b-8c7d-9d81540fab2f with identifier: SF52848
2026-01-28 20:06:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ec1e9b01-9341-542b-8c7d-9d81540fab2f with identifier: SF52848
2026-01-28 20:06:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ec1e9b01-9341-542b-8c7d-9d81540fab2f with identifier: SF52848 to the API
2026-01-28 20:06:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:06:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:06:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SF52848>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'category': None,
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.6L',
 'engine_horse_power': 135,
 'expiration_date': '2026-01-29T16:23:28Z',
 'fuel_type': 'diesel',
 'id': 'ec1e9b01-9341-542b-8c7d-9d81540fab2f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SF52848',
 'listing': 'auction',
 'location': 'IT, Milano',
 'make': 'Opel',
 'model': 'Mokka X',
 'odometer': 139722,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img4d/89/4d898d04bfa64fb7d837029682541bad/pa/SF52848_b12d7315afa65e4ffd68e18f01e6efb9.jpg',
                'https://img-pa.auto1.com/img4d/89/4d898d04bfa64fb7d837029682541bad/pa/SF52848_53385f3451f38b969c1235369153df17.jpg',
                'https://img-pa.auto1.com/img4d/89/4d898d04bfa64fb7d837029682541bad/pa/SF52848_eb99a70ffb224f956c3f465bf3d1c217.jpg',
                'https://img-pa.auto1.com/img4d/89/4d898d04bfa64fb7d837029682541bad/pa/SF52848_ddc532a5cff3139446705c3422e3f564.jpg',
                'https://img-pa.auto1.com/img4d/89/4d898d04bfa64fb7d837029682541bad/pa/SF52848_44ea0e92ac98e81daf9c06a086eb260f.jpg',
                'https://img-pa.auto1.com/img4d/89/4d898d04bfa64fb7d837029682541bad/pa/SF52848_db8da7df33829d46b1e372f00e70b407.jpg',
                'https://img-pa.auto1.com/img4d/89/4d898d04bfa64fb7d837029682541bad/pa/SF52848_39112b50ec06d06de912a5d6d4c74b7d.jpg',
                'https://img-pa.auto1.com/img4d/89/4d898d04bfa64fb7d837029682541bad/pa/SF52848_c23cad7c79b36fc690d5cce5e0ec8a0f.jpg',
                'https://img-pa.auto1.com/img4d/89/4d898d04bfa64fb7d837029682541bad/pa/SF52848_3800dd86eb95ff9a0e80f74dcfd2c472.jpg',
                'https://img-pa.auto1.com/img4d/89/4d898d04bfa64fb7d837029682541bad/pa/SF52848_47ed59082fa0bb95b34a2ac83074bfe3.jpg',
                'https://img-pa.auto1.com/img4d/89/4d898d04bfa64fb7d837029682541bad/pa/SF52848_eaf7a550a5059d38858f7e9a40f204f4.jpg',
                'https://img-pa.auto1.com/img4d/89/4d898d04bfa64fb7d837029682541bad/pa/SF52848_24ac7c8c77d704cafec9a19f5fbd6210.jpg',
                'https://img-pa.auto1.com/img4d/89/4d898d04bfa64fb7d837029682541bad/pa/SF52848_ac820e238ee76a99ff5d1ec18ecf0d9b.jpg',
                'https://img-pa.auto1.com/img4d/89/4d898d04bfa64fb7d837029682541bad/pa/SF52848_fc65223703ff4cdfef8dc390bf3d5170.jpg',
                'https://img-pa.auto1.com/img4d/89/4d898d04bfa64fb7d837029682541bad/pa/SF52848_59ae569b376a3af057e1d4a1af4d4f32.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec1e9b01-9341-542b-8c7d-9d81540fab2f/ec1e9b01-9341-542b-8c7d-9d81540fab2f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66142,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/89/4d898d04bfa64fb7d837029682541bad/pa/SF52848_b12d7315afa65e4ffd68e18f01e6efb9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec1e9b01-9341-542b-8c7d-9d81540fab2f/ec1e9b01-9341-542b-8c7d-9d81540fab2f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62782,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/89/4d898d04bfa64fb7d837029682541bad/pa/SF52848_53385f3451f38b969c1235369153df17.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec1e9b01-9341-542b-8c7d-9d81540fab2f/ec1e9b01-9341-542b-8c7d-9d81540fab2f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61660,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/89/4d898d04bfa64fb7d837029682541bad/pa/SF52848_eb99a70ffb224f956c3f465bf3d1c217.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec1e9b01-9341-542b-8c7d-9d81540fab2f/ec1e9b01-9341-542b-8c7d-9d81540fab2f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52945,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/89/4d898d04bfa64fb7d837029682541bad/pa/SF52848_ddc532a5cff3139446705c3422e3f564.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec1e9b01-9341-542b-8c7d-9d81540fab2f/ec1e9b01-9341-542b-8c7d-9d81540fab2f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53733,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/89/4d898d04bfa64fb7d837029682541bad/pa/SF52848_44ea0e92ac98e81daf9c06a086eb260f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec1e9b01-9341-542b-8c7d-9d81540fab2f/ec1e9b01-9341-542b-8c7d-9d81540fab2f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60435,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/89/4d898d04bfa64fb7d837029682541bad/pa/SF52848_db8da7df33829d46b1e372f00e70b407.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec1e9b01-9341-542b-8c7d-9d81540fab2f/ec1e9b01-9341-542b-8c7d-9d81540fab2f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52417,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/89/4d898d04bfa64fb7d837029682541bad/pa/SF52848_39112b50ec06d06de912a5d6d4c74b7d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec1e9b01-9341-542b-8c7d-9d81540fab2f/ec1e9b01-9341-542b-8c7d-9d81540fab2f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64787,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/89/4d898d04bfa64fb7d837029682541bad/pa/SF52848_c23cad7c79b36fc690d5cce5e0ec8a0f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec1e9b01-9341-542b-8c7d-9d81540fab2f/ec1e9b01-9341-542b-8c7d-9d81540fab2f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63735,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/89/4d898d04bfa64fb7d837029682541bad/pa/SF52848_3800dd86eb95ff9a0e80f74dcfd2c472.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec1e9b01-9341-542b-8c7d-9d81540fab2f/ec1e9b01-9341-542b-8c7d-9d81540fab2f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53372,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/89/4d898d04bfa64fb7d837029682541bad/pa/SF52848_47ed59082fa0bb95b34a2ac83074bfe3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec1e9b01-9341-542b-8c7d-9d81540fab2f/ec1e9b01-9341-542b-8c7d-9d81540fab2f_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63173,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/89/4d898d04bfa64fb7d837029682541bad/pa/SF52848_eaf7a550a5059d38858f7e9a40f204f4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec1e9b01-9341-542b-8c7d-9d81540fab2f/ec1e9b01-9341-542b-8c7d-9d81540fab2f_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65819,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/89/4d898d04bfa64fb7d837029682541bad/pa/SF52848_24ac7c8c77d704cafec9a19f5fbd6210.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec1e9b01-9341-542b-8c7d-9d81540fab2f/ec1e9b01-9341-542b-8c7d-9d81540fab2f_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86022,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/89/4d898d04bfa64fb7d837029682541bad/pa/SF52848_ac820e238ee76a99ff5d1ec18ecf0d9b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec1e9b01-9341-542b-8c7d-9d81540fab2f/ec1e9b01-9341-542b-8c7d-9d81540fab2f_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52470,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/89/4d898d04bfa64fb7d837029682541bad/pa/SF52848_fc65223703ff4cdfef8dc390bf3d5170.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec1e9b01-9341-542b-8c7d-9d81540fab2f/ec1e9b01-9341-542b-8c7d-9d81540fab2f_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43052,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/89/4d898d04bfa64fb7d837029682541bad/pa/SF52848_59ae569b376a3af057e1d4a1af4d4f32.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-02-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Mokka X 1.6 CDTI DPF B-Color S&S',
 'transmission': 'manual',
 'trim': 'B-Color S&S',
 'year': 2018}
2026-01-28 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SF52848%27 HTTP/1.1" 200 None
2026-01-28 20:06:08 [auto1.it] INFO: Saving data for SF52848: {'created_time': 1769630768.394134, 'last_price_update_time': 1769630768.394143, 'auction_closing_time': 1769703808.0}
2026-01-28 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SF52848') HTTP/1.1" 204 0
2026-01-28 20:06:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4b022d89-a16f-5acb-9356-e8222705ed2c with identifier: EF46876
2026-01-28 20:06:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4b022d89-a16f-5acb-9356-e8222705ed2c with identifier: EF46876
2026-01-28 20:06:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4b022d89-a16f-5acb-9356-e8222705ed2c with identifier: EF46876 to the API
2026-01-28 20:06:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:06:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:06:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EF46876>
{'auction_title': '',
 'c_o_2_emission_value': 169,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '3.0L',
 'engine_horse_power': 320,
 'expiration_date': '2026-01-29T16:52:43Z',
 'fuel_type': 'diesel',
 'id': '4b022d89-a16f-5acb-9356-e8222705ed2c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EF46876',
 'listing': 'auction',
 'location': 'IT, Castelnuovo del Garda (VR)',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 110377,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgd3/09/d30937806f4ba02d9b16b9f6b1f6c489/pa/EF46876_bb94a14b4d002426133158eaba102ac6.jpg',
                'https://img-pa.auto1.com/imgd3/09/d30937806f4ba02d9b16b9f6b1f6c489/pa/EF46876_da5943ec69e92a602789644f24f06b9c.jpg',
                'https://img-pa.auto1.com/imgd3/09/d30937806f4ba02d9b16b9f6b1f6c489/pa/EF46876_7503f2c361d9557e7f43040cde1c9ebe.jpg',
                'https://img-pa.auto1.com/imgd3/09/d30937806f4ba02d9b16b9f6b1f6c489/pa/EF46876_7978e8154ba66dbb5e9f26867a173d0f.jpg',
                'https://img-pa.auto1.com/imgd3/09/d30937806f4ba02d9b16b9f6b1f6c489/pa/EF46876_32a88994c945b2eb29ccee8ffa5230af.jpg',
                'https://img-pa.auto1.com/imgd3/09/d30937806f4ba02d9b16b9f6b1f6c489/pa/EF46876_52b79928bb59ea4c7fc5666658d9d8fa.jpg',
                'https://img-pa.auto1.com/imgd3/09/d30937806f4ba02d9b16b9f6b1f6c489/pa/EF46876_a8e11ce04e39cf08bc4605f715063f21.jpg',
                'https://img-pa.auto1.com/imgd3/09/d30937806f4ba02d9b16b9f6b1f6c489/pa/EF46876_7c0fa8f99d677be2ad214e801b03370d.jpg',
                'https://img-pa.auto1.com/imgd3/09/d30937806f4ba02d9b16b9f6b1f6c489/pa/EF46876_7a35097a6dc635c3935b5b70f07a93f4.jpg',
                'https://img-pa.auto1.com/imgd3/09/d30937806f4ba02d9b16b9f6b1f6c489/pa/EF46876_272b260894e3451d4e87c1341200fdb4.jpg',
                'https://img-pa.auto1.com/imgd3/09/d30937806f4ba02d9b16b9f6b1f6c489/pa/EF46876_069e943339fa4492d19d26d5250b5704.jpg',
                'https://img-pa.auto1.com/imgd3/09/d30937806f4ba02d9b16b9f6b1f6c489/pa/EF46876_fbf0582015ae5b3474bad84da1b8c445.jpg',
                'https://img-pa.auto1.com/imgd3/09/d30937806f4ba02d9b16b9f6b1f6c489/pa/EF46876_df00ac94f8c7378f3ee04a93f5e9cd73.jpg',
                'https://img-pa.auto1.com/imgd3/09/d30937806f4ba02d9b16b9f6b1f6c489/pa/EF46876_3bb46c8e03a62ba0015c713b0ecb2f00.jpg',
                'https://img-pa.auto1.com/imgd3/09/d30937806f4ba02d9b16b9f6b1f6c489/pa/EF46876_4f0d2b461dfa2ddff8cc7c12c5c3bfb2.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b022d89-a16f-5acb-9356-e8222705ed2c/4b022d89-a16f-5acb-9356-e8222705ed2c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71786,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/09/d30937806f4ba02d9b16b9f6b1f6c489/pa/EF46876_bb94a14b4d002426133158eaba102ac6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b022d89-a16f-5acb-9356-e8222705ed2c/4b022d89-a16f-5acb-9356-e8222705ed2c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69509,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/09/d30937806f4ba02d9b16b9f6b1f6c489/pa/EF46876_da5943ec69e92a602789644f24f06b9c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b022d89-a16f-5acb-9356-e8222705ed2c/4b022d89-a16f-5acb-9356-e8222705ed2c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69591,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/09/d30937806f4ba02d9b16b9f6b1f6c489/pa/EF46876_7503f2c361d9557e7f43040cde1c9ebe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b022d89-a16f-5acb-9356-e8222705ed2c/4b022d89-a16f-5acb-9356-e8222705ed2c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59247,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/09/d30937806f4ba02d9b16b9f6b1f6c489/pa/EF46876_7978e8154ba66dbb5e9f26867a173d0f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b022d89-a16f-5acb-9356-e8222705ed2c/4b022d89-a16f-5acb-9356-e8222705ed2c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62563,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/09/d30937806f4ba02d9b16b9f6b1f6c489/pa/EF46876_32a88994c945b2eb29ccee8ffa5230af.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b022d89-a16f-5acb-9356-e8222705ed2c/4b022d89-a16f-5acb-9356-e8222705ed2c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65696,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/09/d30937806f4ba02d9b16b9f6b1f6c489/pa/EF46876_52b79928bb59ea4c7fc5666658d9d8fa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b022d89-a16f-5acb-9356-e8222705ed2c/4b022d89-a16f-5acb-9356-e8222705ed2c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60855,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/09/d30937806f4ba02d9b16b9f6b1f6c489/pa/EF46876_a8e11ce04e39cf08bc4605f715063f21.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b022d89-a16f-5acb-9356-e8222705ed2c/4b022d89-a16f-5acb-9356-e8222705ed2c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69106,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/09/d30937806f4ba02d9b16b9f6b1f6c489/pa/EF46876_7c0fa8f99d677be2ad214e801b03370d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b022d89-a16f-5acb-9356-e8222705ed2c/4b022d89-a16f-5acb-9356-e8222705ed2c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70331,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/09/d30937806f4ba02d9b16b9f6b1f6c489/pa/EF46876_7a35097a6dc635c3935b5b70f07a93f4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b022d89-a16f-5acb-9356-e8222705ed2c/4b022d89-a16f-5acb-9356-e8222705ed2c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54031,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/09/d30937806f4ba02d9b16b9f6b1f6c489/pa/EF46876_272b260894e3451d4e87c1341200fdb4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b022d89-a16f-5acb-9356-e8222705ed2c/4b022d89-a16f-5acb-9356-e8222705ed2c_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66995,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/09/d30937806f4ba02d9b16b9f6b1f6c489/pa/EF46876_069e943339fa4492d19d26d5250b5704.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b022d89-a16f-5acb-9356-e8222705ed2c/4b022d89-a16f-5acb-9356-e8222705ed2c_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59246,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/09/d30937806f4ba02d9b16b9f6b1f6c489/pa/EF46876_fbf0582015ae5b3474bad84da1b8c445.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b022d89-a16f-5acb-9356-e8222705ed2c/4b022d89-a16f-5acb-9356-e8222705ed2c_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75890,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/09/d30937806f4ba02d9b16b9f6b1f6c489/pa/EF46876_df00ac94f8c7378f3ee04a93f5e9cd73.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b022d89-a16f-5acb-9356-e8222705ed2c/4b022d89-a16f-5acb-9356-e8222705ed2c_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59324,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/09/d30937806f4ba02d9b16b9f6b1f6c489/pa/EF46876_3bb46c8e03a62ba0015c713b0ecb2f00.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b022d89-a16f-5acb-9356-e8222705ed2c/4b022d89-a16f-5acb-9356-e8222705ed2c_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76927,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/09/d30937806f4ba02d9b16b9f6b1f6c489/pa/EF46876_4f0d2b461dfa2ddff8cc7c12c5c3bfb2.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-05-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A6 3.0 V6 TDI clean diesel quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2018}
2026-01-28 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EF46876%27 HTTP/1.1" 200 None
2026-01-28 20:06:08 [auto1.it] INFO: Saving data for EF46876: {'created_time': 1769630768.760176, 'last_price_update_time': 1769630768.760188, 'auction_closing_time': 1769705563.0}
2026-01-28 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EF46876') HTTP/1.1" 204 0
2026-01-28 20:06:08 [auto1.it] INFO: Found listing with ID: RF65516
2026-01-28 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RF65516%27 HTTP/1.1" 200 None
2026-01-28 20:06:08 [auto1.it] INFO: Scrape type for RF65516: 1
2026-01-28 20:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SA98616/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:06:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:06:08 [auto1.it] INFO: Found listing with ID: KG16431
2026-01-28 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KG16431%27 HTTP/1.1" 200 None
2026-01-28 20:06:08 [auto1.it] INFO: Scrape type for KG16431: 1
2026-01-28 20:06:08 [auto1.it] INFO: Found listing with ID: ZS61961
2026-01-28 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZS61961%27 HTTP/1.1" 200 None
2026-01-28 20:06:08 [auto1.it] INFO: Scrape type for ZS61961: 1
2026-01-28 20:06:08 [auto1.it] INFO: Found listing with ID: VN78624
2026-01-28 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VN78624%27 HTTP/1.1" 200 None
2026-01-28 20:06:08 [auto1.it] INFO: Scrape type for VN78624: 1
2026-01-28 20:06:08 [auto1.it] INFO: Found listing with ID: VE93563
2026-01-28 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VE93563%27 HTTP/1.1" 200 None
2026-01-28 20:06:08 [auto1.it] INFO: Scrape type for VE93563: 2
2026-01-28 20:06:08 [auto1.it] INFO: Found listing with ID: ET31750
2026-01-28 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ET31750%27 HTTP/1.1" 200 None
2026-01-28 20:06:08 [auto1.it] INFO: Scrape type for ET31750: 2
2026-01-28 20:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BK51963/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:06:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GX99899/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:06:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RG29856/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:06:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:06:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:06:09 [auto1.it] INFO: Parsing search results for channel: 24h
2026-01-28 20:06:09 [auto1.it] INFO: Found listing with ID: LB26900
2026-01-28 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LB26900%27 HTTP/1.1" 200 None
2026-01-28 20:06:09 [auto1.it] INFO: Scrape type for LB26900: 0
2026-01-28 20:06:09 [auto1.it] INFO: Found listing with ID: AJ95736
2026-01-28 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AJ95736%27 HTTP/1.1" 200 None
2026-01-28 20:06:09 [auto1.it] INFO: Scrape type for AJ95736: 0
2026-01-28 20:06:09 [auto1.it] INFO: Found listing with ID: DT16990
2026-01-28 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DT16990%27 HTTP/1.1" 200 None
2026-01-28 20:06:09 [auto1.it] INFO: Scrape type for DT16990: 0
2026-01-28 20:06:09 [auto1.it] INFO: Found listing with ID: BE13421
2026-01-28 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BE13421%27 HTTP/1.1" 200 None
2026-01-28 20:06:09 [auto1.it] INFO: Scrape type for BE13421: 0
2026-01-28 20:06:09 [auto1.it] INFO: Found listing with ID: JU28816
2026-01-28 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JU28816%27 HTTP/1.1" 200 None
2026-01-28 20:06:09 [auto1.it] INFO: Scrape type for JU28816: 0
2026-01-28 20:06:09 [auto1.it] INFO: Found listing with ID: YT86489
2026-01-28 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YT86489%27 HTTP/1.1" 200 None
2026-01-28 20:06:09 [auto1.it] INFO: Scrape type for YT86489: 0
2026-01-28 20:06:09 [auto1.it] INFO: Found listing with ID: AS87469
2026-01-28 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AS87469%27 HTTP/1.1" 200 None
2026-01-28 20:06:09 [auto1.it] INFO: Scrape type for AS87469: 0
2026-01-28 20:06:09 [auto1.it] INFO: Found listing with ID: LY86301
2026-01-28 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LY86301%27 HTTP/1.1" 200 None
2026-01-28 20:06:09 [auto1.it] INFO: Scrape type for LY86301: 0
2026-01-28 20:06:09 [auto1.it] INFO: Found listing with ID: ME44035
2026-01-28 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ME44035%27 HTTP/1.1" 200 None
2026-01-28 20:06:09 [auto1.it] INFO: Scrape type for ME44035: 0
2026-01-28 20:06:09 [auto1.it] INFO: Found listing with ID: NE66733
2026-01-28 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NE66733%27 HTTP/1.1" 200 None
2026-01-28 20:06:09 [auto1.it] INFO: Scrape type for NE66733: 0
2026-01-28 20:06:09 [auto1.it] INFO: Found listing with ID: GC47799
2026-01-28 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GC47799%27 HTTP/1.1" 200 None
2026-01-28 20:06:09 [auto1.it] INFO: Scrape type for GC47799: 0
2026-01-28 20:06:09 [auto1.it] INFO: Found listing with ID: DU90270
2026-01-28 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DU90270%27 HTTP/1.1" 200 None
2026-01-28 20:06:09 [auto1.it] INFO: Scrape type for DU90270: 0
2026-01-28 20:06:09 [auto1.it] INFO: Found listing with ID: AX41377
2026-01-28 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AX41377%27 HTTP/1.1" 200 None
2026-01-28 20:06:09 [auto1.it] INFO: Scrape type for AX41377: 0
2026-01-28 20:06:09 [auto1.it] INFO: Found listing with ID: XY86470
2026-01-28 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XY86470%27 HTTP/1.1" 200 None
2026-01-28 20:06:09 [auto1.it] INFO: Scrape type for XY86470: 0
2026-01-28 20:06:09 [auto1.it] INFO: Found listing with ID: NM21779
2026-01-28 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NM21779%27 HTTP/1.1" 200 None
2026-01-28 20:06:09 [auto1.it] INFO: Scrape type for NM21779: 0
2026-01-28 20:06:09 [auto1.it] INFO: Found listing with ID: GZ41788
2026-01-28 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GZ41788%27 HTTP/1.1" 200 None
2026-01-28 20:06:09 [auto1.it] INFO: Scrape type for GZ41788: 0
2026-01-28 20:06:09 [auto1.it] INFO: Found listing with ID: MV90862
2026-01-28 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MV90862%27 HTTP/1.1" 200 None
2026-01-28 20:06:09 [auto1.it] INFO: Scrape type for MV90862: 0
2026-01-28 20:06:09 [auto1.it] INFO: Found listing with ID: NE87836
2026-01-28 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NE87836%27 HTTP/1.1" 200 None
2026-01-28 20:06:09 [auto1.it] INFO: Scrape type for NE87836: 0
2026-01-28 20:06:09 [auto1.it] INFO: Found listing with ID: ZC79626
2026-01-28 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZC79626%27 HTTP/1.1" 200 None
2026-01-28 20:06:09 [auto1.it] INFO: Scrape type for ZC79626: 0
2026-01-28 20:06:09 [auto1.it] INFO: Found listing with ID: FZ01264
2026-01-28 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FZ01264%27 HTTP/1.1" 200 None
2026-01-28 20:06:09 [auto1.it] INFO: Scrape type for FZ01264: 0
2026-01-28 20:06:09 [auto1.it] INFO: Found listing with ID: FC06007
2026-01-28 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FC06007%27 HTTP/1.1" 200 None
2026-01-28 20:06:09 [auto1.it] INFO: Scrape type for FC06007: 0
2026-01-28 20:06:09 [auto1.it] INFO: Found listing with ID: FD10963
2026-01-28 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FD10963%27 HTTP/1.1" 200 None
2026-01-28 20:06:09 [auto1.it] INFO: Scrape type for FD10963: 0
2026-01-28 20:06:09 [auto1.it] INFO: Found listing with ID: ZU18673
2026-01-28 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZU18673%27 HTTP/1.1" 200 None
2026-01-28 20:06:09 [auto1.it] INFO: Scrape type for ZU18673: 0
2026-01-28 20:06:09 [auto1.it] INFO: Found listing with ID: AE78786
2026-01-28 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AE78786%27 HTTP/1.1" 200 None
2026-01-28 20:06:09 [auto1.it] INFO: Scrape type for AE78786: 0
2026-01-28 20:06:09 [auto1.it] INFO: Found listing with ID: EE21788
2026-01-28 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EE21788%27 HTTP/1.1" 200 None
2026-01-28 20:06:09 [auto1.it] INFO: Scrape type for EE21788: 0
2026-01-28 20:06:09 [auto1.it] INFO: Found listing with ID: LA82153
2026-01-28 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LA82153%27 HTTP/1.1" 200 None
2026-01-28 20:06:09 [auto1.it] INFO: Scrape type for LA82153: 0
2026-01-28 20:06:09 [auto1.it] INFO: Found listing with ID: LM91888
2026-01-28 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LM91888%27 HTTP/1.1" 200 None
2026-01-28 20:06:10 [auto1.it] INFO: Scrape type for LM91888: 0
2026-01-28 20:06:10 [auto1.it] INFO: Found listing with ID: JN06043
2026-01-28 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JN06043%27 HTTP/1.1" 200 None
2026-01-28 20:06:10 [auto1.it] INFO: Scrape type for JN06043: 0
2026-01-28 20:06:10 [auto1.it] INFO: Found listing with ID: EE55407
2026-01-28 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EE55407%27 HTTP/1.1" 200 None
2026-01-28 20:06:10 [auto1.it] INFO: Scrape type for EE55407: 0
2026-01-28 20:06:10 [auto1.it] INFO: Found listing with ID: MP41333
2026-01-28 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MP41333%27 HTTP/1.1" 200 None
2026-01-28 20:06:10 [auto1.it] INFO: Scrape type for MP41333: 0
2026-01-28 20:06:10 [auto1.it] INFO: Found listing with ID: WK96429
2026-01-28 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WK96429%27 HTTP/1.1" 200 None
2026-01-28 20:06:10 [auto1.it] INFO: Scrape type for WK96429: 0
2026-01-28 20:06:10 [auto1.it] INFO: Found listing with ID: HL10367
2026-01-28 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HL10367%27 HTTP/1.1" 200 None
2026-01-28 20:06:10 [auto1.it] INFO: Scrape type for HL10367: 0
2026-01-28 20:06:10 [auto1.it] INFO: Found listing with ID: VB99603
2026-01-28 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VB99603%27 HTTP/1.1" 200 None
2026-01-28 20:06:10 [auto1.it] INFO: Scrape type for VB99603: 0
2026-01-28 20:06:10 [auto1.it] INFO: Found listing with ID: EH66713
2026-01-28 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EH66713%27 HTTP/1.1" 200 None
2026-01-28 20:06:10 [auto1.it] INFO: Scrape type for EH66713: 0
2026-01-28 20:06:10 [auto1.it] INFO: Found listing with ID: EK64869
2026-01-28 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EK64869%27 HTTP/1.1" 200 None
2026-01-28 20:06:10 [auto1.it] INFO: Scrape type for EK64869: 0
2026-01-28 20:06:10 [auto1.it] INFO: Found listing with ID: FU09112
2026-01-28 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FU09112%27 HTTP/1.1" 200 None
2026-01-28 20:06:10 [auto1.it] INFO: Scrape type for FU09112: 0
2026-01-28 20:06:10 [auto1.it] INFO: Found listing with ID: WM91186
2026-01-28 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WM91186%27 HTTP/1.1" 200 None
2026-01-28 20:06:10 [auto1.it] INFO: Scrape type for WM91186: 0
2026-01-28 20:06:10 [auto1.it] INFO: Found listing with ID: CL71823
2026-01-28 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CL71823%27 HTTP/1.1" 200 None
2026-01-28 20:06:10 [auto1.it] INFO: Scrape type for CL71823: 0
2026-01-28 20:06:10 [auto1.it] INFO: Found listing with ID: VJ94912
2026-01-28 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VJ94912%27 HTTP/1.1" 200 None
2026-01-28 20:06:10 [auto1.it] INFO: Scrape type for VJ94912: 0
2026-01-28 20:06:10 [auto1.it] INFO: Found listing with ID: CK57785
2026-01-28 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CK57785%27 HTTP/1.1" 200 None
2026-01-28 20:06:10 [auto1.it] INFO: Scrape type for CK57785: 0
2026-01-28 20:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XV25208> (referer: https://www.auto1.com/v1/car-details-view/XV25208/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CZ85123> (referer: https://www.auto1.com/v1/car-details-view/CZ85123/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UZ57933/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RL30055/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WA30602/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:06:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:06:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:06:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:06:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:06:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:06:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 035d9d29-7203-5eb2-b884-038b2213de1c with identifier: XV25208
2026-01-28 20:06:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 035d9d29-7203-5eb2-b884-038b2213de1c with scrape type 2
2026-01-28 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 035d9d29-7203-5eb2-b884-038b2213de1c with scrape type 2
2026-01-28 20:06:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 035d9d29-7203-5eb2-b884-038b2213de1c, identifier: XV25208
2026-01-28 20:06:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 195a16cc-4fa5-5b06-b5b5-745d18457d63 with identifier: CZ85123
2026-01-28 20:06:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 195a16cc-4fa5-5b06-b5b5-745d18457d63 with scrape type 1
2026-01-28 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 195a16cc-4fa5-5b06-b5b5-745d18457d63
2026-01-28 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F01%252F0301e59577c3e9bce06ee817ce13dc2e%252Fpa%252FCZ85123_1b2cf7b2b304dfea4a7e0d1b73023a80.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/01/0301e59577c3e9bce06ee817ce13dc2e/pa/CZ85123_1b2cf7b2b304dfea4a7e0d1b73023a80.jpg already downloaded
2026-01-28 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F01%252F0301e59577c3e9bce06ee817ce13dc2e%252Fpa%252FCZ85123_f163039c56e7b0d65015b502285edc39.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/01/0301e59577c3e9bce06ee817ce13dc2e/pa/CZ85123_f163039c56e7b0d65015b502285edc39.jpg already downloaded
2026-01-28 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F01%252F0301e59577c3e9bce06ee817ce13dc2e%252Fpa%252FCZ85123_98fa0e9d33fd98040395ef327de55c63.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/01/0301e59577c3e9bce06ee817ce13dc2e/pa/CZ85123_98fa0e9d33fd98040395ef327de55c63.jpg already downloaded
2026-01-28 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F01%252F0301e59577c3e9bce06ee817ce13dc2e%252Fpa%252FCZ85123_2af143dfc0a5678b5ff9b317d6b9ff6e.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/01/0301e59577c3e9bce06ee817ce13dc2e/pa/CZ85123_2af143dfc0a5678b5ff9b317d6b9ff6e.jpg already downloaded
2026-01-28 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F01%252F0301e59577c3e9bce06ee817ce13dc2e%252Fpa%252FCZ85123_3c90c9fff0b6893abf270bce73db0a11.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/01/0301e59577c3e9bce06ee817ce13dc2e/pa/CZ85123_3c90c9fff0b6893abf270bce73db0a11.jpg already downloaded
2026-01-28 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F01%252F0301e59577c3e9bce06ee817ce13dc2e%252Fpa%252FCZ85123_b89f02539d1f84c876030f6c0d73fe93.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/01/0301e59577c3e9bce06ee817ce13dc2e/pa/CZ85123_b89f02539d1f84c876030f6c0d73fe93.jpg already downloaded
2026-01-28 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F01%252F0301e59577c3e9bce06ee817ce13dc2e%252Fpa%252FCZ85123_4105c5d5f2d91f4c49e4244d4cab8ef4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/01/0301e59577c3e9bce06ee817ce13dc2e/pa/CZ85123_4105c5d5f2d91f4c49e4244d4cab8ef4.jpg already downloaded
2026-01-28 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F01%252F0301e59577c3e9bce06ee817ce13dc2e%252Fpa%252FCZ85123_ce9e3aa5f987333daf4ee6e88c1b4ae4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/01/0301e59577c3e9bce06ee817ce13dc2e/pa/CZ85123_ce9e3aa5f987333daf4ee6e88c1b4ae4.jpg already downloaded
2026-01-28 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F01%252F0301e59577c3e9bce06ee817ce13dc2e%252Fpa%252FCZ85123_c84e2e90f36190481d0cf880f8789451.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/01/0301e59577c3e9bce06ee817ce13dc2e/pa/CZ85123_c84e2e90f36190481d0cf880f8789451.jpg already downloaded
2026-01-28 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F01%252F0301e59577c3e9bce06ee817ce13dc2e%252Fpa%252FCZ85123_83ad4660a3e0baafd85244f281ff5959.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/01/0301e59577c3e9bce06ee817ce13dc2e/pa/CZ85123_83ad4660a3e0baafd85244f281ff5959.jpg already downloaded
2026-01-28 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F01%252F0301e59577c3e9bce06ee817ce13dc2e%252Fpa%252FCZ85123_b599f6b2ba04b154cacf09e04f482135.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/01/0301e59577c3e9bce06ee817ce13dc2e/pa/CZ85123_b599f6b2ba04b154cacf09e04f482135.jpg already downloaded
2026-01-28 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F01%252F0301e59577c3e9bce06ee817ce13dc2e%252Fpa%252FCZ85123_460902821e020646430c655da8dcb9b0.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/01/0301e59577c3e9bce06ee817ce13dc2e/pa/CZ85123_460902821e020646430c655da8dcb9b0.jpg already downloaded
2026-01-28 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F01%252F0301e59577c3e9bce06ee817ce13dc2e%252Fpa%252FCZ85123_41ee73a7bc30cfd47892e0519a802e40.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/01/0301e59577c3e9bce06ee817ce13dc2e/pa/CZ85123_41ee73a7bc30cfd47892e0519a802e40.jpg already downloaded
2026-01-28 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F01%252F0301e59577c3e9bce06ee817ce13dc2e%252Fpa%252FCZ85123_8062ad4084237a2ab681131b2ef334cb.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/01/0301e59577c3e9bce06ee817ce13dc2e/pa/CZ85123_8062ad4084237a2ab681131b2ef334cb.jpg already downloaded
2026-01-28 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F01%252F0301e59577c3e9bce06ee817ce13dc2e%252Fpa%252FCZ85123_9b9dfc810c3df1b90d8c3994a07195bf.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/01/0301e59577c3e9bce06ee817ce13dc2e/pa/CZ85123_9b9dfc810c3df1b90d8c3994a07195bf.jpg already downloaded
2026-01-28 20:06:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 195a16cc-4fa5-5b06-b5b5-745d18457d63, identifier: CZ85123
2026-01-28 20:06:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 035d9d29-7203-5eb2-b884-038b2213de1c with identifier: XV25208
2026-01-28 20:06:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 035d9d29-7203-5eb2-b884-038b2213de1c with identifier: XV25208
2026-01-28 20:06:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 035d9d29-7203-5eb2-b884-038b2213de1c with identifier: XV25208 to the API
2026-01-28 20:06:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:06:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:06:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XV25208>
{'auction_title': '',
 'c_o_2_emission_value': 171,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6C',
 'engine': '2.0L',
 'engine_horse_power': 180,
 'expiration_date': '2026-01-29T16:50:12Z',
 'fuel_type': 'diesel',
 'id': '035d9d29-7203-5eb2-b884-038b2213de1c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XV25208',
 'listing': 'auction',
 'location': 'IT, Capannori (LU)',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 104931,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-01-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Kuga 2.0 TDCi Vignale',
 'transmission': 'automatic',
 'trim': 'Vignale',
 'year': 2019}
2026-01-28 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XV25208%27 HTTP/1.1" 200 None
2026-01-28 20:06:11 [auto1.it] INFO: Saving data for XV25208: {'auction_closing_time': 1769705412.0, 'created_time': 1767125386.726156, 'last_price_update_time': 1769630771.304551}
2026-01-28 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XV25208') HTTP/1.1" 204 0
2026-01-28 20:06:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 195a16cc-4fa5-5b06-b5b5-745d18457d63 with identifier: CZ85123
2026-01-28 20:06:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 195a16cc-4fa5-5b06-b5b5-745d18457d63 with identifier: CZ85123
2026-01-28 20:06:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 195a16cc-4fa5-5b06-b5b5-745d18457d63 with identifier: CZ85123 to the API
2026-01-28 20:06:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:06:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:06:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CZ85123>
{'auction_title': '',
 'c_o_2_emission_value': 97,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6C',
 'engine': '1.2L',
 'engine_horse_power': 90,
 'expiration_date': '2026-01-29T16:14:52Z',
 'fuel_type': 'petrol',
 'id': '195a16cc-4fa5-5b06-b5b5-745d18457d63',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CZ85123',
 'listing': 'auction',
 'location': 'IT, Roma',
 'make': 'Suzuki',
 'model': 'Ignis',
 'odometer': 92166,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img03/01/0301e59577c3e9bce06ee817ce13dc2e/pa/CZ85123_1b2cf7b2b304dfea4a7e0d1b73023a80.jpg',
                'https://img-pa.auto1.com/img03/01/0301e59577c3e9bce06ee817ce13dc2e/pa/CZ85123_f163039c56e7b0d65015b502285edc39.jpg',
                'https://img-pa.auto1.com/img03/01/0301e59577c3e9bce06ee817ce13dc2e/pa/CZ85123_98fa0e9d33fd98040395ef327de55c63.jpg',
                'https://img-pa.auto1.com/img03/01/0301e59577c3e9bce06ee817ce13dc2e/pa/CZ85123_2af143dfc0a5678b5ff9b317d6b9ff6e.jpg',
                'https://img-pa.auto1.com/img03/01/0301e59577c3e9bce06ee817ce13dc2e/pa/CZ85123_3c90c9fff0b6893abf270bce73db0a11.jpg',
                'https://img-pa.auto1.com/img03/01/0301e59577c3e9bce06ee817ce13dc2e/pa/CZ85123_b89f02539d1f84c876030f6c0d73fe93.jpg',
                'https://img-pa.auto1.com/img03/01/0301e59577c3e9bce06ee817ce13dc2e/pa/CZ85123_4105c5d5f2d91f4c49e4244d4cab8ef4.jpg',
                'https://img-pa.auto1.com/img03/01/0301e59577c3e9bce06ee817ce13dc2e/pa/CZ85123_ce9e3aa5f987333daf4ee6e88c1b4ae4.jpg',
                'https://img-pa.auto1.com/img03/01/0301e59577c3e9bce06ee817ce13dc2e/pa/CZ85123_c84e2e90f36190481d0cf880f8789451.jpg',
                'https://img-pa.auto1.com/img03/01/0301e59577c3e9bce06ee817ce13dc2e/pa/CZ85123_83ad4660a3e0baafd85244f281ff5959.jpg',
                'https://img-pa.auto1.com/img03/01/0301e59577c3e9bce06ee817ce13dc2e/pa/CZ85123_b599f6b2ba04b154cacf09e04f482135.jpg',
                'https://img-pa.auto1.com/img03/01/0301e59577c3e9bce06ee817ce13dc2e/pa/CZ85123_460902821e020646430c655da8dcb9b0.jpg',
                'https://img-pa.auto1.com/img03/01/0301e59577c3e9bce06ee817ce13dc2e/pa/CZ85123_41ee73a7bc30cfd47892e0519a802e40.jpg',
                'https://img-pa.auto1.com/img03/01/0301e59577c3e9bce06ee817ce13dc2e/pa/CZ85123_8062ad4084237a2ab681131b2ef334cb.jpg',
                'https://img-pa.auto1.com/img03/01/0301e59577c3e9bce06ee817ce13dc2e/pa/CZ85123_9b9dfc810c3df1b90d8c3994a07195bf.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_195a16cc-4fa5-5b06-b5b5-745d18457d63/195a16cc-4fa5-5b06-b5b5-745d18457d63_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2886721,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img03/01/0301e59577c3e9bce06ee817ce13dc2e/pa/CZ85123_1b2cf7b2b304dfea4a7e0d1b73023a80.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_195a16cc-4fa5-5b06-b5b5-745d18457d63/195a16cc-4fa5-5b06-b5b5-745d18457d63_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2662601,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img03/01/0301e59577c3e9bce06ee817ce13dc2e/pa/CZ85123_f163039c56e7b0d65015b502285edc39.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_195a16cc-4fa5-5b06-b5b5-745d18457d63/195a16cc-4fa5-5b06-b5b5-745d18457d63_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106806,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/01/0301e59577c3e9bce06ee817ce13dc2e/pa/CZ85123_98fa0e9d33fd98040395ef327de55c63.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_195a16cc-4fa5-5b06-b5b5-745d18457d63/195a16cc-4fa5-5b06-b5b5-745d18457d63_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2150221,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img03/01/0301e59577c3e9bce06ee817ce13dc2e/pa/CZ85123_2af143dfc0a5678b5ff9b317d6b9ff6e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_195a16cc-4fa5-5b06-b5b5-745d18457d63/195a16cc-4fa5-5b06-b5b5-745d18457d63_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104356,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/01/0301e59577c3e9bce06ee817ce13dc2e/pa/CZ85123_3c90c9fff0b6893abf270bce73db0a11.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_195a16cc-4fa5-5b06-b5b5-745d18457d63/195a16cc-4fa5-5b06-b5b5-745d18457d63_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2677639,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img03/01/0301e59577c3e9bce06ee817ce13dc2e/pa/CZ85123_b89f02539d1f84c876030f6c0d73fe93.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_195a16cc-4fa5-5b06-b5b5-745d18457d63/195a16cc-4fa5-5b06-b5b5-745d18457d63_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2228599,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img03/01/0301e59577c3e9bce06ee817ce13dc2e/pa/CZ85123_4105c5d5f2d91f4c49e4244d4cab8ef4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_195a16cc-4fa5-5b06-b5b5-745d18457d63/195a16cc-4fa5-5b06-b5b5-745d18457d63_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2872605,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img03/01/0301e59577c3e9bce06ee817ce13dc2e/pa/CZ85123_ce9e3aa5f987333daf4ee6e88c1b4ae4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_195a16cc-4fa5-5b06-b5b5-745d18457d63/195a16cc-4fa5-5b06-b5b5-745d18457d63_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2905442,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img03/01/0301e59577c3e9bce06ee817ce13dc2e/pa/CZ85123_c84e2e90f36190481d0cf880f8789451.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_195a16cc-4fa5-5b06-b5b5-745d18457d63/195a16cc-4fa5-5b06-b5b5-745d18457d63_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83513,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/01/0301e59577c3e9bce06ee817ce13dc2e/pa/CZ85123_83ad4660a3e0baafd85244f281ff5959.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_195a16cc-4fa5-5b06-b5b5-745d18457d63/195a16cc-4fa5-5b06-b5b5-745d18457d63_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69343,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/01/0301e59577c3e9bce06ee817ce13dc2e/pa/CZ85123_b599f6b2ba04b154cacf09e04f482135.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_195a16cc-4fa5-5b06-b5b5-745d18457d63/195a16cc-4fa5-5b06-b5b5-745d18457d63_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67077,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/01/0301e59577c3e9bce06ee817ce13dc2e/pa/CZ85123_460902821e020646430c655da8dcb9b0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_195a16cc-4fa5-5b06-b5b5-745d18457d63/195a16cc-4fa5-5b06-b5b5-745d18457d63_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66765,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/01/0301e59577c3e9bce06ee817ce13dc2e/pa/CZ85123_41ee73a7bc30cfd47892e0519a802e40.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_195a16cc-4fa5-5b06-b5b5-745d18457d63/195a16cc-4fa5-5b06-b5b5-745d18457d63_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2245961,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img03/01/0301e59577c3e9bce06ee817ce13dc2e/pa/CZ85123_8062ad4084237a2ab681131b2ef334cb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_195a16cc-4fa5-5b06-b5b5-745d18457d63/195a16cc-4fa5-5b06-b5b5-745d18457d63_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68974,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/01/0301e59577c3e9bce06ee817ce13dc2e/pa/CZ85123_9b9dfc810c3df1b90d8c3994a07195bf.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-02-04',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Suzuki Ignis 1.2 DualJet ICool',
 'transmission': 'manual',
 'trim': 'ICool',
 'year': 2018}
2026-01-28 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CZ85123%27 HTTP/1.1" 200 None
2026-01-28 20:06:11 [auto1.it] INFO: Saving data for CZ85123: {'created_time': 1769630771.809506, 'last_price_update_time': 1769630771.80952, 'auction_closing_time': 1769703292.0}
2026-01-28 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CZ85123') HTTP/1.1" 204 0
2026-01-28 20:06:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BR27248/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:06:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:06:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YM94819/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:06:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZT06764/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:06:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DP52947> (referer: https://www.auto1.com/v1/car-details-view/DP52947/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:06:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ET31750/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:06:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VF71012> (referer: https://www.auto1.com/v1/car-details-view/VF71012/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:06:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VE93563/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:06:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:06:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 694526c2-db17-528f-915e-44590ceb86f6 with identifier: DP52947
2026-01-28 20:06:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 694526c2-db17-528f-915e-44590ceb86f6 with scrape type 2
2026-01-28 20:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 694526c2-db17-528f-915e-44590ceb86f6 with scrape type 2
2026-01-28 20:06:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 694526c2-db17-528f-915e-44590ceb86f6, identifier: DP52947
2026-01-28 20:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BN63900> (referer: https://www.auto1.com/v1/car-details-view/BN63900/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RF65516/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:06:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 694526c2-db17-528f-915e-44590ceb86f6 with identifier: DP52947
2026-01-28 20:06:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 694526c2-db17-528f-915e-44590ceb86f6 with identifier: DP52947
2026-01-28 20:06:13 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 180335 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    180335
2026-01-28 20:06:13 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 694526c2-db17-528f-915e-44590ceb86f6 spider: auto1.it
2026-01-28 20:06:13 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 694526c2-db17-528f-915e-44590ceb86f6 due to rule: high_mileage_for_country.json, error: 180335 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    180335
{'auction_title': '',
 'c_o_2_emission_value': 171,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '3.0L',
 'engine_horse_power': 349,
 'expiration_date': '2026-01-29T16:19:12Z',
 'fuel_type': 'diesel',
 'id': '694526c2-db17-528f-915e-44590ceb86f6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DP52947',
 'listing': 'auction',
 'location': 'IT, Castelnuovo del Garda (VR)',
 'make': 'Audi',
 'model': 'S6',
 'odometer': 180335,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-10-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi S6 3.0 TDI Mild-Hybrid quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2019}
2026-01-28 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DP52947%27 HTTP/1.1" 200 None
2026-01-28 20:06:13 [auto1.it] INFO: Saving data for DP52947: {'auction_closing_time': 1769703552.0, 'created_time': 1767953939.98693, 'last_price_update_time': 1769630773.143984}
2026-01-28 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DP52947') HTTP/1.1" 204 0
2026-01-28 20:06:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:06:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:06:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e027ca3-67e9-570c-acd5-c068e23d5fd7 with identifier: VF71012
2026-01-28 20:06:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e027ca3-67e9-570c-acd5-c068e23d5fd7 with scrape type 1
2026-01-28 20:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 1e027ca3-67e9-570c-acd5-c068e23d5fd7
2026-01-28 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F64%252F5c64b519844049af7ad47b5a2f24f5bb%252Fpa%252FVF71012_ab9c49cdbd9a74bac72141bbd78f0beb.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/64/5c64b519844049af7ad47b5a2f24f5bb/pa/VF71012_ab9c49cdbd9a74bac72141bbd78f0beb.jpg not downloaded yet
2026-01-28 20:06:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SA98616> (referer: https://www.auto1.com/v1/car-details-view/SA98616/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:06:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F64%252F5c64b519844049af7ad47b5a2f24f5bb%252Fpa%252FVF71012_84487718fb57802fa294bdf1fab059ff.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/64/5c64b519844049af7ad47b5a2f24f5bb/pa/VF71012_84487718fb57802fa294bdf1fab059ff.jpg not downloaded yet
2026-01-28 20:06:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec231cf9-4ab1-5deb-a0e5-0e6075ed9d67 with identifier: BN63900
2026-01-28 20:06:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec231cf9-4ab1-5deb-a0e5-0e6075ed9d67 with scrape type 1
2026-01-28 20:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item ec231cf9-4ab1-5deb-a0e5-0e6075ed9d67
2026-01-28 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F37%252F9f37f57001c87d847a6e885d373e8ea3%252Fpa%252FBN63900_d1742dcdc7bc2928ddda4de6cfca4672.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/37/9f37f57001c87d847a6e885d373e8ea3/pa/BN63900_d1742dcdc7bc2928ddda4de6cfca4672.jpg already downloaded
2026-01-28 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F37%252F9f37f57001c87d847a6e885d373e8ea3%252Fpa%252FBN63900_a187f33ad7ec96e77acb0199b0eaa16b.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/37/9f37f57001c87d847a6e885d373e8ea3/pa/BN63900_a187f33ad7ec96e77acb0199b0eaa16b.jpg already downloaded
2026-01-28 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F37%252F9f37f57001c87d847a6e885d373e8ea3%252Fpa%252FBN63900_dfbf56fda814e1471031b11d02b0b72c.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/37/9f37f57001c87d847a6e885d373e8ea3/pa/BN63900_dfbf56fda814e1471031b11d02b0b72c.jpg already downloaded
2026-01-28 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F37%252F9f37f57001c87d847a6e885d373e8ea3%252Fpa%252FBN63900_f7ba5d19341bcab8500e5b5259f1a67d.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/37/9f37f57001c87d847a6e885d373e8ea3/pa/BN63900_f7ba5d19341bcab8500e5b5259f1a67d.jpg already downloaded
2026-01-28 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F37%252F9f37f57001c87d847a6e885d373e8ea3%252Fpa%252FBN63900_88d6c42390c0505357755312f73502b2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/37/9f37f57001c87d847a6e885d373e8ea3/pa/BN63900_88d6c42390c0505357755312f73502b2.jpg already downloaded
2026-01-28 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F37%252F9f37f57001c87d847a6e885d373e8ea3%252Fpa%252FBN63900_9fe1328af5348dc5de402e00763b625a.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/37/9f37f57001c87d847a6e885d373e8ea3/pa/BN63900_9fe1328af5348dc5de402e00763b625a.jpg already downloaded
2026-01-28 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F37%252F9f37f57001c87d847a6e885d373e8ea3%252Fpa%252FBN63900_3d8833057aef14fbf2ccf348d70e75a3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/37/9f37f57001c87d847a6e885d373e8ea3/pa/BN63900_3d8833057aef14fbf2ccf348d70e75a3.jpg already downloaded
2026-01-28 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F37%252F9f37f57001c87d847a6e885d373e8ea3%252Fpa%252FBN63900_9f82f5858e6be6aca8ab7b70ae3a0cc3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/37/9f37f57001c87d847a6e885d373e8ea3/pa/BN63900_9f82f5858e6be6aca8ab7b70ae3a0cc3.jpg already downloaded
2026-01-28 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F37%252F9f37f57001c87d847a6e885d373e8ea3%252Fpa%252FBN63900_856575cd4e1e2a8f2af240349b04c3b8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/37/9f37f57001c87d847a6e885d373e8ea3/pa/BN63900_856575cd4e1e2a8f2af240349b04c3b8.jpg already downloaded
2026-01-28 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F37%252F9f37f57001c87d847a6e885d373e8ea3%252Fpa%252FBN63900_88895fc0e0e6615d4f9518d2a274e74c.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/37/9f37f57001c87d847a6e885d373e8ea3/pa/BN63900_88895fc0e0e6615d4f9518d2a274e74c.jpg already downloaded
2026-01-28 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F37%252F9f37f57001c87d847a6e885d373e8ea3%252Fpa%252FBN63900_bd20569f5c6dfbdf409fb0d98ada1451.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/37/9f37f57001c87d847a6e885d373e8ea3/pa/BN63900_bd20569f5c6dfbdf409fb0d98ada1451.jpg already downloaded
2026-01-28 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F37%252F9f37f57001c87d847a6e885d373e8ea3%252Fpa%252FBN63900_66fbb467eee07bb3708cd607d59c8fa8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/37/9f37f57001c87d847a6e885d373e8ea3/pa/BN63900_66fbb467eee07bb3708cd607d59c8fa8.jpg already downloaded
2026-01-28 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F37%252F9f37f57001c87d847a6e885d373e8ea3%252Fpa%252FBN63900_784a864870d8a5c595593dd75d4411b9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/37/9f37f57001c87d847a6e885d373e8ea3/pa/BN63900_784a864870d8a5c595593dd75d4411b9.jpg already downloaded
2026-01-28 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F37%252F9f37f57001c87d847a6e885d373e8ea3%252Fpa%252FBN63900_2d05e3d052b5e59794613b69e34b7778.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/37/9f37f57001c87d847a6e885d373e8ea3/pa/BN63900_2d05e3d052b5e59794613b69e34b7778.jpg already downloaded
2026-01-28 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F37%252F9f37f57001c87d847a6e885d373e8ea3%252Fpa%252FBN63900_35b7343a99857b8cf8ca61950fc0fc93.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/37/9f37f57001c87d847a6e885d373e8ea3/pa/BN63900_35b7343a99857b8cf8ca61950fc0fc93.jpg already downloaded
2026-01-28 20:06:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ec231cf9-4ab1-5deb-a0e5-0e6075ed9d67, identifier: BN63900
2026-01-28 20:06:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ec231cf9-4ab1-5deb-a0e5-0e6075ed9d67 with identifier: BN63900
2026-01-28 20:06:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ec231cf9-4ab1-5deb-a0e5-0e6075ed9d67 with identifier: BN63900
2026-01-28 20:06:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ec231cf9-4ab1-5deb-a0e5-0e6075ed9d67 with identifier: BN63900 to the API
2026-01-28 20:06:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:06:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:06:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BN63900>
{'auction_title': '',
 'c_o_2_emission_value': 157,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 6C',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-01-29T16:08:32Z',
 'fuel_type': 'diesel',
 'id': 'ec231cf9-4ab1-5deb-a0e5-0e6075ed9d67',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BN63900',
 'listing': 'auction',
 'location': 'IT, Milano',
 'make': 'BMW',
 'model': '4er',
 'odometer': 119817,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img9f/37/9f37f57001c87d847a6e885d373e8ea3/pa/BN63900_d1742dcdc7bc2928ddda4de6cfca4672.jpg',
                'https://img-pa.auto1.com/img9f/37/9f37f57001c87d847a6e885d373e8ea3/pa/BN63900_a187f33ad7ec96e77acb0199b0eaa16b.jpg',
                'https://img-pa.auto1.com/img9f/37/9f37f57001c87d847a6e885d373e8ea3/pa/BN63900_dfbf56fda814e1471031b11d02b0b72c.jpg',
                'https://img-pa.auto1.com/img9f/37/9f37f57001c87d847a6e885d373e8ea3/pa/BN63900_f7ba5d19341bcab8500e5b5259f1a67d.jpg',
                'https://img-pa.auto1.com/img9f/37/9f37f57001c87d847a6e885d373e8ea3/pa/BN63900_88d6c42390c0505357755312f73502b2.jpg',
                'https://img-pa.auto1.com/img9f/37/9f37f57001c87d847a6e885d373e8ea3/pa/BN63900_9fe1328af5348dc5de402e00763b625a.jpg',
                'https://img-pa.auto1.com/img9f/37/9f37f57001c87d847a6e885d373e8ea3/pa/BN63900_3d8833057aef14fbf2ccf348d70e75a3.jpg',
                'https://img-pa.auto1.com/img9f/37/9f37f57001c87d847a6e885d373e8ea3/pa/BN63900_9f82f5858e6be6aca8ab7b70ae3a0cc3.jpg',
                'https://img-pa.auto1.com/img9f/37/9f37f57001c87d847a6e885d373e8ea3/pa/BN63900_856575cd4e1e2a8f2af240349b04c3b8.jpg',
                'https://img-pa.auto1.com/img9f/37/9f37f57001c87d847a6e885d373e8ea3/pa/BN63900_88895fc0e0e6615d4f9518d2a274e74c.jpg',
                'https://img-pa.auto1.com/img9f/37/9f37f57001c87d847a6e885d373e8ea3/pa/BN63900_bd20569f5c6dfbdf409fb0d98ada1451.jpg',
                'https://img-pa.auto1.com/img9f/37/9f37f57001c87d847a6e885d373e8ea3/pa/BN63900_66fbb467eee07bb3708cd607d59c8fa8.jpg',
                'https://img-pa.auto1.com/img9f/37/9f37f57001c87d847a6e885d373e8ea3/pa/BN63900_784a864870d8a5c595593dd75d4411b9.jpg',
                'https://img-pa.auto1.com/img9f/37/9f37f57001c87d847a6e885d373e8ea3/pa/BN63900_2d05e3d052b5e59794613b69e34b7778.jpg',
                'https://img-pa.auto1.com/img9f/37/9f37f57001c87d847a6e885d373e8ea3/pa/BN63900_35b7343a99857b8cf8ca61950fc0fc93.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec231cf9-4ab1-5deb-a0e5-0e6075ed9d67/ec231cf9-4ab1-5deb-a0e5-0e6075ed9d67_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2955705,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/37/9f37f57001c87d847a6e885d373e8ea3/pa/BN63900_d1742dcdc7bc2928ddda4de6cfca4672.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec231cf9-4ab1-5deb-a0e5-0e6075ed9d67/ec231cf9-4ab1-5deb-a0e5-0e6075ed9d67_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2966724,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/37/9f37f57001c87d847a6e885d373e8ea3/pa/BN63900_a187f33ad7ec96e77acb0199b0eaa16b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec231cf9-4ab1-5deb-a0e5-0e6075ed9d67/ec231cf9-4ab1-5deb-a0e5-0e6075ed9d67_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2908696,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/37/9f37f57001c87d847a6e885d373e8ea3/pa/BN63900_dfbf56fda814e1471031b11d02b0b72c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec231cf9-4ab1-5deb-a0e5-0e6075ed9d67/ec231cf9-4ab1-5deb-a0e5-0e6075ed9d67_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3100558,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/37/9f37f57001c87d847a6e885d373e8ea3/pa/BN63900_f7ba5d19341bcab8500e5b5259f1a67d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec231cf9-4ab1-5deb-a0e5-0e6075ed9d67/ec231cf9-4ab1-5deb-a0e5-0e6075ed9d67_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2891954,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/37/9f37f57001c87d847a6e885d373e8ea3/pa/BN63900_88d6c42390c0505357755312f73502b2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec231cf9-4ab1-5deb-a0e5-0e6075ed9d67/ec231cf9-4ab1-5deb-a0e5-0e6075ed9d67_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2965318,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/37/9f37f57001c87d847a6e885d373e8ea3/pa/BN63900_9fe1328af5348dc5de402e00763b625a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec231cf9-4ab1-5deb-a0e5-0e6075ed9d67/ec231cf9-4ab1-5deb-a0e5-0e6075ed9d67_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58124,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/37/9f37f57001c87d847a6e885d373e8ea3/pa/BN63900_3d8833057aef14fbf2ccf348d70e75a3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec231cf9-4ab1-5deb-a0e5-0e6075ed9d67/ec231cf9-4ab1-5deb-a0e5-0e6075ed9d67_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2899209,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/37/9f37f57001c87d847a6e885d373e8ea3/pa/BN63900_9f82f5858e6be6aca8ab7b70ae3a0cc3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec231cf9-4ab1-5deb-a0e5-0e6075ed9d67/ec231cf9-4ab1-5deb-a0e5-0e6075ed9d67_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2849003,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/37/9f37f57001c87d847a6e885d373e8ea3/pa/BN63900_856575cd4e1e2a8f2af240349b04c3b8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec231cf9-4ab1-5deb-a0e5-0e6075ed9d67/ec231cf9-4ab1-5deb-a0e5-0e6075ed9d67_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49231,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/37/9f37f57001c87d847a6e885d373e8ea3/pa/BN63900_88895fc0e0e6615d4f9518d2a274e74c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec231cf9-4ab1-5deb-a0e5-0e6075ed9d67/ec231cf9-4ab1-5deb-a0e5-0e6075ed9d67_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81668,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/37/9f37f57001c87d847a6e885d373e8ea3/pa/BN63900_bd20569f5c6dfbdf409fb0d98ada1451.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec231cf9-4ab1-5deb-a0e5-0e6075ed9d67/ec231cf9-4ab1-5deb-a0e5-0e6075ed9d67_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69893,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/37/9f37f57001c87d847a6e885d373e8ea3/pa/BN63900_66fbb467eee07bb3708cd607d59c8fa8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec231cf9-4ab1-5deb-a0e5-0e6075ed9d67/ec231cf9-4ab1-5deb-a0e5-0e6075ed9d67_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68954,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/37/9f37f57001c87d847a6e885d373e8ea3/pa/BN63900_784a864870d8a5c595593dd75d4411b9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec231cf9-4ab1-5deb-a0e5-0e6075ed9d67/ec231cf9-4ab1-5deb-a0e5-0e6075ed9d67_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2650955,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/37/9f37f57001c87d847a6e885d373e8ea3/pa/BN63900_2d05e3d052b5e59794613b69e34b7778.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec231cf9-4ab1-5deb-a0e5-0e6075ed9d67/ec231cf9-4ab1-5deb-a0e5-0e6075ed9d67_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50094,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/37/9f37f57001c87d847a6e885d373e8ea3/pa/BN63900_35b7343a99857b8cf8ca61950fc0fc93.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-04-10',
 'seats_number': 4,
 'seller_name': None,
 'title': 'BMW 4er 420d M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2019}
2026-01-28 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BN63900%27 HTTP/1.1" 200 None
2026-01-28 20:06:13 [auto1.it] INFO: Saving data for BN63900: {'created_time': 1769630773.916695, 'last_price_update_time': 1769630773.916705, 'auction_closing_time': 1769702912.0}
2026-01-28 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BN63900') HTTP/1.1" 204 0
2026-01-28 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F64%252F5c64b519844049af7ad47b5a2f24f5bb%252Fpa%252FVF71012_cf19407c54c7fd4dcd338928b5047f0b.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/64/5c64b519844049af7ad47b5a2f24f5bb/pa/VF71012_cf19407c54c7fd4dcd338928b5047f0b.jpg not downloaded yet
2026-01-28 20:06:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BK51963> (referer: https://www.auto1.com/v1/car-details-view/BK51963/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:06:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:06:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VN78624/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F64%252F5c64b519844049af7ad47b5a2f24f5bb%252Fpa%252FVF71012_8b55c5862b8dba3d4c0c96f24cd33e0a.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/64/5c64b519844049af7ad47b5a2f24f5bb/pa/VF71012_8b55c5862b8dba3d4c0c96f24cd33e0a.jpg not downloaded yet
2026-01-28 20:06:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:06:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:06:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:06:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GX99899> (referer: https://www.auto1.com/v1/car-details-view/GX99899/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:06:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 56724697-330d-560c-b931-37b7a30bc05c with identifier: SA98616
2026-01-28 20:06:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56724697-330d-560c-b931-37b7a30bc05c with scrape type 2
2026-01-28 20:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 56724697-330d-560c-b931-37b7a30bc05c with scrape type 2
2026-01-28 20:06:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 56724697-330d-560c-b931-37b7a30bc05c, identifier: SA98616
2026-01-28 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F64%252F5c64b519844049af7ad47b5a2f24f5bb%252Fpa%252FVF71012_3e1972a652e266ab0318d058d536673e.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/64/5c64b519844049af7ad47b5a2f24f5bb/pa/VF71012_3e1972a652e266ab0318d058d536673e.jpg not downloaded yet
2026-01-28 20:06:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:06:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 56724697-330d-560c-b931-37b7a30bc05c with identifier: SA98616
2026-01-28 20:06:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 56724697-330d-560c-b931-37b7a30bc05c with identifier: SA98616
2026-01-28 20:06:14 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 133803 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    133803
2026-01-28 20:06:14 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: 56724697-330d-560c-b931-37b7a30bc05c spider: auto1.it
2026-01-28 20:06:14 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 56724697-330d-560c-b931-37b7a30bc05c due to rule: high_mileage_for_make.json, error: 133803 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    133803
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'category': 'Rental',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.1L',
 'engine_horse_power': 210,
 'expiration_date': '2026-01-29T16:17:28Z',
 'fuel_type': 'diesel',
 'id': '56724697-330d-560c-b931-37b7a30bc05c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SA98616',
 'listing': 'auction',
 'location': 'IT, Milano',
 'make': 'Alfa Romeo',
 'model': 'Stelvio',
 'odometer': 133803,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-06-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Alfa Romeo Stelvio 2.2 JTDM Super Q4',
 'transmission': 'automatic',
 'trim': 'Super Q4',
 'year': 2018}
2026-01-28 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SA98616%27 HTTP/1.1" 200 None
2026-01-28 20:06:14 [auto1.it] INFO: Saving data for SA98616: {'auction_closing_time': 1769703448.0, 'created_time': 1766433707.713744, 'last_price_update_time': 1769630774.35409}
2026-01-28 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SA98616') HTTP/1.1" 204 0
2026-01-28 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F64%252F5c64b519844049af7ad47b5a2f24f5bb%252Fpa%252FVF71012_110136872f1c292bdc16822d16fc4694.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/64/5c64b519844049af7ad47b5a2f24f5bb/pa/VF71012_110136872f1c292bdc16822d16fc4694.jpg not downloaded yet
2026-01-28 20:06:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5d6c42ae-e85f-51b5-8ddf-53f6e4f44ee5 with identifier: BK51963
2026-01-28 20:06:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d6c42ae-e85f-51b5-8ddf-53f6e4f44ee5 with scrape type 1
2026-01-28 20:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 12 photos for item 5d6c42ae-e85f-51b5-8ddf-53f6e4f44ee5
2026-01-28 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F1d%252F921dd65e297015a56aa4b31a920cf269%252Fpa%252FBK51963_3df3e5bf33d2da269e6c6010d49b46c1.png%27 HTTP/1.1" 200 None
2026-01-28 20:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/1d/921dd65e297015a56aa4b31a920cf269/pa/BK51963_3df3e5bf33d2da269e6c6010d49b46c1.png not downloaded yet
2026-01-28 20:06:14 [auto1.it] INFO: Parsing search results for channel: 24h
2026-01-28 20:06:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a227753-eee8-57ae-8921-dc9370348a07 with identifier: GX99899
2026-01-28 20:06:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a227753-eee8-57ae-8921-dc9370348a07 with scrape type 1
2026-01-28 20:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 3a227753-eee8-57ae-8921-dc9370348a07
2026-01-28 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Ff8%252Fe8f89f7a59822a83e00ec3aa83e4c416%252Fpa%252FGX99899_41e7dea1ed9a5342e9d1f7451246b3a7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/f8/e8f89f7a59822a83e00ec3aa83e4c416/pa/GX99899_41e7dea1ed9a5342e9d1f7451246b3a7.jpg already downloaded
2026-01-28 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Ff8%252Fe8f89f7a59822a83e00ec3aa83e4c416%252Fpa%252FGX99899_8835b2450847f42179662e64b1aa77b7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/f8/e8f89f7a59822a83e00ec3aa83e4c416/pa/GX99899_8835b2450847f42179662e64b1aa77b7.jpg already downloaded
2026-01-28 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Ff8%252Fe8f89f7a59822a83e00ec3aa83e4c416%252Fpa%252FGX99899_dfbad1b1effe0c7fe1c8f0343cf3b9ed.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/f8/e8f89f7a59822a83e00ec3aa83e4c416/pa/GX99899_dfbad1b1effe0c7fe1c8f0343cf3b9ed.jpg already downloaded
2026-01-28 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Ff8%252Fe8f89f7a59822a83e00ec3aa83e4c416%252Fpa%252FGX99899_5ebae06fc1955db5d7b4770b6d1f87f7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/f8/e8f89f7a59822a83e00ec3aa83e4c416/pa/GX99899_5ebae06fc1955db5d7b4770b6d1f87f7.jpg already downloaded
2026-01-28 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Ff8%252Fe8f89f7a59822a83e00ec3aa83e4c416%252Fpa%252FGX99899_fbab08f56bef8ad57b3268c911d5b8bb.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/f8/e8f89f7a59822a83e00ec3aa83e4c416/pa/GX99899_fbab08f56bef8ad57b3268c911d5b8bb.jpg already downloaded
2026-01-28 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Ff8%252Fe8f89f7a59822a83e00ec3aa83e4c416%252Fpa%252FGX99899_8e1e6717833ebdb10ed6722dcf32438f.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/f8/e8f89f7a59822a83e00ec3aa83e4c416/pa/GX99899_8e1e6717833ebdb10ed6722dcf32438f.jpg already downloaded
2026-01-28 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Ff8%252Fe8f89f7a59822a83e00ec3aa83e4c416%252Fpa%252FGX99899_95a6369ffe5ba9558cad430f08f2dfc5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/f8/e8f89f7a59822a83e00ec3aa83e4c416/pa/GX99899_95a6369ffe5ba9558cad430f08f2dfc5.jpg already downloaded
2026-01-28 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Ff8%252Fe8f89f7a59822a83e00ec3aa83e4c416%252Fpa%252FGX99899_16cc94dde1a88cbd855b8b2853feb13c.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/f8/e8f89f7a59822a83e00ec3aa83e4c416/pa/GX99899_16cc94dde1a88cbd855b8b2853feb13c.jpg already downloaded
2026-01-28 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Ff8%252Fe8f89f7a59822a83e00ec3aa83e4c416%252Fpa%252FGX99899_15fcbb4b3f12e87ef3203c085c9b1b91.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/f8/e8f89f7a59822a83e00ec3aa83e4c416/pa/GX99899_15fcbb4b3f12e87ef3203c085c9b1b91.jpg already downloaded
2026-01-28 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Ff8%252Fe8f89f7a59822a83e00ec3aa83e4c416%252Fpa%252FGX99899_e09fc0a97e6fc3d8046126fc8f274398.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/f8/e8f89f7a59822a83e00ec3aa83e4c416/pa/GX99899_e09fc0a97e6fc3d8046126fc8f274398.jpg already downloaded
2026-01-28 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Ff8%252Fe8f89f7a59822a83e00ec3aa83e4c416%252Fpa%252FGX99899_08945a3518e026337b429bf10283b426.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/f8/e8f89f7a59822a83e00ec3aa83e4c416/pa/GX99899_08945a3518e026337b429bf10283b426.jpg already downloaded
2026-01-28 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Ff8%252Fe8f89f7a59822a83e00ec3aa83e4c416%252Fpa%252FGX99899_5d1a20b23febdb450ae89353d351962c.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/f8/e8f89f7a59822a83e00ec3aa83e4c416/pa/GX99899_5d1a20b23febdb450ae89353d351962c.jpg already downloaded
2026-01-28 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Ff8%252Fe8f89f7a59822a83e00ec3aa83e4c416%252Fpa%252FGX99899_2b40fd8fe361351979fb43692c389b0c.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/f8/e8f89f7a59822a83e00ec3aa83e4c416/pa/GX99899_2b40fd8fe361351979fb43692c389b0c.jpg already downloaded
2026-01-28 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Ff8%252Fe8f89f7a59822a83e00ec3aa83e4c416%252Fpa%252FGX99899_4fa5eb2f9b8e17c67639e3702d8544bd.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/f8/e8f89f7a59822a83e00ec3aa83e4c416/pa/GX99899_4fa5eb2f9b8e17c67639e3702d8544bd.jpg already downloaded
2026-01-28 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Ff8%252Fe8f89f7a59822a83e00ec3aa83e4c416%252Fpa%252FGX99899_6d642a4fe5828d47a5d5442e64a76a3b.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/f8/e8f89f7a59822a83e00ec3aa83e4c416/pa/GX99899_6d642a4fe5828d47a5d5442e64a76a3b.jpg already downloaded
2026-01-28 20:06:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3a227753-eee8-57ae-8921-dc9370348a07, identifier: GX99899
2026-01-28 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F64%252F5c64b519844049af7ad47b5a2f24f5bb%252Fpa%252FVF71012_4fc1d70b2396626edf2a610bf5632f58.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/64/5c64b519844049af7ad47b5a2f24f5bb/pa/VF71012_4fc1d70b2396626edf2a610bf5632f58.jpg not downloaded yet
2026-01-28 20:06:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3a227753-eee8-57ae-8921-dc9370348a07 with identifier: GX99899
2026-01-28 20:06:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3a227753-eee8-57ae-8921-dc9370348a07 with identifier: GX99899
2026-01-28 20:06:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3a227753-eee8-57ae-8921-dc9370348a07 with identifier: GX99899 to the API
2026-01-28 20:06:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:06:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GX99899>
{'auction_title': '',
 'c_o_2_emission_value': 108,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.0L',
 'engine_horse_power': 72,
 'expiration_date': '2026-01-29T16:40:19Z',
 'fuel_type': 'petrol',
 'id': '3a227753-eee8-57ae-8921-dc9370348a07',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GX99899',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'Toyota',
 'model': 'Aygo X',
 'odometer': 1540,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imge8/f8/e8f89f7a59822a83e00ec3aa83e4c416/pa/GX99899_41e7dea1ed9a5342e9d1f7451246b3a7.jpg',
                'https://img-pa.auto1.com/imge8/f8/e8f89f7a59822a83e00ec3aa83e4c416/pa/GX99899_8835b2450847f42179662e64b1aa77b7.jpg',
                'https://img-pa.auto1.com/imge8/f8/e8f89f7a59822a83e00ec3aa83e4c416/pa/GX99899_dfbad1b1effe0c7fe1c8f0343cf3b9ed.jpg',
                'https://img-pa.auto1.com/imge8/f8/e8f89f7a59822a83e00ec3aa83e4c416/pa/GX99899_5ebae06fc1955db5d7b4770b6d1f87f7.jpg',
                'https://img-pa.auto1.com/imge8/f8/e8f89f7a59822a83e00ec3aa83e4c416/pa/GX99899_fbab08f56bef8ad57b3268c911d5b8bb.jpg',
                'https://img-pa.auto1.com/imge8/f8/e8f89f7a59822a83e00ec3aa83e4c416/pa/GX99899_8e1e6717833ebdb10ed6722dcf32438f.jpg',
                'https://img-pa.auto1.com/imge8/f8/e8f89f7a59822a83e00ec3aa83e4c416/pa/GX99899_95a6369ffe5ba9558cad430f08f2dfc5.jpg',
                'https://img-pa.auto1.com/imge8/f8/e8f89f7a59822a83e00ec3aa83e4c416/pa/GX99899_16cc94dde1a88cbd855b8b2853feb13c.jpg',
                'https://img-pa.auto1.com/imge8/f8/e8f89f7a59822a83e00ec3aa83e4c416/pa/GX99899_15fcbb4b3f12e87ef3203c085c9b1b91.jpg',
                'https://img-pa.auto1.com/imge8/f8/e8f89f7a59822a83e00ec3aa83e4c416/pa/GX99899_e09fc0a97e6fc3d8046126fc8f274398.jpg',
                'https://img-pa.auto1.com/imge8/f8/e8f89f7a59822a83e00ec3aa83e4c416/pa/GX99899_08945a3518e026337b429bf10283b426.jpg',
                'https://img-pa.auto1.com/imge8/f8/e8f89f7a59822a83e00ec3aa83e4c416/pa/GX99899_5d1a20b23febdb450ae89353d351962c.jpg',
                'https://img-pa.auto1.com/imge8/f8/e8f89f7a59822a83e00ec3aa83e4c416/pa/GX99899_2b40fd8fe361351979fb43692c389b0c.jpg',
                'https://img-pa.auto1.com/imge8/f8/e8f89f7a59822a83e00ec3aa83e4c416/pa/GX99899_4fa5eb2f9b8e17c67639e3702d8544bd.jpg',
                'https://img-pa.auto1.com/imge8/f8/e8f89f7a59822a83e00ec3aa83e4c416/pa/GX99899_6d642a4fe5828d47a5d5442e64a76a3b.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a227753-eee8-57ae-8921-dc9370348a07/3a227753-eee8-57ae-8921-dc9370348a07_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72818,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/f8/e8f89f7a59822a83e00ec3aa83e4c416/pa/GX99899_41e7dea1ed9a5342e9d1f7451246b3a7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a227753-eee8-57ae-8921-dc9370348a07/3a227753-eee8-57ae-8921-dc9370348a07_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67296,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/f8/e8f89f7a59822a83e00ec3aa83e4c416/pa/GX99899_8835b2450847f42179662e64b1aa77b7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a227753-eee8-57ae-8921-dc9370348a07/3a227753-eee8-57ae-8921-dc9370348a07_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71584,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/f8/e8f89f7a59822a83e00ec3aa83e4c416/pa/GX99899_dfbad1b1effe0c7fe1c8f0343cf3b9ed.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a227753-eee8-57ae-8921-dc9370348a07/3a227753-eee8-57ae-8921-dc9370348a07_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58051,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/f8/e8f89f7a59822a83e00ec3aa83e4c416/pa/GX99899_5ebae06fc1955db5d7b4770b6d1f87f7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a227753-eee8-57ae-8921-dc9370348a07/3a227753-eee8-57ae-8921-dc9370348a07_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65254,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/f8/e8f89f7a59822a83e00ec3aa83e4c416/pa/GX99899_fbab08f56bef8ad57b3268c911d5b8bb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a227753-eee8-57ae-8921-dc9370348a07/3a227753-eee8-57ae-8921-dc9370348a07_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70269,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/f8/e8f89f7a59822a83e00ec3aa83e4c416/pa/GX99899_8e1e6717833ebdb10ed6722dcf32438f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a227753-eee8-57ae-8921-dc9370348a07/3a227753-eee8-57ae-8921-dc9370348a07_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58732,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/f8/e8f89f7a59822a83e00ec3aa83e4c416/pa/GX99899_95a6369ffe5ba9558cad430f08f2dfc5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a227753-eee8-57ae-8921-dc9370348a07/3a227753-eee8-57ae-8921-dc9370348a07_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61074,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/f8/e8f89f7a59822a83e00ec3aa83e4c416/pa/GX99899_16cc94dde1a88cbd855b8b2853feb13c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a227753-eee8-57ae-8921-dc9370348a07/3a227753-eee8-57ae-8921-dc9370348a07_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63965,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/f8/e8f89f7a59822a83e00ec3aa83e4c416/pa/GX99899_15fcbb4b3f12e87ef3203c085c9b1b91.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a227753-eee8-57ae-8921-dc9370348a07/3a227753-eee8-57ae-8921-dc9370348a07_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50504,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/f8/e8f89f7a59822a83e00ec3aa83e4c416/pa/GX99899_e09fc0a97e6fc3d8046126fc8f274398.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a227753-eee8-57ae-8921-dc9370348a07/3a227753-eee8-57ae-8921-dc9370348a07_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59623,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/f8/e8f89f7a59822a83e00ec3aa83e4c416/pa/GX99899_08945a3518e026337b429bf10283b426.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a227753-eee8-57ae-8921-dc9370348a07/3a227753-eee8-57ae-8921-dc9370348a07_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56446,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/f8/e8f89f7a59822a83e00ec3aa83e4c416/pa/GX99899_5d1a20b23febdb450ae89353d351962c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a227753-eee8-57ae-8921-dc9370348a07/3a227753-eee8-57ae-8921-dc9370348a07_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51565,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/f8/e8f89f7a59822a83e00ec3aa83e4c416/pa/GX99899_2b40fd8fe361351979fb43692c389b0c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a227753-eee8-57ae-8921-dc9370348a07/3a227753-eee8-57ae-8921-dc9370348a07_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39335,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/f8/e8f89f7a59822a83e00ec3aa83e4c416/pa/GX99899_4fa5eb2f9b8e17c67639e3702d8544bd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a227753-eee8-57ae-8921-dc9370348a07/3a227753-eee8-57ae-8921-dc9370348a07_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80471,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/f8/e8f89f7a59822a83e00ec3aa83e4c416/pa/GX99899_6d642a4fe5828d47a5d5442e64a76a3b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2025-11-18',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Toyota Aygo X 1.0 Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2025}
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GX99899%27 HTTP/1.1" 200 None
2026-01-28 20:06:15 [auto1.it] INFO: Saving data for GX99899: {'created_time': 1769630775.207505, 'last_price_update_time': 1769630775.207514, 'auction_closing_time': 1769704819.0}
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GX99899') HTTP/1.1" 204 0
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F1d%252F921dd65e297015a56aa4b31a920cf269%252Fpa%252FBK51963_6b8f63ad1867765e2466921254cbc78e.png%27 HTTP/1.1" 200 None
2026-01-28 20:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/1d/921dd65e297015a56aa4b31a920cf269/pa/BK51963_6b8f63ad1867765e2466921254cbc78e.png not downloaded yet
2026-01-28 20:06:15 [auto1.it] INFO: Found listing with ID: XX41967
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XX41967%27 HTTP/1.1" 200 None
2026-01-28 20:06:15 [auto1.it] INFO: Scrape type for XX41967: 0
2026-01-28 20:06:15 [auto1.it] INFO: Found listing with ID: KW25674
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KW25674%27 HTTP/1.1" 200 None
2026-01-28 20:06:15 [auto1.it] INFO: Scrape type for KW25674: 0
2026-01-28 20:06:15 [auto1.it] INFO: Found listing with ID: EN28009
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EN28009%27 HTTP/1.1" 200 None
2026-01-28 20:06:15 [auto1.it] INFO: Scrape type for EN28009: 0
2026-01-28 20:06:15 [auto1.it] INFO: Found listing with ID: NK45302
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NK45302%27 HTTP/1.1" 200 None
2026-01-28 20:06:15 [auto1.it] INFO: Scrape type for NK45302: 0
2026-01-28 20:06:15 [auto1.it] INFO: Found listing with ID: ST62683
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ST62683%27 HTTP/1.1" 200 None
2026-01-28 20:06:15 [auto1.it] INFO: Scrape type for ST62683: 0
2026-01-28 20:06:15 [auto1.it] INFO: Found listing with ID: TP44481
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TP44481%27 HTTP/1.1" 200 None
2026-01-28 20:06:15 [auto1.it] INFO: Scrape type for TP44481: 0
2026-01-28 20:06:15 [auto1.it] INFO: Found listing with ID: AK82218
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AK82218%27 HTTP/1.1" 200 None
2026-01-28 20:06:15 [auto1.it] INFO: Scrape type for AK82218: 0
2026-01-28 20:06:15 [auto1.it] INFO: Found listing with ID: PR00110
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PR00110%27 HTTP/1.1" 200 None
2026-01-28 20:06:15 [auto1.it] INFO: Scrape type for PR00110: 0
2026-01-28 20:06:15 [auto1.it] INFO: Found listing with ID: VF21484
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VF21484%27 HTTP/1.1" 200 None
2026-01-28 20:06:15 [auto1.it] INFO: Scrape type for VF21484: 0
2026-01-28 20:06:15 [auto1.it] INFO: Found listing with ID: MM70569
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MM70569%27 HTTP/1.1" 200 None
2026-01-28 20:06:15 [auto1.it] INFO: Scrape type for MM70569: 0
2026-01-28 20:06:15 [auto1.it] INFO: Found listing with ID: ZC81530
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZC81530%27 HTTP/1.1" 200 None
2026-01-28 20:06:15 [auto1.it] INFO: Scrape type for ZC81530: 0
2026-01-28 20:06:15 [auto1.it] INFO: Found listing with ID: YU89741
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YU89741%27 HTTP/1.1" 200 None
2026-01-28 20:06:15 [auto1.it] INFO: Scrape type for YU89741: 0
2026-01-28 20:06:15 [auto1.it] INFO: Found listing with ID: XS07173
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XS07173%27 HTTP/1.1" 200 None
2026-01-28 20:06:15 [auto1.it] INFO: Scrape type for XS07173: 0
2026-01-28 20:06:15 [auto1.it] INFO: Found listing with ID: CE51434
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CE51434%27 HTTP/1.1" 200 None
2026-01-28 20:06:15 [auto1.it] INFO: Scrape type for CE51434: 0
2026-01-28 20:06:15 [auto1.it] INFO: Found listing with ID: EJ48263
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EJ48263%27 HTTP/1.1" 200 None
2026-01-28 20:06:15 [auto1.it] INFO: Scrape type for EJ48263: 0
2026-01-28 20:06:15 [auto1.it] INFO: Found listing with ID: CF92520
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CF92520%27 HTTP/1.1" 200 None
2026-01-28 20:06:15 [auto1.it] INFO: Scrape type for CF92520: 0
2026-01-28 20:06:15 [auto1.it] INFO: Found listing with ID: SC57699
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SC57699%27 HTTP/1.1" 200 None
2026-01-28 20:06:15 [auto1.it] INFO: Scrape type for SC57699: 0
2026-01-28 20:06:15 [auto1.it] INFO: Found listing with ID: JR02947
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JR02947%27 HTTP/1.1" 200 None
2026-01-28 20:06:15 [auto1.it] INFO: Scrape type for JR02947: 0
2026-01-28 20:06:15 [auto1.it] INFO: Found listing with ID: XV95315
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XV95315%27 HTTP/1.1" 200 None
2026-01-28 20:06:15 [auto1.it] INFO: Scrape type for XV95315: 0
2026-01-28 20:06:15 [auto1.it] INFO: Found listing with ID: FJ50946
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FJ50946%27 HTTP/1.1" 200 None
2026-01-28 20:06:15 [auto1.it] INFO: Scrape type for FJ50946: 0
2026-01-28 20:06:15 [auto1.it] INFO: Found listing with ID: LE91264
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LE91264%27 HTTP/1.1" 200 None
2026-01-28 20:06:15 [auto1.it] INFO: Scrape type for LE91264: 0
2026-01-28 20:06:15 [auto1.it] INFO: Found listing with ID: YE57930
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YE57930%27 HTTP/1.1" 200 None
2026-01-28 20:06:15 [auto1.it] INFO: Scrape type for YE57930: 0
2026-01-28 20:06:15 [auto1.it] INFO: Found listing with ID: TP50671
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TP50671%27 HTTP/1.1" 200 None
2026-01-28 20:06:15 [auto1.it] INFO: Scrape type for TP50671: 0
2026-01-28 20:06:15 [auto1.it] INFO: Found listing with ID: UL67147
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UL67147%27 HTTP/1.1" 200 None
2026-01-28 20:06:15 [auto1.it] INFO: Scrape type for UL67147: 0
2026-01-28 20:06:15 [auto1.it] INFO: Found listing with ID: JG96200
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27JG96200%27 HTTP/1.1" 200 None
2026-01-28 20:06:15 [auto1.it] INFO: Scrape type for JG96200: 0
2026-01-28 20:06:15 [auto1.it] INFO: Found listing with ID: DK02214
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DK02214%27 HTTP/1.1" 200 None
2026-01-28 20:06:15 [auto1.it] INFO: Scrape type for DK02214: 0
2026-01-28 20:06:15 [auto1.it] INFO: Found listing with ID: LN32386
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LN32386%27 HTTP/1.1" 200 None
2026-01-28 20:06:15 [auto1.it] INFO: Scrape type for LN32386: 0
2026-01-28 20:06:15 [auto1.it] INFO: Found listing with ID: CT54414
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CT54414%27 HTTP/1.1" 200 None
2026-01-28 20:06:15 [auto1.it] INFO: Scrape type for CT54414: 0
2026-01-28 20:06:15 [auto1.it] INFO: Found listing with ID: NR00583
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NR00583%27 HTTP/1.1" 200 None
2026-01-28 20:06:15 [auto1.it] INFO: Scrape type for NR00583: 0
2026-01-28 20:06:15 [auto1.it] INFO: Found listing with ID: SU22727
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SU22727%27 HTTP/1.1" 200 None
2026-01-28 20:06:15 [auto1.it] INFO: Scrape type for SU22727: 0
2026-01-28 20:06:15 [auto1.it] INFO: Found listing with ID: UB59491
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UB59491%27 HTTP/1.1" 200 None
2026-01-28 20:06:15 [auto1.it] INFO: Scrape type for UB59491: 0
2026-01-28 20:06:15 [auto1.it] INFO: Found listing with ID: CM48697
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CM48697%27 HTTP/1.1" 200 None
2026-01-28 20:06:15 [auto1.it] INFO: Scrape type for CM48697: 0
2026-01-28 20:06:15 [auto1.it] INFO: Found listing with ID: XB13849
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XB13849%27 HTTP/1.1" 200 None
2026-01-28 20:06:15 [auto1.it] INFO: Scrape type for XB13849: 0
2026-01-28 20:06:15 [auto1.it] INFO: Found listing with ID: WP98796
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WP98796%27 HTTP/1.1" 200 None
2026-01-28 20:06:15 [auto1.it] INFO: Scrape type for WP98796: 0
2026-01-28 20:06:15 [auto1.it] INFO: Found listing with ID: ZE02649
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZE02649%27 HTTP/1.1" 200 None
2026-01-28 20:06:15 [auto1.it] INFO: Scrape type for ZE02649: 0
2026-01-28 20:06:15 [auto1.it] INFO: Found listing with ID: NA87958
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NA87958%27 HTTP/1.1" 200 None
2026-01-28 20:06:15 [auto1.it] INFO: Scrape type for NA87958: 0
2026-01-28 20:06:15 [auto1.it] INFO: Found listing with ID: VK09157
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VK09157%27 HTTP/1.1" 200 None
2026-01-28 20:06:15 [auto1.it] INFO: Scrape type for VK09157: 0
2026-01-28 20:06:15 [auto1.it] INFO: Found listing with ID: SY78749
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SY78749%27 HTTP/1.1" 200 None
2026-01-28 20:06:15 [auto1.it] INFO: Scrape type for SY78749: 0
2026-01-28 20:06:15 [auto1.it] INFO: Found listing with ID: FL32335
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FL32335%27 HTTP/1.1" 200 None
2026-01-28 20:06:15 [auto1.it] INFO: Scrape type for FL32335: 0
2026-01-28 20:06:15 [auto1.it] INFO: Found listing with ID: KE50808
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KE50808%27 HTTP/1.1" 200 None
2026-01-28 20:06:15 [auto1.it] INFO: Scrape type for KE50808: 0
2026-01-28 20:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/64/5c64b519844049af7ad47b5a2f24f5bb/pa/VF71012_8b55c5862b8dba3d4c0c96f24cd33e0a.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/64/5c64b519844049af7ad47b5a2f24f5bb/pa/VF71012_cf19407c54c7fd4dcd338928b5047f0b.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F64%252F5c64b519844049af7ad47b5a2f24f5bb%252Fpa%252FVF71012_a11bd037f7bfe5a73fa30645967be93d.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/64/5c64b519844049af7ad47b5a2f24f5bb/pa/VF71012_a11bd037f7bfe5a73fa30645967be93d.jpg not downloaded yet
2026-01-28 20:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZS61961/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RL30055> (referer: https://www.auto1.com/v1/car-details-view/RL30055/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WA30602> (referer: https://www.auto1.com/v1/car-details-view/WA30602/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/64/5c64b519844049af7ad47b5a2f24f5bb/pa/VF71012_84487718fb57802fa294bdf1fab059ff.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F1d%252F921dd65e297015a56aa4b31a920cf269%252Fpa%252FBK51963_d0b3025e50d55c6cb47e82914f762345.png%27 HTTP/1.1" 200 None
2026-01-28 20:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/1d/921dd65e297015a56aa4b31a920cf269/pa/BK51963_d0b3025e50d55c6cb47e82914f762345.png not downloaded yet
2026-01-28 20:06:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:06:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:06:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RG29856> (referer: https://www.auto1.com/v1/car-details-view/RG29856/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F64%252F5c64b519844049af7ad47b5a2f24f5bb%252Fpa%252FVF71012_0100a8ceb69b6e1204ed01dd184d6b28.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/64/5c64b519844049af7ad47b5a2f24f5bb/pa/VF71012_0100a8ceb69b6e1204ed01dd184d6b28.jpg not downloaded yet
2026-01-28 20:06:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F1d%252F921dd65e297015a56aa4b31a920cf269%252Fpa%252FBK51963_5f549e346253fa0aa98f50e51f95bff6.png%27 HTTP/1.1" 200 None
2026-01-28 20:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/1d/921dd65e297015a56aa4b31a920cf269/pa/BK51963_5f549e346253fa0aa98f50e51f95bff6.png not downloaded yet
2026-01-28 20:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F64%252F5c64b519844049af7ad47b5a2f24f5bb%252Fpa%252FVF71012_20f884197ca0a3ebfd6428467c180690.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/64/5c64b519844049af7ad47b5a2f24f5bb/pa/VF71012_20f884197ca0a3ebfd6428467c180690.jpg not downloaded yet
2026-01-28 20:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F1d%252F921dd65e297015a56aa4b31a920cf269%252Fpa%252FBK51963_05de514c1b5b28b6d31c96779b002f9f.png%27 HTTP/1.1" 200 None
2026-01-28 20:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/1d/921dd65e297015a56aa4b31a920cf269/pa/BK51963_05de514c1b5b28b6d31c96779b002f9f.png not downloaded yet
2026-01-28 20:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F64%252F5c64b519844049af7ad47b5a2f24f5bb%252Fpa%252FVF71012_6dca6d04eb5ac4ca11cb7b720e5eb8e4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/64/5c64b519844049af7ad47b5a2f24f5bb/pa/VF71012_6dca6d04eb5ac4ca11cb7b720e5eb8e4.jpg not downloaded yet
2026-01-28 20:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F1d%252F921dd65e297015a56aa4b31a920cf269%252Fpa%252FBK51963_b5d1be8e37a80e419769e746e975d3d4.png%27 HTTP/1.1" 200 None
2026-01-28 20:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/1d/921dd65e297015a56aa4b31a920cf269/pa/BK51963_b5d1be8e37a80e419769e746e975d3d4.png not downloaded yet
2026-01-28 20:06:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09f22a10>
2026-01-28 20:06:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:06:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e027ca3-67e9-570c-acd5-c068e23d5fd7/1e027ca3-67e9-570c-acd5-c068e23d5fd7_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F64%252F5c64b519844049af7ad47b5a2f24f5bb%252Fpa%252FVF71012_8b55c5862b8dba3d4c0c96f24cd33e0a.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/64/5c64b519844049af7ad47b5a2f24f5bb/pa/VF71012_8b55c5862b8dba3d4c0c96f24cd33e0a.jpg saved to cache
2026-01-28 20:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1e027ca3-67e9-570c-acd5-c068e23d5fd7
2026-01-28 20:06:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08b5a410>
2026-01-28 20:06:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:06:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e027ca3-67e9-570c-acd5-c068e23d5fd7/1e027ca3-67e9-570c-acd5-c068e23d5fd7_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F64%252F5c64b519844049af7ad47b5a2f24f5bb%252Fpa%252FVF71012_cf19407c54c7fd4dcd338928b5047f0b.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/64/5c64b519844049af7ad47b5a2f24f5bb/pa/VF71012_cf19407c54c7fd4dcd338928b5047f0b.jpg saved to cache
2026-01-28 20:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1e027ca3-67e9-570c-acd5-c068e23d5fd7
2026-01-28 20:06:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6c916c6a-09e2-541f-879e-27ae56b589a9 with identifier: RL30055
2026-01-28 20:06:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6c916c6a-09e2-541f-879e-27ae56b589a9 with scrape type 2
2026-01-28 20:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6c916c6a-09e2-541f-879e-27ae56b589a9 with scrape type 2
2026-01-28 20:06:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6c916c6a-09e2-541f-879e-27ae56b589a9, identifier: RL30055
2026-01-28 20:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F64%252F5c64b519844049af7ad47b5a2f24f5bb%252Fpa%252FVF71012_27c21332e0577c36aa218a253cb21488.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/64/5c64b519844049af7ad47b5a2f24f5bb/pa/VF71012_27c21332e0577c36aa218a253cb21488.jpg not downloaded yet
2026-01-28 20:06:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6c916c6a-09e2-541f-879e-27ae56b589a9 with identifier: RL30055
2026-01-28 20:06:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6c916c6a-09e2-541f-879e-27ae56b589a9 with identifier: RL30055
2026-01-28 20:06:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6c916c6a-09e2-541f-879e-27ae56b589a9 with identifier: RL30055 to the API
2026-01-28 20:06:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:06:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:06:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RL30055>
{'auction_title': '',
 'c_o_2_emission_value': 153,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.3L',
 'engine_horse_power': 218,
 'expiration_date': '2026-01-29T16:45:20Z',
 'fuel_type': 'hybrid',
 'id': '6c916c6a-09e2-541f-879e-27ae56b589a9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RL30055',
 'listing': 'auction',
 'location': 'IT, Roma',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 22192,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-02-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 250e AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2023}
2026-01-28 20:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RL30055%27 HTTP/1.1" 200 None
2026-01-28 20:06:17 [auto1.it] INFO: Saving data for RL30055: {'auction_closing_time': 1769705120.0, 'created_time': 1768853330.150891, 'last_price_update_time': 1769630777.17332}
2026-01-28 20:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RL30055') HTTP/1.1" 204 0
2026-01-28 20:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F1d%252F921dd65e297015a56aa4b31a920cf269%252Fpa%252FBK51963_bda3e4c73cb2b3b32bd139aabcae458d.png%27 HTTP/1.1" 200 None
2026-01-28 20:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/1d/921dd65e297015a56aa4b31a920cf269/pa/BK51963_bda3e4c73cb2b3b32bd139aabcae458d.png not downloaded yet
2026-01-28 20:06:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 405ba6b0-e495-5350-a910-475daac5fc27 with identifier: WA30602
2026-01-28 20:06:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 405ba6b0-e495-5350-a910-475daac5fc27 with scrape type 2
2026-01-28 20:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 405ba6b0-e495-5350-a910-475daac5fc27 with scrape type 2
2026-01-28 20:06:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 405ba6b0-e495-5350-a910-475daac5fc27, identifier: WA30602
2026-01-28 20:06:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09feaf90>
2026-01-28 20:06:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e027ca3-67e9-570c-acd5-c068e23d5fd7/1e027ca3-67e9-570c-acd5-c068e23d5fd7_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F64%252F5c64b519844049af7ad47b5a2f24f5bb%252Fpa%252FVF71012_84487718fb57802fa294bdf1fab059ff.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/64/5c64b519844049af7ad47b5a2f24f5bb/pa/VF71012_84487718fb57802fa294bdf1fab059ff.jpg saved to cache
2026-01-28 20:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1e027ca3-67e9-570c-acd5-c068e23d5fd7
2026-01-28 20:06:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee3ac5f9-9152-59da-af19-c47b4d060d12 with identifier: RG29856
2026-01-28 20:06:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee3ac5f9-9152-59da-af19-c47b4d060d12 with scrape type 1
2026-01-28 20:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 14 photos for item ee3ac5f9-9152-59da-af19-c47b4d060d12
2026-01-28 20:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F61%252Fb36138c76a8594fe8816492c484a6fce%252Fpa%252FRG29856_6bec7163f274983006733bf7837f37fb.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/61/b36138c76a8594fe8816492c484a6fce/pa/RG29856_6bec7163f274983006733bf7837f37fb.jpg not downloaded yet
2026-01-28 20:06:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/64/5c64b519844049af7ad47b5a2f24f5bb/pa/VF71012_4fc1d70b2396626edf2a610bf5632f58.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:06:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/64/5c64b519844049af7ad47b5a2f24f5bb/pa/VF71012_110136872f1c292bdc16822d16fc4694.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:06:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/64/5c64b519844049af7ad47b5a2f24f5bb/pa/VF71012_a11bd037f7bfe5a73fa30645967be93d.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F64%252F5c64b519844049af7ad47b5a2f24f5bb%252Fpa%252FVF71012_b4166582e00735246a20f53149cffa97.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/64/5c64b519844049af7ad47b5a2f24f5bb/pa/VF71012_b4166582e00735246a20f53149cffa97.jpg not downloaded yet
2026-01-28 20:06:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UZ57933> (referer: https://www.auto1.com/v1/car-details-view/UZ57933/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:06:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BR27248> (referer: https://www.auto1.com/v1/car-details-view/BR27248/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:06:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YM94819> (referer: https://www.auto1.com/v1/car-details-view/YM94819/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:06:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 405ba6b0-e495-5350-a910-475daac5fc27 with identifier: WA30602
2026-01-28 20:06:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 405ba6b0-e495-5350-a910-475daac5fc27 with identifier: WA30602
2026-01-28 20:06:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 405ba6b0-e495-5350-a910-475daac5fc27 with identifier: WA30602 to the API
2026-01-28 20:06:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:06:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:06:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WA30602>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.5L',
 'engine_horse_power': 130,
 'expiration_date': '2026-01-29T16:05:12Z',
 'fuel_type': 'petrol',
 'id': '405ba6b0-e495-5350-a910-475daac5fc27',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WA30602',
 'listing': 'auction',
 'location': 'IT, Senago (MI)',
 'make': 'Honda',
 'model': 'HR-V',
 'odometer': 111088,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-04-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Honda HR-V 1.5 i-VTEC Executive',
 'transmission': 'automatic',
 'trim': 'Executive',
 'year': 2018}
2026-01-28 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WA30602%27 HTTP/1.1" 200 None
2026-01-28 20:06:18 [auto1.it] INFO: Saving data for WA30602: {'auction_closing_time': 1769702712.0, 'created_time': 1766434047.159761, 'last_price_update_time': 1769630778.114667}
2026-01-28 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WA30602') HTTP/1.1" 204 0
2026-01-28 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F1d%252F921dd65e297015a56aa4b31a920cf269%252Fpa%252FBK51963_47f2ef78863930615a3f88ef3d1169de.png%27 HTTP/1.1" 200 None
2026-01-28 20:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/1d/921dd65e297015a56aa4b31a920cf269/pa/BK51963_47f2ef78863930615a3f88ef3d1169de.png not downloaded yet
2026-01-28 20:06:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:06:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:06:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F61%252Fb36138c76a8594fe8816492c484a6fce%252Fpa%252FRG29856_f25cc9bf97f5a2277fb96218c06c9f5b.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/61/b36138c76a8594fe8816492c484a6fce/pa/RG29856_f25cc9bf97f5a2277fb96218c06c9f5b.jpg not downloaded yet
2026-01-28 20:06:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZT06764> (referer: https://www.auto1.com/v1/car-details-view/ZT06764/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F64%252F5c64b519844049af7ad47b5a2f24f5bb%252Fpa%252FVF71012_d9b0d703381540d26d369e9342e55541.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/64/5c64b519844049af7ad47b5a2f24f5bb/pa/VF71012_d9b0d703381540d26d369e9342e55541.jpg not downloaded yet
2026-01-28 20:06:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F1d%252F921dd65e297015a56aa4b31a920cf269%252Fpa%252FBK51963_d6d3714e6d5d967ea00977cd17bd028d.png%27 HTTP/1.1" 200 None
2026-01-28 20:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/1d/921dd65e297015a56aa4b31a920cf269/pa/BK51963_d6d3714e6d5d967ea00977cd17bd028d.png not downloaded yet
2026-01-28 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F61%252Fb36138c76a8594fe8816492c484a6fce%252Fpa%252FRG29856_84dc34d39c69ffa4b7f7070363fb411a.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/61/b36138c76a8594fe8816492c484a6fce/pa/RG29856_84dc34d39c69ffa4b7f7070363fb411a.jpg not downloaded yet
2026-01-28 20:06:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b089c5710>
2026-01-28 20:06:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:06:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e027ca3-67e9-570c-acd5-c068e23d5fd7/1e027ca3-67e9-570c-acd5-c068e23d5fd7_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F64%252F5c64b519844049af7ad47b5a2f24f5bb%252Fpa%252FVF71012_4fc1d70b2396626edf2a610bf5632f58.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/64/5c64b519844049af7ad47b5a2f24f5bb/pa/VF71012_4fc1d70b2396626edf2a610bf5632f58.jpg saved to cache
2026-01-28 20:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1e027ca3-67e9-570c-acd5-c068e23d5fd7
2026-01-28 20:06:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09ed4610>
2026-01-28 20:06:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:06:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e027ca3-67e9-570c-acd5-c068e23d5fd7/1e027ca3-67e9-570c-acd5-c068e23d5fd7_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F64%252F5c64b519844049af7ad47b5a2f24f5bb%252Fpa%252FVF71012_110136872f1c292bdc16822d16fc4694.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/64/5c64b519844049af7ad47b5a2f24f5bb/pa/VF71012_110136872f1c292bdc16822d16fc4694.jpg saved to cache
2026-01-28 20:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1e027ca3-67e9-570c-acd5-c068e23d5fd7
2026-01-28 20:06:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b088e0ed0>
2026-01-28 20:06:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e027ca3-67e9-570c-acd5-c068e23d5fd7/1e027ca3-67e9-570c-acd5-c068e23d5fd7_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F64%252F5c64b519844049af7ad47b5a2f24f5bb%252Fpa%252FVF71012_a11bd037f7bfe5a73fa30645967be93d.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/64/5c64b519844049af7ad47b5a2f24f5bb/pa/VF71012_a11bd037f7bfe5a73fa30645967be93d.jpg saved to cache
2026-01-28 20:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1e027ca3-67e9-570c-acd5-c068e23d5fd7
2026-01-28 20:06:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 83e8794a-4f99-58b1-8e24-41d85cc3338a with identifier: UZ57933
2026-01-28 20:06:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 83e8794a-4f99-58b1-8e24-41d85cc3338a with scrape type 2
2026-01-28 20:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 83e8794a-4f99-58b1-8e24-41d85cc3338a with scrape type 2
2026-01-28 20:06:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 83e8794a-4f99-58b1-8e24-41d85cc3338a, identifier: UZ57933
2026-01-28 20:06:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c196e96-77f3-5a6e-b91e-206a8974e716 with identifier: BR27248
2026-01-28 20:06:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c196e96-77f3-5a6e-b91e-206a8974e716 with scrape type 1
2026-01-28 20:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 14 photos for item 9c196e96-77f3-5a6e-b91e-206a8974e716
2026-01-28 20:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252Fb9%252F24b9db59477d45a42a78009fedb34d11%252Fpa%252FBR27248_009e8a8980468e6dc0d201de85512eeb.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/b9/24b9db59477d45a42a78009fedb34d11/pa/BR27248_009e8a8980468e6dc0d201de85512eeb.jpg not downloaded yet
2026-01-28 20:06:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 27d48b33-6876-5a91-82f3-70aa530b8cc0 with identifier: YM94819
2026-01-28 20:06:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27d48b33-6876-5a91-82f3-70aa530b8cc0 with scrape type 2
2026-01-28 20:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 27d48b33-6876-5a91-82f3-70aa530b8cc0 with scrape type 2
2026-01-28 20:06:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 27d48b33-6876-5a91-82f3-70aa530b8cc0, identifier: YM94819
2026-01-28 20:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F64%252F5c64b519844049af7ad47b5a2f24f5bb%252Fpa%252FVF71012_95aa712814b3bec8050399a95ac73da0.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/64/5c64b519844049af7ad47b5a2f24f5bb/pa/VF71012_95aa712814b3bec8050399a95ac73da0.jpg not downloaded yet
2026-01-28 20:06:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 83e8794a-4f99-58b1-8e24-41d85cc3338a with identifier: UZ57933
2026-01-28 20:06:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 83e8794a-4f99-58b1-8e24-41d85cc3338a with identifier: UZ57933
2026-01-28 20:06:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 83e8794a-4f99-58b1-8e24-41d85cc3338a with identifier: UZ57933 to the API
2026-01-28 20:06:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:06:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:06:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UZ57933>
{'auction_title': '',
 'c_o_2_emission_value': 64,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 392,
 'expiration_date': '2026-01-29T16:40:32Z',
 'fuel_type': 'hybrid',
 'id': '83e8794a-4f99-58b1-8e24-41d85cc3338a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UZ57933',
 'listing': 'auction',
 'location': 'IT',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 134617,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-02-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo XC60 2.0 T8 Plug-in Hybrid Momentum AWD',
 'transmission': 'automatic',
 'trim': 'Momentum AWD',
 'year': 2019}
2026-01-28 20:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UZ57933%27 HTTP/1.1" 200 None
2026-01-28 20:06:19 [auto1.it] INFO: Saving data for UZ57933: {'auction_closing_time': 1769704832.0, 'created_time': 1769458470.060597, 'last_price_update_time': 1769630779.567378}
2026-01-28 20:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UZ57933') HTTP/1.1" 204 0
2026-01-28 20:06:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 27d48b33-6876-5a91-82f3-70aa530b8cc0 with identifier: YM94819
2026-01-28 20:06:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 27d48b33-6876-5a91-82f3-70aa530b8cc0 with identifier: YM94819
2026-01-28 20:06:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 27d48b33-6876-5a91-82f3-70aa530b8cc0 with identifier: YM94819 to the API
2026-01-28 20:06:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:06:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:06:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YM94819>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 306,
 'expiration_date': '2026-01-29T16:56:03Z',
 'fuel_type': 'petrol',
 'id': '27d48b33-6876-5a91-82f3-70aa530b8cc0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YM94819',
 'listing': 'auction',
 'location': 'IT, Capannori (LU)',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 130007,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-08-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 35 Shooting Brake AMG 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2020}
2026-01-28 20:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YM94819%27 HTTP/1.1" 200 None
2026-01-28 20:06:19 [auto1.it] INFO: Saving data for YM94819: {'auction_closing_time': 1769705763.0, 'created_time': 1767693762.249395, 'last_price_update_time': 1769630779.952675}
2026-01-28 20:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YM94819') HTTP/1.1" 204 0
2026-01-28 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F1d%252F921dd65e297015a56aa4b31a920cf269%252Fpa%252FBK51963_10b0de790d2faa6337d8a277b0dd361d.png%27 HTTP/1.1" 200 None
2026-01-28 20:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/1d/921dd65e297015a56aa4b31a920cf269/pa/BK51963_10b0de790d2faa6337d8a277b0dd361d.png not downloaded yet
2026-01-28 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F61%252Fb36138c76a8594fe8816492c484a6fce%252Fpa%252FRG29856_d85afce3b51de474ea48333d515830a7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/61/b36138c76a8594fe8816492c484a6fce/pa/RG29856_d85afce3b51de474ea48333d515830a7.jpg not downloaded yet
2026-01-28 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252Fb9%252F24b9db59477d45a42a78009fedb34d11%252Fpa%252FBR27248_1ee5e6ce6d5dd4ac2e3c2cda16c324a2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/b9/24b9db59477d45a42a78009fedb34d11/pa/BR27248_1ee5e6ce6d5dd4ac2e3c2cda16c324a2.jpg not downloaded yet
2026-01-28 20:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/64/5c64b519844049af7ad47b5a2f24f5bb/pa/VF71012_27c21332e0577c36aa218a253cb21488.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/64/5c64b519844049af7ad47b5a2f24f5bb/pa/VF71012_6dca6d04eb5ac4ca11cb7b720e5eb8e4.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/61/b36138c76a8594fe8816492c484a6fce/pa/RG29856_6bec7163f274983006733bf7837f37fb.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KG16431/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:06:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f7eaeb0-1d12-5d24-ad31-49e0df716d68 with identifier: ZT06764
2026-01-28 20:06:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f7eaeb0-1d12-5d24-ad31-49e0df716d68 with scrape type 1
2026-01-28 20:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 8f7eaeb0-1d12-5d24-ad31-49e0df716d68
2026-01-28 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fdd%252F19dd8b27ab1dd7da8b80d16ff4452f4f%252Fpa%252FZT06764_018738e97960b2631188ad41ea72f13e.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/dd/19dd8b27ab1dd7da8b80d16ff4452f4f/pa/ZT06764_018738e97960b2631188ad41ea72f13e.jpg not downloaded yet
2026-01-28 20:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/64/5c64b519844049af7ad47b5a2f24f5bb/pa/VF71012_b4166582e00735246a20f53149cffa97.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F1d%252F921dd65e297015a56aa4b31a920cf269%252Fpa%252FBK51963_ed1f2b0db79e49025112fd59e85bb94f.png%27 HTTP/1.1" 200 None
2026-01-28 20:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/1d/921dd65e297015a56aa4b31a920cf269/pa/BK51963_ed1f2b0db79e49025112fd59e85bb94f.png not downloaded yet
2026-01-28 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F61%252Fb36138c76a8594fe8816492c484a6fce%252Fpa%252FRG29856_d046b4bbbc2dbcccf83a05c27efdfbb1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/61/b36138c76a8594fe8816492c484a6fce/pa/RG29856_d046b4bbbc2dbcccf83a05c27efdfbb1.jpg not downloaded yet
2026-01-28 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252Fb9%252F24b9db59477d45a42a78009fedb34d11%252Fpa%252FBR27248_40606ab8f7d5ba1eff5e71c86691e26a.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/b9/24b9db59477d45a42a78009fedb34d11/pa/BR27248_40606ab8f7d5ba1eff5e71c86691e26a.jpg not downloaded yet
2026-01-28 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fdd%252F19dd8b27ab1dd7da8b80d16ff4452f4f%252Fpa%252FZT06764_2ad9f4c118f39c79d29473f6fb00d1f9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/dd/19dd8b27ab1dd7da8b80d16ff4452f4f/pa/ZT06764_2ad9f4c118f39c79d29473f6fb00d1f9.jpg not downloaded yet
2026-01-28 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F1d%252F921dd65e297015a56aa4b31a920cf269%252Fpa%252FBK51963_1e9cb7ffa9952dca70786358d382fb64.png%27 HTTP/1.1" 200 None
2026-01-28 20:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/1d/921dd65e297015a56aa4b31a920cf269/pa/BK51963_1e9cb7ffa9952dca70786358d382fb64.png not downloaded yet
2026-01-28 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F61%252Fb36138c76a8594fe8816492c484a6fce%252Fpa%252FRG29856_1ba38b174147ff9e89dca3c8feee827b.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/61/b36138c76a8594fe8816492c484a6fce/pa/RG29856_1ba38b174147ff9e89dca3c8feee827b.jpg not downloaded yet
2026-01-28 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252Fb9%252F24b9db59477d45a42a78009fedb34d11%252Fpa%252FBR27248_9fdc021654b5a9cefb20c9677a442063.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/b9/24b9db59477d45a42a78009fedb34d11/pa/BR27248_9fdc021654b5a9cefb20c9677a442063.jpg not downloaded yet
2026-01-28 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fdd%252F19dd8b27ab1dd7da8b80d16ff4452f4f%252Fpa%252FZT06764_ee69a704cb3327ce26d3dc06f0819d2e.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/dd/19dd8b27ab1dd7da8b80d16ff4452f4f/pa/ZT06764_ee69a704cb3327ce26d3dc06f0819d2e.jpg not downloaded yet
2026-01-28 20:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/64/5c64b519844049af7ad47b5a2f24f5bb/pa/VF71012_95aa712814b3bec8050399a95ac73da0.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img24/b9/24b9db59477d45a42a78009fedb34d11/pa/BR27248_1ee5e6ce6d5dd4ac2e3c2cda16c324a2.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F61%252Fb36138c76a8594fe8816492c484a6fce%252Fpa%252FRG29856_ba9997ca9adad02f7bad23722931ab02.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/61/b36138c76a8594fe8816492c484a6fce/pa/RG29856_ba9997ca9adad02f7bad23722931ab02.jpg not downloaded yet
2026-01-28 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252Fb9%252F24b9db59477d45a42a78009fedb34d11%252Fpa%252FBR27248_80c48f2a493c856f294757e4d9e927d8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/b9/24b9db59477d45a42a78009fedb34d11/pa/BR27248_80c48f2a493c856f294757e4d9e927d8.jpg not downloaded yet
2026-01-28 20:06:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09f87e90>
2026-01-28 20:06:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:06:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e027ca3-67e9-570c-acd5-c068e23d5fd7/1e027ca3-67e9-570c-acd5-c068e23d5fd7_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F64%252F5c64b519844049af7ad47b5a2f24f5bb%252Fpa%252FVF71012_27c21332e0577c36aa218a253cb21488.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/64/5c64b519844049af7ad47b5a2f24f5bb/pa/VF71012_27c21332e0577c36aa218a253cb21488.jpg saved to cache
2026-01-28 20:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 1e027ca3-67e9-570c-acd5-c068e23d5fd7
2026-01-28 20:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img24/b9/24b9db59477d45a42a78009fedb34d11/pa/BR27248_009e8a8980468e6dc0d201de85512eeb.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/61/b36138c76a8594fe8816492c484a6fce/pa/RG29856_84dc34d39c69ffa4b7f7070363fb411a.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fdd%252F19dd8b27ab1dd7da8b80d16ff4452f4f%252Fpa%252FZT06764_a03cc9b8b9170a24408116a4ea2be03e.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/dd/19dd8b27ab1dd7da8b80d16ff4452f4f/pa/ZT06764_a03cc9b8b9170a24408116a4ea2be03e.jpg not downloaded yet
2026-01-28 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F61%252Fb36138c76a8594fe8816492c484a6fce%252Fpa%252FRG29856_26581e1c70c2a8a8548dadd8e8241286.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/61/b36138c76a8594fe8816492c484a6fce/pa/RG29856_26581e1c70c2a8a8548dadd8e8241286.jpg not downloaded yet
2026-01-28 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252Fb9%252F24b9db59477d45a42a78009fedb34d11%252Fpa%252FBR27248_c306249e11b2b7ff9fd562ae3a5f9d28.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/b9/24b9db59477d45a42a78009fedb34d11/pa/BR27248_c306249e11b2b7ff9fd562ae3a5f9d28.jpg not downloaded yet
2026-01-28 20:06:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09f04990>
2026-01-28 20:06:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:06:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e027ca3-67e9-570c-acd5-c068e23d5fd7/1e027ca3-67e9-570c-acd5-c068e23d5fd7_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F64%252F5c64b519844049af7ad47b5a2f24f5bb%252Fpa%252FVF71012_6dca6d04eb5ac4ca11cb7b720e5eb8e4.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/64/5c64b519844049af7ad47b5a2f24f5bb/pa/VF71012_6dca6d04eb5ac4ca11cb7b720e5eb8e4.jpg saved to cache
2026-01-28 20:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 1e027ca3-67e9-570c-acd5-c068e23d5fd7
2026-01-28 20:06:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08b24a50>
2026-01-28 20:06:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:06:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee3ac5f9-9152-59da-af19-c47b4d060d12/ee3ac5f9-9152-59da-af19-c47b4d060d12_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F61%252Fb36138c76a8594fe8816492c484a6fce%252Fpa%252FRG29856_6bec7163f274983006733bf7837f37fb.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/61/b36138c76a8594fe8816492c484a6fce/pa/RG29856_6bec7163f274983006733bf7837f37fb.jpg saved to cache
2026-01-28 20:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ee3ac5f9-9152-59da-af19-c47b4d060d12
2026-01-28 20:06:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08b3b690>
2026-01-28 20:06:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e027ca3-67e9-570c-acd5-c068e23d5fd7/1e027ca3-67e9-570c-acd5-c068e23d5fd7_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F64%252F5c64b519844049af7ad47b5a2f24f5bb%252Fpa%252FVF71012_b4166582e00735246a20f53149cffa97.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/64/5c64b519844049af7ad47b5a2f24f5bb/pa/VF71012_b4166582e00735246a20f53149cffa97.jpg saved to cache
2026-01-28 20:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 1e027ca3-67e9-570c-acd5-c068e23d5fd7
2026-01-28 20:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fdd%252F19dd8b27ab1dd7da8b80d16ff4452f4f%252Fpa%252FZT06764_e0814907b56cf34c67f902307527be25.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/dd/19dd8b27ab1dd7da8b80d16ff4452f4f/pa/ZT06764_e0814907b56cf34c67f902307527be25.jpg not downloaded yet
2026-01-28 20:06:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08be39d0>
2026-01-28 20:06:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e027ca3-67e9-570c-acd5-c068e23d5fd7/1e027ca3-67e9-570c-acd5-c068e23d5fd7_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F64%252F5c64b519844049af7ad47b5a2f24f5bb%252Fpa%252FVF71012_95aa712814b3bec8050399a95ac73da0.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/64/5c64b519844049af7ad47b5a2f24f5bb/pa/VF71012_95aa712814b3bec8050399a95ac73da0.jpg saved to cache
2026-01-28 20:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 1e027ca3-67e9-570c-acd5-c068e23d5fd7
2026-01-28 20:06:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08beae50>
2026-01-28 20:06:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:06:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c196e96-77f3-5a6e-b91e-206a8974e716/9c196e96-77f3-5a6e-b91e-206a8974e716_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252Fb9%252F24b9db59477d45a42a78009fedb34d11%252Fpa%252FBR27248_1ee5e6ce6d5dd4ac2e3c2cda16c324a2.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/b9/24b9db59477d45a42a78009fedb34d11/pa/BR27248_1ee5e6ce6d5dd4ac2e3c2cda16c324a2.jpg saved to cache
2026-01-28 20:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9c196e96-77f3-5a6e-b91e-206a8974e716
2026-01-28 20:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/1d/921dd65e297015a56aa4b31a920cf269/pa/BK51963_3df3e5bf33d2da269e6c6010d49b46c1.png> (referer: https://www.auto1.com/)
2026-01-28 20:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/1d/921dd65e297015a56aa4b31a920cf269/pa/BK51963_6b8f63ad1867765e2466921254cbc78e.png> (referer: https://www.auto1.com/)
2026-01-28 20:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img24/b9/24b9db59477d45a42a78009fedb34d11/pa/BR27248_9fdc021654b5a9cefb20c9677a442063.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F61%252Fb36138c76a8594fe8816492c484a6fce%252Fpa%252FRG29856_504609e8d1e685369aeadfd8723c9013.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/61/b36138c76a8594fe8816492c484a6fce/pa/RG29856_504609e8d1e685369aeadfd8723c9013.jpg not downloaded yet
2026-01-28 20:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252Fb9%252F24b9db59477d45a42a78009fedb34d11%252Fpa%252FBR27248_147abbd275ab932b7b09e058e24f8072.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/b9/24b9db59477d45a42a78009fedb34d11/pa/BR27248_147abbd275ab932b7b09e058e24f8072.jpg not downloaded yet
2026-01-28 20:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/61/b36138c76a8594fe8816492c484a6fce/pa/RG29856_d85afce3b51de474ea48333d515830a7.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/61/b36138c76a8594fe8816492c484a6fce/pa/RG29856_1ba38b174147ff9e89dca3c8feee827b.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fdd%252F19dd8b27ab1dd7da8b80d16ff4452f4f%252Fpa%252FZT06764_668fbb1300ca4f7c7ba9057a9260e6bc.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/dd/19dd8b27ab1dd7da8b80d16ff4452f4f/pa/ZT06764_668fbb1300ca4f7c7ba9057a9260e6bc.jpg not downloaded yet
2026-01-28 20:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WV62374/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WL72741> (referer: https://www.auto1.com/v1/car-details-view/WL72741/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VE93563> (referer: https://www.auto1.com/v1/car-details-view/VE93563/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZS61961> (referer: https://www.auto1.com/v1/car-details-view/ZS61961/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VN78624> (referer: https://www.auto1.com/v1/car-details-view/VN78624/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RF65516> (referer: https://www.auto1.com/v1/car-details-view/RF65516/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:06:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:06:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09d9e150>
2026-01-28 20:06:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c196e96-77f3-5a6e-b91e-206a8974e716/9c196e96-77f3-5a6e-b91e-206a8974e716_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252Fb9%252F24b9db59477d45a42a78009fedb34d11%252Fpa%252FBR27248_009e8a8980468e6dc0d201de85512eeb.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/b9/24b9db59477d45a42a78009fedb34d11/pa/BR27248_009e8a8980468e6dc0d201de85512eeb.jpg saved to cache
2026-01-28 20:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9c196e96-77f3-5a6e-b91e-206a8974e716
2026-01-28 20:06:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09e903d0>
2026-01-28 20:06:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee3ac5f9-9152-59da-af19-c47b4d060d12/ee3ac5f9-9152-59da-af19-c47b4d060d12_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F61%252Fb36138c76a8594fe8816492c484a6fce%252Fpa%252FRG29856_84dc34d39c69ffa4b7f7070363fb411a.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/61/b36138c76a8594fe8816492c484a6fce/pa/RG29856_84dc34d39c69ffa4b7f7070363fb411a.jpg saved to cache
2026-01-28 20:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ee3ac5f9-9152-59da-af19-c47b4d060d12
2026-01-28 20:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F61%252Fb36138c76a8594fe8816492c484a6fce%252Fpa%252FRG29856_d00e5da9602e04774fc914357b76a546.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/61/b36138c76a8594fe8816492c484a6fce/pa/RG29856_d00e5da9602e04774fc914357b76a546.jpg not downloaded yet
2026-01-28 20:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252Fb9%252F24b9db59477d45a42a78009fedb34d11%252Fpa%252FBR27248_f623e4bad77970a74d34535784365427.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/b9/24b9db59477d45a42a78009fedb34d11/pa/BR27248_f623e4bad77970a74d34535784365427.jpg not downloaded yet
2026-01-28 20:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fdd%252F19dd8b27ab1dd7da8b80d16ff4452f4f%252Fpa%252FZT06764_f71fc033ffa817e0858016d9dad4135a.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/dd/19dd8b27ab1dd7da8b80d16ff4452f4f/pa/ZT06764_f71fc033ffa817e0858016d9dad4135a.jpg not downloaded yet
2026-01-28 20:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F61%252Fb36138c76a8594fe8816492c484a6fce%252Fpa%252FRG29856_ed0f042081c45fcb132e8b0244ac039b.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/61/b36138c76a8594fe8816492c484a6fce/pa/RG29856_ed0f042081c45fcb132e8b0244ac039b.jpg not downloaded yet
2026-01-28 20:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252Fb9%252F24b9db59477d45a42a78009fedb34d11%252Fpa%252FBR27248_aea8fd5c825a07be757baa88936722d2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/b9/24b9db59477d45a42a78009fedb34d11/pa/BR27248_aea8fd5c825a07be757baa88936722d2.jpg not downloaded yet
2026-01-28 20:06:22 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-01-28 20:06:22 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 41 9
2026-01-28 20:06:22 [PIL.PngImagePlugin] DEBUG: STREAM b'zTXt' 62 285
2026-01-28 20:06:22 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 359 8192
2026-01-28 20:06:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08cb2510>
2026-01-28 20:06:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d6c42ae-e85f-51b5-8ddf-53f6e4f44ee5/5d6c42ae-e85f-51b5-8ddf-53f6e4f44ee5_image_0.png HTTP/1.1" 201 0
2026-01-28 20:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F1d%252F921dd65e297015a56aa4b31a920cf269%252Fpa%252FBK51963_3df3e5bf33d2da269e6c6010d49b46c1.png') HTTP/1.1" 204 0
2026-01-28 20:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/1d/921dd65e297015a56aa4b31a920cf269/pa/BK51963_3df3e5bf33d2da269e6c6010d49b46c1.png saved to cache
2026-01-28 20:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5d6c42ae-e85f-51b5-8ddf-53f6e4f44ee5
2026-01-28 20:06:23 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-01-28 20:06:23 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 41 9
2026-01-28 20:06:23 [PIL.PngImagePlugin] DEBUG: STREAM b'zTXt' 62 285
2026-01-28 20:06:23 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 359 8192
2026-01-28 20:06:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08a661d0>
2026-01-28 20:06:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d6c42ae-e85f-51b5-8ddf-53f6e4f44ee5/5d6c42ae-e85f-51b5-8ddf-53f6e4f44ee5_image_1.png HTTP/1.1" 201 0
2026-01-28 20:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F1d%252F921dd65e297015a56aa4b31a920cf269%252Fpa%252FBK51963_6b8f63ad1867765e2466921254cbc78e.png') HTTP/1.1" 204 0
2026-01-28 20:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/1d/921dd65e297015a56aa4b31a920cf269/pa/BK51963_6b8f63ad1867765e2466921254cbc78e.png saved to cache
2026-01-28 20:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5d6c42ae-e85f-51b5-8ddf-53f6e4f44ee5
2026-01-28 20:06:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08a5d890>
2026-01-28 20:06:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c196e96-77f3-5a6e-b91e-206a8974e716/9c196e96-77f3-5a6e-b91e-206a8974e716_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252Fb9%252F24b9db59477d45a42a78009fedb34d11%252Fpa%252FBR27248_9fdc021654b5a9cefb20c9677a442063.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/b9/24b9db59477d45a42a78009fedb34d11/pa/BR27248_9fdc021654b5a9cefb20c9677a442063.jpg saved to cache
2026-01-28 20:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9c196e96-77f3-5a6e-b91e-206a8974e716
2026-01-28 20:06:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08a65210>
2026-01-28 20:06:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:06:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee3ac5f9-9152-59da-af19-c47b4d060d12/ee3ac5f9-9152-59da-af19-c47b4d060d12_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F61%252Fb36138c76a8594fe8816492c484a6fce%252Fpa%252FRG29856_d85afce3b51de474ea48333d515830a7.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/61/b36138c76a8594fe8816492c484a6fce/pa/RG29856_d85afce3b51de474ea48333d515830a7.jpg saved to cache
2026-01-28 20:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ee3ac5f9-9152-59da-af19-c47b4d060d12
2026-01-28 20:06:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08a74e10>
2026-01-28 20:06:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:06:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee3ac5f9-9152-59da-af19-c47b4d060d12/ee3ac5f9-9152-59da-af19-c47b4d060d12_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F61%252Fb36138c76a8594fe8816492c484a6fce%252Fpa%252FRG29856_1ba38b174147ff9e89dca3c8feee827b.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/61/b36138c76a8594fe8816492c484a6fce/pa/RG29856_1ba38b174147ff9e89dca3c8feee827b.jpg saved to cache
2026-01-28 20:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ee3ac5f9-9152-59da-af19-c47b4d060d12
2026-01-28 20:06:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 134ef434-97f6-5117-9636-c60e4114ed41 with identifier: WL72741
2026-01-28 20:06:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 134ef434-97f6-5117-9636-c60e4114ed41 with scrape type 1
2026-01-28 20:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 134ef434-97f6-5117-9636-c60e4114ed41
2026-01-28 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fbc%252F6cbc9c9809a498af7b50a0bab1097050%252Fpa%252FWL72741_eeb3cd170393e0f940e4e56c4df0bc3d.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/bc/6cbc9c9809a498af7b50a0bab1097050/pa/WL72741_eeb3cd170393e0f940e4e56c4df0bc3d.jpg already downloaded
2026-01-28 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fbc%252F6cbc9c9809a498af7b50a0bab1097050%252Fpa%252FWL72741_dbbfdaeb2de36c385fd5c931eb60f019.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/bc/6cbc9c9809a498af7b50a0bab1097050/pa/WL72741_dbbfdaeb2de36c385fd5c931eb60f019.jpg already downloaded
2026-01-28 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fbc%252F6cbc9c9809a498af7b50a0bab1097050%252Fpa%252FWL72741_431e65dd2b5a875c7d9258539402da66.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/bc/6cbc9c9809a498af7b50a0bab1097050/pa/WL72741_431e65dd2b5a875c7d9258539402da66.jpg already downloaded
2026-01-28 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fbc%252F6cbc9c9809a498af7b50a0bab1097050%252Fpa%252FWL72741_df51ba974908bdb2ae5a52fc8bd77cb8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/bc/6cbc9c9809a498af7b50a0bab1097050/pa/WL72741_df51ba974908bdb2ae5a52fc8bd77cb8.jpg already downloaded
2026-01-28 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fbc%252F6cbc9c9809a498af7b50a0bab1097050%252Fpa%252FWL72741_6cad29c35958755aba924b2bf04f9d8d.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/bc/6cbc9c9809a498af7b50a0bab1097050/pa/WL72741_6cad29c35958755aba924b2bf04f9d8d.jpg already downloaded
2026-01-28 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fbc%252F6cbc9c9809a498af7b50a0bab1097050%252Fpa%252FWL72741_57ec1bc5e674ff0f0229c433f003188d.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/bc/6cbc9c9809a498af7b50a0bab1097050/pa/WL72741_57ec1bc5e674ff0f0229c433f003188d.jpg already downloaded
2026-01-28 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fbc%252F6cbc9c9809a498af7b50a0bab1097050%252Fpa%252FWL72741_5aa3fd0297ce13606e99e0bd3f8da0bf.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/bc/6cbc9c9809a498af7b50a0bab1097050/pa/WL72741_5aa3fd0297ce13606e99e0bd3f8da0bf.jpg already downloaded
2026-01-28 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fbc%252F6cbc9c9809a498af7b50a0bab1097050%252Fpa%252FWL72741_85fbbfb33f29093e7aed8ac16e21ba80.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/bc/6cbc9c9809a498af7b50a0bab1097050/pa/WL72741_85fbbfb33f29093e7aed8ac16e21ba80.jpg already downloaded
2026-01-28 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fbc%252F6cbc9c9809a498af7b50a0bab1097050%252Fpa%252FWL72741_4c531b96487963caf43ef9ae4eaf8c02.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/bc/6cbc9c9809a498af7b50a0bab1097050/pa/WL72741_4c531b96487963caf43ef9ae4eaf8c02.jpg already downloaded
2026-01-28 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fbc%252F6cbc9c9809a498af7b50a0bab1097050%252Fpa%252FWL72741_56c3c766e841451f612fab0311e6466c.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/bc/6cbc9c9809a498af7b50a0bab1097050/pa/WL72741_56c3c766e841451f612fab0311e6466c.jpg already downloaded
2026-01-28 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fbc%252F6cbc9c9809a498af7b50a0bab1097050%252Fpa%252FWL72741_6f0e8a12f285257ebc0bc5b740b961b2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/bc/6cbc9c9809a498af7b50a0bab1097050/pa/WL72741_6f0e8a12f285257ebc0bc5b740b961b2.jpg already downloaded
2026-01-28 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fbc%252F6cbc9c9809a498af7b50a0bab1097050%252Fpa%252FWL72741_993e548c3d8f3869184ebe189e79a8d4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/bc/6cbc9c9809a498af7b50a0bab1097050/pa/WL72741_993e548c3d8f3869184ebe189e79a8d4.jpg already downloaded
2026-01-28 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fbc%252F6cbc9c9809a498af7b50a0bab1097050%252Fpa%252FWL72741_dc2aeea496798eda4b4167e5c690c9a2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/bc/6cbc9c9809a498af7b50a0bab1097050/pa/WL72741_dc2aeea496798eda4b4167e5c690c9a2.jpg already downloaded
2026-01-28 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fbc%252F6cbc9c9809a498af7b50a0bab1097050%252Fpa%252FWL72741_7df3e477727fd590f3d3544b389c32f6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/bc/6cbc9c9809a498af7b50a0bab1097050/pa/WL72741_7df3e477727fd590f3d3544b389c32f6.jpg already downloaded
2026-01-28 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fbc%252F6cbc9c9809a498af7b50a0bab1097050%252Fpa%252FWL72741_c4bd8fc374f83e263ba3a307d0fb325b.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/bc/6cbc9c9809a498af7b50a0bab1097050/pa/WL72741_c4bd8fc374f83e263ba3a307d0fb325b.jpg already downloaded
2026-01-28 20:06:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 134ef434-97f6-5117-9636-c60e4114ed41, identifier: WL72741
2026-01-28 20:06:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1de626cc-c26c-5fbb-b81e-1566ec25c40a with identifier: VE93563
2026-01-28 20:06:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1de626cc-c26c-5fbb-b81e-1566ec25c40a with scrape type 2
2026-01-28 20:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1de626cc-c26c-5fbb-b81e-1566ec25c40a with scrape type 2
2026-01-28 20:06:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1de626cc-c26c-5fbb-b81e-1566ec25c40a, identifier: VE93563
2026-01-28 20:06:25 [auto1.it] INFO: Parsing search results for channel: 24h
2026-01-28 20:06:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e7cc6e4-10d5-586f-8c6e-8db91fb14160 with identifier: ZS61961
2026-01-28 20:06:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e7cc6e4-10d5-586f-8c6e-8db91fb14160 with scrape type 1
2026-01-28 20:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 14 photos for item 2e7cc6e4-10d5-586f-8c6e-8db91fb14160
2026-01-28 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F3b%252F5d3b6aecc2b4f473e54820351f162a4c%252Fpa%252FZS61961_2e30b39aee8f84f20ca83adb09f1d8e2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/3b/5d3b6aecc2b4f473e54820351f162a4c/pa/ZS61961_2e30b39aee8f84f20ca83adb09f1d8e2.jpg already downloaded
2026-01-28 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F3b%252F5d3b6aecc2b4f473e54820351f162a4c%252Fpa%252FZS61961_c1c57b7bd1e66393cb0a749bac7e1c5e.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/3b/5d3b6aecc2b4f473e54820351f162a4c/pa/ZS61961_c1c57b7bd1e66393cb0a749bac7e1c5e.jpg already downloaded
2026-01-28 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F3b%252F5d3b6aecc2b4f473e54820351f162a4c%252Fpa%252FZS61961_f362a58af6644336af46304b3116f95e.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/3b/5d3b6aecc2b4f473e54820351f162a4c/pa/ZS61961_f362a58af6644336af46304b3116f95e.jpg already downloaded
2026-01-28 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F3b%252F5d3b6aecc2b4f473e54820351f162a4c%252Fpa%252FZS61961_e13202a070f2f0cb1c5c93eb2cc7add6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/3b/5d3b6aecc2b4f473e54820351f162a4c/pa/ZS61961_e13202a070f2f0cb1c5c93eb2cc7add6.jpg already downloaded
2026-01-28 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F3b%252F5d3b6aecc2b4f473e54820351f162a4c%252Fpa%252FZS61961_1a715c6c6dfa7818a985d391eda27dc3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/3b/5d3b6aecc2b4f473e54820351f162a4c/pa/ZS61961_1a715c6c6dfa7818a985d391eda27dc3.jpg already downloaded
2026-01-28 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F3b%252F5d3b6aecc2b4f473e54820351f162a4c%252Fpa%252FZS61961_3d17348bd81788bf09c0f0b2eda28ea6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/3b/5d3b6aecc2b4f473e54820351f162a4c/pa/ZS61961_3d17348bd81788bf09c0f0b2eda28ea6.jpg already downloaded
2026-01-28 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F3b%252F5d3b6aecc2b4f473e54820351f162a4c%252Fpa%252FZS61961_01ca4b0e076210a888c145c877bf8b32.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/3b/5d3b6aecc2b4f473e54820351f162a4c/pa/ZS61961_01ca4b0e076210a888c145c877bf8b32.jpg already downloaded
2026-01-28 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F3b%252F5d3b6aecc2b4f473e54820351f162a4c%252Fpa%252FZS61961_e44136adfea1f6c5b150570742a31814.png%27 HTTP/1.1" 200 None
2026-01-28 20:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/3b/5d3b6aecc2b4f473e54820351f162a4c/pa/ZS61961_e44136adfea1f6c5b150570742a31814.png already downloaded
2026-01-28 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F3b%252F5d3b6aecc2b4f473e54820351f162a4c%252Fpa%252FZS61961_d4b37e754d080b6dc503635f114d4c3d.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/3b/5d3b6aecc2b4f473e54820351f162a4c/pa/ZS61961_d4b37e754d080b6dc503635f114d4c3d.jpg already downloaded
2026-01-28 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F3b%252F5d3b6aecc2b4f473e54820351f162a4c%252Fpa%252FZS61961_560ceaae651f31aa3085db9f83f34477.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/3b/5d3b6aecc2b4f473e54820351f162a4c/pa/ZS61961_560ceaae651f31aa3085db9f83f34477.jpg already downloaded
2026-01-28 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F3b%252F5d3b6aecc2b4f473e54820351f162a4c%252Fpa%252FZS61961_5013e779c5ea97fdcf4732da04ba0107.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/3b/5d3b6aecc2b4f473e54820351f162a4c/pa/ZS61961_5013e779c5ea97fdcf4732da04ba0107.jpg already downloaded
2026-01-28 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F3b%252F5d3b6aecc2b4f473e54820351f162a4c%252Fpa%252FZS61961_cb5bcafb6742e68227e828dafd53d9db.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/3b/5d3b6aecc2b4f473e54820351f162a4c/pa/ZS61961_cb5bcafb6742e68227e828dafd53d9db.jpg already downloaded
2026-01-28 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F3b%252F5d3b6aecc2b4f473e54820351f162a4c%252Fpa%252FZS61961_d13410fced11c346666e3a49848b845c.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/3b/5d3b6aecc2b4f473e54820351f162a4c/pa/ZS61961_d13410fced11c346666e3a49848b845c.jpg already downloaded
2026-01-28 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F3b%252F5d3b6aecc2b4f473e54820351f162a4c%252Fpa%252FZS61961_e3f31e4c45524cc4a77d78cfc0aa3c82.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/3b/5d3b6aecc2b4f473e54820351f162a4c/pa/ZS61961_e3f31e4c45524cc4a77d78cfc0aa3c82.jpg already downloaded
2026-01-28 20:06:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2e7cc6e4-10d5-586f-8c6e-8db91fb14160, identifier: ZS61961
2026-01-28 20:06:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd7c508a-f609-5dae-81a0-4034da8717d5 with identifier: VN78624
2026-01-28 20:06:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd7c508a-f609-5dae-81a0-4034da8717d5 with scrape type 1
2026-01-28 20:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item dd7c508a-f609-5dae-81a0-4034da8717d5
2026-01-28 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F82%252F4982bb2e78b705999beb80091f6f1dcb%252Fpa%252FVN78624_887e1946e4723bfd907a6599520e4183.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/82/4982bb2e78b705999beb80091f6f1dcb/pa/VN78624_887e1946e4723bfd907a6599520e4183.jpg already downloaded
2026-01-28 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F82%252F4982bb2e78b705999beb80091f6f1dcb%252Fpa%252FVN78624_4706dc610e7c80dcf85abc8f42a61eba.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/82/4982bb2e78b705999beb80091f6f1dcb/pa/VN78624_4706dc610e7c80dcf85abc8f42a61eba.jpg already downloaded
2026-01-28 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F82%252F4982bb2e78b705999beb80091f6f1dcb%252Fpa%252FVN78624_d7123d180de8bd85aee9788f31263036.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/82/4982bb2e78b705999beb80091f6f1dcb/pa/VN78624_d7123d180de8bd85aee9788f31263036.jpg already downloaded
2026-01-28 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F82%252F4982bb2e78b705999beb80091f6f1dcb%252Fpa%252FVN78624_eff427c0706cdd2c01cd79c8ebd7762b.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/82/4982bb2e78b705999beb80091f6f1dcb/pa/VN78624_eff427c0706cdd2c01cd79c8ebd7762b.jpg already downloaded
2026-01-28 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F82%252F4982bb2e78b705999beb80091f6f1dcb%252Fpa%252FVN78624_909d4f923356de1148338ca0b8c3de64.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/82/4982bb2e78b705999beb80091f6f1dcb/pa/VN78624_909d4f923356de1148338ca0b8c3de64.jpg already downloaded
2026-01-28 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F82%252F4982bb2e78b705999beb80091f6f1dcb%252Fpa%252FVN78624_0c054fd2ddf0fd59fc639ee1d0ab9fc0.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/82/4982bb2e78b705999beb80091f6f1dcb/pa/VN78624_0c054fd2ddf0fd59fc639ee1d0ab9fc0.jpg already downloaded
2026-01-28 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F82%252F4982bb2e78b705999beb80091f6f1dcb%252Fpa%252FVN78624_ea906e53ebed2dad8835ca46f27b5b66.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/82/4982bb2e78b705999beb80091f6f1dcb/pa/VN78624_ea906e53ebed2dad8835ca46f27b5b66.jpg already downloaded
2026-01-28 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F82%252F4982bb2e78b705999beb80091f6f1dcb%252Fpa%252FVN78624_195632b2bee6dcecfd7fa5b3320f8fd3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/82/4982bb2e78b705999beb80091f6f1dcb/pa/VN78624_195632b2bee6dcecfd7fa5b3320f8fd3.jpg already downloaded
2026-01-28 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F82%252F4982bb2e78b705999beb80091f6f1dcb%252Fpa%252FVN78624_f6f98b4a5326d8fcddac3f7b1d53c977.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/82/4982bb2e78b705999beb80091f6f1dcb/pa/VN78624_f6f98b4a5326d8fcddac3f7b1d53c977.jpg already downloaded
2026-01-28 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F82%252F4982bb2e78b705999beb80091f6f1dcb%252Fpa%252FVN78624_9cd16f2e20be64f184eb9efbd7d65663.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/82/4982bb2e78b705999beb80091f6f1dcb/pa/VN78624_9cd16f2e20be64f184eb9efbd7d65663.jpg already downloaded
2026-01-28 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F82%252F4982bb2e78b705999beb80091f6f1dcb%252Fpa%252FVN78624_2fc8fc66347768770069d33a0e3a28de.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/82/4982bb2e78b705999beb80091f6f1dcb/pa/VN78624_2fc8fc66347768770069d33a0e3a28de.jpg already downloaded
2026-01-28 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F82%252F4982bb2e78b705999beb80091f6f1dcb%252Fpa%252FVN78624_d1ea14a0202577625d4dc1bec477e943.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/82/4982bb2e78b705999beb80091f6f1dcb/pa/VN78624_d1ea14a0202577625d4dc1bec477e943.jpg already downloaded
2026-01-28 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F82%252F4982bb2e78b705999beb80091f6f1dcb%252Fpa%252FVN78624_4e6cccc8ccea578c56e9a9d52efa486a.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/82/4982bb2e78b705999beb80091f6f1dcb/pa/VN78624_4e6cccc8ccea578c56e9a9d52efa486a.jpg already downloaded
2026-01-28 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F82%252F4982bb2e78b705999beb80091f6f1dcb%252Fpa%252FVN78624_fb1d20f7e1931a92d10972fd7c5fafd3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/82/4982bb2e78b705999beb80091f6f1dcb/pa/VN78624_fb1d20f7e1931a92d10972fd7c5fafd3.jpg already downloaded
2026-01-28 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F82%252F4982bb2e78b705999beb80091f6f1dcb%252Fpa%252FVN78624_ed8866e7ff5a86229edc68efe56061bc.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/82/4982bb2e78b705999beb80091f6f1dcb/pa/VN78624_ed8866e7ff5a86229edc68efe56061bc.jpg already downloaded
2026-01-28 20:06:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: dd7c508a-f609-5dae-81a0-4034da8717d5, identifier: VN78624
2026-01-28 20:06:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 69f99255-496b-5647-820a-1dfb2356caad with identifier: RF65516
2026-01-28 20:06:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69f99255-496b-5647-820a-1dfb2356caad with scrape type 1
2026-01-28 20:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 69f99255-496b-5647-820a-1dfb2356caad
2026-01-28 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F92%252F56929b7f454d62f8f4d94e0a9f9b8377%252Fpa%252FRF65516_206dcf9c21a0e493948a69f54ad8f47d.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/92/56929b7f454d62f8f4d94e0a9f9b8377/pa/RF65516_206dcf9c21a0e493948a69f54ad8f47d.jpg not downloaded yet
2026-01-28 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fdd%252F19dd8b27ab1dd7da8b80d16ff4452f4f%252Fpa%252FZT06764_12a5cb0bcc8d59853fc8e0e4f812eca7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/dd/19dd8b27ab1dd7da8b80d16ff4452f4f/pa/ZT06764_12a5cb0bcc8d59853fc8e0e4f812eca7.jpg not downloaded yet
2026-01-28 20:06:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 134ef434-97f6-5117-9636-c60e4114ed41 with identifier: WL72741
2026-01-28 20:06:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 134ef434-97f6-5117-9636-c60e4114ed41 with identifier: WL72741
2026-01-28 20:06:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 134ef434-97f6-5117-9636-c60e4114ed41 with identifier: WL72741 to the API
2026-01-28 20:06:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:06:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:06:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WL72741>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '2.0L',
 'engine_horse_power': 180,
 'expiration_date': '2026-01-29T16:58:21Z',
 'fuel_type': 'diesel',
 'id': '134ef434-97f6-5117-9636-c60e4114ed41',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WL72741',
 'listing': 'auction',
 'location': 'IT, Senago (MI)',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 115681,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img6c/bc/6cbc9c9809a498af7b50a0bab1097050/pa/WL72741_eeb3cd170393e0f940e4e56c4df0bc3d.jpg',
                'https://img-pa.auto1.com/img6c/bc/6cbc9c9809a498af7b50a0bab1097050/pa/WL72741_dbbfdaeb2de36c385fd5c931eb60f019.jpg',
                'https://img-pa.auto1.com/img6c/bc/6cbc9c9809a498af7b50a0bab1097050/pa/WL72741_431e65dd2b5a875c7d9258539402da66.jpg',
                'https://img-pa.auto1.com/img6c/bc/6cbc9c9809a498af7b50a0bab1097050/pa/WL72741_df51ba974908bdb2ae5a52fc8bd77cb8.jpg',
                'https://img-pa.auto1.com/img6c/bc/6cbc9c9809a498af7b50a0bab1097050/pa/WL72741_6cad29c35958755aba924b2bf04f9d8d.jpg',
                'https://img-pa.auto1.com/img6c/bc/6cbc9c9809a498af7b50a0bab1097050/pa/WL72741_57ec1bc5e674ff0f0229c433f003188d.jpg',
                'https://img-pa.auto1.com/img6c/bc/6cbc9c9809a498af7b50a0bab1097050/pa/WL72741_5aa3fd0297ce13606e99e0bd3f8da0bf.jpg',
                'https://img-pa.auto1.com/img6c/bc/6cbc9c9809a498af7b50a0bab1097050/pa/WL72741_85fbbfb33f29093e7aed8ac16e21ba80.jpg',
                'https://img-pa.auto1.com/img6c/bc/6cbc9c9809a498af7b50a0bab1097050/pa/WL72741_4c531b96487963caf43ef9ae4eaf8c02.jpg',
                'https://img-pa.auto1.com/img6c/bc/6cbc9c9809a498af7b50a0bab1097050/pa/WL72741_56c3c766e841451f612fab0311e6466c.jpg',
                'https://img-pa.auto1.com/img6c/bc/6cbc9c9809a498af7b50a0bab1097050/pa/WL72741_6f0e8a12f285257ebc0bc5b740b961b2.jpg',
                'https://img-pa.auto1.com/img6c/bc/6cbc9c9809a498af7b50a0bab1097050/pa/WL72741_993e548c3d8f3869184ebe189e79a8d4.jpg',
                'https://img-pa.auto1.com/img6c/bc/6cbc9c9809a498af7b50a0bab1097050/pa/WL72741_dc2aeea496798eda4b4167e5c690c9a2.jpg',
                'https://img-pa.auto1.com/img6c/bc/6cbc9c9809a498af7b50a0bab1097050/pa/WL72741_7df3e477727fd590f3d3544b389c32f6.jpg',
                'https://img-pa.auto1.com/img6c/bc/6cbc9c9809a498af7b50a0bab1097050/pa/WL72741_c4bd8fc374f83e263ba3a307d0fb325b.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_134ef434-97f6-5117-9636-c60e4114ed41/134ef434-97f6-5117-9636-c60e4114ed41_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70116,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/bc/6cbc9c9809a498af7b50a0bab1097050/pa/WL72741_eeb3cd170393e0f940e4e56c4df0bc3d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_134ef434-97f6-5117-9636-c60e4114ed41/134ef434-97f6-5117-9636-c60e4114ed41_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70323,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/bc/6cbc9c9809a498af7b50a0bab1097050/pa/WL72741_dbbfdaeb2de36c385fd5c931eb60f019.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_134ef434-97f6-5117-9636-c60e4114ed41/134ef434-97f6-5117-9636-c60e4114ed41_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2498433,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/bc/6cbc9c9809a498af7b50a0bab1097050/pa/WL72741_431e65dd2b5a875c7d9258539402da66.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_134ef434-97f6-5117-9636-c60e4114ed41/134ef434-97f6-5117-9636-c60e4114ed41_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2663019,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/bc/6cbc9c9809a498af7b50a0bab1097050/pa/WL72741_df51ba974908bdb2ae5a52fc8bd77cb8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_134ef434-97f6-5117-9636-c60e4114ed41/134ef434-97f6-5117-9636-c60e4114ed41_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69770,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/bc/6cbc9c9809a498af7b50a0bab1097050/pa/WL72741_6cad29c35958755aba924b2bf04f9d8d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_134ef434-97f6-5117-9636-c60e4114ed41/134ef434-97f6-5117-9636-c60e4114ed41_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2560043,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/bc/6cbc9c9809a498af7b50a0bab1097050/pa/WL72741_57ec1bc5e674ff0f0229c433f003188d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_134ef434-97f6-5117-9636-c60e4114ed41/134ef434-97f6-5117-9636-c60e4114ed41_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2550948,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/bc/6cbc9c9809a498af7b50a0bab1097050/pa/WL72741_5aa3fd0297ce13606e99e0bd3f8da0bf.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_134ef434-97f6-5117-9636-c60e4114ed41/134ef434-97f6-5117-9636-c60e4114ed41_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2663708,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/bc/6cbc9c9809a498af7b50a0bab1097050/pa/WL72741_85fbbfb33f29093e7aed8ac16e21ba80.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_134ef434-97f6-5117-9636-c60e4114ed41/134ef434-97f6-5117-9636-c60e4114ed41_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67901,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/bc/6cbc9c9809a498af7b50a0bab1097050/pa/WL72741_4c531b96487963caf43ef9ae4eaf8c02.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_134ef434-97f6-5117-9636-c60e4114ed41/134ef434-97f6-5117-9636-c60e4114ed41_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67480,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/bc/6cbc9c9809a498af7b50a0bab1097050/pa/WL72741_56c3c766e841451f612fab0311e6466c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_134ef434-97f6-5117-9636-c60e4114ed41/134ef434-97f6-5117-9636-c60e4114ed41_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3108905,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/bc/6cbc9c9809a498af7b50a0bab1097050/pa/WL72741_6f0e8a12f285257ebc0bc5b740b961b2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_134ef434-97f6-5117-9636-c60e4114ed41/134ef434-97f6-5117-9636-c60e4114ed41_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68423,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/bc/6cbc9c9809a498af7b50a0bab1097050/pa/WL72741_993e548c3d8f3869184ebe189e79a8d4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_134ef434-97f6-5117-9636-c60e4114ed41/134ef434-97f6-5117-9636-c60e4114ed41_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64760,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/bc/6cbc9c9809a498af7b50a0bab1097050/pa/WL72741_dc2aeea496798eda4b4167e5c690c9a2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_134ef434-97f6-5117-9636-c60e4114ed41/134ef434-97f6-5117-9636-c60e4114ed41_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2814063,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/bc/6cbc9c9809a498af7b50a0bab1097050/pa/WL72741_7df3e477727fd590f3d3544b389c32f6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_134ef434-97f6-5117-9636-c60e4114ed41/134ef434-97f6-5117-9636-c60e4114ed41_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56836,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/bc/6cbc9c9809a498af7b50a0bab1097050/pa/WL72741_c4bd8fc374f83e263ba3a307d0fb325b.jpg',
             'Width': 450}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-08-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 2.0 Blue-HDi GT',
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2019}
2026-01-28 20:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WL72741%27 HTTP/1.1" 200 None
2026-01-28 20:06:26 [auto1.it] INFO: Saving data for WL72741: {'created_time': 1769630786.144584, 'last_price_update_time': 1769630786.144594, 'auction_closing_time': 1769705901.0}
2026-01-28 20:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WL72741') HTTP/1.1" 204 0
2026-01-28 20:06:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1de626cc-c26c-5fbb-b81e-1566ec25c40a with identifier: VE93563
2026-01-28 20:06:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1de626cc-c26c-5fbb-b81e-1566ec25c40a with identifier: VE93563
2026-01-28 20:06:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1de626cc-c26c-5fbb-b81e-1566ec25c40a with identifier: VE93563 to the API
2026-01-28 20:06:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:06:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:06:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VE93563>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '2.1L',
 'engine_horse_power': 210,
 'expiration_date': '2026-01-29T16:35:27Z',
 'fuel_type': 'diesel',
 'id': '1de626cc-c26c-5fbb-b81e-1566ec25c40a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VE93563',
 'listing': 'auction',
 'location': 'IT, Roma',
 'make': 'Alfa Romeo',
 'model': 'Stelvio',
 'odometer': 112865,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-02-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Alfa Romeo Stelvio 2.2 JTDM Q4 Lusso',
 'transmission': 'automatic',
 'trim': 'Q4 Lusso',
 'year': 2019}
2026-01-28 20:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VE93563%27 HTTP/1.1" 200 None
2026-01-28 20:06:26 [auto1.it] INFO: Saving data for VE93563: {'auction_closing_time': 1769704527.0, 'created_time': 1768939291.703173, 'last_price_update_time': 1769630786.505097}
2026-01-28 20:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VE93563') HTTP/1.1" 204 0
2026-01-28 20:06:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2e7cc6e4-10d5-586f-8c6e-8db91fb14160 with identifier: ZS61961
2026-01-28 20:06:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2e7cc6e4-10d5-586f-8c6e-8db91fb14160 with identifier: ZS61961
2026-01-28 20:06:26 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'ford' containing 'ford' and model 'tourneo custom' containing 'tourneo'
2026-01-28 20:06:26 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 2e7cc6e4-10d5-586f-8c6e-8db91fb14160 spider: auto1.it
2026-01-28 20:06:26 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 2e7cc6e4-10d5-586f-8c6e-8db91fb14160 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'ford' containing 'ford' and model 'tourneo custom' containing 'tourneo'
{'auction_title': '',
 'c_o_2_emission_value': 282,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:05:37Z',
 'fuel_type': 'diesel',
 'id': '2e7cc6e4-10d5-586f-8c6e-8db91fb14160',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZS61961',
 'listing': 'auction',
 'location': 'IT',
 'make': 'Ford',
 'model': 'Tourneo Custom',
 'odometer': 41546,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 14,
 'photo_urls': ['https://img-pa.auto1.com/img5d/3b/5d3b6aecc2b4f473e54820351f162a4c/pa/ZS61961_2e30b39aee8f84f20ca83adb09f1d8e2.jpg',
                'https://img-pa.auto1.com/img5d/3b/5d3b6aecc2b4f473e54820351f162a4c/pa/ZS61961_c1c57b7bd1e66393cb0a749bac7e1c5e.jpg',
                'https://img-pa.auto1.com/img5d/3b/5d3b6aecc2b4f473e54820351f162a4c/pa/ZS61961_f362a58af6644336af46304b3116f95e.jpg',
                'https://img-pa.auto1.com/img5d/3b/5d3b6aecc2b4f473e54820351f162a4c/pa/ZS61961_e13202a070f2f0cb1c5c93eb2cc7add6.jpg',
                'https://img-pa.auto1.com/img5d/3b/5d3b6aecc2b4f473e54820351f162a4c/pa/ZS61961_1a715c6c6dfa7818a985d391eda27dc3.jpg',
                'https://img-pa.auto1.com/img5d/3b/5d3b6aecc2b4f473e54820351f162a4c/pa/ZS61961_3d17348bd81788bf09c0f0b2eda28ea6.jpg',
                'https://img-pa.auto1.com/img5d/3b/5d3b6aecc2b4f473e54820351f162a4c/pa/ZS61961_01ca4b0e076210a888c145c877bf8b32.jpg',
                'https://img-pa.auto1.com/img5d/3b/5d3b6aecc2b4f473e54820351f162a4c/pa/ZS61961_e44136adfea1f6c5b150570742a31814.png',
                'https://img-pa.auto1.com/img5d/3b/5d3b6aecc2b4f473e54820351f162a4c/pa/ZS61961_d4b37e754d080b6dc503635f114d4c3d.jpg',
                'https://img-pa.auto1.com/img5d/3b/5d3b6aecc2b4f473e54820351f162a4c/pa/ZS61961_560ceaae651f31aa3085db9f83f34477.jpg',
                'https://img-pa.auto1.com/img5d/3b/5d3b6aecc2b4f473e54820351f162a4c/pa/ZS61961_5013e779c5ea97fdcf4732da04ba0107.jpg',
                'https://img-pa.auto1.com/img5d/3b/5d3b6aecc2b4f473e54820351f162a4c/pa/ZS61961_cb5bcafb6742e68227e828dafd53d9db.jpg',
                'https://img-pa.auto1.com/img5d/3b/5d3b6aecc2b4f473e54820351f162a4c/pa/ZS61961_d13410fced11c346666e3a49848b845c.jpg',
                'https://img-pa.auto1.com/img5d/3b/5d3b6aecc2b4f473e54820351f162a4c/pa/ZS61961_e3f31e4c45524cc4a77d78cfc0aa3c82.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e7cc6e4-10d5-586f-8c6e-8db91fb14160/2e7cc6e4-10d5-586f-8c6e-8db91fb14160_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95773,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/3b/5d3b6aecc2b4f473e54820351f162a4c/pa/ZS61961_2e30b39aee8f84f20ca83adb09f1d8e2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e7cc6e4-10d5-586f-8c6e-8db91fb14160/2e7cc6e4-10d5-586f-8c6e-8db91fb14160_image_1.mpo',
             'Extension': 'mpo',
             'FileSizeInBytes': 2963822,
             'Height': 3024,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/3b/5d3b6aecc2b4f473e54820351f162a4c/pa/ZS61961_c1c57b7bd1e66393cb0a749bac7e1c5e.jpg',
             'Width': 4032},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e7cc6e4-10d5-586f-8c6e-8db91fb14160/2e7cc6e4-10d5-586f-8c6e-8db91fb14160_image_2.mpo',
             'Extension': 'mpo',
             'FileSizeInBytes': 2916614,
             'Height': 3024,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/3b/5d3b6aecc2b4f473e54820351f162a4c/pa/ZS61961_f362a58af6644336af46304b3116f95e.jpg',
             'Width': 4032},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e7cc6e4-10d5-586f-8c6e-8db91fb14160/2e7cc6e4-10d5-586f-8c6e-8db91fb14160_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80016,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/3b/5d3b6aecc2b4f473e54820351f162a4c/pa/ZS61961_e13202a070f2f0cb1c5c93eb2cc7add6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e7cc6e4-10d5-586f-8c6e-8db91fb14160/2e7cc6e4-10d5-586f-8c6e-8db91fb14160_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104352,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/3b/5d3b6aecc2b4f473e54820351f162a4c/pa/ZS61961_1a715c6c6dfa7818a985d391eda27dc3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e7cc6e4-10d5-586f-8c6e-8db91fb14160/2e7cc6e4-10d5-586f-8c6e-8db91fb14160_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98377,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/3b/5d3b6aecc2b4f473e54820351f162a4c/pa/ZS61961_3d17348bd81788bf09c0f0b2eda28ea6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e7cc6e4-10d5-586f-8c6e-8db91fb14160/2e7cc6e4-10d5-586f-8c6e-8db91fb14160_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86236,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/3b/5d3b6aecc2b4f473e54820351f162a4c/pa/ZS61961_01ca4b0e076210a888c145c877bf8b32.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e7cc6e4-10d5-586f-8c6e-8db91fb14160/2e7cc6e4-10d5-586f-8c6e-8db91fb14160_image_7.png',
             'Extension': 'png',
             'FileSizeInBytes': 236770,
             'Height': 243,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/3b/5d3b6aecc2b4f473e54820351f162a4c/pa/ZS61961_e44136adfea1f6c5b150570742a31814.png',
             'Width': 512},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e7cc6e4-10d5-586f-8c6e-8db91fb14160/2e7cc6e4-10d5-586f-8c6e-8db91fb14160_image_8.mpo',
             'Extension': 'mpo',
             'FileSizeInBytes': 3023233,
             'Height': 3024,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/3b/5d3b6aecc2b4f473e54820351f162a4c/pa/ZS61961_d4b37e754d080b6dc503635f114d4c3d.jpg',
             'Width': 4032},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e7cc6e4-10d5-586f-8c6e-8db91fb14160/2e7cc6e4-10d5-586f-8c6e-8db91fb14160_image_9.mpo',
             'Extension': 'mpo',
             'FileSizeInBytes': 4118542,
             'Height': 3024,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/3b/5d3b6aecc2b4f473e54820351f162a4c/pa/ZS61961_560ceaae651f31aa3085db9f83f34477.jpg',
             'Width': 4032},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e7cc6e4-10d5-586f-8c6e-8db91fb14160/2e7cc6e4-10d5-586f-8c6e-8db91fb14160_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101863,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/3b/5d3b6aecc2b4f473e54820351f162a4c/pa/ZS61961_5013e779c5ea97fdcf4732da04ba0107.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e7cc6e4-10d5-586f-8c6e-8db91fb14160/2e7cc6e4-10d5-586f-8c6e-8db91fb14160_image_11.mpo',
             'Extension': 'mpo',
             'FileSizeInBytes': 3029434,
             'Height': 3024,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/3b/5d3b6aecc2b4f473e54820351f162a4c/pa/ZS61961_cb5bcafb6742e68227e828dafd53d9db.jpg',
             'Width': 4032},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e7cc6e4-10d5-586f-8c6e-8db91fb14160/2e7cc6e4-10d5-586f-8c6e-8db91fb14160_image_12.mpo',
             'Extension': 'mpo',
             'FileSizeInBytes': 3806573,
             'Height': 3024,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/3b/5d3b6aecc2b4f473e54820351f162a4c/pa/ZS61961_d13410fced11c346666e3a49848b845c.jpg',
             'Width': 4032},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e7cc6e4-10d5-586f-8c6e-8db91fb14160/2e7cc6e4-10d5-586f-8c6e-8db91fb14160_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43721,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/3b/5d3b6aecc2b4f473e54820351f162a4c/pa/ZS61961_e3f31e4c45524cc4a77d78cfc0aa3c82.jpg',
             'Width': 424}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-06-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Tourneo Custom 2.0 TDCi L1 Trend Business',
 'transmission': 'manual',
 'trim': 'L1 Trend Business',
 'year': 2022}
2026-01-28 20:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZS61961%27 HTTP/1.1" 200 None
2026-01-28 20:06:26 [auto1.it] INFO: Saving data for ZS61961: {'created_time': 1769630786.746507, 'last_price_update_time': 1769630786.746518, 'auction_closing_time': 1769702737.0}
2026-01-28 20:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZS61961') HTTP/1.1" 204 0
2026-01-28 20:06:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: dd7c508a-f609-5dae-81a0-4034da8717d5 with identifier: VN78624
2026-01-28 20:06:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: dd7c508a-f609-5dae-81a0-4034da8717d5 with identifier: VN78624
2026-01-28 20:06:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: dd7c508a-f609-5dae-81a0-4034da8717d5 with identifier: VN78624 to the API
2026-01-28 20:06:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:06:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:06:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VN78624>
{'auction_title': '',
 'c_o_2_emission_value': 145,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:58:13Z',
 'fuel_type': 'petrol',
 'id': 'dd7c508a-f609-5dae-81a0-4034da8717d5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VN78624',
 'listing': 'auction',
 'location': 'IT, Settimo Torinese',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 29006,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img49/82/4982bb2e78b705999beb80091f6f1dcb/pa/VN78624_887e1946e4723bfd907a6599520e4183.jpg',
                'https://img-pa.auto1.com/img49/82/4982bb2e78b705999beb80091f6f1dcb/pa/VN78624_4706dc610e7c80dcf85abc8f42a61eba.jpg',
                'https://img-pa.auto1.com/img49/82/4982bb2e78b705999beb80091f6f1dcb/pa/VN78624_d7123d180de8bd85aee9788f31263036.jpg',
                'https://img-pa.auto1.com/img49/82/4982bb2e78b705999beb80091f6f1dcb/pa/VN78624_eff427c0706cdd2c01cd79c8ebd7762b.jpg',
                'https://img-pa.auto1.com/img49/82/4982bb2e78b705999beb80091f6f1dcb/pa/VN78624_909d4f923356de1148338ca0b8c3de64.jpg',
                'https://img-pa.auto1.com/img49/82/4982bb2e78b705999beb80091f6f1dcb/pa/VN78624_0c054fd2ddf0fd59fc639ee1d0ab9fc0.jpg',
                'https://img-pa.auto1.com/img49/82/4982bb2e78b705999beb80091f6f1dcb/pa/VN78624_ea906e53ebed2dad8835ca46f27b5b66.jpg',
                'https://img-pa.auto1.com/img49/82/4982bb2e78b705999beb80091f6f1dcb/pa/VN78624_195632b2bee6dcecfd7fa5b3320f8fd3.jpg',
                'https://img-pa.auto1.com/img49/82/4982bb2e78b705999beb80091f6f1dcb/pa/VN78624_f6f98b4a5326d8fcddac3f7b1d53c977.jpg',
                'https://img-pa.auto1.com/img49/82/4982bb2e78b705999beb80091f6f1dcb/pa/VN78624_9cd16f2e20be64f184eb9efbd7d65663.jpg',
                'https://img-pa.auto1.com/img49/82/4982bb2e78b705999beb80091f6f1dcb/pa/VN78624_2fc8fc66347768770069d33a0e3a28de.jpg',
                'https://img-pa.auto1.com/img49/82/4982bb2e78b705999beb80091f6f1dcb/pa/VN78624_d1ea14a0202577625d4dc1bec477e943.jpg',
                'https://img-pa.auto1.com/img49/82/4982bb2e78b705999beb80091f6f1dcb/pa/VN78624_4e6cccc8ccea578c56e9a9d52efa486a.jpg',
                'https://img-pa.auto1.com/img49/82/4982bb2e78b705999beb80091f6f1dcb/pa/VN78624_fb1d20f7e1931a92d10972fd7c5fafd3.jpg',
                'https://img-pa.auto1.com/img49/82/4982bb2e78b705999beb80091f6f1dcb/pa/VN78624_ed8866e7ff5a86229edc68efe56061bc.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd7c508a-f609-5dae-81a0-4034da8717d5/dd7c508a-f609-5dae-81a0-4034da8717d5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70341,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/82/4982bb2e78b705999beb80091f6f1dcb/pa/VN78624_887e1946e4723bfd907a6599520e4183.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd7c508a-f609-5dae-81a0-4034da8717d5/dd7c508a-f609-5dae-81a0-4034da8717d5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2757383,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img49/82/4982bb2e78b705999beb80091f6f1dcb/pa/VN78624_4706dc610e7c80dcf85abc8f42a61eba.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd7c508a-f609-5dae-81a0-4034da8717d5/dd7c508a-f609-5dae-81a0-4034da8717d5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67855,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/82/4982bb2e78b705999beb80091f6f1dcb/pa/VN78624_d7123d180de8bd85aee9788f31263036.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd7c508a-f609-5dae-81a0-4034da8717d5/dd7c508a-f609-5dae-81a0-4034da8717d5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61376,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/82/4982bb2e78b705999beb80091f6f1dcb/pa/VN78624_eff427c0706cdd2c01cd79c8ebd7762b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd7c508a-f609-5dae-81a0-4034da8717d5/dd7c508a-f609-5dae-81a0-4034da8717d5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2713313,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img49/82/4982bb2e78b705999beb80091f6f1dcb/pa/VN78624_909d4f923356de1148338ca0b8c3de64.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd7c508a-f609-5dae-81a0-4034da8717d5/dd7c508a-f609-5dae-81a0-4034da8717d5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49885,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/82/4982bb2e78b705999beb80091f6f1dcb/pa/VN78624_0c054fd2ddf0fd59fc639ee1d0ab9fc0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd7c508a-f609-5dae-81a0-4034da8717d5/dd7c508a-f609-5dae-81a0-4034da8717d5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2487501,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img49/82/4982bb2e78b705999beb80091f6f1dcb/pa/VN78624_ea906e53ebed2dad8835ca46f27b5b66.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd7c508a-f609-5dae-81a0-4034da8717d5/dd7c508a-f609-5dae-81a0-4034da8717d5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72027,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/82/4982bb2e78b705999beb80091f6f1dcb/pa/VN78624_195632b2bee6dcecfd7fa5b3320f8fd3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd7c508a-f609-5dae-81a0-4034da8717d5/dd7c508a-f609-5dae-81a0-4034da8717d5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71468,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/82/4982bb2e78b705999beb80091f6f1dcb/pa/VN78624_f6f98b4a5326d8fcddac3f7b1d53c977.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd7c508a-f609-5dae-81a0-4034da8717d5/dd7c508a-f609-5dae-81a0-4034da8717d5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62184,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/82/4982bb2e78b705999beb80091f6f1dcb/pa/VN78624_9cd16f2e20be64f184eb9efbd7d65663.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd7c508a-f609-5dae-81a0-4034da8717d5/dd7c508a-f609-5dae-81a0-4034da8717d5_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54083,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/82/4982bb2e78b705999beb80091f6f1dcb/pa/VN78624_2fc8fc66347768770069d33a0e3a28de.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd7c508a-f609-5dae-81a0-4034da8717d5/dd7c508a-f609-5dae-81a0-4034da8717d5_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68526,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/82/4982bb2e78b705999beb80091f6f1dcb/pa/VN78624_d1ea14a0202577625d4dc1bec477e943.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd7c508a-f609-5dae-81a0-4034da8717d5/dd7c508a-f609-5dae-81a0-4034da8717d5_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62105,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/82/4982bb2e78b705999beb80091f6f1dcb/pa/VN78624_4e6cccc8ccea578c56e9a9d52efa486a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd7c508a-f609-5dae-81a0-4034da8717d5/dd7c508a-f609-5dae-81a0-4034da8717d5_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45164,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/82/4982bb2e78b705999beb80091f6f1dcb/pa/VN78624_fb1d20f7e1931a92d10972fd7c5fafd3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd7c508a-f609-5dae-81a0-4034da8717d5/dd7c508a-f609-5dae-81a0-4034da8717d5_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50431,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/82/4982bb2e78b705999beb80091f6f1dcb/pa/VN78624_ed8866e7ff5a86229edc68efe56061bc.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-01-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.5 TSI ACT R-Line',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2023}
2026-01-28 20:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VN78624%27 HTTP/1.1" 200 None
2026-01-28 20:06:27 [auto1.it] INFO: Saving data for VN78624: {'created_time': 1769630787.157584, 'last_price_update_time': 1769630787.157595, 'auction_closing_time': 1769705893.0}
2026-01-28 20:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VN78624') HTTP/1.1" 204 0
2026-01-28 20:06:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img24/b9/24b9db59477d45a42a78009fedb34d11/pa/BR27248_c306249e11b2b7ff9fd562ae3a5f9d28.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:06:27 [scrapy.extensions.logstats] INFO: Crawled 376 pages (at 74 pages/min), scraped 116 items (at 28 items/min)
2026-01-28 20:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F61%252Fb36138c76a8594fe8816492c484a6fce%252Fpa%252FRG29856_82b520bf35873bd58c079279d2c0ac07.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/61/b36138c76a8594fe8816492c484a6fce/pa/RG29856_82b520bf35873bd58c079279d2c0ac07.jpg not downloaded yet
2026-01-28 20:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252Fb9%252F24b9db59477d45a42a78009fedb34d11%252Fpa%252FBR27248_486079d0302d7e0f65c128e96baca43e.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/b9/24b9db59477d45a42a78009fedb34d11/pa/BR27248_486079d0302d7e0f65c128e96baca43e.jpg not downloaded yet
2026-01-28 20:06:27 [auto1.it] INFO: Found listing with ID: UZ89898
2026-01-28 20:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UZ89898%27 HTTP/1.1" 200 None
2026-01-28 20:06:27 [auto1.it] INFO: Scrape type for UZ89898: 0
2026-01-28 20:06:27 [auto1.it] INFO: Found listing with ID: CA75041
2026-01-28 20:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CA75041%27 HTTP/1.1" 200 None
2026-01-28 20:06:27 [auto1.it] INFO: Scrape type for CA75041: 0
2026-01-28 20:06:27 [auto1.it] INFO: Found listing with ID: TZ24707
2026-01-28 20:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TZ24707%27 HTTP/1.1" 200 None
2026-01-28 20:06:27 [auto1.it] INFO: Scrape type for TZ24707: 0
2026-01-28 20:06:27 [auto1.it] INFO: Found listing with ID: HW40098
2026-01-28 20:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HW40098%27 HTTP/1.1" 200 None
2026-01-28 20:06:27 [auto1.it] INFO: Scrape type for HW40098: 0
2026-01-28 20:06:27 [auto1.it] INFO: Found listing with ID: EJ94115
2026-01-28 20:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EJ94115%27 HTTP/1.1" 200 None
2026-01-28 20:06:27 [auto1.it] INFO: Scrape type for EJ94115: 0
2026-01-28 20:06:27 [auto1.it] INFO: Found listing with ID: EH94386
2026-01-28 20:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EH94386%27 HTTP/1.1" 200 None
2026-01-28 20:06:27 [auto1.it] INFO: Scrape type for EH94386: 0
2026-01-28 20:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F92%252F56929b7f454d62f8f4d94e0a9f9b8377%252Fpa%252FRF65516_2a6746ef8115bc062f8dfb7c6fe533ae.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/92/56929b7f454d62f8f4d94e0a9f9b8377/pa/RF65516_2a6746ef8115bc062f8dfb7c6fe533ae.jpg not downloaded yet
2026-01-28 20:06:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/61/b36138c76a8594fe8816492c484a6fce/pa/RG29856_26581e1c70c2a8a8548dadd8e8241286.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fdd%252F19dd8b27ab1dd7da8b80d16ff4452f4f%252Fpa%252FZT06764_a46641eca4774ccabd54d9cac40ca718.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/dd/19dd8b27ab1dd7da8b80d16ff4452f4f/pa/ZT06764_a46641eca4774ccabd54d9cac40ca718.jpg not downloaded yet
2026-01-28 20:06:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/1d/921dd65e297015a56aa4b31a920cf269/pa/BK51963_bda3e4c73cb2b3b32bd139aabcae458d.png> (referer: https://www.auto1.com/)
2026-01-28 20:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F61%252Fb36138c76a8594fe8816492c484a6fce%252Fpa%252FRG29856_5c019a933231ab5e9c11ece967b403cd.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/61/b36138c76a8594fe8816492c484a6fce/pa/RG29856_5c019a933231ab5e9c11ece967b403cd.jpg not downloaded yet
2026-01-28 20:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252Fb9%252F24b9db59477d45a42a78009fedb34d11%252Fpa%252FBR27248_d65a8e22d1d4d2a21554a0b2653e4e10.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/b9/24b9db59477d45a42a78009fedb34d11/pa/BR27248_d65a8e22d1d4d2a21554a0b2653e4e10.jpg not downloaded yet
2026-01-28 20:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F92%252F56929b7f454d62f8f4d94e0a9f9b8377%252Fpa%252FRF65516_85441ea6a3d44a075e8f653d6acb4242.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/92/56929b7f454d62f8f4d94e0a9f9b8377/pa/RF65516_85441ea6a3d44a075e8f653d6acb4242.jpg not downloaded yet
2026-01-28 20:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fdd%252F19dd8b27ab1dd7da8b80d16ff4452f4f%252Fpa%252FZT06764_272b6a6b2d45d5836f3608dda437a2e5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/dd/19dd8b27ab1dd7da8b80d16ff4452f4f/pa/ZT06764_272b6a6b2d45d5836f3608dda437a2e5.jpg not downloaded yet
2026-01-28 20:06:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09f4a110>
2026-01-28 20:06:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:06:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c196e96-77f3-5a6e-b91e-206a8974e716/9c196e96-77f3-5a6e-b91e-206a8974e716_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252Fb9%252F24b9db59477d45a42a78009fedb34d11%252Fpa%252FBR27248_c306249e11b2b7ff9fd562ae3a5f9d28.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/b9/24b9db59477d45a42a78009fedb34d11/pa/BR27248_c306249e11b2b7ff9fd562ae3a5f9d28.jpg saved to cache
2026-01-28 20:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9c196e96-77f3-5a6e-b91e-206a8974e716
2026-01-28 20:06:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/1d/921dd65e297015a56aa4b31a920cf269/pa/BK51963_b5d1be8e37a80e419769e746e975d3d4.png> (referer: https://www.auto1.com/)
2026-01-28 20:06:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img24/b9/24b9db59477d45a42a78009fedb34d11/pa/BR27248_147abbd275ab932b7b09e058e24f8072.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:06:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/61/b36138c76a8594fe8816492c484a6fce/pa/RG29856_504609e8d1e685369aeadfd8723c9013.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F61%252Fb36138c76a8594fe8816492c484a6fce%252Fpa%252FRG29856_5183793f31e84785190f827d3f285550.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/61/b36138c76a8594fe8816492c484a6fce/pa/RG29856_5183793f31e84785190f827d3f285550.jpg not downloaded yet
2026-01-28 20:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252Fb9%252F24b9db59477d45a42a78009fedb34d11%252Fpa%252FBR27248_ffedcaabfb66dc883de2c7338e1e6ca2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/b9/24b9db59477d45a42a78009fedb34d11/pa/BR27248_ffedcaabfb66dc883de2c7338e1e6ca2.jpg not downloaded yet
2026-01-28 20:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F92%252F56929b7f454d62f8f4d94e0a9f9b8377%252Fpa%252FRF65516_05a67fb18360c09e3bd7a5f311d7ccd6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/92/56929b7f454d62f8f4d94e0a9f9b8377/pa/RF65516_05a67fb18360c09e3bd7a5f311d7ccd6.jpg not downloaded yet
2026-01-28 20:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fdd%252F19dd8b27ab1dd7da8b80d16ff4452f4f%252Fpa%252FZT06764_860e38ee594eed9efb1eb3eee533babc.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/dd/19dd8b27ab1dd7da8b80d16ff4452f4f/pa/ZT06764_860e38ee594eed9efb1eb3eee533babc.jpg not downloaded yet
2026-01-28 20:06:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img24/b9/24b9db59477d45a42a78009fedb34d11/pa/BR27248_80c48f2a493c856f294757e4d9e927d8.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252Fb9%252F24b9db59477d45a42a78009fedb34d11%252Fpa%252FBR27248_afc53202946845a364ba6a0f2c89ca83.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/b9/24b9db59477d45a42a78009fedb34d11/pa/BR27248_afc53202946845a364ba6a0f2c89ca83.jpg not downloaded yet
2026-01-28 20:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F92%252F56929b7f454d62f8f4d94e0a9f9b8377%252Fpa%252FRF65516_a385c3aa28f4a02131d1b58a1865ec39.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/92/56929b7f454d62f8f4d94e0a9f9b8377/pa/RF65516_a385c3aa28f4a02131d1b58a1865ec39.jpg not downloaded yet
2026-01-28 20:06:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b086c01d0>
2026-01-28 20:06:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:06:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee3ac5f9-9152-59da-af19-c47b4d060d12/ee3ac5f9-9152-59da-af19-c47b4d060d12_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F61%252Fb36138c76a8594fe8816492c484a6fce%252Fpa%252FRG29856_26581e1c70c2a8a8548dadd8e8241286.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/61/b36138c76a8594fe8816492c484a6fce/pa/RG29856_26581e1c70c2a8a8548dadd8e8241286.jpg saved to cache
2026-01-28 20:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ee3ac5f9-9152-59da-af19-c47b4d060d12
2026-01-28 20:06:28 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-01-28 20:06:28 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 41 9
2026-01-28 20:06:28 [PIL.PngImagePlugin] DEBUG: STREAM b'zTXt' 62 285
2026-01-28 20:06:28 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 359 8192
2026-01-28 20:06:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0eaa7f50>
2026-01-28 20:06:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:06:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d6c42ae-e85f-51b5-8ddf-53f6e4f44ee5/5d6c42ae-e85f-51b5-8ddf-53f6e4f44ee5_image_6.png HTTP/1.1" 201 0
2026-01-28 20:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F1d%252F921dd65e297015a56aa4b31a920cf269%252Fpa%252FBK51963_bda3e4c73cb2b3b32bd139aabcae458d.png') HTTP/1.1" 204 0
2026-01-28 20:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/1d/921dd65e297015a56aa4b31a920cf269/pa/BK51963_bda3e4c73cb2b3b32bd139aabcae458d.png saved to cache
2026-01-28 20:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5d6c42ae-e85f-51b5-8ddf-53f6e4f44ee5
2026-01-28 20:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fdd%252F19dd8b27ab1dd7da8b80d16ff4452f4f%252Fpa%252FZT06764_8d4367f827dd5cca38ba31f3726b475c.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/dd/19dd8b27ab1dd7da8b80d16ff4452f4f/pa/ZT06764_8d4367f827dd5cca38ba31f3726b475c.jpg not downloaded yet
2026-01-28 20:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/dd/19dd8b27ab1dd7da8b80d16ff4452f4f/pa/ZT06764_2ad9f4c118f39c79d29473f6fb00d1f9.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img24/b9/24b9db59477d45a42a78009fedb34d11/pa/BR27248_40606ab8f7d5ba1eff5e71c86691e26a.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252Fb9%252F24b9db59477d45a42a78009fedb34d11%252Fpa%252FBR27248_ba8e81dcf4cba9b79ccdecf1d2eb16d1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/b9/24b9db59477d45a42a78009fedb34d11/pa/BR27248_ba8e81dcf4cba9b79ccdecf1d2eb16d1.jpg not downloaded yet
2026-01-28 20:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F92%252F56929b7f454d62f8f4d94e0a9f9b8377%252Fpa%252FRF65516_70af025c2ae57eb76167b0188b22ab4a.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/92/56929b7f454d62f8f4d94e0a9f9b8377/pa/RF65516_70af025c2ae57eb76167b0188b22ab4a.jpg not downloaded yet
2026-01-28 20:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/61/b36138c76a8594fe8816492c484a6fce/pa/RG29856_ba9997ca9adad02f7bad23722931ab02.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fdd%252F19dd8b27ab1dd7da8b80d16ff4452f4f%252Fpa%252FZT06764_6649b776d8c47148b14e9bd9c3a593c7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/dd/19dd8b27ab1dd7da8b80d16ff4452f4f/pa/ZT06764_6649b776d8c47148b14e9bd9c3a593c7.jpg not downloaded yet
2026-01-28 20:06:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KG16431> (referer: https://www.auto1.com/v1/car-details-view/KG16431/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:06:29 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-01-28 20:06:29 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 41 9
2026-01-28 20:06:29 [PIL.PngImagePlugin] DEBUG: STREAM b'zTXt' 62 285
2026-01-28 20:06:29 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 359 8192
2026-01-28 20:06:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09e48e90>
2026-01-28 20:06:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:06:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d6c42ae-e85f-51b5-8ddf-53f6e4f44ee5/5d6c42ae-e85f-51b5-8ddf-53f6e4f44ee5_image_5.png HTTP/1.1" 201 0
2026-01-28 20:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F1d%252F921dd65e297015a56aa4b31a920cf269%252Fpa%252FBK51963_b5d1be8e37a80e419769e746e975d3d4.png') HTTP/1.1" 204 0
2026-01-28 20:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/1d/921dd65e297015a56aa4b31a920cf269/pa/BK51963_b5d1be8e37a80e419769e746e975d3d4.png saved to cache
2026-01-28 20:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5d6c42ae-e85f-51b5-8ddf-53f6e4f44ee5
2026-01-28 20:06:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b086f9b10>
2026-01-28 20:06:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:06:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c196e96-77f3-5a6e-b91e-206a8974e716/9c196e96-77f3-5a6e-b91e-206a8974e716_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252Fb9%252F24b9db59477d45a42a78009fedb34d11%252Fpa%252FBR27248_147abbd275ab932b7b09e058e24f8072.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/b9/24b9db59477d45a42a78009fedb34d11/pa/BR27248_147abbd275ab932b7b09e058e24f8072.jpg saved to cache
2026-01-28 20:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9c196e96-77f3-5a6e-b91e-206a8974e716
2026-01-28 20:06:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08a6fe50>
2026-01-28 20:06:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:06:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee3ac5f9-9152-59da-af19-c47b4d060d12/ee3ac5f9-9152-59da-af19-c47b4d060d12_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F61%252Fb36138c76a8594fe8816492c484a6fce%252Fpa%252FRG29856_504609e8d1e685369aeadfd8723c9013.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/61/b36138c76a8594fe8816492c484a6fce/pa/RG29856_504609e8d1e685369aeadfd8723c9013.jpg saved to cache
2026-01-28 20:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ee3ac5f9-9152-59da-af19-c47b4d060d12
2026-01-28 20:06:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09e62950>
2026-01-28 20:06:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c196e96-77f3-5a6e-b91e-206a8974e716/9c196e96-77f3-5a6e-b91e-206a8974e716_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252Fb9%252F24b9db59477d45a42a78009fedb34d11%252Fpa%252FBR27248_80c48f2a493c856f294757e4d9e927d8.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/b9/24b9db59477d45a42a78009fedb34d11/pa/BR27248_80c48f2a493c856f294757e4d9e927d8.jpg saved to cache
2026-01-28 20:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9c196e96-77f3-5a6e-b91e-206a8974e716
2026-01-28 20:06:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/1d/921dd65e297015a56aa4b31a920cf269/pa/BK51963_1e9cb7ffa9952dca70786358d382fb64.png> (referer: https://www.auto1.com/)
2026-01-28 20:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F92%252F56929b7f454d62f8f4d94e0a9f9b8377%252Fpa%252FRF65516_2cd550d4899c0f0007830c1f917cad5b.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/92/56929b7f454d62f8f4d94e0a9f9b8377/pa/RF65516_2cd550d4899c0f0007830c1f917cad5b.jpg not downloaded yet
2026-01-28 20:06:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/61/b36138c76a8594fe8816492c484a6fce/pa/RG29856_d046b4bbbc2dbcccf83a05c27efdfbb1.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fdd%252F19dd8b27ab1dd7da8b80d16ff4452f4f%252Fpa%252FZT06764_795870b53afa5db26a674f035a76eb6e.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/dd/19dd8b27ab1dd7da8b80d16ff4452f4f/pa/ZT06764_795870b53afa5db26a674f035a76eb6e.jpg not downloaded yet
2026-01-28 20:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F92%252F56929b7f454d62f8f4d94e0a9f9b8377%252Fpa%252FRF65516_54aa254bbc616e407832b62ef451292c.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/92/56929b7f454d62f8f4d94e0a9f9b8377/pa/RF65516_54aa254bbc616e407832b62ef451292c.jpg not downloaded yet
2026-01-28 20:06:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08b105d0>
2026-01-28 20:06:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:06:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f7eaeb0-1d12-5d24-ad31-49e0df716d68/8f7eaeb0-1d12-5d24-ad31-49e0df716d68_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fdd%252F19dd8b27ab1dd7da8b80d16ff4452f4f%252Fpa%252FZT06764_2ad9f4c118f39c79d29473f6fb00d1f9.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/dd/19dd8b27ab1dd7da8b80d16ff4452f4f/pa/ZT06764_2ad9f4c118f39c79d29473f6fb00d1f9.jpg saved to cache
2026-01-28 20:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8f7eaeb0-1d12-5d24-ad31-49e0df716d68
2026-01-28 20:06:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09e4a890>
2026-01-28 20:06:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:06:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c196e96-77f3-5a6e-b91e-206a8974e716/9c196e96-77f3-5a6e-b91e-206a8974e716_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252Fb9%252F24b9db59477d45a42a78009fedb34d11%252Fpa%252FBR27248_40606ab8f7d5ba1eff5e71c86691e26a.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/b9/24b9db59477d45a42a78009fedb34d11/pa/BR27248_40606ab8f7d5ba1eff5e71c86691e26a.jpg saved to cache
2026-01-28 20:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9c196e96-77f3-5a6e-b91e-206a8974e716
2026-01-28 20:06:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b089c7b50>
2026-01-28 20:06:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:06:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee3ac5f9-9152-59da-af19-c47b4d060d12/ee3ac5f9-9152-59da-af19-c47b4d060d12_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F61%252Fb36138c76a8594fe8816492c484a6fce%252Fpa%252FRG29856_ba9997ca9adad02f7bad23722931ab02.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/61/b36138c76a8594fe8816492c484a6fce/pa/RG29856_ba9997ca9adad02f7bad23722931ab02.jpg saved to cache
2026-01-28 20:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ee3ac5f9-9152-59da-af19-c47b4d060d12
2026-01-28 20:06:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 271e5dd3-ea97-5609-bdb2-76a4a7d5c839 with identifier: KG16431
2026-01-28 20:06:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 271e5dd3-ea97-5609-bdb2-76a4a7d5c839 with scrape type 1
2026-01-28 20:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 271e5dd3-ea97-5609-bdb2-76a4a7d5c839
2026-01-28 20:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Ff0%252F2ef001f8871f72802d3631eb7ec2cdc2%252Fpa%252FKG16431_1c40bd613be80fb1b4d73d4079a9e2a2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/f0/2ef001f8871f72802d3631eb7ec2cdc2/pa/KG16431_1c40bd613be80fb1b4d73d4079a9e2a2.jpg not downloaded yet
2026-01-28 20:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fdd%252F19dd8b27ab1dd7da8b80d16ff4452f4f%252Fpa%252FZT06764_8cdb6549d2e7f4d802845e7275369ee7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/dd/19dd8b27ab1dd7da8b80d16ff4452f4f/pa/ZT06764_8cdb6549d2e7f4d802845e7275369ee7.jpg not downloaded yet
2026-01-28 20:06:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img24/b9/24b9db59477d45a42a78009fedb34d11/pa/BR27248_d65a8e22d1d4d2a21554a0b2653e4e10.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:06:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/92/56929b7f454d62f8f4d94e0a9f9b8377/pa/RF65516_206dcf9c21a0e493948a69f54ad8f47d.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F92%252F56929b7f454d62f8f4d94e0a9f9b8377%252Fpa%252FRF65516_e8ba7ea1c8000da929e57956d6db8e4e.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/92/56929b7f454d62f8f4d94e0a9f9b8377/pa/RF65516_e8ba7ea1c8000da929e57956d6db8e4e.jpg not downloaded yet
2026-01-28 20:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Ff0%252F2ef001f8871f72802d3631eb7ec2cdc2%252Fpa%252FKG16431_09504b433b3b30fe99341e48407d4ff6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/f0/2ef001f8871f72802d3631eb7ec2cdc2/pa/KG16431_09504b433b3b30fe99341e48407d4ff6.jpg not downloaded yet
2026-01-28 20:06:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/92/56929b7f454d62f8f4d94e0a9f9b8377/pa/RF65516_85441ea6a3d44a075e8f653d6acb4242.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:06:31 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-01-28 20:06:31 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 41 9
2026-01-28 20:06:31 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 62 8192
2026-01-28 20:06:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b086faf50>
2026-01-28 20:06:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:06:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d6c42ae-e85f-51b5-8ddf-53f6e4f44ee5/5d6c42ae-e85f-51b5-8ddf-53f6e4f44ee5_image_11.png HTTP/1.1" 201 0
2026-01-28 20:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F1d%252F921dd65e297015a56aa4b31a920cf269%252Fpa%252FBK51963_1e9cb7ffa9952dca70786358d382fb64.png') HTTP/1.1" 204 0
2026-01-28 20:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/1d/921dd65e297015a56aa4b31a920cf269/pa/BK51963_1e9cb7ffa9952dca70786358d382fb64.png saved to cache
2026-01-28 20:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 5d6c42ae-e85f-51b5-8ddf-53f6e4f44ee5
2026-01-28 20:06:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09e2b1d0>
2026-01-28 20:06:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee3ac5f9-9152-59da-af19-c47b4d060d12/ee3ac5f9-9152-59da-af19-c47b4d060d12_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F61%252Fb36138c76a8594fe8816492c484a6fce%252Fpa%252FRG29856_d046b4bbbc2dbcccf83a05c27efdfbb1.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/61/b36138c76a8594fe8816492c484a6fce/pa/RG29856_d046b4bbbc2dbcccf83a05c27efdfbb1.jpg saved to cache
2026-01-28 20:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ee3ac5f9-9152-59da-af19-c47b4d060d12
2026-01-28 20:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F92%252F56929b7f454d62f8f4d94e0a9f9b8377%252Fpa%252FRF65516_f1bf33a5a0cdc3fa0408d675c8751ce7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/92/56929b7f454d62f8f4d94e0a9f9b8377/pa/RF65516_f1bf33a5a0cdc3fa0408d675c8751ce7.jpg not downloaded yet
2026-01-28 20:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Ff0%252F2ef001f8871f72802d3631eb7ec2cdc2%252Fpa%252FKG16431_6607044ae537682c8283a1f8fdb12e83.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/f0/2ef001f8871f72802d3631eb7ec2cdc2/pa/KG16431_6607044ae537682c8283a1f8fdb12e83.jpg not downloaded yet
2026-01-28 20:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F92%252F56929b7f454d62f8f4d94e0a9f9b8377%252Fpa%252FRF65516_49dfca43f59302c7cc5bdecbd9337ae0.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/92/56929b7f454d62f8f4d94e0a9f9b8377/pa/RF65516_49dfca43f59302c7cc5bdecbd9337ae0.jpg not downloaded yet
2026-01-28 20:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Ff0%252F2ef001f8871f72802d3631eb7ec2cdc2%252Fpa%252FKG16431_df853d4c05ba7ecb584ada7882934cbd.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/f0/2ef001f8871f72802d3631eb7ec2cdc2/pa/KG16431_df853d4c05ba7ecb584ada7882934cbd.jpg not downloaded yet
2026-01-28 20:06:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08a804d0>
2026-01-28 20:06:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:06:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c196e96-77f3-5a6e-b91e-206a8974e716/9c196e96-77f3-5a6e-b91e-206a8974e716_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252Fb9%252F24b9db59477d45a42a78009fedb34d11%252Fpa%252FBR27248_d65a8e22d1d4d2a21554a0b2653e4e10.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/b9/24b9db59477d45a42a78009fedb34d11/pa/BR27248_d65a8e22d1d4d2a21554a0b2653e4e10.jpg saved to cache
2026-01-28 20:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 9c196e96-77f3-5a6e-b91e-206a8974e716
2026-01-28 20:06:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08bddcd0>
2026-01-28 20:06:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:06:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69f99255-496b-5647-820a-1dfb2356caad/69f99255-496b-5647-820a-1dfb2356caad_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F92%252F56929b7f454d62f8f4d94e0a9f9b8377%252Fpa%252FRF65516_206dcf9c21a0e493948a69f54ad8f47d.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/92/56929b7f454d62f8f4d94e0a9f9b8377/pa/RF65516_206dcf9c21a0e493948a69f54ad8f47d.jpg saved to cache
2026-01-28 20:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 69f99255-496b-5647-820a-1dfb2356caad
2026-01-28 20:06:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08a893d0>
2026-01-28 20:06:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69f99255-496b-5647-820a-1dfb2356caad/69f99255-496b-5647-820a-1dfb2356caad_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F92%252F56929b7f454d62f8f4d94e0a9f9b8377%252Fpa%252FRF65516_85441ea6a3d44a075e8f653d6acb4242.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/92/56929b7f454d62f8f4d94e0a9f9b8377/pa/RF65516_85441ea6a3d44a075e8f653d6acb4242.jpg saved to cache
2026-01-28 20:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 69f99255-496b-5647-820a-1dfb2356caad
2026-01-28 20:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/61/b36138c76a8594fe8816492c484a6fce/pa/RG29856_5c019a933231ab5e9c11ece967b403cd.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/92/56929b7f454d62f8f4d94e0a9f9b8377/pa/RF65516_05a67fb18360c09e3bd7a5f311d7ccd6.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F92%252F56929b7f454d62f8f4d94e0a9f9b8377%252Fpa%252FRF65516_b3d0f855309a298259026ac91372378e.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/92/56929b7f454d62f8f4d94e0a9f9b8377/pa/RF65516_b3d0f855309a298259026ac91372378e.jpg not downloaded yet
2026-01-28 20:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Ff0%252F2ef001f8871f72802d3631eb7ec2cdc2%252Fpa%252FKG16431_244b4c59b3a71a9640ab7c365c8d9929.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/f0/2ef001f8871f72802d3631eb7ec2cdc2/pa/KG16431_244b4c59b3a71a9640ab7c365c8d9929.jpg not downloaded yet
2026-01-28 20:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F92%252F56929b7f454d62f8f4d94e0a9f9b8377%252Fpa%252FRF65516_188f58604ef079d83597f632d8ab9c5c.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/92/56929b7f454d62f8f4d94e0a9f9b8377/pa/RF65516_188f58604ef079d83597f632d8ab9c5c.jpg not downloaded yet
2026-01-28 20:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Ff0%252F2ef001f8871f72802d3631eb7ec2cdc2%252Fpa%252FKG16431_a49334ba66dccc9a544e60d8ece0ec78.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/f0/2ef001f8871f72802d3631eb7ec2cdc2/pa/KG16431_a49334ba66dccc9a544e60d8ece0ec78.jpg not downloaded yet
2026-01-28 20:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F92%252F56929b7f454d62f8f4d94e0a9f9b8377%252Fpa%252FRF65516_15d8c5802fed878d735199a32ec66309.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/92/56929b7f454d62f8f4d94e0a9f9b8377/pa/RF65516_15d8c5802fed878d735199a32ec66309.jpg not downloaded yet
2026-01-28 20:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Ff0%252F2ef001f8871f72802d3631eb7ec2cdc2%252Fpa%252FKG16431_cc4884d864ffa64e012f048bb02336ba.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/f0/2ef001f8871f72802d3631eb7ec2cdc2/pa/KG16431_cc4884d864ffa64e012f048bb02336ba.jpg not downloaded yet
2026-01-28 20:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img24/b9/24b9db59477d45a42a78009fedb34d11/pa/BR27248_afc53202946845a364ba6a0f2c89ca83.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F92%252F56929b7f454d62f8f4d94e0a9f9b8377%252Fpa%252FRF65516_9e157b0dd8423ab60ba403f4630165f3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/92/56929b7f454d62f8f4d94e0a9f9b8377/pa/RF65516_9e157b0dd8423ab60ba403f4630165f3.jpg not downloaded yet
2026-01-28 20:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Ff0%252F2ef001f8871f72802d3631eb7ec2cdc2%252Fpa%252FKG16431_22cfc7333728659513e3aeaf2663fbde.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/f0/2ef001f8871f72802d3631eb7ec2cdc2/pa/KG16431_22cfc7333728659513e3aeaf2663fbde.jpg not downloaded yet
2026-01-28 20:06:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08ca0310>
2026-01-28 20:06:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:06:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee3ac5f9-9152-59da-af19-c47b4d060d12/ee3ac5f9-9152-59da-af19-c47b4d060d12_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F61%252Fb36138c76a8594fe8816492c484a6fce%252Fpa%252FRG29856_5c019a933231ab5e9c11ece967b403cd.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/61/b36138c76a8594fe8816492c484a6fce/pa/RG29856_5c019a933231ab5e9c11ece967b403cd.jpg saved to cache
2026-01-28 20:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item ee3ac5f9-9152-59da-af19-c47b4d060d12
2026-01-28 20:06:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b086e4bd0>
2026-01-28 20:06:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:06:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69f99255-496b-5647-820a-1dfb2356caad/69f99255-496b-5647-820a-1dfb2356caad_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F92%252F56929b7f454d62f8f4d94e0a9f9b8377%252Fpa%252FRF65516_05a67fb18360c09e3bd7a5f311d7ccd6.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/92/56929b7f454d62f8f4d94e0a9f9b8377/pa/RF65516_05a67fb18360c09e3bd7a5f311d7ccd6.jpg saved to cache
2026-01-28 20:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 69f99255-496b-5647-820a-1dfb2356caad
2026-01-28 20:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Ff0%252F2ef001f8871f72802d3631eb7ec2cdc2%252Fpa%252FKG16431_acaec65ab9355cdaa4759efb5c5484f8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/f0/2ef001f8871f72802d3631eb7ec2cdc2/pa/KG16431_acaec65ab9355cdaa4759efb5c5484f8.jpg not downloaded yet
2026-01-28 20:06:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/92/56929b7f454d62f8f4d94e0a9f9b8377/pa/RF65516_a385c3aa28f4a02131d1b58a1865ec39.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:06:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0c000650>
2026-01-28 20:06:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:06:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c196e96-77f3-5a6e-b91e-206a8974e716/9c196e96-77f3-5a6e-b91e-206a8974e716_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252Fb9%252F24b9db59477d45a42a78009fedb34d11%252Fpa%252FBR27248_afc53202946845a364ba6a0f2c89ca83.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/b9/24b9db59477d45a42a78009fedb34d11/pa/BR27248_afc53202946845a364ba6a0f2c89ca83.jpg saved to cache
2026-01-28 20:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 9c196e96-77f3-5a6e-b91e-206a8974e716
2026-01-28 20:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Ff0%252F2ef001f8871f72802d3631eb7ec2cdc2%252Fpa%252FKG16431_071fadd11f01a729aee212a91e3ad0d4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/f0/2ef001f8871f72802d3631eb7ec2cdc2/pa/KG16431_071fadd11f01a729aee212a91e3ad0d4.jpg not downloaded yet
2026-01-28 20:06:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/92/56929b7f454d62f8f4d94e0a9f9b8377/pa/RF65516_70af025c2ae57eb76167b0188b22ab4a.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Ff0%252F2ef001f8871f72802d3631eb7ec2cdc2%252Fpa%252FKG16431_a26dfd23193298ea9526d9bfc9657f14.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/f0/2ef001f8871f72802d3631eb7ec2cdc2/pa/KG16431_a26dfd23193298ea9526d9bfc9657f14.jpg not downloaded yet
2026-01-28 20:06:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b086c2a10>
2026-01-28 20:06:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:06:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69f99255-496b-5647-820a-1dfb2356caad/69f99255-496b-5647-820a-1dfb2356caad_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F92%252F56929b7f454d62f8f4d94e0a9f9b8377%252Fpa%252FRF65516_a385c3aa28f4a02131d1b58a1865ec39.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/92/56929b7f454d62f8f4d94e0a9f9b8377/pa/RF65516_a385c3aa28f4a02131d1b58a1865ec39.jpg saved to cache
2026-01-28 20:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 69f99255-496b-5647-820a-1dfb2356caad
2026-01-28 20:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/dd/19dd8b27ab1dd7da8b80d16ff4452f4f/pa/ZT06764_ee69a704cb3327ce26d3dc06f0819d2e.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img24/b9/24b9db59477d45a42a78009fedb34d11/pa/BR27248_ba8e81dcf4cba9b79ccdecf1d2eb16d1.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Ff0%252F2ef001f8871f72802d3631eb7ec2cdc2%252Fpa%252FKG16431_24e00658f0546922f2590af063c179b2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/f0/2ef001f8871f72802d3631eb7ec2cdc2/pa/KG16431_24e00658f0546922f2590af063c179b2.jpg not downloaded yet
2026-01-28 20:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Ff0%252F2ef001f8871f72802d3631eb7ec2cdc2%252Fpa%252FKG16431_e0ed6437e3f556f8bc1f8df463409562.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/f0/2ef001f8871f72802d3631eb7ec2cdc2/pa/KG16431_e0ed6437e3f556f8bc1f8df463409562.jpg not downloaded yet
2026-01-28 20:06:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0a07cf50>
2026-01-28 20:06:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:06:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69f99255-496b-5647-820a-1dfb2356caad/69f99255-496b-5647-820a-1dfb2356caad_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F92%252F56929b7f454d62f8f4d94e0a9f9b8377%252Fpa%252FRF65516_70af025c2ae57eb76167b0188b22ab4a.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/92/56929b7f454d62f8f4d94e0a9f9b8377/pa/RF65516_70af025c2ae57eb76167b0188b22ab4a.jpg saved to cache
2026-01-28 20:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 69f99255-496b-5647-820a-1dfb2356caad
2026-01-28 20:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/dd/19dd8b27ab1dd7da8b80d16ff4452f4f/pa/ZT06764_6649b776d8c47148b14e9bd9c3a593c7.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Ff0%252F2ef001f8871f72802d3631eb7ec2cdc2%252Fpa%252FKG16431_8bedc23b54c6a756fa205ca1f27d0610.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/f0/2ef001f8871f72802d3631eb7ec2cdc2/pa/KG16431_8bedc23b54c6a756fa205ca1f27d0610.jpg not downloaded yet
2026-01-28 20:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/f0/2ef001f8871f72802d3631eb7ec2cdc2/pa/KG16431_1c40bd613be80fb1b4d73d4079a9e2a2.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/dd/19dd8b27ab1dd7da8b80d16ff4452f4f/pa/ZT06764_8cdb6549d2e7f4d802845e7275369ee7.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/dd/19dd8b27ab1dd7da8b80d16ff4452f4f/pa/ZT06764_e0814907b56cf34c67f902307527be25.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Ff0%252F2ef001f8871f72802d3631eb7ec2cdc2%252Fpa%252FKG16431_fa1a719fa20c8a17e58099616e0a641d.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/f0/2ef001f8871f72802d3631eb7ec2cdc2/pa/KG16431_fa1a719fa20c8a17e58099616e0a641d.jpg not downloaded yet
2026-01-28 20:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/dd/19dd8b27ab1dd7da8b80d16ff4452f4f/pa/ZT06764_a03cc9b8b9170a24408116a4ea2be03e.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:06:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:06:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0873a850>
2026-01-28 20:06:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:06:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f7eaeb0-1d12-5d24-ad31-49e0df716d68/8f7eaeb0-1d12-5d24-ad31-49e0df716d68_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fdd%252F19dd8b27ab1dd7da8b80d16ff4452f4f%252Fpa%252FZT06764_ee69a704cb3327ce26d3dc06f0819d2e.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/dd/19dd8b27ab1dd7da8b80d16ff4452f4f/pa/ZT06764_ee69a704cb3327ce26d3dc06f0819d2e.jpg saved to cache
2026-01-28 20:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8f7eaeb0-1d12-5d24-ad31-49e0df716d68
2026-01-28 20:06:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09e48f50>
2026-01-28 20:06:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c196e96-77f3-5a6e-b91e-206a8974e716/9c196e96-77f3-5a6e-b91e-206a8974e716_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252Fb9%252F24b9db59477d45a42a78009fedb34d11%252Fpa%252FBR27248_ba8e81dcf4cba9b79ccdecf1d2eb16d1.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/b9/24b9db59477d45a42a78009fedb34d11/pa/BR27248_ba8e81dcf4cba9b79ccdecf1d2eb16d1.jpg saved to cache
2026-01-28 20:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 9c196e96-77f3-5a6e-b91e-206a8974e716
2026-01-28 20:06:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/f0/2ef001f8871f72802d3631eb7ec2cdc2/pa/KG16431_df853d4c05ba7ecb584ada7882934cbd.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:06:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/92/56929b7f454d62f8f4d94e0a9f9b8377/pa/RF65516_54aa254bbc616e407832b62ef451292c.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:06:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08bdb1d0>
2026-01-28 20:06:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:06:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f7eaeb0-1d12-5d24-ad31-49e0df716d68/8f7eaeb0-1d12-5d24-ad31-49e0df716d68_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fdd%252F19dd8b27ab1dd7da8b80d16ff4452f4f%252Fpa%252FZT06764_6649b776d8c47148b14e9bd9c3a593c7.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/dd/19dd8b27ab1dd7da8b80d16ff4452f4f/pa/ZT06764_6649b776d8c47148b14e9bd9c3a593c7.jpg saved to cache
2026-01-28 20:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 8f7eaeb0-1d12-5d24-ad31-49e0df716d68
2026-01-28 20:06:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09eb4450>
2026-01-28 20:06:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_271e5dd3-ea97-5609-bdb2-76a4a7d5c839/271e5dd3-ea97-5609-bdb2-76a4a7d5c839_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Ff0%252F2ef001f8871f72802d3631eb7ec2cdc2%252Fpa%252FKG16431_1c40bd613be80fb1b4d73d4079a9e2a2.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/f0/2ef001f8871f72802d3631eb7ec2cdc2/pa/KG16431_1c40bd613be80fb1b4d73d4079a9e2a2.jpg saved to cache
2026-01-28 20:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 271e5dd3-ea97-5609-bdb2-76a4a7d5c839
2026-01-28 20:06:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08aa7d50>
2026-01-28 20:06:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f7eaeb0-1d12-5d24-ad31-49e0df716d68/8f7eaeb0-1d12-5d24-ad31-49e0df716d68_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fdd%252F19dd8b27ab1dd7da8b80d16ff4452f4f%252Fpa%252FZT06764_8cdb6549d2e7f4d802845e7275369ee7.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/dd/19dd8b27ab1dd7da8b80d16ff4452f4f/pa/ZT06764_8cdb6549d2e7f4d802845e7275369ee7.jpg saved to cache
2026-01-28 20:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 8f7eaeb0-1d12-5d24-ad31-49e0df716d68
2026-01-28 20:06:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:06:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b089fe810>
2026-01-28 20:06:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:06:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f7eaeb0-1d12-5d24-ad31-49e0df716d68/8f7eaeb0-1d12-5d24-ad31-49e0df716d68_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fdd%252F19dd8b27ab1dd7da8b80d16ff4452f4f%252Fpa%252FZT06764_e0814907b56cf34c67f902307527be25.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/dd/19dd8b27ab1dd7da8b80d16ff4452f4f/pa/ZT06764_e0814907b56cf34c67f902307527be25.jpg saved to cache
2026-01-28 20:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8f7eaeb0-1d12-5d24-ad31-49e0df716d68
2026-01-28 20:06:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:06:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09f29a10>
2026-01-28 20:06:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f7eaeb0-1d12-5d24-ad31-49e0df716d68/8f7eaeb0-1d12-5d24-ad31-49e0df716d68_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fdd%252F19dd8b27ab1dd7da8b80d16ff4452f4f%252Fpa%252FZT06764_a03cc9b8b9170a24408116a4ea2be03e.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/dd/19dd8b27ab1dd7da8b80d16ff4452f4f/pa/ZT06764_a03cc9b8b9170a24408116a4ea2be03e.jpg saved to cache
2026-01-28 20:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8f7eaeb0-1d12-5d24-ad31-49e0df716d68
2026-01-28 20:06:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/f0/2ef001f8871f72802d3631eb7ec2cdc2/pa/KG16431_071fadd11f01a729aee212a91e3ad0d4.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:06:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/f0/2ef001f8871f72802d3631eb7ec2cdc2/pa/KG16431_cc4884d864ffa64e012f048bb02336ba.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:06:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08b12e50>
2026-01-28 20:06:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_271e5dd3-ea97-5609-bdb2-76a4a7d5c839/271e5dd3-ea97-5609-bdb2-76a4a7d5c839_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Ff0%252F2ef001f8871f72802d3631eb7ec2cdc2%252Fpa%252FKG16431_df853d4c05ba7ecb584ada7882934cbd.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/f0/2ef001f8871f72802d3631eb7ec2cdc2/pa/KG16431_df853d4c05ba7ecb584ada7882934cbd.jpg saved to cache
2026-01-28 20:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 271e5dd3-ea97-5609-bdb2-76a4a7d5c839
2026-01-28 20:06:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08cb8c90>
2026-01-28 20:06:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:06:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69f99255-496b-5647-820a-1dfb2356caad/69f99255-496b-5647-820a-1dfb2356caad_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F92%252F56929b7f454d62f8f4d94e0a9f9b8377%252Fpa%252FRF65516_54aa254bbc616e407832b62ef451292c.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/92/56929b7f454d62f8f4d94e0a9f9b8377/pa/RF65516_54aa254bbc616e407832b62ef451292c.jpg saved to cache
2026-01-28 20:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 69f99255-496b-5647-820a-1dfb2356caad
2026-01-28 20:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/f0/2ef001f8871f72802d3631eb7ec2cdc2/pa/KG16431_22cfc7333728659513e3aeaf2663fbde.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/f0/2ef001f8871f72802d3631eb7ec2cdc2/pa/KG16431_a26dfd23193298ea9526d9bfc9657f14.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/f0/2ef001f8871f72802d3631eb7ec2cdc2/pa/KG16431_acaec65ab9355cdaa4759efb5c5484f8.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/dd/19dd8b27ab1dd7da8b80d16ff4452f4f/pa/ZT06764_a46641eca4774ccabd54d9cac40ca718.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/dd/19dd8b27ab1dd7da8b80d16ff4452f4f/pa/ZT06764_12a5cb0bcc8d59853fc8e0e4f812eca7.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:06:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09f49b90>
2026-01-28 20:06:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:06:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_271e5dd3-ea97-5609-bdb2-76a4a7d5c839/271e5dd3-ea97-5609-bdb2-76a4a7d5c839_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Ff0%252F2ef001f8871f72802d3631eb7ec2cdc2%252Fpa%252FKG16431_071fadd11f01a729aee212a91e3ad0d4.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/f0/2ef001f8871f72802d3631eb7ec2cdc2/pa/KG16431_071fadd11f01a729aee212a91e3ad0d4.jpg saved to cache
2026-01-28 20:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 271e5dd3-ea97-5609-bdb2-76a4a7d5c839
2026-01-28 20:06:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09e63010>
2026-01-28 20:06:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_271e5dd3-ea97-5609-bdb2-76a4a7d5c839/271e5dd3-ea97-5609-bdb2-76a4a7d5c839_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Ff0%252F2ef001f8871f72802d3631eb7ec2cdc2%252Fpa%252FKG16431_cc4884d864ffa64e012f048bb02336ba.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/f0/2ef001f8871f72802d3631eb7ec2cdc2/pa/KG16431_cc4884d864ffa64e012f048bb02336ba.jpg saved to cache
2026-01-28 20:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 271e5dd3-ea97-5609-bdb2-76a4a7d5c839
2026-01-28 20:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/f0/2ef001f8871f72802d3631eb7ec2cdc2/pa/KG16431_24e00658f0546922f2590af063c179b2.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/f0/2ef001f8871f72802d3631eb7ec2cdc2/pa/KG16431_e0ed6437e3f556f8bc1f8df463409562.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/92/56929b7f454d62f8f4d94e0a9f9b8377/pa/RF65516_9e157b0dd8423ab60ba403f4630165f3.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/f0/2ef001f8871f72802d3631eb7ec2cdc2/pa/KG16431_fa1a719fa20c8a17e58099616e0a641d.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:06:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08aa6050>
2026-01-28 20:06:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:06:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_271e5dd3-ea97-5609-bdb2-76a4a7d5c839/271e5dd3-ea97-5609-bdb2-76a4a7d5c839_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Ff0%252F2ef001f8871f72802d3631eb7ec2cdc2%252Fpa%252FKG16431_22cfc7333728659513e3aeaf2663fbde.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/f0/2ef001f8871f72802d3631eb7ec2cdc2/pa/KG16431_22cfc7333728659513e3aeaf2663fbde.jpg saved to cache
2026-01-28 20:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 271e5dd3-ea97-5609-bdb2-76a4a7d5c839
2026-01-28 20:06:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08733010>
2026-01-28 20:06:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_271e5dd3-ea97-5609-bdb2-76a4a7d5c839/271e5dd3-ea97-5609-bdb2-76a4a7d5c839_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Ff0%252F2ef001f8871f72802d3631eb7ec2cdc2%252Fpa%252FKG16431_a26dfd23193298ea9526d9bfc9657f14.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/f0/2ef001f8871f72802d3631eb7ec2cdc2/pa/KG16431_a26dfd23193298ea9526d9bfc9657f14.jpg saved to cache
2026-01-28 20:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 271e5dd3-ea97-5609-bdb2-76a4a7d5c839
2026-01-28 20:06:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09f36290>
2026-01-28 20:06:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:06:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_271e5dd3-ea97-5609-bdb2-76a4a7d5c839/271e5dd3-ea97-5609-bdb2-76a4a7d5c839_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Ff0%252F2ef001f8871f72802d3631eb7ec2cdc2%252Fpa%252FKG16431_acaec65ab9355cdaa4759efb5c5484f8.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/f0/2ef001f8871f72802d3631eb7ec2cdc2/pa/KG16431_acaec65ab9355cdaa4759efb5c5484f8.jpg saved to cache
2026-01-28 20:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 271e5dd3-ea97-5609-bdb2-76a4a7d5c839
2026-01-28 20:06:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:06:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08b66510>
2026-01-28 20:06:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:06:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f7eaeb0-1d12-5d24-ad31-49e0df716d68/8f7eaeb0-1d12-5d24-ad31-49e0df716d68_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fdd%252F19dd8b27ab1dd7da8b80d16ff4452f4f%252Fpa%252FZT06764_a46641eca4774ccabd54d9cac40ca718.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/dd/19dd8b27ab1dd7da8b80d16ff4452f4f/pa/ZT06764_a46641eca4774ccabd54d9cac40ca718.jpg saved to cache
2026-01-28 20:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8f7eaeb0-1d12-5d24-ad31-49e0df716d68
2026-01-28 20:06:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:06:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09eb45d0>
2026-01-28 20:06:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:06:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f7eaeb0-1d12-5d24-ad31-49e0df716d68/8f7eaeb0-1d12-5d24-ad31-49e0df716d68_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fdd%252F19dd8b27ab1dd7da8b80d16ff4452f4f%252Fpa%252FZT06764_12a5cb0bcc8d59853fc8e0e4f812eca7.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/dd/19dd8b27ab1dd7da8b80d16ff4452f4f/pa/ZT06764_12a5cb0bcc8d59853fc8e0e4f812eca7.jpg saved to cache
2026-01-28 20:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8f7eaeb0-1d12-5d24-ad31-49e0df716d68
2026-01-28 20:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/f0/2ef001f8871f72802d3631eb7ec2cdc2/pa/KG16431_8bedc23b54c6a756fa205ca1f27d0610.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/92/56929b7f454d62f8f4d94e0a9f9b8377/pa/RF65516_15d8c5802fed878d735199a32ec66309.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/92/56929b7f454d62f8f4d94e0a9f9b8377/pa/RF65516_188f58604ef079d83597f632d8ab9c5c.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:06:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09dc7b10>
2026-01-28 20:06:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_271e5dd3-ea97-5609-bdb2-76a4a7d5c839/271e5dd3-ea97-5609-bdb2-76a4a7d5c839_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Ff0%252F2ef001f8871f72802d3631eb7ec2cdc2%252Fpa%252FKG16431_24e00658f0546922f2590af063c179b2.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/f0/2ef001f8871f72802d3631eb7ec2cdc2/pa/KG16431_24e00658f0546922f2590af063c179b2.jpg saved to cache
2026-01-28 20:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 271e5dd3-ea97-5609-bdb2-76a4a7d5c839
2026-01-28 20:06:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08a8ad50>
2026-01-28 20:06:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:06:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_271e5dd3-ea97-5609-bdb2-76a4a7d5c839/271e5dd3-ea97-5609-bdb2-76a4a7d5c839_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Ff0%252F2ef001f8871f72802d3631eb7ec2cdc2%252Fpa%252FKG16431_e0ed6437e3f556f8bc1f8df463409562.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/f0/2ef001f8871f72802d3631eb7ec2cdc2/pa/KG16431_e0ed6437e3f556f8bc1f8df463409562.jpg saved to cache
2026-01-28 20:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 271e5dd3-ea97-5609-bdb2-76a4a7d5c839
2026-01-28 20:06:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08b8e710>
2026-01-28 20:06:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69f99255-496b-5647-820a-1dfb2356caad/69f99255-496b-5647-820a-1dfb2356caad_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F92%252F56929b7f454d62f8f4d94e0a9f9b8377%252Fpa%252FRF65516_9e157b0dd8423ab60ba403f4630165f3.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/92/56929b7f454d62f8f4d94e0a9f9b8377/pa/RF65516_9e157b0dd8423ab60ba403f4630165f3.jpg saved to cache
2026-01-28 20:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 69f99255-496b-5647-820a-1dfb2356caad
2026-01-28 20:06:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08a23310>
2026-01-28 20:06:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:06:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_271e5dd3-ea97-5609-bdb2-76a4a7d5c839/271e5dd3-ea97-5609-bdb2-76a4a7d5c839_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Ff0%252F2ef001f8871f72802d3631eb7ec2cdc2%252Fpa%252FKG16431_fa1a719fa20c8a17e58099616e0a641d.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/f0/2ef001f8871f72802d3631eb7ec2cdc2/pa/KG16431_fa1a719fa20c8a17e58099616e0a641d.jpg saved to cache
2026-01-28 20:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 271e5dd3-ea97-5609-bdb2-76a4a7d5c839
2026-01-28 20:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/dd/19dd8b27ab1dd7da8b80d16ff4452f4f/pa/ZT06764_8d4367f827dd5cca38ba31f3726b475c.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/92/56929b7f454d62f8f4d94e0a9f9b8377/pa/RF65516_b3d0f855309a298259026ac91372378e.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/f0/2ef001f8871f72802d3631eb7ec2cdc2/pa/KG16431_244b4c59b3a71a9640ab7c365c8d9929.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:06:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/f0/2ef001f8871f72802d3631eb7ec2cdc2/pa/KG16431_a49334ba66dccc9a544e60d8ece0ec78.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:06:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:06:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0a031110>
2026-01-28 20:06:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:06:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_271e5dd3-ea97-5609-bdb2-76a4a7d5c839/271e5dd3-ea97-5609-bdb2-76a4a7d5c839_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Ff0%252F2ef001f8871f72802d3631eb7ec2cdc2%252Fpa%252FKG16431_8bedc23b54c6a756fa205ca1f27d0610.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/f0/2ef001f8871f72802d3631eb7ec2cdc2/pa/KG16431_8bedc23b54c6a756fa205ca1f27d0610.jpg saved to cache
2026-01-28 20:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 271e5dd3-ea97-5609-bdb2-76a4a7d5c839
2026-01-28 20:06:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09ee3b90>
2026-01-28 20:06:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:06:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69f99255-496b-5647-820a-1dfb2356caad/69f99255-496b-5647-820a-1dfb2356caad_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F92%252F56929b7f454d62f8f4d94e0a9f9b8377%252Fpa%252FRF65516_15d8c5802fed878d735199a32ec66309.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/92/56929b7f454d62f8f4d94e0a9f9b8377/pa/RF65516_15d8c5802fed878d735199a32ec66309.jpg saved to cache
2026-01-28 20:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 69f99255-496b-5647-820a-1dfb2356caad
2026-01-28 20:06:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09f348d0>
2026-01-28 20:06:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:06:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69f99255-496b-5647-820a-1dfb2356caad/69f99255-496b-5647-820a-1dfb2356caad_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F92%252F56929b7f454d62f8f4d94e0a9f9b8377%252Fpa%252FRF65516_188f58604ef079d83597f632d8ab9c5c.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/92/56929b7f454d62f8f4d94e0a9f9b8377/pa/RF65516_188f58604ef079d83597f632d8ab9c5c.jpg saved to cache
2026-01-28 20:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 69f99255-496b-5647-820a-1dfb2356caad
2026-01-28 20:06:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/f0/2ef001f8871f72802d3631eb7ec2cdc2/pa/KG16431_6607044ae537682c8283a1f8fdb12e83.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:06:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/dd/19dd8b27ab1dd7da8b80d16ff4452f4f/pa/ZT06764_795870b53afa5db26a674f035a76eb6e.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:06:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/92/56929b7f454d62f8f4d94e0a9f9b8377/pa/RF65516_2cd550d4899c0f0007830c1f917cad5b.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:06:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/92/56929b7f454d62f8f4d94e0a9f9b8377/pa/RF65516_e8ba7ea1c8000da929e57956d6db8e4e.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:06:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:06:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08a75d90>
2026-01-28 20:06:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f7eaeb0-1d12-5d24-ad31-49e0df716d68/8f7eaeb0-1d12-5d24-ad31-49e0df716d68_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fdd%252F19dd8b27ab1dd7da8b80d16ff4452f4f%252Fpa%252FZT06764_8d4367f827dd5cca38ba31f3726b475c.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/dd/19dd8b27ab1dd7da8b80d16ff4452f4f/pa/ZT06764_8d4367f827dd5cca38ba31f3726b475c.jpg saved to cache
2026-01-28 20:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 8f7eaeb0-1d12-5d24-ad31-49e0df716d68
2026-01-28 20:06:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09ef8dd0>
2026-01-28 20:06:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:06:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69f99255-496b-5647-820a-1dfb2356caad/69f99255-496b-5647-820a-1dfb2356caad_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F92%252F56929b7f454d62f8f4d94e0a9f9b8377%252Fpa%252FRF65516_b3d0f855309a298259026ac91372378e.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/92/56929b7f454d62f8f4d94e0a9f9b8377/pa/RF65516_b3d0f855309a298259026ac91372378e.jpg saved to cache
2026-01-28 20:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 69f99255-496b-5647-820a-1dfb2356caad
2026-01-28 20:06:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08aac790>
2026-01-28 20:06:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:06:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_271e5dd3-ea97-5609-bdb2-76a4a7d5c839/271e5dd3-ea97-5609-bdb2-76a4a7d5c839_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Ff0%252F2ef001f8871f72802d3631eb7ec2cdc2%252Fpa%252FKG16431_244b4c59b3a71a9640ab7c365c8d9929.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/f0/2ef001f8871f72802d3631eb7ec2cdc2/pa/KG16431_244b4c59b3a71a9640ab7c365c8d9929.jpg saved to cache
2026-01-28 20:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 271e5dd3-ea97-5609-bdb2-76a4a7d5c839
2026-01-28 20:06:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09efae50>
2026-01-28 20:06:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_271e5dd3-ea97-5609-bdb2-76a4a7d5c839/271e5dd3-ea97-5609-bdb2-76a4a7d5c839_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Ff0%252F2ef001f8871f72802d3631eb7ec2cdc2%252Fpa%252FKG16431_a49334ba66dccc9a544e60d8ece0ec78.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/f0/2ef001f8871f72802d3631eb7ec2cdc2/pa/KG16431_a49334ba66dccc9a544e60d8ece0ec78.jpg saved to cache
2026-01-28 20:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 271e5dd3-ea97-5609-bdb2-76a4a7d5c839
2026-01-28 20:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/dd/19dd8b27ab1dd7da8b80d16ff4452f4f/pa/ZT06764_272b6a6b2d45d5836f3608dda437a2e5.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img24/b9/24b9db59477d45a42a78009fedb34d11/pa/BR27248_ffedcaabfb66dc883de2c7338e1e6ca2.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/61/b36138c76a8594fe8816492c484a6fce/pa/RG29856_5183793f31e84785190f827d3f285550.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/f0/2ef001f8871f72802d3631eb7ec2cdc2/pa/KG16431_09504b433b3b30fe99341e48407d4ff6.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:06:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0a029890>
2026-01-28 20:06:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:06:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_271e5dd3-ea97-5609-bdb2-76a4a7d5c839/271e5dd3-ea97-5609-bdb2-76a4a7d5c839_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Ff0%252F2ef001f8871f72802d3631eb7ec2cdc2%252Fpa%252FKG16431_6607044ae537682c8283a1f8fdb12e83.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/f0/2ef001f8871f72802d3631eb7ec2cdc2/pa/KG16431_6607044ae537682c8283a1f8fdb12e83.jpg saved to cache
2026-01-28 20:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 271e5dd3-ea97-5609-bdb2-76a4a7d5c839
2026-01-28 20:06:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08a6d5d0>
2026-01-28 20:06:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f7eaeb0-1d12-5d24-ad31-49e0df716d68/8f7eaeb0-1d12-5d24-ad31-49e0df716d68_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fdd%252F19dd8b27ab1dd7da8b80d16ff4452f4f%252Fpa%252FZT06764_795870b53afa5db26a674f035a76eb6e.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/dd/19dd8b27ab1dd7da8b80d16ff4452f4f/pa/ZT06764_795870b53afa5db26a674f035a76eb6e.jpg saved to cache
2026-01-28 20:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 8f7eaeb0-1d12-5d24-ad31-49e0df716d68
2026-01-28 20:06:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09f4a2d0>
2026-01-28 20:06:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:06:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69f99255-496b-5647-820a-1dfb2356caad/69f99255-496b-5647-820a-1dfb2356caad_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F92%252F56929b7f454d62f8f4d94e0a9f9b8377%252Fpa%252FRF65516_2cd550d4899c0f0007830c1f917cad5b.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/92/56929b7f454d62f8f4d94e0a9f9b8377/pa/RF65516_2cd550d4899c0f0007830c1f917cad5b.jpg saved to cache
2026-01-28 20:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 69f99255-496b-5647-820a-1dfb2356caad
2026-01-28 20:06:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08a67cd0>
2026-01-28 20:06:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:06:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69f99255-496b-5647-820a-1dfb2356caad/69f99255-496b-5647-820a-1dfb2356caad_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F92%252F56929b7f454d62f8f4d94e0a9f9b8377%252Fpa%252FRF65516_e8ba7ea1c8000da929e57956d6db8e4e.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/92/56929b7f454d62f8f4d94e0a9f9b8377/pa/RF65516_e8ba7ea1c8000da929e57956d6db8e4e.jpg saved to cache
2026-01-28 20:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 69f99255-496b-5647-820a-1dfb2356caad
2026-01-28 20:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img24/b9/24b9db59477d45a42a78009fedb34d11/pa/BR27248_aea8fd5c825a07be757baa88936722d2.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/61/b36138c76a8594fe8816492c484a6fce/pa/RG29856_82b520bf35873bd58c079279d2c0ac07.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img24/b9/24b9db59477d45a42a78009fedb34d11/pa/BR27248_486079d0302d7e0f65c128e96baca43e.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/92/56929b7f454d62f8f4d94e0a9f9b8377/pa/RF65516_2a6746ef8115bc062f8dfb7c6fe533ae.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:06:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0a07c990>
2026-01-28 20:06:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f7eaeb0-1d12-5d24-ad31-49e0df716d68/8f7eaeb0-1d12-5d24-ad31-49e0df716d68_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fdd%252F19dd8b27ab1dd7da8b80d16ff4452f4f%252Fpa%252FZT06764_272b6a6b2d45d5836f3608dda437a2e5.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/dd/19dd8b27ab1dd7da8b80d16ff4452f4f/pa/ZT06764_272b6a6b2d45d5836f3608dda437a2e5.jpg saved to cache
2026-01-28 20:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8f7eaeb0-1d12-5d24-ad31-49e0df716d68
2026-01-28 20:06:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08b8dc10>
2026-01-28 20:06:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:06:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c196e96-77f3-5a6e-b91e-206a8974e716/9c196e96-77f3-5a6e-b91e-206a8974e716_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252Fb9%252F24b9db59477d45a42a78009fedb34d11%252Fpa%252FBR27248_ffedcaabfb66dc883de2c7338e1e6ca2.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/b9/24b9db59477d45a42a78009fedb34d11/pa/BR27248_ffedcaabfb66dc883de2c7338e1e6ca2.jpg saved to cache
2026-01-28 20:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 9c196e96-77f3-5a6e-b91e-206a8974e716
2026-01-28 20:06:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08bda650>
2026-01-28 20:06:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:06:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee3ac5f9-9152-59da-af19-c47b4d060d12/ee3ac5f9-9152-59da-af19-c47b4d060d12_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F61%252Fb36138c76a8594fe8816492c484a6fce%252Fpa%252FRG29856_5183793f31e84785190f827d3f285550.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/61/b36138c76a8594fe8816492c484a6fce/pa/RG29856_5183793f31e84785190f827d3f285550.jpg saved to cache
2026-01-28 20:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item ee3ac5f9-9152-59da-af19-c47b4d060d12
2026-01-28 20:06:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08ca1f50>
2026-01-28 20:06:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:06:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_271e5dd3-ea97-5609-bdb2-76a4a7d5c839/271e5dd3-ea97-5609-bdb2-76a4a7d5c839_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Ff0%252F2ef001f8871f72802d3631eb7ec2cdc2%252Fpa%252FKG16431_09504b433b3b30fe99341e48407d4ff6.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/f0/2ef001f8871f72802d3631eb7ec2cdc2/pa/KG16431_09504b433b3b30fe99341e48407d4ff6.jpg saved to cache
2026-01-28 20:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 271e5dd3-ea97-5609-bdb2-76a4a7d5c839
2026-01-28 20:06:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 271e5dd3-ea97-5609-bdb2-76a4a7d5c839, skipping ID generation
2026-01-28 20:06:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 271e5dd3-ea97-5609-bdb2-76a4a7d5c839 with scrape type 1
2026-01-28 20:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 271e5dd3-ea97-5609-bdb2-76a4a7d5c839 from tracking dictionaries
2026-01-28 20:06:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 271e5dd3-ea97-5609-bdb2-76a4a7d5c839 sending to next pipeline
2026-01-28 20:06:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 271e5dd3-ea97-5609-bdb2-76a4a7d5c839, identifier: KG16431
2026-01-28 20:06:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/61/b36138c76a8594fe8816492c484a6fce/pa/RG29856_ed0f042081c45fcb132e8b0244ac039b.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:06:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/61/b36138c76a8594fe8816492c484a6fce/pa/RG29856_d00e5da9602e04774fc914357b76a546.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:06:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 271e5dd3-ea97-5609-bdb2-76a4a7d5c839 with identifier: KG16431
2026-01-28 20:06:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 271e5dd3-ea97-5609-bdb2-76a4a7d5c839 with identifier: KG16431
2026-01-28 20:06:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 271e5dd3-ea97-5609-bdb2-76a4a7d5c839 with identifier: KG16431 to the API
2026-01-28 20:06:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:06:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:06:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img2e/f0/2ef001f8871f72802d3631eb7ec2cdc2/pa/KG16431_09504b433b3b30fe99341e48407d4ff6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 156,
 'category': 'Rental',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '3.0L',
 'engine_horse_power': 285,
 'expiration_date': '2026-01-29T16:22:45Z',
 'fuel_type': 'diesel',
 'id': '271e5dd3-ea97-5609-bdb2-76a4a7d5c839',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KG16431',
 'listing': 'auction',
 'location': 'IT, Settimo Torinese',
 'make': 'Audi',
 'model': 'A8',
 'odometer': 75376,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_271e5dd3-ea97-5609-bdb2-76a4a7d5c839/271e5dd3-ea97-5609-bdb2-76a4a7d5c839_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42779,
             'Height': 533,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/f0/2ef001f8871f72802d3631eb7ec2cdc2/pa/KG16431_1c40bd613be80fb1b4d73d4079a9e2a2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_271e5dd3-ea97-5609-bdb2-76a4a7d5c839/271e5dd3-ea97-5609-bdb2-76a4a7d5c839_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 380873,
             'Height': 1365,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/f0/2ef001f8871f72802d3631eb7ec2cdc2/pa/KG16431_09504b433b3b30fe99341e48407d4ff6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_271e5dd3-ea97-5609-bdb2-76a4a7d5c839/271e5dd3-ea97-5609-bdb2-76a4a7d5c839_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 370592,
             'Height': 1365,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/f0/2ef001f8871f72802d3631eb7ec2cdc2/pa/KG16431_6607044ae537682c8283a1f8fdb12e83.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_271e5dd3-ea97-5609-bdb2-76a4a7d5c839/271e5dd3-ea97-5609-bdb2-76a4a7d5c839_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38827,
             'Height': 533,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/f0/2ef001f8871f72802d3631eb7ec2cdc2/pa/KG16431_df853d4c05ba7ecb584ada7882934cbd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_271e5dd3-ea97-5609-bdb2-76a4a7d5c839/271e5dd3-ea97-5609-bdb2-76a4a7d5c839_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33892,
             'Height': 533,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/f0/2ef001f8871f72802d3631eb7ec2cdc2/pa/KG16431_244b4c59b3a71a9640ab7c365c8d9929.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_271e5dd3-ea97-5609-bdb2-76a4a7d5c839/271e5dd3-ea97-5609-bdb2-76a4a7d5c839_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 368860,
             'Height': 1365,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/f0/2ef001f8871f72802d3631eb7ec2cdc2/pa/KG16431_a49334ba66dccc9a544e60d8ece0ec78.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_271e5dd3-ea97-5609-bdb2-76a4a7d5c839/271e5dd3-ea97-5609-bdb2-76a4a7d5c839_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 407453,
             'Height': 1365,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/f0/2ef001f8871f72802d3631eb7ec2cdc2/pa/KG16431_cc4884d864ffa64e012f048bb02336ba.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_271e5dd3-ea97-5609-bdb2-76a4a7d5c839/271e5dd3-ea97-5609-bdb2-76a4a7d5c839_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 373244,
             'Height': 1358,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/f0/2ef001f8871f72802d3631eb7ec2cdc2/pa/KG16431_22cfc7333728659513e3aeaf2663fbde.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_271e5dd3-ea97-5609-bdb2-76a4a7d5c839/271e5dd3-ea97-5609-bdb2-76a4a7d5c839_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37119,
             'Height': 533,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/f0/2ef001f8871f72802d3631eb7ec2cdc2/pa/KG16431_acaec65ab9355cdaa4759efb5c5484f8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_271e5dd3-ea97-5609-bdb2-76a4a7d5c839/271e5dd3-ea97-5609-bdb2-76a4a7d5c839_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41550,
             'Height': 533,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/f0/2ef001f8871f72802d3631eb7ec2cdc2/pa/KG16431_071fadd11f01a729aee212a91e3ad0d4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_271e5dd3-ea97-5609-bdb2-76a4a7d5c839/271e5dd3-ea97-5609-bdb2-76a4a7d5c839_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48463,
             'Height': 533,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/f0/2ef001f8871f72802d3631eb7ec2cdc2/pa/KG16431_a26dfd23193298ea9526d9bfc9657f14.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_271e5dd3-ea97-5609-bdb2-76a4a7d5c839/271e5dd3-ea97-5609-bdb2-76a4a7d5c839_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46379,
             'Height': 533,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/f0/2ef001f8871f72802d3631eb7ec2cdc2/pa/KG16431_24e00658f0546922f2590af063c179b2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_271e5dd3-ea97-5609-bdb2-76a4a7d5c839/271e5dd3-ea97-5609-bdb2-76a4a7d5c839_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45008,
             'Height': 533,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/f0/2ef001f8871f72802d3631eb7ec2cdc2/pa/KG16431_e0ed6437e3f556f8bc1f8df463409562.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_271e5dd3-ea97-5609-bdb2-76a4a7d5c839/271e5dd3-ea97-5609-bdb2-76a4a7d5c839_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32992,
             'Height': 533,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/f0/2ef001f8871f72802d3631eb7ec2cdc2/pa/KG16431_8bedc23b54c6a756fa205ca1f27d0610.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_271e5dd3-ea97-5609-bdb2-76a4a7d5c839/271e5dd3-ea97-5609-bdb2-76a4a7d5c839_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78203,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/f0/2ef001f8871f72802d3631eb7ec2cdc2/pa/KG16431_fa1a719fa20c8a17e58099616e0a641d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-04-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A8 3.0 TDI Mild-Hybrid 50 quattro',
 'transmission': 'automatic',
 'trim': '50 quattro',
 'year': 2019}
2026-01-28 20:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KG16431%27 HTTP/1.1" 200 None
2026-01-28 20:06:45 [auto1.it] INFO: Saving data for KG16431: {'created_time': 1769630805.97534, 'last_price_update_time': 1769630805.975349, 'auction_closing_time': 1769703765.0}
2026-01-28 20:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KG16431') HTTP/1.1" 204 0
2026-01-28 20:06:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/92/56929b7f454d62f8f4d94e0a9f9b8377/pa/RF65516_49dfca43f59302c7cc5bdecbd9337ae0.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:06:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img24/b9/24b9db59477d45a42a78009fedb34d11/pa/BR27248_f623e4bad77970a74d34535784365427.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:06:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/dd/19dd8b27ab1dd7da8b80d16ff4452f4f/pa/ZT06764_f71fc033ffa817e0858016d9dad4135a.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:06:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:06:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09d77010>
2026-01-28 20:06:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:06:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c196e96-77f3-5a6e-b91e-206a8974e716/9c196e96-77f3-5a6e-b91e-206a8974e716_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252Fb9%252F24b9db59477d45a42a78009fedb34d11%252Fpa%252FBR27248_aea8fd5c825a07be757baa88936722d2.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/b9/24b9db59477d45a42a78009fedb34d11/pa/BR27248_aea8fd5c825a07be757baa88936722d2.jpg saved to cache
2026-01-28 20:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9c196e96-77f3-5a6e-b91e-206a8974e716
2026-01-28 20:06:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09d46fd0>
2026-01-28 20:06:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee3ac5f9-9152-59da-af19-c47b4d060d12/ee3ac5f9-9152-59da-af19-c47b4d060d12_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F61%252Fb36138c76a8594fe8816492c484a6fce%252Fpa%252FRG29856_82b520bf35873bd58c079279d2c0ac07.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/61/b36138c76a8594fe8816492c484a6fce/pa/RG29856_82b520bf35873bd58c079279d2c0ac07.jpg saved to cache
2026-01-28 20:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item ee3ac5f9-9152-59da-af19-c47b4d060d12
2026-01-28 20:06:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09d434d0>
2026-01-28 20:06:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:06:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c196e96-77f3-5a6e-b91e-206a8974e716/9c196e96-77f3-5a6e-b91e-206a8974e716_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252Fb9%252F24b9db59477d45a42a78009fedb34d11%252Fpa%252FBR27248_486079d0302d7e0f65c128e96baca43e.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/b9/24b9db59477d45a42a78009fedb34d11/pa/BR27248_486079d0302d7e0f65c128e96baca43e.jpg saved to cache
2026-01-28 20:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9c196e96-77f3-5a6e-b91e-206a8974e716
2026-01-28 20:06:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08c5cb10>
2026-01-28 20:06:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69f99255-496b-5647-820a-1dfb2356caad/69f99255-496b-5647-820a-1dfb2356caad_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F92%252F56929b7f454d62f8f4d94e0a9f9b8377%252Fpa%252FRF65516_2a6746ef8115bc062f8dfb7c6fe533ae.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/92/56929b7f454d62f8f4d94e0a9f9b8377/pa/RF65516_2a6746ef8115bc062f8dfb7c6fe533ae.jpg saved to cache
2026-01-28 20:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 69f99255-496b-5647-820a-1dfb2356caad
2026-01-28 20:06:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b087162d0>
2026-01-28 20:06:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:06:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee3ac5f9-9152-59da-af19-c47b4d060d12/ee3ac5f9-9152-59da-af19-c47b4d060d12_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F61%252Fb36138c76a8594fe8816492c484a6fce%252Fpa%252FRG29856_ed0f042081c45fcb132e8b0244ac039b.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/61/b36138c76a8594fe8816492c484a6fce/pa/RG29856_ed0f042081c45fcb132e8b0244ac039b.jpg saved to cache
2026-01-28 20:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item ee3ac5f9-9152-59da-af19-c47b4d060d12
2026-01-28 20:06:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b086e88d0>
2026-01-28 20:06:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee3ac5f9-9152-59da-af19-c47b4d060d12/ee3ac5f9-9152-59da-af19-c47b4d060d12_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F61%252Fb36138c76a8594fe8816492c484a6fce%252Fpa%252FRG29856_d00e5da9602e04774fc914357b76a546.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/61/b36138c76a8594fe8816492c484a6fce/pa/RG29856_d00e5da9602e04774fc914357b76a546.jpg saved to cache
2026-01-28 20:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ee3ac5f9-9152-59da-af19-c47b4d060d12
2026-01-28 20:06:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/dd/19dd8b27ab1dd7da8b80d16ff4452f4f/pa/ZT06764_018738e97960b2631188ad41ea72f13e.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:06:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/64/5c64b519844049af7ad47b5a2f24f5bb/pa/VF71012_d9b0d703381540d26d369e9342e55541.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:06:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WV62374> (referer: https://www.auto1.com/v1/car-details-view/WV62374/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:06:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:06:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:06:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08c788d0>
2026-01-28 20:06:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:06:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69f99255-496b-5647-820a-1dfb2356caad/69f99255-496b-5647-820a-1dfb2356caad_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F92%252F56929b7f454d62f8f4d94e0a9f9b8377%252Fpa%252FRF65516_49dfca43f59302c7cc5bdecbd9337ae0.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/92/56929b7f454d62f8f4d94e0a9f9b8377/pa/RF65516_49dfca43f59302c7cc5bdecbd9337ae0.jpg saved to cache
2026-01-28 20:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 69f99255-496b-5647-820a-1dfb2356caad
2026-01-28 20:06:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0a031f10>
2026-01-28 20:06:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c196e96-77f3-5a6e-b91e-206a8974e716/9c196e96-77f3-5a6e-b91e-206a8974e716_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252Fb9%252F24b9db59477d45a42a78009fedb34d11%252Fpa%252FBR27248_f623e4bad77970a74d34535784365427.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/b9/24b9db59477d45a42a78009fedb34d11/pa/BR27248_f623e4bad77970a74d34535784365427.jpg saved to cache
2026-01-28 20:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9c196e96-77f3-5a6e-b91e-206a8974e716
2026-01-28 20:06:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9c196e96-77f3-5a6e-b91e-206a8974e716, skipping ID generation
2026-01-28 20:06:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c196e96-77f3-5a6e-b91e-206a8974e716 with scrape type 1
2026-01-28 20:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 9c196e96-77f3-5a6e-b91e-206a8974e716 from tracking dictionaries
2026-01-28 20:06:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9c196e96-77f3-5a6e-b91e-206a8974e716 sending to next pipeline
2026-01-28 20:06:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9c196e96-77f3-5a6e-b91e-206a8974e716, identifier: BR27248
2026-01-28 20:06:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0a0313d0>
2026-01-28 20:06:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f7eaeb0-1d12-5d24-ad31-49e0df716d68/8f7eaeb0-1d12-5d24-ad31-49e0df716d68_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fdd%252F19dd8b27ab1dd7da8b80d16ff4452f4f%252Fpa%252FZT06764_f71fc033ffa817e0858016d9dad4135a.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/dd/19dd8b27ab1dd7da8b80d16ff4452f4f/pa/ZT06764_f71fc033ffa817e0858016d9dad4135a.jpg saved to cache
2026-01-28 20:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8f7eaeb0-1d12-5d24-ad31-49e0df716d68
2026-01-28 20:06:48 [auto1.it] INFO: Parsing search results for channel: 24h
2026-01-28 20:06:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9c196e96-77f3-5a6e-b91e-206a8974e716 with identifier: BR27248
2026-01-28 20:06:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9c196e96-77f3-5a6e-b91e-206a8974e716 with identifier: BR27248
2026-01-28 20:06:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 9c196e96-77f3-5a6e-b91e-206a8974e716 with identifier: BR27248 to the API
2026-01-28 20:06:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:06:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:06:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img24/b9/24b9db59477d45a42a78009fedb34d11/pa/BR27248_f623e4bad77970a74d34535784365427.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 122,
 'expiration_date': '2026-01-29T16:05:34Z',
 'fuel_type': 'diesel',
 'id': '9c196e96-77f3-5a6e-b91e-206a8974e716',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BR27248',
 'listing': 'auction',
 'location': 'IT',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 144744,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c196e96-77f3-5a6e-b91e-206a8974e716/9c196e96-77f3-5a6e-b91e-206a8974e716_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68147,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img24/b9/24b9db59477d45a42a78009fedb34d11/pa/BR27248_009e8a8980468e6dc0d201de85512eeb.jpg',
             'Width': 637},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c196e96-77f3-5a6e-b91e-206a8974e716/9c196e96-77f3-5a6e-b91e-206a8974e716_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39780,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img24/b9/24b9db59477d45a42a78009fedb34d11/pa/BR27248_1ee5e6ce6d5dd4ac2e3c2cda16c324a2.jpg',
             'Width': 637},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c196e96-77f3-5a6e-b91e-206a8974e716/9c196e96-77f3-5a6e-b91e-206a8974e716_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59360,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img24/b9/24b9db59477d45a42a78009fedb34d11/pa/BR27248_40606ab8f7d5ba1eff5e71c86691e26a.jpg',
             'Width': 637},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c196e96-77f3-5a6e-b91e-206a8974e716/9c196e96-77f3-5a6e-b91e-206a8974e716_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36086,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img24/b9/24b9db59477d45a42a78009fedb34d11/pa/BR27248_9fdc021654b5a9cefb20c9677a442063.jpg',
             'Width': 637},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c196e96-77f3-5a6e-b91e-206a8974e716/9c196e96-77f3-5a6e-b91e-206a8974e716_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36458,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img24/b9/24b9db59477d45a42a78009fedb34d11/pa/BR27248_80c48f2a493c856f294757e4d9e927d8.jpg',
             'Width': 637},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c196e96-77f3-5a6e-b91e-206a8974e716/9c196e96-77f3-5a6e-b91e-206a8974e716_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37708,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img24/b9/24b9db59477d45a42a78009fedb34d11/pa/BR27248_c306249e11b2b7ff9fd562ae3a5f9d28.jpg',
             'Width': 637},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c196e96-77f3-5a6e-b91e-206a8974e716/9c196e96-77f3-5a6e-b91e-206a8974e716_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35191,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img24/b9/24b9db59477d45a42a78009fedb34d11/pa/BR27248_147abbd275ab932b7b09e058e24f8072.jpg',
             'Width': 637},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c196e96-77f3-5a6e-b91e-206a8974e716/9c196e96-77f3-5a6e-b91e-206a8974e716_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59734,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img24/b9/24b9db59477d45a42a78009fedb34d11/pa/BR27248_f623e4bad77970a74d34535784365427.jpg',
             'Width': 637},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c196e96-77f3-5a6e-b91e-206a8974e716/9c196e96-77f3-5a6e-b91e-206a8974e716_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30317,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img24/b9/24b9db59477d45a42a78009fedb34d11/pa/BR27248_aea8fd5c825a07be757baa88936722d2.jpg',
             'Width': 637},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c196e96-77f3-5a6e-b91e-206a8974e716/9c196e96-77f3-5a6e-b91e-206a8974e716_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37977,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img24/b9/24b9db59477d45a42a78009fedb34d11/pa/BR27248_486079d0302d7e0f65c128e96baca43e.jpg',
             'Width': 637},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c196e96-77f3-5a6e-b91e-206a8974e716/9c196e96-77f3-5a6e-b91e-206a8974e716_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32995,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img24/b9/24b9db59477d45a42a78009fedb34d11/pa/BR27248_d65a8e22d1d4d2a21554a0b2653e4e10.jpg',
             'Width': 637},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c196e96-77f3-5a6e-b91e-206a8974e716/9c196e96-77f3-5a6e-b91e-206a8974e716_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31230,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img24/b9/24b9db59477d45a42a78009fedb34d11/pa/BR27248_ffedcaabfb66dc883de2c7338e1e6ca2.jpg',
             'Width': 637},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c196e96-77f3-5a6e-b91e-206a8974e716/9c196e96-77f3-5a6e-b91e-206a8974e716_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46704,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img24/b9/24b9db59477d45a42a78009fedb34d11/pa/BR27248_afc53202946845a364ba6a0f2c89ca83.jpg',
             'Width': 637},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c196e96-77f3-5a6e-b91e-206a8974e716/9c196e96-77f3-5a6e-b91e-206a8974e716_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 27768,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img24/b9/24b9db59477d45a42a78009fedb34d11/pa/BR27248_ba8e81dcf4cba9b79ccdecf1d2eb16d1.jpg',
             'Width': 637}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-11-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2022}
2026-01-28 20:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BR27248%27 HTTP/1.1" 200 None
2026-01-28 20:06:49 [auto1.it] INFO: Saving data for BR27248: {'created_time': 1769630809.496145, 'last_price_update_time': 1769630809.496156, 'auction_closing_time': 1769702734.0}
2026-01-28 20:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BR27248') HTTP/1.1" 204 0
2026-01-28 20:06:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/61/b36138c76a8594fe8816492c484a6fce/pa/RG29856_f25cc9bf97f5a2277fb96218c06c9f5b.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:06:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:06:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08a86ed0>
2026-01-28 20:06:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:06:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f7eaeb0-1d12-5d24-ad31-49e0df716d68/8f7eaeb0-1d12-5d24-ad31-49e0df716d68_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fdd%252F19dd8b27ab1dd7da8b80d16ff4452f4f%252Fpa%252FZT06764_018738e97960b2631188ad41ea72f13e.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/dd/19dd8b27ab1dd7da8b80d16ff4452f4f/pa/ZT06764_018738e97960b2631188ad41ea72f13e.jpg saved to cache
2026-01-28 20:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8f7eaeb0-1d12-5d24-ad31-49e0df716d68
2026-01-28 20:06:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08c7b290>
2026-01-28 20:06:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:06:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e027ca3-67e9-570c-acd5-c068e23d5fd7/1e027ca3-67e9-570c-acd5-c068e23d5fd7_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F64%252F5c64b519844049af7ad47b5a2f24f5bb%252Fpa%252FVF71012_d9b0d703381540d26d369e9342e55541.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/64/5c64b519844049af7ad47b5a2f24f5bb/pa/VF71012_d9b0d703381540d26d369e9342e55541.jpg saved to cache
2026-01-28 20:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 1e027ca3-67e9-570c-acd5-c068e23d5fd7
2026-01-28 20:06:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 002e2457-01af-5a37-a503-602624ebc00e with identifier: WV62374
2026-01-28 20:06:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 002e2457-01af-5a37-a503-602624ebc00e with scrape type 2
2026-01-28 20:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 002e2457-01af-5a37-a503-602624ebc00e with scrape type 2
2026-01-28 20:06:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 002e2457-01af-5a37-a503-602624ebc00e, identifier: WV62374
2026-01-28 20:06:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 002e2457-01af-5a37-a503-602624ebc00e with identifier: WV62374
2026-01-28 20:06:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 002e2457-01af-5a37-a503-602624ebc00e with identifier: WV62374
2026-01-28 20:06:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 002e2457-01af-5a37-a503-602624ebc00e with identifier: WV62374 to the API
2026-01-28 20:06:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:06:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:06:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WV62374>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.5L',
 'engine_horse_power': 120,
 'expiration_date': '2026-01-29T16:01:56Z',
 'fuel_type': 'diesel',
 'id': '002e2457-01af-5a37-a503-602624ebc00e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WV62374',
 'listing': 'auction',
 'location': 'IT, Milano',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 93033,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-10-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Focus 1.5 EcoBlue TDCi ST-Line',
 'transmission': 'automatic',
 'trim': 'ST-Line',
 'year': 2020}
2026-01-28 20:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WV62374%27 HTTP/1.1" 200 None
2026-01-28 20:06:50 [auto1.it] INFO: Saving data for WV62374: {'auction_closing_time': 1769702516.0, 'created_time': 1768334748.958081, 'last_price_update_time': 1769630810.605321}
2026-01-28 20:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WV62374') HTTP/1.1" 204 0
2026-01-28 20:06:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/1d/921dd65e297015a56aa4b31a920cf269/pa/BK51963_ed1f2b0db79e49025112fd59e85bb94f.png> (referer: https://www.auto1.com/)
2026-01-28 20:06:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0a0cc490>
2026-01-28 20:06:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:06:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee3ac5f9-9152-59da-af19-c47b4d060d12/ee3ac5f9-9152-59da-af19-c47b4d060d12_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F61%252Fb36138c76a8594fe8816492c484a6fce%252Fpa%252FRG29856_f25cc9bf97f5a2277fb96218c06c9f5b.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/61/b36138c76a8594fe8816492c484a6fce/pa/RG29856_f25cc9bf97f5a2277fb96218c06c9f5b.jpg saved to cache
2026-01-28 20:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ee3ac5f9-9152-59da-af19-c47b4d060d12
2026-01-28 20:06:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ee3ac5f9-9152-59da-af19-c47b4d060d12, skipping ID generation
2026-01-28 20:06:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee3ac5f9-9152-59da-af19-c47b4d060d12 with scrape type 1
2026-01-28 20:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Removing item ee3ac5f9-9152-59da-af19-c47b4d060d12 from tracking dictionaries
2026-01-28 20:06:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ee3ac5f9-9152-59da-af19-c47b4d060d12 sending to next pipeline
2026-01-28 20:06:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ee3ac5f9-9152-59da-af19-c47b4d060d12, identifier: RG29856
2026-01-28 20:06:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:06:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ee3ac5f9-9152-59da-af19-c47b4d060d12 with identifier: RG29856
2026-01-28 20:06:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ee3ac5f9-9152-59da-af19-c47b4d060d12 with identifier: RG29856
2026-01-28 20:06:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ee3ac5f9-9152-59da-af19-c47b4d060d12 with identifier: RG29856 to the API
2026-01-28 20:06:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:06:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:06:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb3/61/b36138c76a8594fe8816492c484a6fce/pa/RG29856_f25cc9bf97f5a2277fb96218c06c9f5b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 110,
 'expiration_date': '2026-01-29T16:28:14Z',
 'fuel_type': 'petrol',
 'id': 'ee3ac5f9-9152-59da-af19-c47b4d060d12',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RG29856',
 'listing': 'auction',
 'location': 'IT',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 47878,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee3ac5f9-9152-59da-af19-c47b4d060d12/ee3ac5f9-9152-59da-af19-c47b4d060d12_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76016,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/61/b36138c76a8594fe8816492c484a6fce/pa/RG29856_6bec7163f274983006733bf7837f37fb.jpg',
             'Width': 637},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee3ac5f9-9152-59da-af19-c47b4d060d12/ee3ac5f9-9152-59da-af19-c47b4d060d12_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44331,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/61/b36138c76a8594fe8816492c484a6fce/pa/RG29856_f25cc9bf97f5a2277fb96218c06c9f5b.jpg',
             'Width': 637},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee3ac5f9-9152-59da-af19-c47b4d060d12/ee3ac5f9-9152-59da-af19-c47b4d060d12_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77907,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/61/b36138c76a8594fe8816492c484a6fce/pa/RG29856_84dc34d39c69ffa4b7f7070363fb411a.jpg',
             'Width': 637},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee3ac5f9-9152-59da-af19-c47b4d060d12/ee3ac5f9-9152-59da-af19-c47b4d060d12_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76907,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/61/b36138c76a8594fe8816492c484a6fce/pa/RG29856_d85afce3b51de474ea48333d515830a7.jpg',
             'Width': 637},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee3ac5f9-9152-59da-af19-c47b4d060d12/ee3ac5f9-9152-59da-af19-c47b4d060d12_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39882,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/61/b36138c76a8594fe8816492c484a6fce/pa/RG29856_d046b4bbbc2dbcccf83a05c27efdfbb1.jpg',
             'Width': 637},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee3ac5f9-9152-59da-af19-c47b4d060d12/ee3ac5f9-9152-59da-af19-c47b4d060d12_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65850,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/61/b36138c76a8594fe8816492c484a6fce/pa/RG29856_1ba38b174147ff9e89dca3c8feee827b.jpg',
             'Width': 637},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee3ac5f9-9152-59da-af19-c47b4d060d12/ee3ac5f9-9152-59da-af19-c47b4d060d12_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65850,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/61/b36138c76a8594fe8816492c484a6fce/pa/RG29856_ba9997ca9adad02f7bad23722931ab02.jpg',
             'Width': 637},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee3ac5f9-9152-59da-af19-c47b4d060d12/ee3ac5f9-9152-59da-af19-c47b4d060d12_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65850,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/61/b36138c76a8594fe8816492c484a6fce/pa/RG29856_26581e1c70c2a8a8548dadd8e8241286.jpg',
             'Width': 637},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee3ac5f9-9152-59da-af19-c47b4d060d12/ee3ac5f9-9152-59da-af19-c47b4d060d12_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 20285,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/61/b36138c76a8594fe8816492c484a6fce/pa/RG29856_504609e8d1e685369aeadfd8723c9013.jpg',
             'Width': 637},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee3ac5f9-9152-59da-af19-c47b4d060d12/ee3ac5f9-9152-59da-af19-c47b4d060d12_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38500,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/61/b36138c76a8594fe8816492c484a6fce/pa/RG29856_d00e5da9602e04774fc914357b76a546.jpg',
             'Width': 637},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee3ac5f9-9152-59da-af19-c47b4d060d12/ee3ac5f9-9152-59da-af19-c47b4d060d12_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38270,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/61/b36138c76a8594fe8816492c484a6fce/pa/RG29856_ed0f042081c45fcb132e8b0244ac039b.jpg',
             'Width': 637},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee3ac5f9-9152-59da-af19-c47b4d060d12/ee3ac5f9-9152-59da-af19-c47b4d060d12_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 24174,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/61/b36138c76a8594fe8816492c484a6fce/pa/RG29856_82b520bf35873bd58c079279d2c0ac07.jpg',
             'Width': 637},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee3ac5f9-9152-59da-af19-c47b4d060d12/ee3ac5f9-9152-59da-af19-c47b4d060d12_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31350,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/61/b36138c76a8594fe8816492c484a6fce/pa/RG29856_5c019a933231ab5e9c11ece967b403cd.jpg',
             'Width': 637},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee3ac5f9-9152-59da-af19-c47b4d060d12/ee3ac5f9-9152-59da-af19-c47b4d060d12_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 28676,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/61/b36138c76a8594fe8816492c484a6fce/pa/RG29856_5183793f31e84785190f827d3f285550.jpg',
             'Width': 361}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-02-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.0 TSI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2023}
2026-01-28 20:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RG29856%27 HTTP/1.1" 200 None
2026-01-28 20:06:51 [auto1.it] INFO: Saving data for RG29856: {'created_time': 1769630811.64003, 'last_price_update_time': 1769630811.640039, 'auction_closing_time': 1769704094.0}
2026-01-28 20:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RG29856') HTTP/1.1" 204 0
2026-01-28 20:06:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/92/56929b7f454d62f8f4d94e0a9f9b8377/pa/RF65516_f1bf33a5a0cdc3fa0408d675c8751ce7.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:06:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:06:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ET31750> (referer: https://www.auto1.com/v1/car-details-view/ET31750/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:06:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/1d/921dd65e297015a56aa4b31a920cf269/pa/BK51963_10b0de790d2faa6337d8a277b0dd361d.png> (referer: https://www.auto1.com/)
2026-01-28 20:06:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/64/5c64b519844049af7ad47b5a2f24f5bb/pa/VF71012_20f884197ca0a3ebfd6428467c180690.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:06:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/1d/921dd65e297015a56aa4b31a920cf269/pa/BK51963_d6d3714e6d5d967ea00977cd17bd028d.png> (referer: https://www.auto1.com/)
2026-01-28 20:06:51 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-01-28 20:06:51 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 41 9
2026-01-28 20:06:51 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 62 8192
2026-01-28 20:06:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09d429d0>
2026-01-28 20:06:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:06:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d6c42ae-e85f-51b5-8ddf-53f6e4f44ee5/5d6c42ae-e85f-51b5-8ddf-53f6e4f44ee5_image_10.png HTTP/1.1" 201 0
2026-01-28 20:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F1d%252F921dd65e297015a56aa4b31a920cf269%252Fpa%252FBK51963_ed1f2b0db79e49025112fd59e85bb94f.png') HTTP/1.1" 204 0
2026-01-28 20:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/1d/921dd65e297015a56aa4b31a920cf269/pa/BK51963_ed1f2b0db79e49025112fd59e85bb94f.png saved to cache
2026-01-28 20:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 5d6c42ae-e85f-51b5-8ddf-53f6e4f44ee5
2026-01-28 20:06:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:06:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:06:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:06:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:06:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:06:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0899e510>
2026-01-28 20:06:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69f99255-496b-5647-820a-1dfb2356caad/69f99255-496b-5647-820a-1dfb2356caad_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F92%252F56929b7f454d62f8f4d94e0a9f9b8377%252Fpa%252FRF65516_f1bf33a5a0cdc3fa0408d675c8751ce7.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/92/56929b7f454d62f8f4d94e0a9f9b8377/pa/RF65516_f1bf33a5a0cdc3fa0408d675c8751ce7.jpg saved to cache
2026-01-28 20:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 69f99255-496b-5647-820a-1dfb2356caad
2026-01-28 20:06:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 69f99255-496b-5647-820a-1dfb2356caad, skipping ID generation
2026-01-28 20:06:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69f99255-496b-5647-820a-1dfb2356caad with scrape type 1
2026-01-28 20:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 69f99255-496b-5647-820a-1dfb2356caad from tracking dictionaries
2026-01-28 20:06:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 69f99255-496b-5647-820a-1dfb2356caad sending to next pipeline
2026-01-28 20:06:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 69f99255-496b-5647-820a-1dfb2356caad, identifier: RF65516
2026-01-28 20:06:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 49ddf902-be47-52eb-b115-f82cf22daf83 with identifier: ET31750
2026-01-28 20:06:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49ddf902-be47-52eb-b115-f82cf22daf83 with scrape type 2
2026-01-28 20:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 49ddf902-be47-52eb-b115-f82cf22daf83 with scrape type 2
2026-01-28 20:06:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 49ddf902-be47-52eb-b115-f82cf22daf83, identifier: ET31750
2026-01-28 20:06:52 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-01-28 20:06:52 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 41 9
2026-01-28 20:06:52 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 62 8192
2026-01-28 20:06:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09e31dd0>
2026-01-28 20:06:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:06:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d6c42ae-e85f-51b5-8ddf-53f6e4f44ee5/5d6c42ae-e85f-51b5-8ddf-53f6e4f44ee5_image_9.png HTTP/1.1" 201 0
2026-01-28 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F1d%252F921dd65e297015a56aa4b31a920cf269%252Fpa%252FBK51963_10b0de790d2faa6337d8a277b0dd361d.png') HTTP/1.1" 204 0
2026-01-28 20:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/1d/921dd65e297015a56aa4b31a920cf269/pa/BK51963_10b0de790d2faa6337d8a277b0dd361d.png saved to cache
2026-01-28 20:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5d6c42ae-e85f-51b5-8ddf-53f6e4f44ee5
2026-01-28 20:06:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08a83890>
2026-01-28 20:06:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:06:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e027ca3-67e9-570c-acd5-c068e23d5fd7/1e027ca3-67e9-570c-acd5-c068e23d5fd7_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F64%252F5c64b519844049af7ad47b5a2f24f5bb%252Fpa%252FVF71012_20f884197ca0a3ebfd6428467c180690.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/64/5c64b519844049af7ad47b5a2f24f5bb/pa/VF71012_20f884197ca0a3ebfd6428467c180690.jpg saved to cache
2026-01-28 20:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1e027ca3-67e9-570c-acd5-c068e23d5fd7
2026-01-28 20:06:53 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-01-28 20:06:53 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 41 9
2026-01-28 20:06:53 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 62 8192
2026-01-28 20:06:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09fc3c10>
2026-01-28 20:06:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:06:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d6c42ae-e85f-51b5-8ddf-53f6e4f44ee5/5d6c42ae-e85f-51b5-8ddf-53f6e4f44ee5_image_8.png HTTP/1.1" 201 0
2026-01-28 20:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F1d%252F921dd65e297015a56aa4b31a920cf269%252Fpa%252FBK51963_d6d3714e6d5d967ea00977cd17bd028d.png') HTTP/1.1" 204 0
2026-01-28 20:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/1d/921dd65e297015a56aa4b31a920cf269/pa/BK51963_d6d3714e6d5d967ea00977cd17bd028d.png saved to cache
2026-01-28 20:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5d6c42ae-e85f-51b5-8ddf-53f6e4f44ee5
2026-01-28 20:06:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 69f99255-496b-5647-820a-1dfb2356caad with identifier: RF65516
2026-01-28 20:06:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 69f99255-496b-5647-820a-1dfb2356caad with identifier: RF65516
2026-01-28 20:06:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 69f99255-496b-5647-820a-1dfb2356caad with identifier: RF65516 to the API
2026-01-28 20:06:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:06:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:06:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img56/92/56929b7f454d62f8f4d94e0a9f9b8377/pa/RF65516_f1bf33a5a0cdc3fa0408d675c8751ce7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.5L',
 'engine_horse_power': 116,
 'expiration_date': '2026-01-29T16:49:48Z',
 'fuel_type': 'diesel',
 'id': '69f99255-496b-5647-820a-1dfb2356caad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RF65516',
 'listing': 'auction',
 'location': 'Casagiove',
 'make': 'BMW',
 'model': '1er',
 'odometer': 46884,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69f99255-496b-5647-820a-1dfb2356caad/69f99255-496b-5647-820a-1dfb2356caad_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90057,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/92/56929b7f454d62f8f4d94e0a9f9b8377/pa/RF65516_206dcf9c21a0e493948a69f54ad8f47d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69f99255-496b-5647-820a-1dfb2356caad/69f99255-496b-5647-820a-1dfb2356caad_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89483,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/92/56929b7f454d62f8f4d94e0a9f9b8377/pa/RF65516_2a6746ef8115bc062f8dfb7c6fe533ae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69f99255-496b-5647-820a-1dfb2356caad/69f99255-496b-5647-820a-1dfb2356caad_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78989,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/92/56929b7f454d62f8f4d94e0a9f9b8377/pa/RF65516_85441ea6a3d44a075e8f653d6acb4242.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69f99255-496b-5647-820a-1dfb2356caad/69f99255-496b-5647-820a-1dfb2356caad_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52424,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/92/56929b7f454d62f8f4d94e0a9f9b8377/pa/RF65516_05a67fb18360c09e3bd7a5f311d7ccd6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69f99255-496b-5647-820a-1dfb2356caad/69f99255-496b-5647-820a-1dfb2356caad_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75545,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/92/56929b7f454d62f8f4d94e0a9f9b8377/pa/RF65516_a385c3aa28f4a02131d1b58a1865ec39.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69f99255-496b-5647-820a-1dfb2356caad/69f99255-496b-5647-820a-1dfb2356caad_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73498,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/92/56929b7f454d62f8f4d94e0a9f9b8377/pa/RF65516_70af025c2ae57eb76167b0188b22ab4a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69f99255-496b-5647-820a-1dfb2356caad/69f99255-496b-5647-820a-1dfb2356caad_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62006,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/92/56929b7f454d62f8f4d94e0a9f9b8377/pa/RF65516_2cd550d4899c0f0007830c1f917cad5b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69f99255-496b-5647-820a-1dfb2356caad/69f99255-496b-5647-820a-1dfb2356caad_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88237,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/92/56929b7f454d62f8f4d94e0a9f9b8377/pa/RF65516_54aa254bbc616e407832b62ef451292c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69f99255-496b-5647-820a-1dfb2356caad/69f99255-496b-5647-820a-1dfb2356caad_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82466,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/92/56929b7f454d62f8f4d94e0a9f9b8377/pa/RF65516_e8ba7ea1c8000da929e57956d6db8e4e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69f99255-496b-5647-820a-1dfb2356caad/69f99255-496b-5647-820a-1dfb2356caad_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2340322,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img56/92/56929b7f454d62f8f4d94e0a9f9b8377/pa/RF65516_f1bf33a5a0cdc3fa0408d675c8751ce7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69f99255-496b-5647-820a-1dfb2356caad/69f99255-496b-5647-820a-1dfb2356caad_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2555650,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img56/92/56929b7f454d62f8f4d94e0a9f9b8377/pa/RF65516_49dfca43f59302c7cc5bdecbd9337ae0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69f99255-496b-5647-820a-1dfb2356caad/69f99255-496b-5647-820a-1dfb2356caad_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55592,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/92/56929b7f454d62f8f4d94e0a9f9b8377/pa/RF65516_b3d0f855309a298259026ac91372378e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69f99255-496b-5647-820a-1dfb2356caad/69f99255-496b-5647-820a-1dfb2356caad_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72308,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/92/56929b7f454d62f8f4d94e0a9f9b8377/pa/RF65516_188f58604ef079d83597f632d8ab9c5c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69f99255-496b-5647-820a-1dfb2356caad/69f99255-496b-5647-820a-1dfb2356caad_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60076,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/92/56929b7f454d62f8f4d94e0a9f9b8377/pa/RF65516_15d8c5802fed878d735199a32ec66309.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69f99255-496b-5647-820a-1dfb2356caad/69f99255-496b-5647-820a-1dfb2356caad_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70125,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/92/56929b7f454d62f8f4d94e0a9f9b8377/pa/RF65516_9e157b0dd8423ab60ba403f4630165f3.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-02-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1er 116d M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2023}
2026-01-28 20:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RF65516%27 HTTP/1.1" 200 None
2026-01-28 20:06:53 [auto1.it] INFO: Saving data for RF65516: {'created_time': 1769630813.997218, 'last_price_update_time': 1769630813.997228, 'auction_closing_time': 1769705388.0}
2026-01-28 20:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RF65516') HTTP/1.1" 204 0
2026-01-28 20:06:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 49ddf902-be47-52eb-b115-f82cf22daf83 with identifier: ET31750
2026-01-28 20:06:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 49ddf902-be47-52eb-b115-f82cf22daf83 with identifier: ET31750
2026-01-28 20:06:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 49ddf902-be47-52eb-b115-f82cf22daf83 with identifier: ET31750 to the API
2026-01-28 20:06:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:06:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:06:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ET31750>
{'auction_title': '',
 'c_o_2_emission_value': 34,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2026-01-29T16:28:07Z',
 'fuel_type': 'petrol',
 'id': '49ddf902-be47-52eb-b115-f82cf22daf83',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ET31750',
 'listing': 'auction',
 'location': 'IT, Palermo',
 'make': 'Fiat',
 'model': '500',
 'odometer': 36556,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-05-08',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat 500 1.2 Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2019}
2026-01-28 20:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ET31750%27 HTTP/1.1" 200 None
2026-01-28 20:06:54 [auto1.it] INFO: Saving data for ET31750: {'auction_closing_time': 1769704087.0, 'created_time': 1769284953.293872, 'last_price_update_time': 1769630814.34585}
2026-01-28 20:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ET31750') HTTP/1.1" 204 0
2026-01-28 20:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/1d/921dd65e297015a56aa4b31a920cf269/pa/BK51963_47f2ef78863930615a3f88ef3d1169de.png> (referer: https://www.auto1.com/)
2026-01-28 20:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/64/5c64b519844049af7ad47b5a2f24f5bb/pa/VF71012_3e1972a652e266ab0318d058d536673e.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/64/5c64b519844049af7ad47b5a2f24f5bb/pa/VF71012_0100a8ceb69b6e1204ed01dd184d6b28.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NF45221/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PX44496> (referer: https://www.auto1.com/v1/car-details-view/PX44496/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:06:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/dd/19dd8b27ab1dd7da8b80d16ff4452f4f/pa/ZT06764_860e38ee594eed9efb1eb3eee533babc.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:06:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:06:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/1d/921dd65e297015a56aa4b31a920cf269/pa/BK51963_05de514c1b5b28b6d31c96779b002f9f.png> (referer: https://www.auto1.com/)
2026-01-28 20:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/1d/921dd65e297015a56aa4b31a920cf269/pa/BK51963_5f549e346253fa0aa98f50e51f95bff6.png> (referer: https://www.auto1.com/)
2026-01-28 20:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/dd/19dd8b27ab1dd7da8b80d16ff4452f4f/pa/ZT06764_668fbb1300ca4f7c7ba9057a9260e6bc.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/1d/921dd65e297015a56aa4b31a920cf269/pa/BK51963_d0b3025e50d55c6cb47e82914f762345.png> (referer: https://www.auto1.com/)
2026-01-28 20:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/b4/4fb4ec31496439d2846b55a99cd2b5ae/pa/BE15819_6c97cf553940b9a502bae0c051788d13.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/b4/4fb4ec31496439d2846b55a99cd2b5ae/pa/BE15819_6320bfb5ec93c7c93f1f20ad6c9e74f7.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/64/5c64b519844049af7ad47b5a2f24f5bb/pa/VF71012_ab9c49cdbd9a74bac72141bbd78f0beb.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:06:54 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-01-28 20:06:54 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 41 9
2026-01-28 20:06:54 [PIL.PngImagePlugin] DEBUG: STREAM b'zTXt' 62 285
2026-01-28 20:06:54 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 359 8192
2026-01-28 20:06:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08c28e90>
2026-01-28 20:06:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d6c42ae-e85f-51b5-8ddf-53f6e4f44ee5/5d6c42ae-e85f-51b5-8ddf-53f6e4f44ee5_image_7.png HTTP/1.1" 201 0
2026-01-28 20:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F1d%252F921dd65e297015a56aa4b31a920cf269%252Fpa%252FBK51963_47f2ef78863930615a3f88ef3d1169de.png') HTTP/1.1" 204 0
2026-01-28 20:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/1d/921dd65e297015a56aa4b31a920cf269/pa/BK51963_47f2ef78863930615a3f88ef3d1169de.png saved to cache
2026-01-28 20:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5d6c42ae-e85f-51b5-8ddf-53f6e4f44ee5
2026-01-28 20:06:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09e7cc10>
2026-01-28 20:06:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e027ca3-67e9-570c-acd5-c068e23d5fd7/1e027ca3-67e9-570c-acd5-c068e23d5fd7_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F64%252F5c64b519844049af7ad47b5a2f24f5bb%252Fpa%252FVF71012_3e1972a652e266ab0318d058d536673e.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/64/5c64b519844049af7ad47b5a2f24f5bb/pa/VF71012_3e1972a652e266ab0318d058d536673e.jpg saved to cache
2026-01-28 20:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1e027ca3-67e9-570c-acd5-c068e23d5fd7
2026-01-28 20:06:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0872ed50>
2026-01-28 20:06:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:06:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e027ca3-67e9-570c-acd5-c068e23d5fd7/1e027ca3-67e9-570c-acd5-c068e23d5fd7_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F64%252F5c64b519844049af7ad47b5a2f24f5bb%252Fpa%252FVF71012_0100a8ceb69b6e1204ed01dd184d6b28.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/64/5c64b519844049af7ad47b5a2f24f5bb/pa/VF71012_0100a8ceb69b6e1204ed01dd184d6b28.jpg saved to cache
2026-01-28 20:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1e027ca3-67e9-570c-acd5-c068e23d5fd7
2026-01-28 20:06:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f3baca52-5968-5dd9-b7df-b3906cb0e52c with identifier: PX44496
2026-01-28 20:06:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f3baca52-5968-5dd9-b7df-b3906cb0e52c with scrape type 1
2026-01-28 20:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item f3baca52-5968-5dd9-b7df-b3906cb0e52c
2026-01-28 20:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F08%252Fd2088e9e968b890af086ee4b2fd2ee56%252Fpa%252FPX44496_a7a82539c6e56da9e9c62c2395e0ebf3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/08/d2088e9e968b890af086ee4b2fd2ee56/pa/PX44496_a7a82539c6e56da9e9c62c2395e0ebf3.jpg already downloaded
2026-01-28 20:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F08%252Fd2088e9e968b890af086ee4b2fd2ee56%252Fpa%252FPX44496_d20b2a5685fbe5ff48b55ca0d95d75bc.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/08/d2088e9e968b890af086ee4b2fd2ee56/pa/PX44496_d20b2a5685fbe5ff48b55ca0d95d75bc.jpg already downloaded
2026-01-28 20:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F08%252Fd2088e9e968b890af086ee4b2fd2ee56%252Fpa%252FPX44496_df61c276db874862ba6a0fb1432228cd.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/08/d2088e9e968b890af086ee4b2fd2ee56/pa/PX44496_df61c276db874862ba6a0fb1432228cd.jpg already downloaded
2026-01-28 20:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F08%252Fd2088e9e968b890af086ee4b2fd2ee56%252Fpa%252FPX44496_f787b814e95db6021e6ab135ebf6ae7f.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/08/d2088e9e968b890af086ee4b2fd2ee56/pa/PX44496_f787b814e95db6021e6ab135ebf6ae7f.jpg already downloaded
2026-01-28 20:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F08%252Fd2088e9e968b890af086ee4b2fd2ee56%252Fpa%252FPX44496_3c676302493a124b6c7ae17adc978948.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/08/d2088e9e968b890af086ee4b2fd2ee56/pa/PX44496_3c676302493a124b6c7ae17adc978948.jpg already downloaded
2026-01-28 20:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F08%252Fd2088e9e968b890af086ee4b2fd2ee56%252Fpa%252FPX44496_478dd919191a8b73597a6fe4ae61a361.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/08/d2088e9e968b890af086ee4b2fd2ee56/pa/PX44496_478dd919191a8b73597a6fe4ae61a361.jpg already downloaded
2026-01-28 20:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F08%252Fd2088e9e968b890af086ee4b2fd2ee56%252Fpa%252FPX44496_ec7bc18503989beae4a729df09ebc058.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/08/d2088e9e968b890af086ee4b2fd2ee56/pa/PX44496_ec7bc18503989beae4a729df09ebc058.jpg already downloaded
2026-01-28 20:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F08%252Fd2088e9e968b890af086ee4b2fd2ee56%252Fpa%252FPX44496_36c40e4e2eef4d3838ab456982c2f2ff.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/08/d2088e9e968b890af086ee4b2fd2ee56/pa/PX44496_36c40e4e2eef4d3838ab456982c2f2ff.jpg already downloaded
2026-01-28 20:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F08%252Fd2088e9e968b890af086ee4b2fd2ee56%252Fpa%252FPX44496_f26dd08564f4d14243da0b67a215053c.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/08/d2088e9e968b890af086ee4b2fd2ee56/pa/PX44496_f26dd08564f4d14243da0b67a215053c.jpg already downloaded
2026-01-28 20:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F08%252Fd2088e9e968b890af086ee4b2fd2ee56%252Fpa%252FPX44496_84c3789fc7454b246d3a9fac6c045460.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/08/d2088e9e968b890af086ee4b2fd2ee56/pa/PX44496_84c3789fc7454b246d3a9fac6c045460.jpg already downloaded
2026-01-28 20:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F08%252Fd2088e9e968b890af086ee4b2fd2ee56%252Fpa%252FPX44496_aed7f4ccf601310e396e2c1fa7d743c4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/08/d2088e9e968b890af086ee4b2fd2ee56/pa/PX44496_aed7f4ccf601310e396e2c1fa7d743c4.jpg already downloaded
2026-01-28 20:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F08%252Fd2088e9e968b890af086ee4b2fd2ee56%252Fpa%252FPX44496_cb23053c87ca2642f64d29241d955327.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/08/d2088e9e968b890af086ee4b2fd2ee56/pa/PX44496_cb23053c87ca2642f64d29241d955327.jpg already downloaded
2026-01-28 20:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F08%252Fd2088e9e968b890af086ee4b2fd2ee56%252Fpa%252FPX44496_956e6c32ce83c93c8838139a776729cd.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/08/d2088e9e968b890af086ee4b2fd2ee56/pa/PX44496_956e6c32ce83c93c8838139a776729cd.jpg already downloaded
2026-01-28 20:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F08%252Fd2088e9e968b890af086ee4b2fd2ee56%252Fpa%252FPX44496_6060ca44e365304603a29df45e57d776.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/08/d2088e9e968b890af086ee4b2fd2ee56/pa/PX44496_6060ca44e365304603a29df45e57d776.jpg already downloaded
2026-01-28 20:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F08%252Fd2088e9e968b890af086ee4b2fd2ee56%252Fpa%252FPX44496_519f62af795446f4fcd81a23653dab20.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/08/d2088e9e968b890af086ee4b2fd2ee56/pa/PX44496_519f62af795446f4fcd81a23653dab20.jpg already downloaded
2026-01-28 20:06:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f3baca52-5968-5dd9-b7df-b3906cb0e52c, identifier: PX44496
2026-01-28 20:06:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:06:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b086cf1d0>
2026-01-28 20:06:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f7eaeb0-1d12-5d24-ad31-49e0df716d68/8f7eaeb0-1d12-5d24-ad31-49e0df716d68_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fdd%252F19dd8b27ab1dd7da8b80d16ff4452f4f%252Fpa%252FZT06764_860e38ee594eed9efb1eb3eee533babc.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/dd/19dd8b27ab1dd7da8b80d16ff4452f4f/pa/ZT06764_860e38ee594eed9efb1eb3eee533babc.jpg saved to cache
2026-01-28 20:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 8f7eaeb0-1d12-5d24-ad31-49e0df716d68
2026-01-28 20:06:56 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-01-28 20:06:56 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 41 9
2026-01-28 20:06:56 [PIL.PngImagePlugin] DEBUG: STREAM b'zTXt' 62 285
2026-01-28 20:06:56 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 359 8192
2026-01-28 20:06:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09e33b50>
2026-01-28 20:06:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:06:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d6c42ae-e85f-51b5-8ddf-53f6e4f44ee5/5d6c42ae-e85f-51b5-8ddf-53f6e4f44ee5_image_4.png HTTP/1.1" 201 0
2026-01-28 20:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F1d%252F921dd65e297015a56aa4b31a920cf269%252Fpa%252FBK51963_05de514c1b5b28b6d31c96779b002f9f.png') HTTP/1.1" 204 0
2026-01-28 20:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/1d/921dd65e297015a56aa4b31a920cf269/pa/BK51963_05de514c1b5b28b6d31c96779b002f9f.png saved to cache
2026-01-28 20:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5d6c42ae-e85f-51b5-8ddf-53f6e4f44ee5
2026-01-28 20:06:56 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-01-28 20:06:56 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 41 9
2026-01-28 20:06:56 [PIL.PngImagePlugin] DEBUG: STREAM b'zTXt' 62 285
2026-01-28 20:06:56 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 359 8192
2026-01-28 20:06:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08b07e90>
2026-01-28 20:06:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:06:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d6c42ae-e85f-51b5-8ddf-53f6e4f44ee5/5d6c42ae-e85f-51b5-8ddf-53f6e4f44ee5_image_3.png HTTP/1.1" 201 0
2026-01-28 20:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F1d%252F921dd65e297015a56aa4b31a920cf269%252Fpa%252FBK51963_5f549e346253fa0aa98f50e51f95bff6.png') HTTP/1.1" 204 0
2026-01-28 20:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/1d/921dd65e297015a56aa4b31a920cf269/pa/BK51963_5f549e346253fa0aa98f50e51f95bff6.png saved to cache
2026-01-28 20:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5d6c42ae-e85f-51b5-8ddf-53f6e4f44ee5
2026-01-28 20:06:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:06:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09e5e510>
2026-01-28 20:06:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:06:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f7eaeb0-1d12-5d24-ad31-49e0df716d68/8f7eaeb0-1d12-5d24-ad31-49e0df716d68_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fdd%252F19dd8b27ab1dd7da8b80d16ff4452f4f%252Fpa%252FZT06764_668fbb1300ca4f7c7ba9057a9260e6bc.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/dd/19dd8b27ab1dd7da8b80d16ff4452f4f/pa/ZT06764_668fbb1300ca4f7c7ba9057a9260e6bc.jpg saved to cache
2026-01-28 20:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8f7eaeb0-1d12-5d24-ad31-49e0df716d68
2026-01-28 20:06:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8f7eaeb0-1d12-5d24-ad31-49e0df716d68, skipping ID generation
2026-01-28 20:06:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f7eaeb0-1d12-5d24-ad31-49e0df716d68 with scrape type 1
2026-01-28 20:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 8f7eaeb0-1d12-5d24-ad31-49e0df716d68 from tracking dictionaries
2026-01-28 20:06:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8f7eaeb0-1d12-5d24-ad31-49e0df716d68 sending to next pipeline
2026-01-28 20:06:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8f7eaeb0-1d12-5d24-ad31-49e0df716d68, identifier: ZT06764
2026-01-28 20:06:57 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-01-28 20:06:57 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 41 9
2026-01-28 20:06:57 [PIL.PngImagePlugin] DEBUG: STREAM b'zTXt' 62 285
2026-01-28 20:06:57 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 359 8192
2026-01-28 20:06:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0a07d0d0>
2026-01-28 20:06:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:06:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d6c42ae-e85f-51b5-8ddf-53f6e4f44ee5/5d6c42ae-e85f-51b5-8ddf-53f6e4f44ee5_image_2.png HTTP/1.1" 201 0
2026-01-28 20:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F1d%252F921dd65e297015a56aa4b31a920cf269%252Fpa%252FBK51963_d0b3025e50d55c6cb47e82914f762345.png') HTTP/1.1" 204 0
2026-01-28 20:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/1d/921dd65e297015a56aa4b31a920cf269/pa/BK51963_d0b3025e50d55c6cb47e82914f762345.png saved to cache
2026-01-28 20:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5d6c42ae-e85f-51b5-8ddf-53f6e4f44ee5
2026-01-28 20:06:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5d6c42ae-e85f-51b5-8ddf-53f6e4f44ee5, skipping ID generation
2026-01-28 20:06:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d6c42ae-e85f-51b5-8ddf-53f6e4f44ee5 with scrape type 1
2026-01-28 20:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 5d6c42ae-e85f-51b5-8ddf-53f6e4f44ee5 from tracking dictionaries
2026-01-28 20:06:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5d6c42ae-e85f-51b5-8ddf-53f6e4f44ee5 sending to next pipeline
2026-01-28 20:06:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5d6c42ae-e85f-51b5-8ddf-53f6e4f44ee5, identifier: BK51963
2026-01-28 20:06:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09ea3e90>
2026-01-28 20:06:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:06:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a23c743d-1f5c-5ce1-98dd-2048bdcb6fb9/a23c743d-1f5c-5ce1-98dd-2048bdcb6fb9_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252Fb4%252F4fb4ec31496439d2846b55a99cd2b5ae%252Fpa%252FBE15819_6c97cf553940b9a502bae0c051788d13.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/b4/4fb4ec31496439d2846b55a99cd2b5ae/pa/BE15819_6c97cf553940b9a502bae0c051788d13.jpg saved to cache
2026-01-28 20:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item a23c743d-1f5c-5ce1-98dd-2048bdcb6fb9
2026-01-28 20:06:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0a066810>
2026-01-28 20:06:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:06:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a23c743d-1f5c-5ce1-98dd-2048bdcb6fb9/a23c743d-1f5c-5ce1-98dd-2048bdcb6fb9_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252Fb4%252F4fb4ec31496439d2846b55a99cd2b5ae%252Fpa%252FBE15819_6320bfb5ec93c7c93f1f20ad6c9e74f7.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/b4/4fb4ec31496439d2846b55a99cd2b5ae/pa/BE15819_6320bfb5ec93c7c93f1f20ad6c9e74f7.jpg saved to cache
2026-01-28 20:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item a23c743d-1f5c-5ce1-98dd-2048bdcb6fb9
2026-01-28 20:06:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08a28d10>
2026-01-28 20:06:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:06:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e027ca3-67e9-570c-acd5-c068e23d5fd7/1e027ca3-67e9-570c-acd5-c068e23d5fd7_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F64%252F5c64b519844049af7ad47b5a2f24f5bb%252Fpa%252FVF71012_ab9c49cdbd9a74bac72141bbd78f0beb.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/64/5c64b519844049af7ad47b5a2f24f5bb/pa/VF71012_ab9c49cdbd9a74bac72141bbd78f0beb.jpg saved to cache
2026-01-28 20:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1e027ca3-67e9-570c-acd5-c068e23d5fd7
2026-01-28 20:06:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1e027ca3-67e9-570c-acd5-c068e23d5fd7, skipping ID generation
2026-01-28 20:06:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e027ca3-67e9-570c-acd5-c068e23d5fd7 with scrape type 1
2026-01-28 20:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 1e027ca3-67e9-570c-acd5-c068e23d5fd7 from tracking dictionaries
2026-01-28 20:06:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1e027ca3-67e9-570c-acd5-c068e23d5fd7 sending to next pipeline
2026-01-28 20:06:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1e027ca3-67e9-570c-acd5-c068e23d5fd7, identifier: VF71012
2026-01-28 20:06:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f3baca52-5968-5dd9-b7df-b3906cb0e52c with identifier: PX44496
2026-01-28 20:06:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f3baca52-5968-5dd9-b7df-b3906cb0e52c with identifier: PX44496
2026-01-28 20:06:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f3baca52-5968-5dd9-b7df-b3906cb0e52c with identifier: PX44496 to the API
2026-01-28 20:06:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:06:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:06:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PX44496>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:10:44Z',
 'fuel_type': 'diesel',
 'id': 'f3baca52-5968-5dd9-b7df-b3906cb0e52c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PX44496',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 64044,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgd2/08/d2088e9e968b890af086ee4b2fd2ee56/pa/PX44496_a7a82539c6e56da9e9c62c2395e0ebf3.jpg',
                'https://img-pa.auto1.com/imgd2/08/d2088e9e968b890af086ee4b2fd2ee56/pa/PX44496_d20b2a5685fbe5ff48b55ca0d95d75bc.jpg',
                'https://img-pa.auto1.com/imgd2/08/d2088e9e968b890af086ee4b2fd2ee56/pa/PX44496_df61c276db874862ba6a0fb1432228cd.jpg',
                'https://img-pa.auto1.com/imgd2/08/d2088e9e968b890af086ee4b2fd2ee56/pa/PX44496_f787b814e95db6021e6ab135ebf6ae7f.jpg',
                'https://img-pa.auto1.com/imgd2/08/d2088e9e968b890af086ee4b2fd2ee56/pa/PX44496_3c676302493a124b6c7ae17adc978948.jpg',
                'https://img-pa.auto1.com/imgd2/08/d2088e9e968b890af086ee4b2fd2ee56/pa/PX44496_478dd919191a8b73597a6fe4ae61a361.jpg',
                'https://img-pa.auto1.com/imgd2/08/d2088e9e968b890af086ee4b2fd2ee56/pa/PX44496_ec7bc18503989beae4a729df09ebc058.jpg',
                'https://img-pa.auto1.com/imgd2/08/d2088e9e968b890af086ee4b2fd2ee56/pa/PX44496_36c40e4e2eef4d3838ab456982c2f2ff.jpg',
                'https://img-pa.auto1.com/imgd2/08/d2088e9e968b890af086ee4b2fd2ee56/pa/PX44496_f26dd08564f4d14243da0b67a215053c.jpg',
                'https://img-pa.auto1.com/imgd2/08/d2088e9e968b890af086ee4b2fd2ee56/pa/PX44496_84c3789fc7454b246d3a9fac6c045460.jpg',
                'https://img-pa.auto1.com/imgd2/08/d2088e9e968b890af086ee4b2fd2ee56/pa/PX44496_aed7f4ccf601310e396e2c1fa7d743c4.jpg',
                'https://img-pa.auto1.com/imgd2/08/d2088e9e968b890af086ee4b2fd2ee56/pa/PX44496_cb23053c87ca2642f64d29241d955327.jpg',
                'https://img-pa.auto1.com/imgd2/08/d2088e9e968b890af086ee4b2fd2ee56/pa/PX44496_956e6c32ce83c93c8838139a776729cd.jpg',
                'https://img-pa.auto1.com/imgd2/08/d2088e9e968b890af086ee4b2fd2ee56/pa/PX44496_6060ca44e365304603a29df45e57d776.jpg',
                'https://img-pa.auto1.com/imgd2/08/d2088e9e968b890af086ee4b2fd2ee56/pa/PX44496_519f62af795446f4fcd81a23653dab20.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3baca52-5968-5dd9-b7df-b3906cb0e52c/f3baca52-5968-5dd9-b7df-b3906cb0e52c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66194,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/08/d2088e9e968b890af086ee4b2fd2ee56/pa/PX44496_a7a82539c6e56da9e9c62c2395e0ebf3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3baca52-5968-5dd9-b7df-b3906cb0e52c/f3baca52-5968-5dd9-b7df-b3906cb0e52c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2999506,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/08/d2088e9e968b890af086ee4b2fd2ee56/pa/PX44496_d20b2a5685fbe5ff48b55ca0d95d75bc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3baca52-5968-5dd9-b7df-b3906cb0e52c/f3baca52-5968-5dd9-b7df-b3906cb0e52c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2951345,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/08/d2088e9e968b890af086ee4b2fd2ee56/pa/PX44496_df61c276db874862ba6a0fb1432228cd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3baca52-5968-5dd9-b7df-b3906cb0e52c/f3baca52-5968-5dd9-b7df-b3906cb0e52c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2912352,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/08/d2088e9e968b890af086ee4b2fd2ee56/pa/PX44496_f787b814e95db6021e6ab135ebf6ae7f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3baca52-5968-5dd9-b7df-b3906cb0e52c/f3baca52-5968-5dd9-b7df-b3906cb0e52c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66602,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/08/d2088e9e968b890af086ee4b2fd2ee56/pa/PX44496_3c676302493a124b6c7ae17adc978948.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3baca52-5968-5dd9-b7df-b3906cb0e52c/f3baca52-5968-5dd9-b7df-b3906cb0e52c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66727,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/08/d2088e9e968b890af086ee4b2fd2ee56/pa/PX44496_478dd919191a8b73597a6fe4ae61a361.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3baca52-5968-5dd9-b7df-b3906cb0e52c/f3baca52-5968-5dd9-b7df-b3906cb0e52c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2346714,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/08/d2088e9e968b890af086ee4b2fd2ee56/pa/PX44496_ec7bc18503989beae4a729df09ebc058.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3baca52-5968-5dd9-b7df-b3906cb0e52c/f3baca52-5968-5dd9-b7df-b3906cb0e52c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2483371,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/08/d2088e9e968b890af086ee4b2fd2ee56/pa/PX44496_36c40e4e2eef4d3838ab456982c2f2ff.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3baca52-5968-5dd9-b7df-b3906cb0e52c/f3baca52-5968-5dd9-b7df-b3906cb0e52c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68743,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/08/d2088e9e968b890af086ee4b2fd2ee56/pa/PX44496_f26dd08564f4d14243da0b67a215053c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3baca52-5968-5dd9-b7df-b3906cb0e52c/f3baca52-5968-5dd9-b7df-b3906cb0e52c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53066,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/08/d2088e9e968b890af086ee4b2fd2ee56/pa/PX44496_84c3789fc7454b246d3a9fac6c045460.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3baca52-5968-5dd9-b7df-b3906cb0e52c/f3baca52-5968-5dd9-b7df-b3906cb0e52c_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2542884,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/08/d2088e9e968b890af086ee4b2fd2ee56/pa/PX44496_aed7f4ccf601310e396e2c1fa7d743c4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3baca52-5968-5dd9-b7df-b3906cb0e52c/f3baca52-5968-5dd9-b7df-b3906cb0e52c_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57444,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/08/d2088e9e968b890af086ee4b2fd2ee56/pa/PX44496_cb23053c87ca2642f64d29241d955327.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3baca52-5968-5dd9-b7df-b3906cb0e52c/f3baca52-5968-5dd9-b7df-b3906cb0e52c_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58965,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/08/d2088e9e968b890af086ee4b2fd2ee56/pa/PX44496_956e6c32ce83c93c8838139a776729cd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3baca52-5968-5dd9-b7df-b3906cb0e52c/f3baca52-5968-5dd9-b7df-b3906cb0e52c_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47517,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/08/d2088e9e968b890af086ee4b2fd2ee56/pa/PX44496_6060ca44e365304603a29df45e57d776.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3baca52-5968-5dd9-b7df-b3906cb0e52c/f3baca52-5968-5dd9-b7df-b3906cb0e52c_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54396,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/08/d2088e9e968b890af086ee4b2fd2ee56/pa/PX44496_519f62af795446f4fcd81a23653dab20.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-07-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q3 35 TDI Advanced',
 'transmission': 'automatic',
 'trim': 'Advanced',
 'year': 2019}
2026-01-28 20:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27PX44496%27 HTTP/1.1" 200 None
2026-01-28 20:06:59 [auto1.it] INFO: Saving data for PX44496: {'created_time': 1769630819.123554, 'last_price_update_time': 1769630819.123565, 'auction_closing_time': 1769703044.0}
2026-01-28 20:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='PX44496') HTTP/1.1" 204 0
2026-01-28 20:06:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8f7eaeb0-1d12-5d24-ad31-49e0df716d68 with identifier: ZT06764
2026-01-28 20:06:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8f7eaeb0-1d12-5d24-ad31-49e0df716d68 with identifier: ZT06764
2026-01-28 20:06:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8f7eaeb0-1d12-5d24-ad31-49e0df716d68 with identifier: ZT06764 to the API
2026-01-28 20:06:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:06:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:06:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img19/dd/19dd8b27ab1dd7da8b80d16ff4452f4f/pa/ZT06764_668fbb1300ca4f7c7ba9057a9260e6bc.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 165,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 6',
 'engine': '1.9L',
 'engine_horse_power': 195,
 'expiration_date': '2026-01-29T16:07:10Z',
 'fuel_type': 'diesel',
 'id': '8f7eaeb0-1d12-5d24-ad31-49e0df716d68',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZT06764',
 'listing': 'auction',
 'location': 'IT, Piacenza',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 85735,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f7eaeb0-1d12-5d24-ad31-49e0df716d68/8f7eaeb0-1d12-5d24-ad31-49e0df716d68_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59627,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/dd/19dd8b27ab1dd7da8b80d16ff4452f4f/pa/ZT06764_018738e97960b2631188ad41ea72f13e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f7eaeb0-1d12-5d24-ad31-49e0df716d68/8f7eaeb0-1d12-5d24-ad31-49e0df716d68_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61550,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/dd/19dd8b27ab1dd7da8b80d16ff4452f4f/pa/ZT06764_2ad9f4c118f39c79d29473f6fb00d1f9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f7eaeb0-1d12-5d24-ad31-49e0df716d68/8f7eaeb0-1d12-5d24-ad31-49e0df716d68_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2557792,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img19/dd/19dd8b27ab1dd7da8b80d16ff4452f4f/pa/ZT06764_ee69a704cb3327ce26d3dc06f0819d2e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f7eaeb0-1d12-5d24-ad31-49e0df716d68/8f7eaeb0-1d12-5d24-ad31-49e0df716d68_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2847703,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img19/dd/19dd8b27ab1dd7da8b80d16ff4452f4f/pa/ZT06764_a03cc9b8b9170a24408116a4ea2be03e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f7eaeb0-1d12-5d24-ad31-49e0df716d68/8f7eaeb0-1d12-5d24-ad31-49e0df716d68_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2644413,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img19/dd/19dd8b27ab1dd7da8b80d16ff4452f4f/pa/ZT06764_e0814907b56cf34c67f902307527be25.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f7eaeb0-1d12-5d24-ad31-49e0df716d68/8f7eaeb0-1d12-5d24-ad31-49e0df716d68_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2704900,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img19/dd/19dd8b27ab1dd7da8b80d16ff4452f4f/pa/ZT06764_668fbb1300ca4f7c7ba9057a9260e6bc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f7eaeb0-1d12-5d24-ad31-49e0df716d68/8f7eaeb0-1d12-5d24-ad31-49e0df716d68_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39769,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/dd/19dd8b27ab1dd7da8b80d16ff4452f4f/pa/ZT06764_f71fc033ffa817e0858016d9dad4135a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f7eaeb0-1d12-5d24-ad31-49e0df716d68/8f7eaeb0-1d12-5d24-ad31-49e0df716d68_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2767760,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img19/dd/19dd8b27ab1dd7da8b80d16ff4452f4f/pa/ZT06764_12a5cb0bcc8d59853fc8e0e4f812eca7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f7eaeb0-1d12-5d24-ad31-49e0df716d68/8f7eaeb0-1d12-5d24-ad31-49e0df716d68_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2785845,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img19/dd/19dd8b27ab1dd7da8b80d16ff4452f4f/pa/ZT06764_a46641eca4774ccabd54d9cac40ca718.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f7eaeb0-1d12-5d24-ad31-49e0df716d68/8f7eaeb0-1d12-5d24-ad31-49e0df716d68_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48911,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/dd/19dd8b27ab1dd7da8b80d16ff4452f4f/pa/ZT06764_272b6a6b2d45d5836f3608dda437a2e5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f7eaeb0-1d12-5d24-ad31-49e0df716d68/8f7eaeb0-1d12-5d24-ad31-49e0df716d68_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2767285,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img19/dd/19dd8b27ab1dd7da8b80d16ff4452f4f/pa/ZT06764_860e38ee594eed9efb1eb3eee533babc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f7eaeb0-1d12-5d24-ad31-49e0df716d68/8f7eaeb0-1d12-5d24-ad31-49e0df716d68_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3003995,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img19/dd/19dd8b27ab1dd7da8b80d16ff4452f4f/pa/ZT06764_8d4367f827dd5cca38ba31f3726b475c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f7eaeb0-1d12-5d24-ad31-49e0df716d68/8f7eaeb0-1d12-5d24-ad31-49e0df716d68_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50104,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/dd/19dd8b27ab1dd7da8b80d16ff4452f4f/pa/ZT06764_6649b776d8c47148b14e9bd9c3a593c7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f7eaeb0-1d12-5d24-ad31-49e0df716d68/8f7eaeb0-1d12-5d24-ad31-49e0df716d68_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 25365,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/dd/19dd8b27ab1dd7da8b80d16ff4452f4f/pa/ZT06764_795870b53afa5db26a674f035a76eb6e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f7eaeb0-1d12-5d24-ad31-49e0df716d68/8f7eaeb0-1d12-5d24-ad31-49e0df716d68_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50761,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/dd/19dd8b27ab1dd7da8b80d16ff4452f4f/pa/ZT06764_8cdb6549d2e7f4d802845e7275369ee7.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-05-20',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 220 d 4Matic Premium',
 'transmission': 'automatic',
 'trim': '4Matic Premium',
 'year': 2021}
2026-01-28 20:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZT06764%27 HTTP/1.1" 200 None
2026-01-28 20:06:59 [auto1.it] INFO: Saving data for ZT06764: {'created_time': 1769630819.548504, 'last_price_update_time': 1769630819.548516, 'auction_closing_time': 1769702830.0}
2026-01-28 20:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZT06764') HTTP/1.1" 204 0
2026-01-28 20:06:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5d6c42ae-e85f-51b5-8ddf-53f6e4f44ee5 with identifier: BK51963
2026-01-28 20:06:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5d6c42ae-e85f-51b5-8ddf-53f6e4f44ee5 with identifier: BK51963
2026-01-28 20:06:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5d6c42ae-e85f-51b5-8ddf-53f6e4f44ee5 with identifier: BK51963 to the API
2026-01-28 20:06:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:06:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:06:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img92/1d/921dd65e297015a56aa4b31a920cf269/pa/BK51963_d0b3025e50d55c6cb47e82914f762345.png>
{'auction_title': '',
 'c_o_2_emission_value': 35,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 224,
 'expiration_date': '2026-01-29T16:30:34Z',
 'fuel_type': 'hybrid',
 'id': '5d6c42ae-e85f-51b5-8ddf-53f6e4f44ee5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BK51963',
 'listing': 'auction',
 'location': 'IT, Fiumicino (RM)',
 'make': 'DS Automobiles',
 'model': 'DS9',
 'odometer': 14784,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d6c42ae-e85f-51b5-8ddf-53f6e4f44ee5/5d6c42ae-e85f-51b5-8ddf-53f6e4f44ee5_image_0.png',
             'Extension': 'png',
             'FileSizeInBytes': 1204797,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/1d/921dd65e297015a56aa4b31a920cf269/pa/BK51963_3df3e5bf33d2da269e6c6010d49b46c1.png',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d6c42ae-e85f-51b5-8ddf-53f6e4f44ee5/5d6c42ae-e85f-51b5-8ddf-53f6e4f44ee5_image_1.png',
             'Extension': 'png',
             'FileSizeInBytes': 1204797,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/1d/921dd65e297015a56aa4b31a920cf269/pa/BK51963_6b8f63ad1867765e2466921254cbc78e.png',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d6c42ae-e85f-51b5-8ddf-53f6e4f44ee5/5d6c42ae-e85f-51b5-8ddf-53f6e4f44ee5_image_2.png',
             'Extension': 'png',
             'FileSizeInBytes': 1168001,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/1d/921dd65e297015a56aa4b31a920cf269/pa/BK51963_d0b3025e50d55c6cb47e82914f762345.png',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d6c42ae-e85f-51b5-8ddf-53f6e4f44ee5/5d6c42ae-e85f-51b5-8ddf-53f6e4f44ee5_image_3.png',
             'Extension': 'png',
             'FileSizeInBytes': 1199440,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/1d/921dd65e297015a56aa4b31a920cf269/pa/BK51963_5f549e346253fa0aa98f50e51f95bff6.png',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d6c42ae-e85f-51b5-8ddf-53f6e4f44ee5/5d6c42ae-e85f-51b5-8ddf-53f6e4f44ee5_image_4.png',
             'Extension': 'png',
             'FileSizeInBytes': 1199440,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/1d/921dd65e297015a56aa4b31a920cf269/pa/BK51963_05de514c1b5b28b6d31c96779b002f9f.png',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d6c42ae-e85f-51b5-8ddf-53f6e4f44ee5/5d6c42ae-e85f-51b5-8ddf-53f6e4f44ee5_image_5.png',
             'Extension': 'png',
             'FileSizeInBytes': 1335311,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/1d/921dd65e297015a56aa4b31a920cf269/pa/BK51963_b5d1be8e37a80e419769e746e975d3d4.png',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d6c42ae-e85f-51b5-8ddf-53f6e4f44ee5/5d6c42ae-e85f-51b5-8ddf-53f6e4f44ee5_image_6.png',
             'Extension': 'png',
             'FileSizeInBytes': 1204797,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/1d/921dd65e297015a56aa4b31a920cf269/pa/BK51963_bda3e4c73cb2b3b32bd139aabcae458d.png',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d6c42ae-e85f-51b5-8ddf-53f6e4f44ee5/5d6c42ae-e85f-51b5-8ddf-53f6e4f44ee5_image_7.png',
             'Extension': 'png',
             'FileSizeInBytes': 1204797,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/1d/921dd65e297015a56aa4b31a920cf269/pa/BK51963_47f2ef78863930615a3f88ef3d1169de.png',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d6c42ae-e85f-51b5-8ddf-53f6e4f44ee5/5d6c42ae-e85f-51b5-8ddf-53f6e4f44ee5_image_8.png',
             'Extension': 'png',
             'FileSizeInBytes': 1091842,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/1d/921dd65e297015a56aa4b31a920cf269/pa/BK51963_d6d3714e6d5d967ea00977cd17bd028d.png',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d6c42ae-e85f-51b5-8ddf-53f6e4f44ee5/5d6c42ae-e85f-51b5-8ddf-53f6e4f44ee5_image_9.png',
             'Extension': 'png',
             'FileSizeInBytes': 1032900,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/1d/921dd65e297015a56aa4b31a920cf269/pa/BK51963_10b0de790d2faa6337d8a277b0dd361d.png',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d6c42ae-e85f-51b5-8ddf-53f6e4f44ee5/5d6c42ae-e85f-51b5-8ddf-53f6e4f44ee5_image_10.png',
             'Extension': 'png',
             'FileSizeInBytes': 768692,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/1d/921dd65e297015a56aa4b31a920cf269/pa/BK51963_ed1f2b0db79e49025112fd59e85bb94f.png',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d6c42ae-e85f-51b5-8ddf-53f6e4f44ee5/5d6c42ae-e85f-51b5-8ddf-53f6e4f44ee5_image_11.png',
             'Extension': 'png',
             'FileSizeInBytes': 835484,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/1d/921dd65e297015a56aa4b31a920cf269/pa/BK51963_1e9cb7ffa9952dca70786358d382fb64.png',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-04-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DS Automobiles DS9 1.6 E-Tense Hybrid Rivoli +',
 'transmission': 'automatic',
 'trim': 'Rivoli +',
 'year': 2021}
2026-01-28 20:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BK51963%27 HTTP/1.1" 200 None
2026-01-28 20:06:59 [auto1.it] INFO: Saving data for BK51963: {'created_time': 1769630819.922987, 'last_price_update_time': 1769630819.922998, 'auction_closing_time': 1769704234.0}
2026-01-28 20:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BK51963') HTTP/1.1" 204 0
2026-01-28 20:06:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1e027ca3-67e9-570c-acd5-c068e23d5fd7 with identifier: VF71012
2026-01-28 20:06:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1e027ca3-67e9-570c-acd5-c068e23d5fd7 with identifier: VF71012
2026-01-28 20:07:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1e027ca3-67e9-570c-acd5-c068e23d5fd7 with identifier: VF71012 to the API
2026-01-28 20:07:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:07:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:07:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img5c/64/5c64b519844049af7ad47b5a2f24f5bb/pa/VF71012_ab9c49cdbd9a74bac72141bbd78f0beb.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.0L',
 'engine_horse_power': 120,
 'expiration_date': '2026-01-29T16:34:59Z',
 'fuel_type': 'petrol',
 'id': '1e027ca3-67e9-570c-acd5-c068e23d5fd7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VF71012',
 'listing': 'auction',
 'location': 'IT, Milazzo',
 'make': 'Hyundai',
 'model': 'Kona',
 'odometer': 57208,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e027ca3-67e9-570c-acd5-c068e23d5fd7/1e027ca3-67e9-570c-acd5-c068e23d5fd7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 141774,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/64/5c64b519844049af7ad47b5a2f24f5bb/pa/VF71012_ab9c49cdbd9a74bac72141bbd78f0beb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e027ca3-67e9-570c-acd5-c068e23d5fd7/1e027ca3-67e9-570c-acd5-c068e23d5fd7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 130911,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/64/5c64b519844049af7ad47b5a2f24f5bb/pa/VF71012_84487718fb57802fa294bdf1fab059ff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e027ca3-67e9-570c-acd5-c068e23d5fd7/1e027ca3-67e9-570c-acd5-c068e23d5fd7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108041,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/64/5c64b519844049af7ad47b5a2f24f5bb/pa/VF71012_cf19407c54c7fd4dcd338928b5047f0b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e027ca3-67e9-570c-acd5-c068e23d5fd7/1e027ca3-67e9-570c-acd5-c068e23d5fd7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91878,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/64/5c64b519844049af7ad47b5a2f24f5bb/pa/VF71012_8b55c5862b8dba3d4c0c96f24cd33e0a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e027ca3-67e9-570c-acd5-c068e23d5fd7/1e027ca3-67e9-570c-acd5-c068e23d5fd7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108760,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/64/5c64b519844049af7ad47b5a2f24f5bb/pa/VF71012_3e1972a652e266ab0318d058d536673e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e027ca3-67e9-570c-acd5-c068e23d5fd7/1e027ca3-67e9-570c-acd5-c068e23d5fd7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101140,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/64/5c64b519844049af7ad47b5a2f24f5bb/pa/VF71012_110136872f1c292bdc16822d16fc4694.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e027ca3-67e9-570c-acd5-c068e23d5fd7/1e027ca3-67e9-570c-acd5-c068e23d5fd7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94631,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/64/5c64b519844049af7ad47b5a2f24f5bb/pa/VF71012_4fc1d70b2396626edf2a610bf5632f58.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e027ca3-67e9-570c-acd5-c068e23d5fd7/1e027ca3-67e9-570c-acd5-c068e23d5fd7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 120063,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/64/5c64b519844049af7ad47b5a2f24f5bb/pa/VF71012_a11bd037f7bfe5a73fa30645967be93d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e027ca3-67e9-570c-acd5-c068e23d5fd7/1e027ca3-67e9-570c-acd5-c068e23d5fd7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 123152,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/64/5c64b519844049af7ad47b5a2f24f5bb/pa/VF71012_0100a8ceb69b6e1204ed01dd184d6b28.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e027ca3-67e9-570c-acd5-c068e23d5fd7/1e027ca3-67e9-570c-acd5-c068e23d5fd7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101667,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/64/5c64b519844049af7ad47b5a2f24f5bb/pa/VF71012_20f884197ca0a3ebfd6428467c180690.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e027ca3-67e9-570c-acd5-c068e23d5fd7/1e027ca3-67e9-570c-acd5-c068e23d5fd7_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76278,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/64/5c64b519844049af7ad47b5a2f24f5bb/pa/VF71012_6dca6d04eb5ac4ca11cb7b720e5eb8e4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e027ca3-67e9-570c-acd5-c068e23d5fd7/1e027ca3-67e9-570c-acd5-c068e23d5fd7_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74618,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/64/5c64b519844049af7ad47b5a2f24f5bb/pa/VF71012_27c21332e0577c36aa218a253cb21488.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e027ca3-67e9-570c-acd5-c068e23d5fd7/1e027ca3-67e9-570c-acd5-c068e23d5fd7_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74628,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/64/5c64b519844049af7ad47b5a2f24f5bb/pa/VF71012_b4166582e00735246a20f53149cffa97.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e027ca3-67e9-570c-acd5-c068e23d5fd7/1e027ca3-67e9-570c-acd5-c068e23d5fd7_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63526,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/64/5c64b519844049af7ad47b5a2f24f5bb/pa/VF71012_d9b0d703381540d26d369e9342e55541.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e027ca3-67e9-570c-acd5-c068e23d5fd7/1e027ca3-67e9-570c-acd5-c068e23d5fd7_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50780,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/64/5c64b519844049af7ad47b5a2f24f5bb/pa/VF71012_95aa712814b3bec8050399a95ac73da0.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-06-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai Kona 1.0 TGDI Comfort 2WD',
 'transmission': 'manual',
 'trim': 'Comfort 2WD',
 'year': 2018}
2026-01-28 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VF71012%27 HTTP/1.1" 200 None
2026-01-28 20:07:00 [auto1.it] INFO: Saving data for VF71012: {'created_time': 1769630820.387959, 'last_price_update_time': 1769630820.387971, 'auction_closing_time': 1769704499.0}
2026-01-28 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VF71012') HTTP/1.1" 204 0
2026-01-28 20:07:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MW21403/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:07:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VV63858/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:07:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZS31369/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:07:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GA26401/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:07:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:07:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:07:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:07:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:07:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/b4/4fb4ec31496439d2846b55a99cd2b5ae/pa/BE15819_7ff478b67a231fd772dd64d08feb7f3a.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:07:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08c11710>
2026-01-28 20:07:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a23c743d-1f5c-5ce1-98dd-2048bdcb6fb9/a23c743d-1f5c-5ce1-98dd-2048bdcb6fb9_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252Fb4%252F4fb4ec31496439d2846b55a99cd2b5ae%252Fpa%252FBE15819_7ff478b67a231fd772dd64d08feb7f3a.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/b4/4fb4ec31496439d2846b55a99cd2b5ae/pa/BE15819_7ff478b67a231fd772dd64d08feb7f3a.jpg saved to cache
2026-01-28 20:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item a23c743d-1f5c-5ce1-98dd-2048bdcb6fb9
2026-01-28 20:07:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/b4/4fb4ec31496439d2846b55a99cd2b5ae/pa/BE15819_69c5116208e3fb39c0ced18172b315f1.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:07:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b086e0510>
2026-01-28 20:07:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:07:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a23c743d-1f5c-5ce1-98dd-2048bdcb6fb9/a23c743d-1f5c-5ce1-98dd-2048bdcb6fb9_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252Fb4%252F4fb4ec31496439d2846b55a99cd2b5ae%252Fpa%252FBE15819_69c5116208e3fb39c0ced18172b315f1.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/b4/4fb4ec31496439d2846b55a99cd2b5ae/pa/BE15819_69c5116208e3fb39c0ced18172b315f1.jpg saved to cache
2026-01-28 20:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a23c743d-1f5c-5ce1-98dd-2048bdcb6fb9
2026-01-28 20:07:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NZ23957/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:07:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UR17754> (referer: https://www.auto1.com/v1/car-details-view/UR17754/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:07:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:07:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:07:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d7192c06-0e36-56c6-a32f-2d4e2f1bdf47 with identifier: UR17754
2026-01-28 20:07:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7192c06-0e36-56c6-a32f-2d4e2f1bdf47 with scrape type 1
2026-01-28 20:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item d7192c06-0e36-56c6-a32f-2d4e2f1bdf47
2026-01-28 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F7c%252Fe77cefab987ddf6386216d3d79646274%252Fpa%252FUR17754_ba3eeef20fbfc654c8e4868f69e1f50b.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/7c/e77cefab987ddf6386216d3d79646274/pa/UR17754_ba3eeef20fbfc654c8e4868f69e1f50b.jpg not downloaded yet
2026-01-28 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F7c%252Fe77cefab987ddf6386216d3d79646274%252Fpa%252FUR17754_0c41899a3708c81d44a7dacf2d30d3ed.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/7c/e77cefab987ddf6386216d3d79646274/pa/UR17754_0c41899a3708c81d44a7dacf2d30d3ed.jpg not downloaded yet
2026-01-28 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F7c%252Fe77cefab987ddf6386216d3d79646274%252Fpa%252FUR17754_b857512a9031802632b68f7e151add35.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/7c/e77cefab987ddf6386216d3d79646274/pa/UR17754_b857512a9031802632b68f7e151add35.jpg not downloaded yet
2026-01-28 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F7c%252Fe77cefab987ddf6386216d3d79646274%252Fpa%252FUR17754_666d2b11986a0f2b4d293b14321e30bd.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/7c/e77cefab987ddf6386216d3d79646274/pa/UR17754_666d2b11986a0f2b4d293b14321e30bd.jpg not downloaded yet
2026-01-28 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F7c%252Fe77cefab987ddf6386216d3d79646274%252Fpa%252FUR17754_c45050838884c0d69d645b4db9f6f5cb.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/7c/e77cefab987ddf6386216d3d79646274/pa/UR17754_c45050838884c0d69d645b4db9f6f5cb.jpg not downloaded yet
2026-01-28 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F7c%252Fe77cefab987ddf6386216d3d79646274%252Fpa%252FUR17754_b844599306f4f13de4bedb66f4f30fc1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/7c/e77cefab987ddf6386216d3d79646274/pa/UR17754_b844599306f4f13de4bedb66f4f30fc1.jpg not downloaded yet
2026-01-28 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F7c%252Fe77cefab987ddf6386216d3d79646274%252Fpa%252FUR17754_4a1aef38c192d80840fa4332cb96b66b.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/7c/e77cefab987ddf6386216d3d79646274/pa/UR17754_4a1aef38c192d80840fa4332cb96b66b.jpg not downloaded yet
2026-01-28 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F7c%252Fe77cefab987ddf6386216d3d79646274%252Fpa%252FUR17754_8741aa95e77398f0f8eb97b9628c8924.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/7c/e77cefab987ddf6386216d3d79646274/pa/UR17754_8741aa95e77398f0f8eb97b9628c8924.jpg not downloaded yet
2026-01-28 20:07:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KY70746/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F7c%252Fe77cefab987ddf6386216d3d79646274%252Fpa%252FUR17754_14fbd0c3d06f050ce61dae78fa673ec4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/7c/e77cefab987ddf6386216d3d79646274/pa/UR17754_14fbd0c3d06f050ce61dae78fa673ec4.jpg not downloaded yet
2026-01-28 20:07:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F7c%252Fe77cefab987ddf6386216d3d79646274%252Fpa%252FUR17754_361a2c45ec313aa43e0bcbdc78651e39.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/7c/e77cefab987ddf6386216d3d79646274/pa/UR17754_361a2c45ec313aa43e0bcbdc78651e39.jpg not downloaded yet
2026-01-28 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F7c%252Fe77cefab987ddf6386216d3d79646274%252Fpa%252FUR17754_f44b7157afb957c96d72e549676118a0.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/7c/e77cefab987ddf6386216d3d79646274/pa/UR17754_f44b7157afb957c96d72e549676118a0.jpg not downloaded yet
2026-01-28 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F7c%252Fe77cefab987ddf6386216d3d79646274%252Fpa%252FUR17754_76afffad44e67d204122313d62f53e61.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/7c/e77cefab987ddf6386216d3d79646274/pa/UR17754_76afffad44e67d204122313d62f53e61.jpg not downloaded yet
2026-01-28 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F7c%252Fe77cefab987ddf6386216d3d79646274%252Fpa%252FUR17754_a4e472ff049d44ca730afea3fd05edf1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/7c/e77cefab987ddf6386216d3d79646274/pa/UR17754_a4e472ff049d44ca730afea3fd05edf1.jpg not downloaded yet
2026-01-28 20:07:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RU07739/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F7c%252Fe77cefab987ddf6386216d3d79646274%252Fpa%252FUR17754_ea6dc3e85a5f8113036b629ab7e7adc0.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/7c/e77cefab987ddf6386216d3d79646274/pa/UR17754_ea6dc3e85a5f8113036b629ab7e7adc0.jpg not downloaded yet
2026-01-28 20:07:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:07:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/7c/e77cefab987ddf6386216d3d79646274/pa/UR17754_8741aa95e77398f0f8eb97b9628c8924.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F7c%252Fe77cefab987ddf6386216d3d79646274%252Fpa%252FUR17754_7bbc3236421f5940745eba70c96cebed.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/7c/e77cefab987ddf6386216d3d79646274/pa/UR17754_7bbc3236421f5940745eba70c96cebed.jpg not downloaded yet
2026-01-28 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F7c%252Fe77cefab987ddf6386216d3d79646274%252Fpa%252FUR17754_5889d2bf61b238577ab0c5a2b6289cf4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/7c/e77cefab987ddf6386216d3d79646274/pa/UR17754_5889d2bf61b238577ab0c5a2b6289cf4.jpg not downloaded yet
2026-01-28 20:07:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/7c/e77cefab987ddf6386216d3d79646274/pa/UR17754_a4e472ff049d44ca730afea3fd05edf1.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:07:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/7c/e77cefab987ddf6386216d3d79646274/pa/UR17754_ea6dc3e85a5f8113036b629ab7e7adc0.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:07:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b086e2ad0>
2026-01-28 20:07:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7192c06-0e36-56c6-a32f-2d4e2f1bdf47/d7192c06-0e36-56c6-a32f-2d4e2f1bdf47_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F7c%252Fe77cefab987ddf6386216d3d79646274%252Fpa%252FUR17754_8741aa95e77398f0f8eb97b9628c8924.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/7c/e77cefab987ddf6386216d3d79646274/pa/UR17754_8741aa95e77398f0f8eb97b9628c8924.jpg saved to cache
2026-01-28 20:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d7192c06-0e36-56c6-a32f-2d4e2f1bdf47
2026-01-28 20:07:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/7c/e77cefab987ddf6386216d3d79646274/pa/UR17754_5889d2bf61b238577ab0c5a2b6289cf4.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:07:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZZ39223> (referer: https://www.auto1.com/v1/car-details-view/ZZ39223/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:07:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:07:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NF45221> (referer: https://www.auto1.com/v1/car-details-view/NF45221/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:07:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:07:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0a038b90>
2026-01-28 20:07:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:07:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7192c06-0e36-56c6-a32f-2d4e2f1bdf47/d7192c06-0e36-56c6-a32f-2d4e2f1bdf47_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F7c%252Fe77cefab987ddf6386216d3d79646274%252Fpa%252FUR17754_a4e472ff049d44ca730afea3fd05edf1.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/7c/e77cefab987ddf6386216d3d79646274/pa/UR17754_a4e472ff049d44ca730afea3fd05edf1.jpg saved to cache
2026-01-28 20:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item d7192c06-0e36-56c6-a32f-2d4e2f1bdf47
2026-01-28 20:07:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08712c10>
2026-01-28 20:07:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:07:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7192c06-0e36-56c6-a32f-2d4e2f1bdf47/d7192c06-0e36-56c6-a32f-2d4e2f1bdf47_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F7c%252Fe77cefab987ddf6386216d3d79646274%252Fpa%252FUR17754_ea6dc3e85a5f8113036b629ab7e7adc0.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/7c/e77cefab987ddf6386216d3d79646274/pa/UR17754_ea6dc3e85a5f8113036b629ab7e7adc0.jpg saved to cache
2026-01-28 20:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item d7192c06-0e36-56c6-a32f-2d4e2f1bdf47
2026-01-28 20:07:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FP59077> (referer: https://www.auto1.com/v1/car-details-view/FP59077/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:07:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XP38725/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:07:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BS31038> (referer: https://www.auto1.com/v1/car-details-view/BS31038/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:07:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NS14568/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:07:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09e92190>
2026-01-28 20:07:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7192c06-0e36-56c6-a32f-2d4e2f1bdf47/d7192c06-0e36-56c6-a32f-2d4e2f1bdf47_image_15.jpg HTTP/1.1" 201 0
2026-01-28 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F7c%252Fe77cefab987ddf6386216d3d79646274%252Fpa%252FUR17754_5889d2bf61b238577ab0c5a2b6289cf4.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/7c/e77cefab987ddf6386216d3d79646274/pa/UR17754_5889d2bf61b238577ab0c5a2b6289cf4.jpg saved to cache
2026-01-28 20:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item d7192c06-0e36-56c6-a32f-2d4e2f1bdf47
2026-01-28 20:07:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d9b4efce-5b6b-54a8-bb83-1807fb2509d1 with identifier: ZZ39223
2026-01-28 20:07:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9b4efce-5b6b-54a8-bb83-1807fb2509d1 with scrape type 1
2026-01-28 20:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item d9b4efce-5b6b-54a8-bb83-1807fb2509d1
2026-01-28 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F37%252Fc3375b32fe3836e17b68c0ce46056e31%252Fpa%252FZZ39223_c32e3ec34d11c0179079a1a94dce0b0a.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/37/c3375b32fe3836e17b68c0ce46056e31/pa/ZZ39223_c32e3ec34d11c0179079a1a94dce0b0a.jpg already downloaded
2026-01-28 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F37%252Fc3375b32fe3836e17b68c0ce46056e31%252Fpa%252FZZ39223_413eff918b8dee61b29a3ec22595281d.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/37/c3375b32fe3836e17b68c0ce46056e31/pa/ZZ39223_413eff918b8dee61b29a3ec22595281d.jpg already downloaded
2026-01-28 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F37%252Fc3375b32fe3836e17b68c0ce46056e31%252Fpa%252FZZ39223_4f4e412b981d55470a65f2d5f8d83789.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/37/c3375b32fe3836e17b68c0ce46056e31/pa/ZZ39223_4f4e412b981d55470a65f2d5f8d83789.jpg already downloaded
2026-01-28 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F37%252Fc3375b32fe3836e17b68c0ce46056e31%252Fpa%252FZZ39223_1dfd76dd7aa57257ef18625b4a7465cd.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/37/c3375b32fe3836e17b68c0ce46056e31/pa/ZZ39223_1dfd76dd7aa57257ef18625b4a7465cd.jpg already downloaded
2026-01-28 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F37%252Fc3375b32fe3836e17b68c0ce46056e31%252Fpa%252FZZ39223_cae85eed5a162d984335f7f1ec88f625.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/37/c3375b32fe3836e17b68c0ce46056e31/pa/ZZ39223_cae85eed5a162d984335f7f1ec88f625.jpg already downloaded
2026-01-28 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F37%252Fc3375b32fe3836e17b68c0ce46056e31%252Fpa%252FZZ39223_6eb68af513fb94412ac61251337d1294.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/37/c3375b32fe3836e17b68c0ce46056e31/pa/ZZ39223_6eb68af513fb94412ac61251337d1294.jpg already downloaded
2026-01-28 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F37%252Fc3375b32fe3836e17b68c0ce46056e31%252Fpa%252FZZ39223_20d4a83d50bd95ca22da92cf4c5a4001.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/37/c3375b32fe3836e17b68c0ce46056e31/pa/ZZ39223_20d4a83d50bd95ca22da92cf4c5a4001.jpg already downloaded
2026-01-28 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F37%252Fc3375b32fe3836e17b68c0ce46056e31%252Fpa%252FZZ39223_f2cdf163d739d4aaa9995d818bd776d9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/37/c3375b32fe3836e17b68c0ce46056e31/pa/ZZ39223_f2cdf163d739d4aaa9995d818bd776d9.jpg already downloaded
2026-01-28 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F37%252Fc3375b32fe3836e17b68c0ce46056e31%252Fpa%252FZZ39223_d5f102fbaf864ef3a7246f955f93ec7b.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/37/c3375b32fe3836e17b68c0ce46056e31/pa/ZZ39223_d5f102fbaf864ef3a7246f955f93ec7b.jpg already downloaded
2026-01-28 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F37%252Fc3375b32fe3836e17b68c0ce46056e31%252Fpa%252FZZ39223_fb35a50a4c5fab073bb77ed87172a8fb.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/37/c3375b32fe3836e17b68c0ce46056e31/pa/ZZ39223_fb35a50a4c5fab073bb77ed87172a8fb.jpg already downloaded
2026-01-28 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F37%252Fc3375b32fe3836e17b68c0ce46056e31%252Fpa%252FZZ39223_215b6cd5c172637983e79a6af5b23545.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/37/c3375b32fe3836e17b68c0ce46056e31/pa/ZZ39223_215b6cd5c172637983e79a6af5b23545.jpg already downloaded
2026-01-28 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F37%252Fc3375b32fe3836e17b68c0ce46056e31%252Fpa%252FZZ39223_a16cf0b2d961b54dec944d6a850b4919.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/37/c3375b32fe3836e17b68c0ce46056e31/pa/ZZ39223_a16cf0b2d961b54dec944d6a850b4919.jpg already downloaded
2026-01-28 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F37%252Fc3375b32fe3836e17b68c0ce46056e31%252Fpa%252FZZ39223_4aae849e96f79c14daa61f4d4e52b310.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/37/c3375b32fe3836e17b68c0ce46056e31/pa/ZZ39223_4aae849e96f79c14daa61f4d4e52b310.jpg already downloaded
2026-01-28 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F37%252Fc3375b32fe3836e17b68c0ce46056e31%252Fpa%252FZZ39223_078beddc5586e73727200027c6d8a50b.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/37/c3375b32fe3836e17b68c0ce46056e31/pa/ZZ39223_078beddc5586e73727200027c6d8a50b.jpg already downloaded
2026-01-28 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F37%252Fc3375b32fe3836e17b68c0ce46056e31%252Fpa%252FZZ39223_d70793aa61bbf03683d6974a3d48509b.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/37/c3375b32fe3836e17b68c0ce46056e31/pa/ZZ39223_d70793aa61bbf03683d6974a3d48509b.jpg already downloaded
2026-01-28 20:07:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d9b4efce-5b6b-54a8-bb83-1807fb2509d1, identifier: ZZ39223
2026-01-28 20:07:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1c76bfc3-aa3f-5a5b-8de3-2981365773c8 with identifier: NF45221
2026-01-28 20:07:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c76bfc3-aa3f-5a5b-8de3-2981365773c8 with scrape type 2
2026-01-28 20:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1c76bfc3-aa3f-5a5b-8de3-2981365773c8 with scrape type 2
2026-01-28 20:07:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1c76bfc3-aa3f-5a5b-8de3-2981365773c8, identifier: NF45221
2026-01-28 20:07:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:07:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:07:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:07:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:07:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d9b4efce-5b6b-54a8-bb83-1807fb2509d1 with identifier: ZZ39223
2026-01-28 20:07:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d9b4efce-5b6b-54a8-bb83-1807fb2509d1 with identifier: ZZ39223
2026-01-28 20:07:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d9b4efce-5b6b-54a8-bb83-1807fb2509d1 with identifier: ZZ39223 to the API
2026-01-28 20:07:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:07:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:07:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZZ39223>
{'auction_title': '',
 'c_o_2_emission_value': 224,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '2.0L',
 'engine_horse_power': 143,
 'expiration_date': '2026-01-29T16:44:17Z',
 'fuel_type': 'diesel',
 'id': 'd9b4efce-5b6b-54a8-bb83-1807fb2509d1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZZ39223',
 'listing': 'auction',
 'location': 'IT, Reggio Emilia',
 'make': 'GWM',
 'model': 'H6',
 'odometer': 19963,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgc3/37/c3375b32fe3836e17b68c0ce46056e31/pa/ZZ39223_c32e3ec34d11c0179079a1a94dce0b0a.jpg',
                'https://img-pa.auto1.com/imgc3/37/c3375b32fe3836e17b68c0ce46056e31/pa/ZZ39223_413eff918b8dee61b29a3ec22595281d.jpg',
                'https://img-pa.auto1.com/imgc3/37/c3375b32fe3836e17b68c0ce46056e31/pa/ZZ39223_4f4e412b981d55470a65f2d5f8d83789.jpg',
                'https://img-pa.auto1.com/imgc3/37/c3375b32fe3836e17b68c0ce46056e31/pa/ZZ39223_1dfd76dd7aa57257ef18625b4a7465cd.jpg',
                'https://img-pa.auto1.com/imgc3/37/c3375b32fe3836e17b68c0ce46056e31/pa/ZZ39223_cae85eed5a162d984335f7f1ec88f625.jpg',
                'https://img-pa.auto1.com/imgc3/37/c3375b32fe3836e17b68c0ce46056e31/pa/ZZ39223_6eb68af513fb94412ac61251337d1294.jpg',
                'https://img-pa.auto1.com/imgc3/37/c3375b32fe3836e17b68c0ce46056e31/pa/ZZ39223_20d4a83d50bd95ca22da92cf4c5a4001.jpg',
                'https://img-pa.auto1.com/imgc3/37/c3375b32fe3836e17b68c0ce46056e31/pa/ZZ39223_f2cdf163d739d4aaa9995d818bd776d9.jpg',
                'https://img-pa.auto1.com/imgc3/37/c3375b32fe3836e17b68c0ce46056e31/pa/ZZ39223_d5f102fbaf864ef3a7246f955f93ec7b.jpg',
                'https://img-pa.auto1.com/imgc3/37/c3375b32fe3836e17b68c0ce46056e31/pa/ZZ39223_fb35a50a4c5fab073bb77ed87172a8fb.jpg',
                'https://img-pa.auto1.com/imgc3/37/c3375b32fe3836e17b68c0ce46056e31/pa/ZZ39223_215b6cd5c172637983e79a6af5b23545.jpg',
                'https://img-pa.auto1.com/imgc3/37/c3375b32fe3836e17b68c0ce46056e31/pa/ZZ39223_a16cf0b2d961b54dec944d6a850b4919.jpg',
                'https://img-pa.auto1.com/imgc3/37/c3375b32fe3836e17b68c0ce46056e31/pa/ZZ39223_4aae849e96f79c14daa61f4d4e52b310.jpg',
                'https://img-pa.auto1.com/imgc3/37/c3375b32fe3836e17b68c0ce46056e31/pa/ZZ39223_078beddc5586e73727200027c6d8a50b.jpg',
                'https://img-pa.auto1.com/imgc3/37/c3375b32fe3836e17b68c0ce46056e31/pa/ZZ39223_d70793aa61bbf03683d6974a3d48509b.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9b4efce-5b6b-54a8-bb83-1807fb2509d1/d9b4efce-5b6b-54a8-bb83-1807fb2509d1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2463867,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/37/c3375b32fe3836e17b68c0ce46056e31/pa/ZZ39223_c32e3ec34d11c0179079a1a94dce0b0a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9b4efce-5b6b-54a8-bb83-1807fb2509d1/d9b4efce-5b6b-54a8-bb83-1807fb2509d1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2541312,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/37/c3375b32fe3836e17b68c0ce46056e31/pa/ZZ39223_413eff918b8dee61b29a3ec22595281d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9b4efce-5b6b-54a8-bb83-1807fb2509d1/d9b4efce-5b6b-54a8-bb83-1807fb2509d1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2351684,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/37/c3375b32fe3836e17b68c0ce46056e31/pa/ZZ39223_4f4e412b981d55470a65f2d5f8d83789.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9b4efce-5b6b-54a8-bb83-1807fb2509d1/d9b4efce-5b6b-54a8-bb83-1807fb2509d1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2108944,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/37/c3375b32fe3836e17b68c0ce46056e31/pa/ZZ39223_1dfd76dd7aa57257ef18625b4a7465cd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9b4efce-5b6b-54a8-bb83-1807fb2509d1/d9b4efce-5b6b-54a8-bb83-1807fb2509d1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2223154,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/37/c3375b32fe3836e17b68c0ce46056e31/pa/ZZ39223_cae85eed5a162d984335f7f1ec88f625.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9b4efce-5b6b-54a8-bb83-1807fb2509d1/d9b4efce-5b6b-54a8-bb83-1807fb2509d1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2507551,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/37/c3375b32fe3836e17b68c0ce46056e31/pa/ZZ39223_6eb68af513fb94412ac61251337d1294.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9b4efce-5b6b-54a8-bb83-1807fb2509d1/d9b4efce-5b6b-54a8-bb83-1807fb2509d1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2160357,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/37/c3375b32fe3836e17b68c0ce46056e31/pa/ZZ39223_20d4a83d50bd95ca22da92cf4c5a4001.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9b4efce-5b6b-54a8-bb83-1807fb2509d1/d9b4efce-5b6b-54a8-bb83-1807fb2509d1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2469057,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/37/c3375b32fe3836e17b68c0ce46056e31/pa/ZZ39223_f2cdf163d739d4aaa9995d818bd776d9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9b4efce-5b6b-54a8-bb83-1807fb2509d1/d9b4efce-5b6b-54a8-bb83-1807fb2509d1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2442834,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/37/c3375b32fe3836e17b68c0ce46056e31/pa/ZZ39223_d5f102fbaf864ef3a7246f955f93ec7b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9b4efce-5b6b-54a8-bb83-1807fb2509d1/d9b4efce-5b6b-54a8-bb83-1807fb2509d1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2564550,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/37/c3375b32fe3836e17b68c0ce46056e31/pa/ZZ39223_fb35a50a4c5fab073bb77ed87172a8fb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9b4efce-5b6b-54a8-bb83-1807fb2509d1/d9b4efce-5b6b-54a8-bb83-1807fb2509d1_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2701435,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/37/c3375b32fe3836e17b68c0ce46056e31/pa/ZZ39223_215b6cd5c172637983e79a6af5b23545.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9b4efce-5b6b-54a8-bb83-1807fb2509d1/d9b4efce-5b6b-54a8-bb83-1807fb2509d1_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2671071,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/37/c3375b32fe3836e17b68c0ce46056e31/pa/ZZ39223_a16cf0b2d961b54dec944d6a850b4919.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9b4efce-5b6b-54a8-bb83-1807fb2509d1/d9b4efce-5b6b-54a8-bb83-1807fb2509d1_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2659342,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/37/c3375b32fe3836e17b68c0ce46056e31/pa/ZZ39223_4aae849e96f79c14daa61f4d4e52b310.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9b4efce-5b6b-54a8-bb83-1807fb2509d1/d9b4efce-5b6b-54a8-bb83-1807fb2509d1_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2425165,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/37/c3375b32fe3836e17b68c0ce46056e31/pa/ZZ39223_078beddc5586e73727200027c6d8a50b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9b4efce-5b6b-54a8-bb83-1807fb2509d1/d9b4efce-5b6b-54a8-bb83-1807fb2509d1_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44548,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/37/c3375b32fe3836e17b68c0ce46056e31/pa/ZZ39223_d70793aa61bbf03683d6974a3d48509b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2025-01-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'GWM H6 2.0 Turbodiesel Premium 4WD',
 'transmission': 'manual',
 'trim': 'Premium 4WD',
 'year': 2025}
2026-01-28 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZZ39223%27 HTTP/1.1" 200 None
2026-01-28 20:07:03 [auto1.it] INFO: Saving data for ZZ39223: {'created_time': 1769630823.876612, 'last_price_update_time': 1769630823.876622, 'auction_closing_time': 1769705057.0}
2026-01-28 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZZ39223') HTTP/1.1" 204 0
2026-01-28 20:07:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1c76bfc3-aa3f-5a5b-8de3-2981365773c8 with identifier: NF45221
2026-01-28 20:07:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1c76bfc3-aa3f-5a5b-8de3-2981365773c8 with identifier: NF45221
2026-01-28 20:07:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1c76bfc3-aa3f-5a5b-8de3-2981365773c8 with identifier: NF45221 to the API
2026-01-28 20:07:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:07:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:07:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NF45221>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 180,
 'expiration_date': '2026-01-29T16:55:54Z',
 'fuel_type': 'diesel',
 'id': '1c76bfc3-aa3f-5a5b-8de3-2981365773c8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NF45221',
 'listing': 'auction',
 'location': 'IT, Milano',
 'make': 'DS Automobiles',
 'model': 'DS7 Crossback',
 'odometer': 135770,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-12-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DS Automobiles DS7 Crossback 2.0 Blue-HDi Business Line',
 'transmission': 'automatic',
 'trim': 'Business Line',
 'year': 2019}
2026-01-28 20:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NF45221%27 HTTP/1.1" 200 None
2026-01-28 20:07:04 [auto1.it] INFO: Saving data for NF45221: {'auction_closing_time': 1769705754.0, 'created_time': 1767816707.632988, 'last_price_update_time': 1769630824.287512}
2026-01-28 20:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NF45221') HTTP/1.1" 204 0
2026-01-28 20:07:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/7c/e77cefab987ddf6386216d3d79646274/pa/UR17754_76afffad44e67d204122313d62f53e61.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:07:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/7c/e77cefab987ddf6386216d3d79646274/pa/UR17754_7bbc3236421f5940745eba70c96cebed.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:07:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SU23914/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:07:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea32b545-f686-5edc-8f58-05785cbb0745 with identifier: FP59077
2026-01-28 20:07:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea32b545-f686-5edc-8f58-05785cbb0745 with scrape type 2
2026-01-28 20:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ea32b545-f686-5edc-8f58-05785cbb0745 with scrape type 2
2026-01-28 20:07:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ea32b545-f686-5edc-8f58-05785cbb0745, identifier: FP59077
2026-01-28 20:07:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e87b374-9fae-502c-bbc7-43b963f69ad6 with identifier: BS31038
2026-01-28 20:07:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e87b374-9fae-502c-bbc7-43b963f69ad6 with scrape type 2
2026-01-28 20:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0e87b374-9fae-502c-bbc7-43b963f69ad6 with scrape type 2
2026-01-28 20:07:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0e87b374-9fae-502c-bbc7-43b963f69ad6, identifier: BS31038
2026-01-28 20:07:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:07:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ea32b545-f686-5edc-8f58-05785cbb0745 with identifier: FP59077
2026-01-28 20:07:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ea32b545-f686-5edc-8f58-05785cbb0745 with identifier: FP59077
2026-01-28 20:07:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ea32b545-f686-5edc-8f58-05785cbb0745 with identifier: FP59077 to the API
2026-01-28 20:07:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:07:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:07:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FP59077>
{'auction_title': '',
 'c_o_2_emission_value': 190,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '3.0L',
 'engine_horse_power': 286,
 'expiration_date': '2026-01-29T16:48:54Z',
 'fuel_type': 'diesel',
 'id': 'ea32b545-f686-5edc-8f58-05785cbb0745',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FP59077',
 'listing': 'auction',
 'location': 'IT, Varedo (MB)',
 'make': 'BMW',
 'model': 'X5',
 'odometer': 113623,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-01-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X5 xDrive 30d Mild-Hybrid M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2021}
2026-01-28 20:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FP59077%27 HTTP/1.1" 200 None
2026-01-28 20:07:04 [auto1.it] INFO: Saving data for FP59077: {'auction_closing_time': 1769705334.0, 'created_time': 1768471398.767026, 'last_price_update_time': 1769630824.880714}
2026-01-28 20:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FP59077') HTTP/1.1" 204 0
2026-01-28 20:07:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0e87b374-9fae-502c-bbc7-43b963f69ad6 with identifier: BS31038
2026-01-28 20:07:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0e87b374-9fae-502c-bbc7-43b963f69ad6 with identifier: BS31038
2026-01-28 20:07:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0e87b374-9fae-502c-bbc7-43b963f69ad6 with identifier: BS31038 to the API
2026-01-28 20:07:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:07:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:07:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BS31038>
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.6L',
 'engine_horse_power': 143,
 'expiration_date': '2026-01-29T16:28:24Z',
 'fuel_type': 'hybrid',
 'id': '0e87b374-9fae-502c-bbc7-43b963f69ad6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BS31038',
 'listing': 'auction',
 'location': 'IT, Roma',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 42400,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-05-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Captur 1.6 Hybrid E-Tech Intens',
 'transmission': 'automatic',
 'trim': 'Intens',
 'year': 2022}
2026-01-28 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BS31038%27 HTTP/1.1" 200 None
2026-01-28 20:07:05 [auto1.it] INFO: Saving data for BS31038: {'auction_closing_time': 1769704104.0, 'created_time': 1768507416.406153, 'last_price_update_time': 1769630825.25017}
2026-01-28 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BS31038') HTTP/1.1" 204 0
2026-01-28 20:07:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/7c/e77cefab987ddf6386216d3d79646274/pa/UR17754_14fbd0c3d06f050ce61dae78fa673ec4.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:07:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/7c/e77cefab987ddf6386216d3d79646274/pa/UR17754_4a1aef38c192d80840fa4332cb96b66b.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:07:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/7c/e77cefab987ddf6386216d3d79646274/pa/UR17754_361a2c45ec313aa43e0bcbdc78651e39.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:07:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/7c/e77cefab987ddf6386216d3d79646274/pa/UR17754_b844599306f4f13de4bedb66f4f30fc1.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:07:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/7c/e77cefab987ddf6386216d3d79646274/pa/UR17754_f44b7157afb957c96d72e549676118a0.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:07:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/7c/e77cefab987ddf6386216d3d79646274/pa/UR17754_c45050838884c0d69d645b4db9f6f5cb.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:07:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08cf60d0>
2026-01-28 20:07:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7192c06-0e36-56c6-a32f-2d4e2f1bdf47/d7192c06-0e36-56c6-a32f-2d4e2f1bdf47_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F7c%252Fe77cefab987ddf6386216d3d79646274%252Fpa%252FUR17754_76afffad44e67d204122313d62f53e61.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/7c/e77cefab987ddf6386216d3d79646274/pa/UR17754_76afffad44e67d204122313d62f53e61.jpg saved to cache
2026-01-28 20:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item d7192c06-0e36-56c6-a32f-2d4e2f1bdf47
2026-01-28 20:07:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0a0ce710>
2026-01-28 20:07:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:07:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7192c06-0e36-56c6-a32f-2d4e2f1bdf47/d7192c06-0e36-56c6-a32f-2d4e2f1bdf47_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F7c%252Fe77cefab987ddf6386216d3d79646274%252Fpa%252FUR17754_7bbc3236421f5940745eba70c96cebed.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/7c/e77cefab987ddf6386216d3d79646274/pa/UR17754_7bbc3236421f5940745eba70c96cebed.jpg saved to cache
2026-01-28 20:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item d7192c06-0e36-56c6-a32f-2d4e2f1bdf47
2026-01-28 20:07:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/7c/e77cefab987ddf6386216d3d79646274/pa/UR17754_666d2b11986a0f2b4d293b14321e30bd.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:07:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/7c/e77cefab987ddf6386216d3d79646274/pa/UR17754_b857512a9031802632b68f7e151add35.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:07:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08c8fed0>
2026-01-28 20:07:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:07:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7192c06-0e36-56c6-a32f-2d4e2f1bdf47/d7192c06-0e36-56c6-a32f-2d4e2f1bdf47_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F7c%252Fe77cefab987ddf6386216d3d79646274%252Fpa%252FUR17754_14fbd0c3d06f050ce61dae78fa673ec4.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/7c/e77cefab987ddf6386216d3d79646274/pa/UR17754_14fbd0c3d06f050ce61dae78fa673ec4.jpg saved to cache
2026-01-28 20:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d7192c06-0e36-56c6-a32f-2d4e2f1bdf47
2026-01-28 20:07:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08cefed0>
2026-01-28 20:07:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:07:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7192c06-0e36-56c6-a32f-2d4e2f1bdf47/d7192c06-0e36-56c6-a32f-2d4e2f1bdf47_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F7c%252Fe77cefab987ddf6386216d3d79646274%252Fpa%252FUR17754_4a1aef38c192d80840fa4332cb96b66b.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/7c/e77cefab987ddf6386216d3d79646274/pa/UR17754_4a1aef38c192d80840fa4332cb96b66b.jpg saved to cache
2026-01-28 20:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d7192c06-0e36-56c6-a32f-2d4e2f1bdf47
2026-01-28 20:07:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09fc3410>
2026-01-28 20:07:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:07:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7192c06-0e36-56c6-a32f-2d4e2f1bdf47/d7192c06-0e36-56c6-a32f-2d4e2f1bdf47_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F7c%252Fe77cefab987ddf6386216d3d79646274%252Fpa%252FUR17754_361a2c45ec313aa43e0bcbdc78651e39.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/7c/e77cefab987ddf6386216d3d79646274/pa/UR17754_361a2c45ec313aa43e0bcbdc78651e39.jpg saved to cache
2026-01-28 20:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d7192c06-0e36-56c6-a32f-2d4e2f1bdf47
2026-01-28 20:07:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08b01890>
2026-01-28 20:07:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:07:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7192c06-0e36-56c6-a32f-2d4e2f1bdf47/d7192c06-0e36-56c6-a32f-2d4e2f1bdf47_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F7c%252Fe77cefab987ddf6386216d3d79646274%252Fpa%252FUR17754_b844599306f4f13de4bedb66f4f30fc1.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/7c/e77cefab987ddf6386216d3d79646274/pa/UR17754_b844599306f4f13de4bedb66f4f30fc1.jpg saved to cache
2026-01-28 20:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d7192c06-0e36-56c6-a32f-2d4e2f1bdf47
2026-01-28 20:07:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08b2d8d0>
2026-01-28 20:07:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7192c06-0e36-56c6-a32f-2d4e2f1bdf47/d7192c06-0e36-56c6-a32f-2d4e2f1bdf47_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F7c%252Fe77cefab987ddf6386216d3d79646274%252Fpa%252FUR17754_f44b7157afb957c96d72e549676118a0.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/7c/e77cefab987ddf6386216d3d79646274/pa/UR17754_f44b7157afb957c96d72e549676118a0.jpg saved to cache
2026-01-28 20:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item d7192c06-0e36-56c6-a32f-2d4e2f1bdf47
2026-01-28 20:07:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b088e0fd0>
2026-01-28 20:07:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7192c06-0e36-56c6-a32f-2d4e2f1bdf47/d7192c06-0e36-56c6-a32f-2d4e2f1bdf47_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F7c%252Fe77cefab987ddf6386216d3d79646274%252Fpa%252FUR17754_c45050838884c0d69d645b4db9f6f5cb.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/7c/e77cefab987ddf6386216d3d79646274/pa/UR17754_c45050838884c0d69d645b4db9f6f5cb.jpg saved to cache
2026-01-28 20:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d7192c06-0e36-56c6-a32f-2d4e2f1bdf47
2026-01-28 20:07:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ME44881/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:07:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/7c/e77cefab987ddf6386216d3d79646274/pa/UR17754_0c41899a3708c81d44a7dacf2d30d3ed.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:07:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/7c/e77cefab987ddf6386216d3d79646274/pa/UR17754_ba3eeef20fbfc654c8e4868f69e1f50b.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:07:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:07:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FC65085> (referer: https://www.auto1.com/v1/car-details-view/FC65085/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:07:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RU07739> (referer: https://www.auto1.com/v1/car-details-view/RU07739/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:07:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VV63858> (referer: https://www.auto1.com/v1/car-details-view/VV63858/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:07:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GA26401> (referer: https://www.auto1.com/v1/car-details-view/GA26401/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:07:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GV88147/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:07:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZS31369> (referer: https://www.auto1.com/v1/car-details-view/ZS31369/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:07:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08b8b0d0>
2026-01-28 20:07:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:07:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7192c06-0e36-56c6-a32f-2d4e2f1bdf47/d7192c06-0e36-56c6-a32f-2d4e2f1bdf47_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F7c%252Fe77cefab987ddf6386216d3d79646274%252Fpa%252FUR17754_666d2b11986a0f2b4d293b14321e30bd.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/7c/e77cefab987ddf6386216d3d79646274/pa/UR17754_666d2b11986a0f2b4d293b14321e30bd.jpg saved to cache
2026-01-28 20:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d7192c06-0e36-56c6-a32f-2d4e2f1bdf47
2026-01-28 20:07:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09e3c5d0>
2026-01-28 20:07:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:07:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7192c06-0e36-56c6-a32f-2d4e2f1bdf47/d7192c06-0e36-56c6-a32f-2d4e2f1bdf47_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F7c%252Fe77cefab987ddf6386216d3d79646274%252Fpa%252FUR17754_b857512a9031802632b68f7e151add35.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/7c/e77cefab987ddf6386216d3d79646274/pa/UR17754_b857512a9031802632b68f7e151add35.jpg saved to cache
2026-01-28 20:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d7192c06-0e36-56c6-a32f-2d4e2f1bdf47
2026-01-28 20:07:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:07:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:07:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:07:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:07:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:07:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:07:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08c4f450>
2026-01-28 20:07:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:07:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7192c06-0e36-56c6-a32f-2d4e2f1bdf47/d7192c06-0e36-56c6-a32f-2d4e2f1bdf47_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F7c%252Fe77cefab987ddf6386216d3d79646274%252Fpa%252FUR17754_0c41899a3708c81d44a7dacf2d30d3ed.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/7c/e77cefab987ddf6386216d3d79646274/pa/UR17754_0c41899a3708c81d44a7dacf2d30d3ed.jpg saved to cache
2026-01-28 20:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d7192c06-0e36-56c6-a32f-2d4e2f1bdf47
2026-01-28 20:07:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08c7b650>
2026-01-28 20:07:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7192c06-0e36-56c6-a32f-2d4e2f1bdf47/d7192c06-0e36-56c6-a32f-2d4e2f1bdf47_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F7c%252Fe77cefab987ddf6386216d3d79646274%252Fpa%252FUR17754_ba3eeef20fbfc654c8e4868f69e1f50b.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/7c/e77cefab987ddf6386216d3d79646274/pa/UR17754_ba3eeef20fbfc654c8e4868f69e1f50b.jpg saved to cache
2026-01-28 20:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d7192c06-0e36-56c6-a32f-2d4e2f1bdf47
2026-01-28 20:07:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d7192c06-0e36-56c6-a32f-2d4e2f1bdf47, skipping ID generation
2026-01-28 20:07:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7192c06-0e36-56c6-a32f-2d4e2f1bdf47 with scrape type 1
2026-01-28 20:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Removing item d7192c06-0e36-56c6-a32f-2d4e2f1bdf47 from tracking dictionaries
2026-01-28 20:07:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d7192c06-0e36-56c6-a32f-2d4e2f1bdf47 sending to next pipeline
2026-01-28 20:07:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d7192c06-0e36-56c6-a32f-2d4e2f1bdf47, identifier: UR17754
2026-01-28 20:07:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5dd64f3-1cdf-56ec-90a4-fe3871df7bf4 with identifier: FC65085
2026-01-28 20:07:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5dd64f3-1cdf-56ec-90a4-fe3871df7bf4 with scrape type 2
2026-01-28 20:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c5dd64f3-1cdf-56ec-90a4-fe3871df7bf4 with scrape type 2
2026-01-28 20:07:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c5dd64f3-1cdf-56ec-90a4-fe3871df7bf4, identifier: FC65085
2026-01-28 20:07:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd948979-429a-5345-950d-a71727b89247 with identifier: RU07739
2026-01-28 20:07:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd948979-429a-5345-950d-a71727b89247 with scrape type 2
2026-01-28 20:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cd948979-429a-5345-950d-a71727b89247 with scrape type 2
2026-01-28 20:07:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: cd948979-429a-5345-950d-a71727b89247, identifier: RU07739
2026-01-28 20:07:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c3bf9b1-7456-5718-91f2-07826bbe40cb with identifier: VV63858
2026-01-28 20:07:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c3bf9b1-7456-5718-91f2-07826bbe40cb with scrape type 1
2026-01-28 20:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 5c3bf9b1-7456-5718-91f2-07826bbe40cb
2026-01-28 20:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F42%252F9a42b39ba497c7b44d7d4c90c0bf2747%252Fpa%252FVV63858_b6824a848a7696447c2afce5aa18f7d2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/42/9a42b39ba497c7b44d7d4c90c0bf2747/pa/VV63858_b6824a848a7696447c2afce5aa18f7d2.jpg already downloaded
2026-01-28 20:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F42%252F9a42b39ba497c7b44d7d4c90c0bf2747%252Fpa%252FVV63858_decb6bffa1892af922ceca4358f072df.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/42/9a42b39ba497c7b44d7d4c90c0bf2747/pa/VV63858_decb6bffa1892af922ceca4358f072df.jpg already downloaded
2026-01-28 20:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F42%252F9a42b39ba497c7b44d7d4c90c0bf2747%252Fpa%252FVV63858_88aef2d181dfeee8f999b3684d2b7c38.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/42/9a42b39ba497c7b44d7d4c90c0bf2747/pa/VV63858_88aef2d181dfeee8f999b3684d2b7c38.jpg already downloaded
2026-01-28 20:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F42%252F9a42b39ba497c7b44d7d4c90c0bf2747%252Fpa%252FVV63858_0b09179ce5e80e8e850e644fd342dba8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/42/9a42b39ba497c7b44d7d4c90c0bf2747/pa/VV63858_0b09179ce5e80e8e850e644fd342dba8.jpg already downloaded
2026-01-28 20:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F42%252F9a42b39ba497c7b44d7d4c90c0bf2747%252Fpa%252FVV63858_f475e2b8766c89267726fd1997c2223c.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/42/9a42b39ba497c7b44d7d4c90c0bf2747/pa/VV63858_f475e2b8766c89267726fd1997c2223c.jpg already downloaded
2026-01-28 20:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F42%252F9a42b39ba497c7b44d7d4c90c0bf2747%252Fpa%252FVV63858_778ea458e48d70077545fef87c38942f.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/42/9a42b39ba497c7b44d7d4c90c0bf2747/pa/VV63858_778ea458e48d70077545fef87c38942f.jpg already downloaded
2026-01-28 20:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F42%252F9a42b39ba497c7b44d7d4c90c0bf2747%252Fpa%252FVV63858_6c5ef460b1e85bf1ffcbc061fc7ba87f.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/42/9a42b39ba497c7b44d7d4c90c0bf2747/pa/VV63858_6c5ef460b1e85bf1ffcbc061fc7ba87f.jpg already downloaded
2026-01-28 20:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F42%252F9a42b39ba497c7b44d7d4c90c0bf2747%252Fpa%252FVV63858_b4d65a4d2616fb3c64b66bfad4ac07b0.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/42/9a42b39ba497c7b44d7d4c90c0bf2747/pa/VV63858_b4d65a4d2616fb3c64b66bfad4ac07b0.jpg already downloaded
2026-01-28 20:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F42%252F9a42b39ba497c7b44d7d4c90c0bf2747%252Fpa%252FVV63858_d883106e185b15083b24a0365485b111.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/42/9a42b39ba497c7b44d7d4c90c0bf2747/pa/VV63858_d883106e185b15083b24a0365485b111.jpg already downloaded
2026-01-28 20:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F42%252F9a42b39ba497c7b44d7d4c90c0bf2747%252Fpa%252FVV63858_00898ebe6f256960eb4d221f800bdeef.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/42/9a42b39ba497c7b44d7d4c90c0bf2747/pa/VV63858_00898ebe6f256960eb4d221f800bdeef.jpg already downloaded
2026-01-28 20:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F42%252F9a42b39ba497c7b44d7d4c90c0bf2747%252Fpa%252FVV63858_c1c9d012ff5e9f0cc5c9f0ca139c840c.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/42/9a42b39ba497c7b44d7d4c90c0bf2747/pa/VV63858_c1c9d012ff5e9f0cc5c9f0ca139c840c.jpg already downloaded
2026-01-28 20:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F42%252F9a42b39ba497c7b44d7d4c90c0bf2747%252Fpa%252FVV63858_2776a9ac3400c102f4f5d6668a6cd97e.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/42/9a42b39ba497c7b44d7d4c90c0bf2747/pa/VV63858_2776a9ac3400c102f4f5d6668a6cd97e.jpg already downloaded
2026-01-28 20:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F42%252F9a42b39ba497c7b44d7d4c90c0bf2747%252Fpa%252FVV63858_c5d014a2553193af09d28b9aeef939e6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/42/9a42b39ba497c7b44d7d4c90c0bf2747/pa/VV63858_c5d014a2553193af09d28b9aeef939e6.jpg already downloaded
2026-01-28 20:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F42%252F9a42b39ba497c7b44d7d4c90c0bf2747%252Fpa%252FVV63858_9a533f5fde0169558946b2c9d0ecea4b.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/42/9a42b39ba497c7b44d7d4c90c0bf2747/pa/VV63858_9a533f5fde0169558946b2c9d0ecea4b.jpg already downloaded
2026-01-28 20:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F42%252F9a42b39ba497c7b44d7d4c90c0bf2747%252Fpa%252FVV63858_48b52d5645ff698a578a9753d9df6572.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/42/9a42b39ba497c7b44d7d4c90c0bf2747/pa/VV63858_48b52d5645ff698a578a9753d9df6572.jpg already downloaded
2026-01-28 20:07:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5c3bf9b1-7456-5718-91f2-07826bbe40cb, identifier: VV63858
2026-01-28 20:07:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 56914c2c-5778-593b-9361-da63608d5adf with identifier: GA26401
2026-01-28 20:07:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56914c2c-5778-593b-9361-da63608d5adf with scrape type 1
2026-01-28 20:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 56914c2c-5778-593b-9361-da63608d5adf
2026-01-28 20:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Feb%252F0bebcff2ba9efb92d9f1924da3eb4f49%252Fpa%252FGA26401_abae2b464464c8638bb4d3aa8309185c.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/eb/0bebcff2ba9efb92d9f1924da3eb4f49/pa/GA26401_abae2b464464c8638bb4d3aa8309185c.jpg already downloaded
2026-01-28 20:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Feb%252F0bebcff2ba9efb92d9f1924da3eb4f49%252Fpa%252FGA26401_756c0ec66e22d42d2a1a44ef175746dc.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/eb/0bebcff2ba9efb92d9f1924da3eb4f49/pa/GA26401_756c0ec66e22d42d2a1a44ef175746dc.jpg already downloaded
2026-01-28 20:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Feb%252F0bebcff2ba9efb92d9f1924da3eb4f49%252Fpa%252FGA26401_def824d2e4617fa089bd891c55aa76fa.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/eb/0bebcff2ba9efb92d9f1924da3eb4f49/pa/GA26401_def824d2e4617fa089bd891c55aa76fa.jpg already downloaded
2026-01-28 20:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Feb%252F0bebcff2ba9efb92d9f1924da3eb4f49%252Fpa%252FGA26401_9f12a93129456a23b308ee297b01a67f.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/eb/0bebcff2ba9efb92d9f1924da3eb4f49/pa/GA26401_9f12a93129456a23b308ee297b01a67f.jpg already downloaded
2026-01-28 20:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Feb%252F0bebcff2ba9efb92d9f1924da3eb4f49%252Fpa%252FGA26401_6695cb76c7fa9f49d0c19830f48a5b2b.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/eb/0bebcff2ba9efb92d9f1924da3eb4f49/pa/GA26401_6695cb76c7fa9f49d0c19830f48a5b2b.jpg already downloaded
2026-01-28 20:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Feb%252F0bebcff2ba9efb92d9f1924da3eb4f49%252Fpa%252FGA26401_ef7297276a189a91920257167c87e335.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/eb/0bebcff2ba9efb92d9f1924da3eb4f49/pa/GA26401_ef7297276a189a91920257167c87e335.jpg already downloaded
2026-01-28 20:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Feb%252F0bebcff2ba9efb92d9f1924da3eb4f49%252Fpa%252FGA26401_68b5022afd77c6fe7f68ca3cd46fb8df.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/eb/0bebcff2ba9efb92d9f1924da3eb4f49/pa/GA26401_68b5022afd77c6fe7f68ca3cd46fb8df.jpg already downloaded
2026-01-28 20:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Feb%252F0bebcff2ba9efb92d9f1924da3eb4f49%252Fpa%252FGA26401_80bbee901d82d7ab214fd46eb1f136d3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/eb/0bebcff2ba9efb92d9f1924da3eb4f49/pa/GA26401_80bbee901d82d7ab214fd46eb1f136d3.jpg already downloaded
2026-01-28 20:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Feb%252F0bebcff2ba9efb92d9f1924da3eb4f49%252Fpa%252FGA26401_b31efeaa6a3ff92d87c8edd4a9696819.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/eb/0bebcff2ba9efb92d9f1924da3eb4f49/pa/GA26401_b31efeaa6a3ff92d87c8edd4a9696819.jpg already downloaded
2026-01-28 20:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Feb%252F0bebcff2ba9efb92d9f1924da3eb4f49%252Fpa%252FGA26401_ea8f55048b7ff449c9382603a7498309.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/eb/0bebcff2ba9efb92d9f1924da3eb4f49/pa/GA26401_ea8f55048b7ff449c9382603a7498309.jpg already downloaded
2026-01-28 20:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Feb%252F0bebcff2ba9efb92d9f1924da3eb4f49%252Fpa%252FGA26401_ba1d5f1e339d17f72aab78396094f562.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/eb/0bebcff2ba9efb92d9f1924da3eb4f49/pa/GA26401_ba1d5f1e339d17f72aab78396094f562.jpg already downloaded
2026-01-28 20:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Feb%252F0bebcff2ba9efb92d9f1924da3eb4f49%252Fpa%252FGA26401_8589a4bdef1a265da9caa22dd0691700.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/eb/0bebcff2ba9efb92d9f1924da3eb4f49/pa/GA26401_8589a4bdef1a265da9caa22dd0691700.jpg already downloaded
2026-01-28 20:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Feb%252F0bebcff2ba9efb92d9f1924da3eb4f49%252Fpa%252FGA26401_72ee4386ba5e4090d45a45dbbbf49f13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/eb/0bebcff2ba9efb92d9f1924da3eb4f49/pa/GA26401_72ee4386ba5e4090d45a45dbbbf49f13.jpg already downloaded
2026-01-28 20:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Feb%252F0bebcff2ba9efb92d9f1924da3eb4f49%252Fpa%252FGA26401_7bcd0784361e7495528a84095699b0e7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/eb/0bebcff2ba9efb92d9f1924da3eb4f49/pa/GA26401_7bcd0784361e7495528a84095699b0e7.jpg already downloaded
2026-01-28 20:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Feb%252F0bebcff2ba9efb92d9f1924da3eb4f49%252Fpa%252FGA26401_6344b88d7cc92e58e02b458674af4be2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/eb/0bebcff2ba9efb92d9f1924da3eb4f49/pa/GA26401_6344b88d7cc92e58e02b458674af4be2.jpg already downloaded
2026-01-28 20:07:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 56914c2c-5778-593b-9361-da63608d5adf, identifier: GA26401
2026-01-28 20:07:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0be77a2c-4c77-56fc-9178-17d97e4fe893 with identifier: ZS31369
2026-01-28 20:07:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0be77a2c-4c77-56fc-9178-17d97e4fe893 with scrape type 2
2026-01-28 20:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0be77a2c-4c77-56fc-9178-17d97e4fe893 with scrape type 2
2026-01-28 20:07:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0be77a2c-4c77-56fc-9178-17d97e4fe893, identifier: ZS31369
2026-01-28 20:07:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/b4/4fb4ec31496439d2846b55a99cd2b5ae/pa/BE15819_c257bb48ed284977fc9aebf5abba72c6.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:07:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d7192c06-0e36-56c6-a32f-2d4e2f1bdf47 with identifier: UR17754
2026-01-28 20:07:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d7192c06-0e36-56c6-a32f-2d4e2f1bdf47 with identifier: UR17754
2026-01-28 20:07:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d7192c06-0e36-56c6-a32f-2d4e2f1bdf47 with identifier: UR17754 to the API
2026-01-28 20:07:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:07:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:07:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge7/7c/e77cefab987ddf6386216d3d79646274/pa/UR17754_ba3eeef20fbfc654c8e4868f69e1f50b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:22:47Z',
 'fuel_type': 'petrol',
 'id': 'd7192c06-0e36-56c6-a32f-2d4e2f1bdf47',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UR17754',
 'listing': 'auction',
 'location': 'IT',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 117450,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7192c06-0e36-56c6-a32f-2d4e2f1bdf47/d7192c06-0e36-56c6-a32f-2d4e2f1bdf47_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60449,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/7c/e77cefab987ddf6386216d3d79646274/pa/UR17754_ba3eeef20fbfc654c8e4868f69e1f50b.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7192c06-0e36-56c6-a32f-2d4e2f1bdf47/d7192c06-0e36-56c6-a32f-2d4e2f1bdf47_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60449,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/7c/e77cefab987ddf6386216d3d79646274/pa/UR17754_0c41899a3708c81d44a7dacf2d30d3ed.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7192c06-0e36-56c6-a32f-2d4e2f1bdf47/d7192c06-0e36-56c6-a32f-2d4e2f1bdf47_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62645,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/7c/e77cefab987ddf6386216d3d79646274/pa/UR17754_b857512a9031802632b68f7e151add35.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7192c06-0e36-56c6-a32f-2d4e2f1bdf47/d7192c06-0e36-56c6-a32f-2d4e2f1bdf47_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36812,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/7c/e77cefab987ddf6386216d3d79646274/pa/UR17754_666d2b11986a0f2b4d293b14321e30bd.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7192c06-0e36-56c6-a32f-2d4e2f1bdf47/d7192c06-0e36-56c6-a32f-2d4e2f1bdf47_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66788,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/7c/e77cefab987ddf6386216d3d79646274/pa/UR17754_c45050838884c0d69d645b4db9f6f5cb.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7192c06-0e36-56c6-a32f-2d4e2f1bdf47/d7192c06-0e36-56c6-a32f-2d4e2f1bdf47_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63897,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/7c/e77cefab987ddf6386216d3d79646274/pa/UR17754_b844599306f4f13de4bedb66f4f30fc1.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7192c06-0e36-56c6-a32f-2d4e2f1bdf47/d7192c06-0e36-56c6-a32f-2d4e2f1bdf47_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60449,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/7c/e77cefab987ddf6386216d3d79646274/pa/UR17754_4a1aef38c192d80840fa4332cb96b66b.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7192c06-0e36-56c6-a32f-2d4e2f1bdf47/d7192c06-0e36-56c6-a32f-2d4e2f1bdf47_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46007,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/7c/e77cefab987ddf6386216d3d79646274/pa/UR17754_8741aa95e77398f0f8eb97b9628c8924.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7192c06-0e36-56c6-a32f-2d4e2f1bdf47/d7192c06-0e36-56c6-a32f-2d4e2f1bdf47_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57749,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/7c/e77cefab987ddf6386216d3d79646274/pa/UR17754_14fbd0c3d06f050ce61dae78fa673ec4.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7192c06-0e36-56c6-a32f-2d4e2f1bdf47/d7192c06-0e36-56c6-a32f-2d4e2f1bdf47_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41038,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/7c/e77cefab987ddf6386216d3d79646274/pa/UR17754_361a2c45ec313aa43e0bcbdc78651e39.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7192c06-0e36-56c6-a32f-2d4e2f1bdf47/d7192c06-0e36-56c6-a32f-2d4e2f1bdf47_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81646,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/7c/e77cefab987ddf6386216d3d79646274/pa/UR17754_f44b7157afb957c96d72e549676118a0.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7192c06-0e36-56c6-a32f-2d4e2f1bdf47/d7192c06-0e36-56c6-a32f-2d4e2f1bdf47_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 20774,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/7c/e77cefab987ddf6386216d3d79646274/pa/UR17754_76afffad44e67d204122313d62f53e61.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7192c06-0e36-56c6-a32f-2d4e2f1bdf47/d7192c06-0e36-56c6-a32f-2d4e2f1bdf47_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 23902,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/7c/e77cefab987ddf6386216d3d79646274/pa/UR17754_a4e472ff049d44ca730afea3fd05edf1.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7192c06-0e36-56c6-a32f-2d4e2f1bdf47/d7192c06-0e36-56c6-a32f-2d4e2f1bdf47_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44396,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/7c/e77cefab987ddf6386216d3d79646274/pa/UR17754_ea6dc3e85a5f8113036b629ab7e7adc0.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7192c06-0e36-56c6-a32f-2d4e2f1bdf47/d7192c06-0e36-56c6-a32f-2d4e2f1bdf47_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34553,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/7c/e77cefab987ddf6386216d3d79646274/pa/UR17754_7bbc3236421f5940745eba70c96cebed.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7192c06-0e36-56c6-a32f-2d4e2f1bdf47/d7192c06-0e36-56c6-a32f-2d4e2f1bdf47_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3928,
             'Height': 131,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/7c/e77cefab987ddf6386216d3d79646274/pa/UR17754_5889d2bf61b238577ab0c5a2b6289cf4.jpg',
             'Width': 152}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-03-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 1.5 TSI ACT R-Line',
 'transmission': 'manual',
 'trim': 'R-Line',
 'year': 2021}
2026-01-28 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UR17754%27 HTTP/1.1" 200 None
2026-01-28 20:07:10 [auto1.it] INFO: Saving data for UR17754: {'created_time': 1769630830.459489, 'last_price_update_time': 1769630830.459502, 'auction_closing_time': 1769703767.0}
2026-01-28 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UR17754') HTTP/1.1" 204 0
2026-01-28 20:07:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c5dd64f3-1cdf-56ec-90a4-fe3871df7bf4 with identifier: FC65085
2026-01-28 20:07:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c5dd64f3-1cdf-56ec-90a4-fe3871df7bf4 with identifier: FC65085
2026-01-28 20:07:10 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 170988 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    170988
2026-01-28 20:07:10 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: c5dd64f3-1cdf-56ec-90a4-fe3871df7bf4 spider: auto1.it
2026-01-28 20:07:10 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: c5dd64f3-1cdf-56ec-90a4-fe3871df7bf4 due to rule: high_mileage_for_country.json, error: 170988 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    170988
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.5L',
 'engine_horse_power': 101,
 'expiration_date': '2026-01-29T16:35:43Z',
 'fuel_type': 'diesel',
 'id': 'c5dd64f3-1cdf-56ec-90a4-fe3871df7bf4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FC65085',
 'listing': 'auction',
 'location': 'IT, Milazzo',
 'make': 'Ford',
 'model': 'EcoSport',
 'odometer': 170988,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-04-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford EcoSport 1.5 EcoBlue TDCi ST-Line',
 'transmission': 'manual',
 'trim': 'ST-Line',
 'year': 2019}
2026-01-28 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FC65085%27 HTTP/1.1" 200 None
2026-01-28 20:07:10 [auto1.it] INFO: Saving data for FC65085: {'auction_closing_time': 1769704543.0, 'created_time': 1768990068.707025, 'last_price_update_time': 1769630830.710407}
2026-01-28 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FC65085') HTTP/1.1" 204 0
2026-01-28 20:07:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: cd948979-429a-5345-950d-a71727b89247 with identifier: RU07739
2026-01-28 20:07:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: cd948979-429a-5345-950d-a71727b89247 with identifier: RU07739
2026-01-28 20:07:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: cd948979-429a-5345-950d-a71727b89247 with identifier: RU07739 to the API
2026-01-28 20:07:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:07:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:07:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RU07739>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 110,
 'expiration_date': '2026-01-29T16:33:21Z',
 'fuel_type': 'petrol',
 'id': 'cd948979-429a-5345-950d-a71727b89247',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RU07739',
 'listing': 'auction',
 'location': 'IT, Milazzo',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 50253,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-10-31',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Seat Ibiza 1.0 TSI FR',
 'transmission': 'manual',
 'trim': 'FR',
 'year': 2022}
2026-01-28 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27RU07739%27 HTTP/1.1" 200 None
2026-01-28 20:07:11 [auto1.it] INFO: Saving data for RU07739: {'auction_closing_time': 1769704401.0, 'created_time': 1767350120.796431, 'last_price_update_time': 1769630831.087581}
2026-01-28 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='RU07739') HTTP/1.1" 204 0
2026-01-28 20:07:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5c3bf9b1-7456-5718-91f2-07826bbe40cb with identifier: VV63858
2026-01-28 20:07:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5c3bf9b1-7456-5718-91f2-07826bbe40cb with identifier: VV63858
2026-01-28 20:07:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5c3bf9b1-7456-5718-91f2-07826bbe40cb with identifier: VV63858 to the API
2026-01-28 20:07:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:07:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:07:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VV63858>
{'auction_title': '',
 'c_o_2_emission_value': 160,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:09:53Z',
 'fuel_type': 'gas',
 'id': '5c3bf9b1-7456-5718-91f2-07826bbe40cb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VV63858',
 'listing': 'auction',
 'location': 'IT, Milazzo',
 'make': 'DR',
 'model': 'DR 5.0',
 'odometer': 9747,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img9a/42/9a42b39ba497c7b44d7d4c90c0bf2747/pa/VV63858_b6824a848a7696447c2afce5aa18f7d2.jpg',
                'https://img-pa.auto1.com/img9a/42/9a42b39ba497c7b44d7d4c90c0bf2747/pa/VV63858_decb6bffa1892af922ceca4358f072df.jpg',
                'https://img-pa.auto1.com/img9a/42/9a42b39ba497c7b44d7d4c90c0bf2747/pa/VV63858_88aef2d181dfeee8f999b3684d2b7c38.jpg',
                'https://img-pa.auto1.com/img9a/42/9a42b39ba497c7b44d7d4c90c0bf2747/pa/VV63858_0b09179ce5e80e8e850e644fd342dba8.jpg',
                'https://img-pa.auto1.com/img9a/42/9a42b39ba497c7b44d7d4c90c0bf2747/pa/VV63858_f475e2b8766c89267726fd1997c2223c.jpg',
                'https://img-pa.auto1.com/img9a/42/9a42b39ba497c7b44d7d4c90c0bf2747/pa/VV63858_778ea458e48d70077545fef87c38942f.jpg',
                'https://img-pa.auto1.com/img9a/42/9a42b39ba497c7b44d7d4c90c0bf2747/pa/VV63858_6c5ef460b1e85bf1ffcbc061fc7ba87f.jpg',
                'https://img-pa.auto1.com/img9a/42/9a42b39ba497c7b44d7d4c90c0bf2747/pa/VV63858_b4d65a4d2616fb3c64b66bfad4ac07b0.jpg',
                'https://img-pa.auto1.com/img9a/42/9a42b39ba497c7b44d7d4c90c0bf2747/pa/VV63858_d883106e185b15083b24a0365485b111.jpg',
                'https://img-pa.auto1.com/img9a/42/9a42b39ba497c7b44d7d4c90c0bf2747/pa/VV63858_00898ebe6f256960eb4d221f800bdeef.jpg',
                'https://img-pa.auto1.com/img9a/42/9a42b39ba497c7b44d7d4c90c0bf2747/pa/VV63858_c1c9d012ff5e9f0cc5c9f0ca139c840c.jpg',
                'https://img-pa.auto1.com/img9a/42/9a42b39ba497c7b44d7d4c90c0bf2747/pa/VV63858_2776a9ac3400c102f4f5d6668a6cd97e.jpg',
                'https://img-pa.auto1.com/img9a/42/9a42b39ba497c7b44d7d4c90c0bf2747/pa/VV63858_c5d014a2553193af09d28b9aeef939e6.jpg',
                'https://img-pa.auto1.com/img9a/42/9a42b39ba497c7b44d7d4c90c0bf2747/pa/VV63858_9a533f5fde0169558946b2c9d0ecea4b.jpg',
                'https://img-pa.auto1.com/img9a/42/9a42b39ba497c7b44d7d4c90c0bf2747/pa/VV63858_48b52d5645ff698a578a9753d9df6572.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c3bf9b1-7456-5718-91f2-07826bbe40cb/5c3bf9b1-7456-5718-91f2-07826bbe40cb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2094961,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/42/9a42b39ba497c7b44d7d4c90c0bf2747/pa/VV63858_b6824a848a7696447c2afce5aa18f7d2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c3bf9b1-7456-5718-91f2-07826bbe40cb/5c3bf9b1-7456-5718-91f2-07826bbe40cb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2074922,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/42/9a42b39ba497c7b44d7d4c90c0bf2747/pa/VV63858_decb6bffa1892af922ceca4358f072df.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c3bf9b1-7456-5718-91f2-07826bbe40cb/5c3bf9b1-7456-5718-91f2-07826bbe40cb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1998719,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/42/9a42b39ba497c7b44d7d4c90c0bf2747/pa/VV63858_88aef2d181dfeee8f999b3684d2b7c38.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c3bf9b1-7456-5718-91f2-07826bbe40cb/5c3bf9b1-7456-5718-91f2-07826bbe40cb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45245,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/42/9a42b39ba497c7b44d7d4c90c0bf2747/pa/VV63858_0b09179ce5e80e8e850e644fd342dba8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c3bf9b1-7456-5718-91f2-07826bbe40cb/5c3bf9b1-7456-5718-91f2-07826bbe40cb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64633,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/42/9a42b39ba497c7b44d7d4c90c0bf2747/pa/VV63858_f475e2b8766c89267726fd1997c2223c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c3bf9b1-7456-5718-91f2-07826bbe40cb/5c3bf9b1-7456-5718-91f2-07826bbe40cb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70493,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/42/9a42b39ba497c7b44d7d4c90c0bf2747/pa/VV63858_778ea458e48d70077545fef87c38942f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c3bf9b1-7456-5718-91f2-07826bbe40cb/5c3bf9b1-7456-5718-91f2-07826bbe40cb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61697,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/42/9a42b39ba497c7b44d7d4c90c0bf2747/pa/VV63858_6c5ef460b1e85bf1ffcbc061fc7ba87f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c3bf9b1-7456-5718-91f2-07826bbe40cb/5c3bf9b1-7456-5718-91f2-07826bbe40cb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79528,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/42/9a42b39ba497c7b44d7d4c90c0bf2747/pa/VV63858_b4d65a4d2616fb3c64b66bfad4ac07b0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c3bf9b1-7456-5718-91f2-07826bbe40cb/5c3bf9b1-7456-5718-91f2-07826bbe40cb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1992005,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/42/9a42b39ba497c7b44d7d4c90c0bf2747/pa/VV63858_d883106e185b15083b24a0365485b111.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c3bf9b1-7456-5718-91f2-07826bbe40cb/5c3bf9b1-7456-5718-91f2-07826bbe40cb_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72202,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/42/9a42b39ba497c7b44d7d4c90c0bf2747/pa/VV63858_00898ebe6f256960eb4d221f800bdeef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c3bf9b1-7456-5718-91f2-07826bbe40cb/5c3bf9b1-7456-5718-91f2-07826bbe40cb_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60283,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/42/9a42b39ba497c7b44d7d4c90c0bf2747/pa/VV63858_c1c9d012ff5e9f0cc5c9f0ca139c840c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c3bf9b1-7456-5718-91f2-07826bbe40cb/5c3bf9b1-7456-5718-91f2-07826bbe40cb_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2320839,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/42/9a42b39ba497c7b44d7d4c90c0bf2747/pa/VV63858_2776a9ac3400c102f4f5d6668a6cd97e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c3bf9b1-7456-5718-91f2-07826bbe40cb/5c3bf9b1-7456-5718-91f2-07826bbe40cb_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53803,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/42/9a42b39ba497c7b44d7d4c90c0bf2747/pa/VV63858_c5d014a2553193af09d28b9aeef939e6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c3bf9b1-7456-5718-91f2-07826bbe40cb/5c3bf9b1-7456-5718-91f2-07826bbe40cb_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2026962,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/42/9a42b39ba497c7b44d7d4c90c0bf2747/pa/VV63858_9a533f5fde0169558946b2c9d0ecea4b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c3bf9b1-7456-5718-91f2-07826bbe40cb/5c3bf9b1-7456-5718-91f2-07826bbe40cb_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58456,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/42/9a42b39ba497c7b44d7d4c90c0bf2747/pa/VV63858_48b52d5645ff698a578a9753d9df6572.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2025-05-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DR DR 5.0 1.5 LPG',
 'transmission': 'automatic',
 'trim': '',
 'year': 2025}
2026-01-28 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VV63858%27 HTTP/1.1" 200 None
2026-01-28 20:07:11 [auto1.it] INFO: Saving data for VV63858: {'created_time': 1769630831.48359, 'last_price_update_time': 1769630831.4836, 'auction_closing_time': 1769702993.0}
2026-01-28 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VV63858') HTTP/1.1" 204 0
2026-01-28 20:07:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 56914c2c-5778-593b-9361-da63608d5adf with identifier: GA26401
2026-01-28 20:07:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 56914c2c-5778-593b-9361-da63608d5adf with identifier: GA26401
2026-01-28 20:07:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 56914c2c-5778-593b-9361-da63608d5adf with identifier: GA26401 to the API
2026-01-28 20:07:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:07:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:07:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GA26401>
{'auction_title': '',
 'c_o_2_emission_value': 240,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 6B',
 'engine': '2.8L',
 'engine_horse_power': 200,
 'expiration_date': '2026-01-29T16:51:07Z',
 'fuel_type': 'diesel',
 'id': '56914c2c-5778-593b-9361-da63608d5adf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GA26401',
 'listing': 'auction',
 'location': 'IT, Padova',
 'make': 'Jeep',
 'model': 'Wrangler Unlimited',
 'odometer': 58839,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img0b/eb/0bebcff2ba9efb92d9f1924da3eb4f49/pa/GA26401_abae2b464464c8638bb4d3aa8309185c.jpg',
                'https://img-pa.auto1.com/img0b/eb/0bebcff2ba9efb92d9f1924da3eb4f49/pa/GA26401_756c0ec66e22d42d2a1a44ef175746dc.jpg',
                'https://img-pa.auto1.com/img0b/eb/0bebcff2ba9efb92d9f1924da3eb4f49/pa/GA26401_def824d2e4617fa089bd891c55aa76fa.jpg',
                'https://img-pa.auto1.com/img0b/eb/0bebcff2ba9efb92d9f1924da3eb4f49/pa/GA26401_9f12a93129456a23b308ee297b01a67f.jpg',
                'https://img-pa.auto1.com/img0b/eb/0bebcff2ba9efb92d9f1924da3eb4f49/pa/GA26401_6695cb76c7fa9f49d0c19830f48a5b2b.jpg',
                'https://img-pa.auto1.com/img0b/eb/0bebcff2ba9efb92d9f1924da3eb4f49/pa/GA26401_ef7297276a189a91920257167c87e335.jpg',
                'https://img-pa.auto1.com/img0b/eb/0bebcff2ba9efb92d9f1924da3eb4f49/pa/GA26401_68b5022afd77c6fe7f68ca3cd46fb8df.jpg',
                'https://img-pa.auto1.com/img0b/eb/0bebcff2ba9efb92d9f1924da3eb4f49/pa/GA26401_80bbee901d82d7ab214fd46eb1f136d3.jpg',
                'https://img-pa.auto1.com/img0b/eb/0bebcff2ba9efb92d9f1924da3eb4f49/pa/GA26401_b31efeaa6a3ff92d87c8edd4a9696819.jpg',
                'https://img-pa.auto1.com/img0b/eb/0bebcff2ba9efb92d9f1924da3eb4f49/pa/GA26401_ea8f55048b7ff449c9382603a7498309.jpg',
                'https://img-pa.auto1.com/img0b/eb/0bebcff2ba9efb92d9f1924da3eb4f49/pa/GA26401_ba1d5f1e339d17f72aab78396094f562.jpg',
                'https://img-pa.auto1.com/img0b/eb/0bebcff2ba9efb92d9f1924da3eb4f49/pa/GA26401_8589a4bdef1a265da9caa22dd0691700.jpg',
                'https://img-pa.auto1.com/img0b/eb/0bebcff2ba9efb92d9f1924da3eb4f49/pa/GA26401_72ee4386ba5e4090d45a45dbbbf49f13.jpg',
                'https://img-pa.auto1.com/img0b/eb/0bebcff2ba9efb92d9f1924da3eb4f49/pa/GA26401_7bcd0784361e7495528a84095699b0e7.jpg',
                'https://img-pa.auto1.com/img0b/eb/0bebcff2ba9efb92d9f1924da3eb4f49/pa/GA26401_6344b88d7cc92e58e02b458674af4be2.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56914c2c-5778-593b-9361-da63608d5adf/56914c2c-5778-593b-9361-da63608d5adf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78003,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/eb/0bebcff2ba9efb92d9f1924da3eb4f49/pa/GA26401_abae2b464464c8638bb4d3aa8309185c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56914c2c-5778-593b-9361-da63608d5adf/56914c2c-5778-593b-9361-da63608d5adf_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67056,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/eb/0bebcff2ba9efb92d9f1924da3eb4f49/pa/GA26401_756c0ec66e22d42d2a1a44ef175746dc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56914c2c-5778-593b-9361-da63608d5adf/56914c2c-5778-593b-9361-da63608d5adf_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58911,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/eb/0bebcff2ba9efb92d9f1924da3eb4f49/pa/GA26401_def824d2e4617fa089bd891c55aa76fa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56914c2c-5778-593b-9361-da63608d5adf/56914c2c-5778-593b-9361-da63608d5adf_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60055,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/eb/0bebcff2ba9efb92d9f1924da3eb4f49/pa/GA26401_9f12a93129456a23b308ee297b01a67f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56914c2c-5778-593b-9361-da63608d5adf/56914c2c-5778-593b-9361-da63608d5adf_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53891,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/eb/0bebcff2ba9efb92d9f1924da3eb4f49/pa/GA26401_6695cb76c7fa9f49d0c19830f48a5b2b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56914c2c-5778-593b-9361-da63608d5adf/56914c2c-5778-593b-9361-da63608d5adf_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53510,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/eb/0bebcff2ba9efb92d9f1924da3eb4f49/pa/GA26401_ef7297276a189a91920257167c87e335.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56914c2c-5778-593b-9361-da63608d5adf/56914c2c-5778-593b-9361-da63608d5adf_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63472,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/eb/0bebcff2ba9efb92d9f1924da3eb4f49/pa/GA26401_68b5022afd77c6fe7f68ca3cd46fb8df.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56914c2c-5778-593b-9361-da63608d5adf/56914c2c-5778-593b-9361-da63608d5adf_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64571,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/eb/0bebcff2ba9efb92d9f1924da3eb4f49/pa/GA26401_80bbee901d82d7ab214fd46eb1f136d3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56914c2c-5778-593b-9361-da63608d5adf/56914c2c-5778-593b-9361-da63608d5adf_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65517,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/eb/0bebcff2ba9efb92d9f1924da3eb4f49/pa/GA26401_b31efeaa6a3ff92d87c8edd4a9696819.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56914c2c-5778-593b-9361-da63608d5adf/56914c2c-5778-593b-9361-da63608d5adf_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55939,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/eb/0bebcff2ba9efb92d9f1924da3eb4f49/pa/GA26401_ea8f55048b7ff449c9382603a7498309.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56914c2c-5778-593b-9361-da63608d5adf/56914c2c-5778-593b-9361-da63608d5adf_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50880,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/eb/0bebcff2ba9efb92d9f1924da3eb4f49/pa/GA26401_ba1d5f1e339d17f72aab78396094f562.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56914c2c-5778-593b-9361-da63608d5adf/56914c2c-5778-593b-9361-da63608d5adf_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64782,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/eb/0bebcff2ba9efb92d9f1924da3eb4f49/pa/GA26401_8589a4bdef1a265da9caa22dd0691700.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56914c2c-5778-593b-9361-da63608d5adf/56914c2c-5778-593b-9361-da63608d5adf_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72228,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/eb/0bebcff2ba9efb92d9f1924da3eb4f49/pa/GA26401_72ee4386ba5e4090d45a45dbbbf49f13.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56914c2c-5778-593b-9361-da63608d5adf/56914c2c-5778-593b-9361-da63608d5adf_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42455,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/eb/0bebcff2ba9efb92d9f1924da3eb4f49/pa/GA26401_7bcd0784361e7495528a84095699b0e7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56914c2c-5778-593b-9361-da63608d5adf/56914c2c-5778-593b-9361-da63608d5adf_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89139,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/eb/0bebcff2ba9efb92d9f1924da3eb4f49/pa/GA26401_6344b88d7cc92e58e02b458674af4be2.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-08-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jeep Wrangler Unlimited 2.8 CRD Sahara',
 'transmission': 'automatic',
 'trim': 'Sahara',
 'year': 2018}
2026-01-28 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GA26401%27 HTTP/1.1" 200 None
2026-01-28 20:07:11 [auto1.it] INFO: Saving data for GA26401: {'created_time': 1769630831.822323, 'last_price_update_time': 1769630831.822336, 'auction_closing_time': 1769705467.0}
2026-01-28 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GA26401') HTTP/1.1" 204 0
2026-01-28 20:07:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0be77a2c-4c77-56fc-9178-17d97e4fe893 with identifier: ZS31369
2026-01-28 20:07:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0be77a2c-4c77-56fc-9178-17d97e4fe893 with identifier: ZS31369
2026-01-28 20:07:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0be77a2c-4c77-56fc-9178-17d97e4fe893 with identifier: ZS31369 to the API
2026-01-28 20:07:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:07:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:07:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZS31369>
{'auction_title': '',
 'c_o_2_emission_value': 158,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:16:30Z',
 'fuel_type': 'petrol',
 'id': '0be77a2c-4c77-56fc-9178-17d97e4fe893',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZS31369',
 'listing': 'auction',
 'location': 'IT, Settimo Torinese',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 58568,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-06-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.5 TSI ACT R-Line',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2023}
2026-01-28 20:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZS31369%27 HTTP/1.1" 200 None
2026-01-28 20:07:12 [auto1.it] INFO: Saving data for ZS31369: {'auction_closing_time': 1769703390.0, 'created_time': 1768298534.540142, 'last_price_update_time': 1769630832.177965}
2026-01-28 20:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZS31369') HTTP/1.1" 204 0
2026-01-28 20:07:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/b4/4fb4ec31496439d2846b55a99cd2b5ae/pa/BE15819_3512aa337dc92436a9edb8d87cc5d0a7.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:07:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/05/ed0515a90d6efed767e4defc5c867fde/pa/UH29837_438b517cfde743a7af5c1e5bf5e230b8.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:07:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09d77590>
2026-01-28 20:07:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a23c743d-1f5c-5ce1-98dd-2048bdcb6fb9/a23c743d-1f5c-5ce1-98dd-2048bdcb6fb9_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252Fb4%252F4fb4ec31496439d2846b55a99cd2b5ae%252Fpa%252FBE15819_c257bb48ed284977fc9aebf5abba72c6.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/b4/4fb4ec31496439d2846b55a99cd2b5ae/pa/BE15819_c257bb48ed284977fc9aebf5abba72c6.jpg saved to cache
2026-01-28 20:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a23c743d-1f5c-5ce1-98dd-2048bdcb6fb9
2026-01-28 20:07:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09f160d0>
2026-01-28 20:07:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a23c743d-1f5c-5ce1-98dd-2048bdcb6fb9/a23c743d-1f5c-5ce1-98dd-2048bdcb6fb9_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252Fb4%252F4fb4ec31496439d2846b55a99cd2b5ae%252Fpa%252FBE15819_3512aa337dc92436a9edb8d87cc5d0a7.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/b4/4fb4ec31496439d2846b55a99cd2b5ae/pa/BE15819_3512aa337dc92436a9edb8d87cc5d0a7.jpg saved to cache
2026-01-28 20:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a23c743d-1f5c-5ce1-98dd-2048bdcb6fb9
2026-01-28 20:07:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a23c743d-1f5c-5ce1-98dd-2048bdcb6fb9, skipping ID generation
2026-01-28 20:07:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a23c743d-1f5c-5ce1-98dd-2048bdcb6fb9 with scrape type 1
2026-01-28 20:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Removing item a23c743d-1f5c-5ce1-98dd-2048bdcb6fb9 from tracking dictionaries
2026-01-28 20:07:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a23c743d-1f5c-5ce1-98dd-2048bdcb6fb9 sending to next pipeline
2026-01-28 20:07:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a23c743d-1f5c-5ce1-98dd-2048bdcb6fb9, identifier: BE15819
2026-01-28 20:07:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08a59fd0>
2026-01-28 20:07:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:07:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_587e2dac-1d94-5964-96a9-a84650f493b1/587e2dac-1d94-5964-96a9-a84650f493b1_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F05%252Fed0515a90d6efed767e4defc5c867fde%252Fpa%252FUH29837_438b517cfde743a7af5c1e5bf5e230b8.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/05/ed0515a90d6efed767e4defc5c867fde/pa/UH29837_438b517cfde743a7af5c1e5bf5e230b8.jpg saved to cache
2026-01-28 20:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 587e2dac-1d94-5964-96a9-a84650f493b1
2026-01-28 20:07:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 587e2dac-1d94-5964-96a9-a84650f493b1, skipping ID generation
2026-01-28 20:07:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 587e2dac-1d94-5964-96a9-a84650f493b1 with scrape type 1
2026-01-28 20:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 587e2dac-1d94-5964-96a9-a84650f493b1 from tracking dictionaries
2026-01-28 20:07:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 587e2dac-1d94-5964-96a9-a84650f493b1 sending to next pipeline
2026-01-28 20:07:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 587e2dac-1d94-5964-96a9-a84650f493b1, identifier: UH29837
2026-01-28 20:07:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a23c743d-1f5c-5ce1-98dd-2048bdcb6fb9 with identifier: BE15819
2026-01-28 20:07:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a23c743d-1f5c-5ce1-98dd-2048bdcb6fb9 with identifier: BE15819
2026-01-28 20:07:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a23c743d-1f5c-5ce1-98dd-2048bdcb6fb9 with identifier: BE15819 to the API
2026-01-28 20:07:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:07:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:07:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4f/b4/4fb4ec31496439d2846b55a99cd2b5ae/pa/BE15819_3512aa337dc92436a9edb8d87cc5d0a7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 229,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 265,
 'expiration_date': '2026-01-29T16:49:07Z',
 'fuel_type': 'petrol',
 'id': 'a23c743d-1f5c-5ce1-98dd-2048bdcb6fb9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BE15819',
 'listing': 'auction',
 'location': 'IT, Agliana (PT)',
 'make': 'Porsche',
 'model': 'Macan',
 'odometer': 80062,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a23c743d-1f5c-5ce1-98dd-2048bdcb6fb9/a23c743d-1f5c-5ce1-98dd-2048bdcb6fb9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70965,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/b4/4fb4ec31496439d2846b55a99cd2b5ae/pa/BE15819_59eb8de837cbf319dec7c8a7ac0611a1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a23c743d-1f5c-5ce1-98dd-2048bdcb6fb9/a23c743d-1f5c-5ce1-98dd-2048bdcb6fb9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68314,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/b4/4fb4ec31496439d2846b55a99cd2b5ae/pa/BE15819_4f58f7f7c15de9dbf0dd6f6cd81ea337.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a23c743d-1f5c-5ce1-98dd-2048bdcb6fb9/a23c743d-1f5c-5ce1-98dd-2048bdcb6fb9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72295,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/b4/4fb4ec31496439d2846b55a99cd2b5ae/pa/BE15819_244230afa795f363493e992b66a3577e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a23c743d-1f5c-5ce1-98dd-2048bdcb6fb9/a23c743d-1f5c-5ce1-98dd-2048bdcb6fb9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61062,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/b4/4fb4ec31496439d2846b55a99cd2b5ae/pa/BE15819_c257bb48ed284977fc9aebf5abba72c6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a23c743d-1f5c-5ce1-98dd-2048bdcb6fb9/a23c743d-1f5c-5ce1-98dd-2048bdcb6fb9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67659,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/b4/4fb4ec31496439d2846b55a99cd2b5ae/pa/BE15819_3512aa337dc92436a9edb8d87cc5d0a7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a23c743d-1f5c-5ce1-98dd-2048bdcb6fb9/a23c743d-1f5c-5ce1-98dd-2048bdcb6fb9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67827,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/b4/4fb4ec31496439d2846b55a99cd2b5ae/pa/BE15819_9f52c5f1b814a840724aafede9f5f1b9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a23c743d-1f5c-5ce1-98dd-2048bdcb6fb9/a23c743d-1f5c-5ce1-98dd-2048bdcb6fb9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57371,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/b4/4fb4ec31496439d2846b55a99cd2b5ae/pa/BE15819_e9dc8af0208814639555b8b5b059319e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a23c743d-1f5c-5ce1-98dd-2048bdcb6fb9/a23c743d-1f5c-5ce1-98dd-2048bdcb6fb9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67563,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/b4/4fb4ec31496439d2846b55a99cd2b5ae/pa/BE15819_69c5116208e3fb39c0ced18172b315f1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a23c743d-1f5c-5ce1-98dd-2048bdcb6fb9/a23c743d-1f5c-5ce1-98dd-2048bdcb6fb9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60851,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/b4/4fb4ec31496439d2846b55a99cd2b5ae/pa/BE15819_344f87d95611ae59a13a7b60362d32cb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a23c743d-1f5c-5ce1-98dd-2048bdcb6fb9/a23c743d-1f5c-5ce1-98dd-2048bdcb6fb9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70027,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/b4/4fb4ec31496439d2846b55a99cd2b5ae/pa/BE15819_421f3eb3482e93c3d9a62f004d7ea8e0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a23c743d-1f5c-5ce1-98dd-2048bdcb6fb9/a23c743d-1f5c-5ce1-98dd-2048bdcb6fb9_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69608,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/b4/4fb4ec31496439d2846b55a99cd2b5ae/pa/BE15819_7ff478b67a231fd772dd64d08feb7f3a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a23c743d-1f5c-5ce1-98dd-2048bdcb6fb9/a23c743d-1f5c-5ce1-98dd-2048bdcb6fb9_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66009,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/b4/4fb4ec31496439d2846b55a99cd2b5ae/pa/BE15819_eae4b54ae1b528cea4d9b8c787e0d1b3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a23c743d-1f5c-5ce1-98dd-2048bdcb6fb9/a23c743d-1f5c-5ce1-98dd-2048bdcb6fb9_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80484,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/b4/4fb4ec31496439d2846b55a99cd2b5ae/pa/BE15819_6320bfb5ec93c7c93f1f20ad6c9e74f7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a23c743d-1f5c-5ce1-98dd-2048bdcb6fb9/a23c743d-1f5c-5ce1-98dd-2048bdcb6fb9_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63905,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/b4/4fb4ec31496439d2846b55a99cd2b5ae/pa/BE15819_6c97cf553940b9a502bae0c051788d13.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a23c743d-1f5c-5ce1-98dd-2048bdcb6fb9/a23c743d-1f5c-5ce1-98dd-2048bdcb6fb9_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100877,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/b4/4fb4ec31496439d2846b55a99cd2b5ae/pa/BE15819_7a2b4f6b172c42d477e793a82e1bcfc1.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-09-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Porsche Macan 2.0',
 'transmission': 'automatic',
 'trim': '',
 'year': 2022}
2026-01-28 20:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BE15819%27 HTTP/1.1" 200 None
2026-01-28 20:07:14 [auto1.it] INFO: Saving data for BE15819: {'created_time': 1769630834.398323, 'last_price_update_time': 1769630834.398334, 'auction_closing_time': 1769705347.0}
2026-01-28 20:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BE15819') HTTP/1.1" 204 0
2026-01-28 20:07:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 587e2dac-1d94-5964-96a9-a84650f493b1 with identifier: UH29837
2026-01-28 20:07:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 587e2dac-1d94-5964-96a9-a84650f493b1 with identifier: UH29837
2026-01-28 20:07:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 587e2dac-1d94-5964-96a9-a84650f493b1 with identifier: UH29837 to the API
2026-01-28 20:07:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:07:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:07:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imged/05/ed0515a90d6efed767e4defc5c867fde/pa/UH29837_438b517cfde743a7af5c1e5bf5e230b8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 49,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.3L',
 'engine_horse_power': 190,
 'expiration_date': '2026-01-29T16:07:09Z',
 'fuel_type': 'hybrid',
 'id': '587e2dac-1d94-5964-96a9-a84650f493b1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UH29837',
 'listing': 'auction',
 'location': 'IT, Teramo',
 'make': 'Jeep',
 'model': 'Renegade',
 'odometer': 58994,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_587e2dac-1d94-5964-96a9-a84650f493b1/587e2dac-1d94-5964-96a9-a84650f493b1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 114807,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/05/ed0515a90d6efed767e4defc5c867fde/pa/UH29837_438b517cfde743a7af5c1e5bf5e230b8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_587e2dac-1d94-5964-96a9-a84650f493b1/587e2dac-1d94-5964-96a9-a84650f493b1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99189,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/05/ed0515a90d6efed767e4defc5c867fde/pa/UH29837_c53724e1f72a2a9fa4e349aa79ccd53b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_587e2dac-1d94-5964-96a9-a84650f493b1/587e2dac-1d94-5964-96a9-a84650f493b1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99692,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/05/ed0515a90d6efed767e4defc5c867fde/pa/UH29837_05ca72c3ea0b0b3067071d04e8b4f8c4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_587e2dac-1d94-5964-96a9-a84650f493b1/587e2dac-1d94-5964-96a9-a84650f493b1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72750,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/05/ed0515a90d6efed767e4defc5c867fde/pa/UH29837_8c3015c4691806b62fe433aec1339f6c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_587e2dac-1d94-5964-96a9-a84650f493b1/587e2dac-1d94-5964-96a9-a84650f493b1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106938,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/05/ed0515a90d6efed767e4defc5c867fde/pa/UH29837_defbe6bc4fb4c38991a2947c39a72aab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_587e2dac-1d94-5964-96a9-a84650f493b1/587e2dac-1d94-5964-96a9-a84650f493b1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101171,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/05/ed0515a90d6efed767e4defc5c867fde/pa/UH29837_1eae31bbb273cbddc33513ec25c751df.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_587e2dac-1d94-5964-96a9-a84650f493b1/587e2dac-1d94-5964-96a9-a84650f493b1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74618,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/05/ed0515a90d6efed767e4defc5c867fde/pa/UH29837_c755823f13a9fe5132fe08fb81c4717d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_587e2dac-1d94-5964-96a9-a84650f493b1/587e2dac-1d94-5964-96a9-a84650f493b1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99890,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/05/ed0515a90d6efed767e4defc5c867fde/pa/UH29837_d7869889a4bcf962405af07ca0c0b1b0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_587e2dac-1d94-5964-96a9-a84650f493b1/587e2dac-1d94-5964-96a9-a84650f493b1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112692,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/05/ed0515a90d6efed767e4defc5c867fde/pa/UH29837_15909f3e64080a68eac2adc1e6796c07.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_587e2dac-1d94-5964-96a9-a84650f493b1/587e2dac-1d94-5964-96a9-a84650f493b1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95044,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/05/ed0515a90d6efed767e4defc5c867fde/pa/UH29837_972a08aad4dbddadea33727577e154e2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_587e2dac-1d94-5964-96a9-a84650f493b1/587e2dac-1d94-5964-96a9-a84650f493b1_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75466,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/05/ed0515a90d6efed767e4defc5c867fde/pa/UH29837_e95760a474364e6c10ef3f142cbdccad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_587e2dac-1d94-5964-96a9-a84650f493b1/587e2dac-1d94-5964-96a9-a84650f493b1_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69107,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/05/ed0515a90d6efed767e4defc5c867fde/pa/UH29837_746d90a28f42e3b455fe04e859982adc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_587e2dac-1d94-5964-96a9-a84650f493b1/587e2dac-1d94-5964-96a9-a84650f493b1_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69489,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/05/ed0515a90d6efed767e4defc5c867fde/pa/UH29837_afad117fa27d7e783505b1f779cfef70.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_587e2dac-1d94-5964-96a9-a84650f493b1/587e2dac-1d94-5964-96a9-a84650f493b1_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55246,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/05/ed0515a90d6efed767e4defc5c867fde/pa/UH29837_a6f12c77ee93b698a6a5157188439b11.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_587e2dac-1d94-5964-96a9-a84650f493b1/587e2dac-1d94-5964-96a9-a84650f493b1_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47432,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/05/ed0515a90d6efed767e4defc5c867fde/pa/UH29837_f435e6f7f5c82f1b4e726fd24900adfa.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-06-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jeep Renegade 1.3 T4 4xe Plug-in Hybrid Limited',
 'transmission': 'automatic',
 'trim': 'Limited',
 'year': 2021}
2026-01-28 20:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27UH29837%27 HTTP/1.1" 200 None
2026-01-28 20:07:14 [auto1.it] INFO: Saving data for UH29837: {'created_time': 1769630834.76806, 'last_price_update_time': 1769630834.768072, 'auction_closing_time': 1769702829.0}
2026-01-28 20:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='UH29837') HTTP/1.1" 204 0
2026-01-28 20:07:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NZ23957> (referer: https://www.auto1.com/v1/car-details-view/NZ23957/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:07:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NS14568> (referer: https://www.auto1.com/v1/car-details-view/NS14568/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:07:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SU23914> (referer: https://www.auto1.com/v1/car-details-view/SU23914/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:07:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XP38725> (referer: https://www.auto1.com/v1/car-details-view/XP38725/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:07:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HV34244/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:07:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MW21403> (referer: https://www.auto1.com/v1/car-details-view/MW21403/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:07:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KY70746> (referer: https://www.auto1.com/v1/car-details-view/KY70746/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:07:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:07:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:07:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:07:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:07:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:07:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:07:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:07:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/1c/e21cfb98a73e65a314352c3a1ce5c145/pa/BM05081_5a63eea88f1d19a3e33e2d31b30d7061.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:07:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/0b/2c0bb7ccc201057468358464a15bb096/pa/KX95898_acc48f0d82e32a50d57c6c1845fe6c60.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:07:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/0b/2c0bb7ccc201057468358464a15bb096/pa/KX95898_daf747ba2233026e74d5f1cf7061fc4e.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:07:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/0b/2c0bb7ccc201057468358464a15bb096/pa/KX95898_846fd19f770610642df44b62d04776d8.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:07:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/1c/e21cfb98a73e65a314352c3a1ce5c145/pa/BM05081_1f8ff955862e0330c0cd6126a93e977f.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:07:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 98151db2-4aa4-5a40-84f5-bc81e535a501 with identifier: NZ23957
2026-01-28 20:07:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98151db2-4aa4-5a40-84f5-bc81e535a501 with scrape type 2
2026-01-28 20:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 98151db2-4aa4-5a40-84f5-bc81e535a501 with scrape type 2
2026-01-28 20:07:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 98151db2-4aa4-5a40-84f5-bc81e535a501, identifier: NZ23957
2026-01-28 20:07:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a29707ce-c7f5-5813-a79a-b969c24a53c8 with identifier: NS14568
2026-01-28 20:07:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a29707ce-c7f5-5813-a79a-b969c24a53c8 with scrape type 2
2026-01-28 20:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a29707ce-c7f5-5813-a79a-b969c24a53c8 with scrape type 2
2026-01-28 20:07:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a29707ce-c7f5-5813-a79a-b969c24a53c8, identifier: NS14568
2026-01-28 20:07:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43681869-9f06-5f9d-82ca-86d8f1244288 with identifier: SU23914
2026-01-28 20:07:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43681869-9f06-5f9d-82ca-86d8f1244288 with scrape type 1
2026-01-28 20:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 14 photos for item 43681869-9f06-5f9d-82ca-86d8f1244288
2026-01-28 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fdc%252F3cdc924cbe41dcbd9e4d8e2932cc3a1a%252Fpa%252FSU23914_f789038f31443d11a903468716c53049.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/dc/3cdc924cbe41dcbd9e4d8e2932cc3a1a/pa/SU23914_f789038f31443d11a903468716c53049.jpg already downloaded
2026-01-28 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fdc%252F3cdc924cbe41dcbd9e4d8e2932cc3a1a%252Fpa%252FSU23914_b6cee0ed185f474061d8455461557aeb.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/dc/3cdc924cbe41dcbd9e4d8e2932cc3a1a/pa/SU23914_b6cee0ed185f474061d8455461557aeb.jpg already downloaded
2026-01-28 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fdc%252F3cdc924cbe41dcbd9e4d8e2932cc3a1a%252Fpa%252FSU23914_5d5a3e3879a74d9509c0843a227574ad.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/dc/3cdc924cbe41dcbd9e4d8e2932cc3a1a/pa/SU23914_5d5a3e3879a74d9509c0843a227574ad.jpg already downloaded
2026-01-28 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fdc%252F3cdc924cbe41dcbd9e4d8e2932cc3a1a%252Fpa%252FSU23914_8938b599db8039f5eeecb56785530279.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/dc/3cdc924cbe41dcbd9e4d8e2932cc3a1a/pa/SU23914_8938b599db8039f5eeecb56785530279.jpg already downloaded
2026-01-28 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fdc%252F3cdc924cbe41dcbd9e4d8e2932cc3a1a%252Fpa%252FSU23914_75dfe5cc59100160faabbcc7b438d636.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/dc/3cdc924cbe41dcbd9e4d8e2932cc3a1a/pa/SU23914_75dfe5cc59100160faabbcc7b438d636.jpg already downloaded
2026-01-28 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fdc%252F3cdc924cbe41dcbd9e4d8e2932cc3a1a%252Fpa%252FSU23914_da25aa4128a6eea87fe8544ab622d797.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/dc/3cdc924cbe41dcbd9e4d8e2932cc3a1a/pa/SU23914_da25aa4128a6eea87fe8544ab622d797.jpg already downloaded
2026-01-28 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fdc%252F3cdc924cbe41dcbd9e4d8e2932cc3a1a%252Fpa%252FSU23914_051bdc5c6a9daf756368b89831a1072f.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/dc/3cdc924cbe41dcbd9e4d8e2932cc3a1a/pa/SU23914_051bdc5c6a9daf756368b89831a1072f.jpg already downloaded
2026-01-28 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fdc%252F3cdc924cbe41dcbd9e4d8e2932cc3a1a%252Fpa%252FSU23914_94848e7c2e55bb89b6e4a7ab0f0c5a89.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/dc/3cdc924cbe41dcbd9e4d8e2932cc3a1a/pa/SU23914_94848e7c2e55bb89b6e4a7ab0f0c5a89.jpg already downloaded
2026-01-28 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fdc%252F3cdc924cbe41dcbd9e4d8e2932cc3a1a%252Fpa%252FSU23914_0ac56dbe9cb89bdf31232394b3532426.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/dc/3cdc924cbe41dcbd9e4d8e2932cc3a1a/pa/SU23914_0ac56dbe9cb89bdf31232394b3532426.jpg already downloaded
2026-01-28 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fdc%252F3cdc924cbe41dcbd9e4d8e2932cc3a1a%252Fpa%252FSU23914_c15f156714fb8f6cc7f8a9fb60001b4c.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/dc/3cdc924cbe41dcbd9e4d8e2932cc3a1a/pa/SU23914_c15f156714fb8f6cc7f8a9fb60001b4c.jpg already downloaded
2026-01-28 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fdc%252F3cdc924cbe41dcbd9e4d8e2932cc3a1a%252Fpa%252FSU23914_35d866c2b7d3f6e5692041f893e3b33f.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/dc/3cdc924cbe41dcbd9e4d8e2932cc3a1a/pa/SU23914_35d866c2b7d3f6e5692041f893e3b33f.jpg already downloaded
2026-01-28 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fdc%252F3cdc924cbe41dcbd9e4d8e2932cc3a1a%252Fpa%252FSU23914_078c8486bc3215b26a6112e182426a3e.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/dc/3cdc924cbe41dcbd9e4d8e2932cc3a1a/pa/SU23914_078c8486bc3215b26a6112e182426a3e.jpg already downloaded
2026-01-28 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fdc%252F3cdc924cbe41dcbd9e4d8e2932cc3a1a%252Fpa%252FSU23914_f1f04567e8315678883791110787ee89.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/dc/3cdc924cbe41dcbd9e4d8e2932cc3a1a/pa/SU23914_f1f04567e8315678883791110787ee89.jpg already downloaded
2026-01-28 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fdc%252F3cdc924cbe41dcbd9e4d8e2932cc3a1a%252Fpa%252FSU23914_e8de94fd4ae5119db99b80e2a2abcd98.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/dc/3cdc924cbe41dcbd9e4d8e2932cc3a1a/pa/SU23914_e8de94fd4ae5119db99b80e2a2abcd98.jpg already downloaded
2026-01-28 20:07:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 43681869-9f06-5f9d-82ca-86d8f1244288, identifier: SU23914
2026-01-28 20:07:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 01b4aacc-e245-587e-a919-de55face0462 with identifier: XP38725
2026-01-28 20:07:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01b4aacc-e245-587e-a919-de55face0462 with scrape type 2
2026-01-28 20:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 01b4aacc-e245-587e-a919-de55face0462 with scrape type 2
2026-01-28 20:07:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 01b4aacc-e245-587e-a919-de55face0462, identifier: XP38725
2026-01-28 20:07:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 28de05d6-76f4-5f6a-86d4-546d77c72ce3 with identifier: MW21403
2026-01-28 20:07:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28de05d6-76f4-5f6a-86d4-546d77c72ce3 with scrape type 2
2026-01-28 20:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 28de05d6-76f4-5f6a-86d4-546d77c72ce3 with scrape type 2
2026-01-28 20:07:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 28de05d6-76f4-5f6a-86d4-546d77c72ce3, identifier: MW21403
2026-01-28 20:07:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f17ccc5d-ba7e-51dd-9efb-5956620baa2e with identifier: KY70746
2026-01-28 20:07:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f17ccc5d-ba7e-51dd-9efb-5956620baa2e with scrape type 1
2026-01-28 20:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item f17ccc5d-ba7e-51dd-9efb-5956620baa2e
2026-01-28 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F6b%252F8f6b0c83d8ef22390c7cd576a1da950c%252Fpa%252FKY70746_216bbcdec046793eecc173bf37b2e64f.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/6b/8f6b0c83d8ef22390c7cd576a1da950c/pa/KY70746_216bbcdec046793eecc173bf37b2e64f.jpg already downloaded
2026-01-28 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F6b%252F8f6b0c83d8ef22390c7cd576a1da950c%252Fpa%252FKY70746_f76ab1e1f3fe067b7aa1f8363db73db7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/6b/8f6b0c83d8ef22390c7cd576a1da950c/pa/KY70746_f76ab1e1f3fe067b7aa1f8363db73db7.jpg already downloaded
2026-01-28 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F6b%252F8f6b0c83d8ef22390c7cd576a1da950c%252Fpa%252FKY70746_28bb7a50c74e0a7d8af7fdbf40490194.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/6b/8f6b0c83d8ef22390c7cd576a1da950c/pa/KY70746_28bb7a50c74e0a7d8af7fdbf40490194.jpg already downloaded
2026-01-28 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F6b%252F8f6b0c83d8ef22390c7cd576a1da950c%252Fpa%252FKY70746_5ace3f71a697638019dd1f047d559ea6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/6b/8f6b0c83d8ef22390c7cd576a1da950c/pa/KY70746_5ace3f71a697638019dd1f047d559ea6.jpg already downloaded
2026-01-28 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F6b%252F8f6b0c83d8ef22390c7cd576a1da950c%252Fpa%252FKY70746_0f0768885151814889e03fe69816fa5d.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/6b/8f6b0c83d8ef22390c7cd576a1da950c/pa/KY70746_0f0768885151814889e03fe69816fa5d.jpg already downloaded
2026-01-28 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F6b%252F8f6b0c83d8ef22390c7cd576a1da950c%252Fpa%252FKY70746_f20f93a3b25b208556a83849896ffe82.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/6b/8f6b0c83d8ef22390c7cd576a1da950c/pa/KY70746_f20f93a3b25b208556a83849896ffe82.jpg already downloaded
2026-01-28 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F6b%252F8f6b0c83d8ef22390c7cd576a1da950c%252Fpa%252FKY70746_abd938cf3f9c65b1ed539cfcbcfc58e7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/6b/8f6b0c83d8ef22390c7cd576a1da950c/pa/KY70746_abd938cf3f9c65b1ed539cfcbcfc58e7.jpg already downloaded
2026-01-28 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F6b%252F8f6b0c83d8ef22390c7cd576a1da950c%252Fpa%252FKY70746_f031eef1922fbb4944d7d6832678c116.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/6b/8f6b0c83d8ef22390c7cd576a1da950c/pa/KY70746_f031eef1922fbb4944d7d6832678c116.jpg already downloaded
2026-01-28 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F6b%252F8f6b0c83d8ef22390c7cd576a1da950c%252Fpa%252FKY70746_b5200000a371af145c9de71ec9637b8e.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/6b/8f6b0c83d8ef22390c7cd576a1da950c/pa/KY70746_b5200000a371af145c9de71ec9637b8e.jpg already downloaded
2026-01-28 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F6b%252F8f6b0c83d8ef22390c7cd576a1da950c%252Fpa%252FKY70746_5bb75ed6a35c94469784dae5f905e0e3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/6b/8f6b0c83d8ef22390c7cd576a1da950c/pa/KY70746_5bb75ed6a35c94469784dae5f905e0e3.jpg already downloaded
2026-01-28 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F6b%252F8f6b0c83d8ef22390c7cd576a1da950c%252Fpa%252FKY70746_4191d9a5bf580b7c528fedb67f9c99ce.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/6b/8f6b0c83d8ef22390c7cd576a1da950c/pa/KY70746_4191d9a5bf580b7c528fedb67f9c99ce.jpg already downloaded
2026-01-28 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F6b%252F8f6b0c83d8ef22390c7cd576a1da950c%252Fpa%252FKY70746_2f1a3fc41419800092d6db9ad6f11af3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/6b/8f6b0c83d8ef22390c7cd576a1da950c/pa/KY70746_2f1a3fc41419800092d6db9ad6f11af3.jpg already downloaded
2026-01-28 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F6b%252F8f6b0c83d8ef22390c7cd576a1da950c%252Fpa%252FKY70746_d5044ca5511714895f3b365c30df7907.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/6b/8f6b0c83d8ef22390c7cd576a1da950c/pa/KY70746_d5044ca5511714895f3b365c30df7907.jpg already downloaded
2026-01-28 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F6b%252F8f6b0c83d8ef22390c7cd576a1da950c%252Fpa%252FKY70746_faf219b59939c27d64d741736c7eb691.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/6b/8f6b0c83d8ef22390c7cd576a1da950c/pa/KY70746_faf219b59939c27d64d741736c7eb691.jpg already downloaded
2026-01-28 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F6b%252F8f6b0c83d8ef22390c7cd576a1da950c%252Fpa%252FKY70746_dbece13f613428365cb73bee16f4a230.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/6b/8f6b0c83d8ef22390c7cd576a1da950c/pa/KY70746_dbece13f613428365cb73bee16f4a230.jpg already downloaded
2026-01-28 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F6b%252F8f6b0c83d8ef22390c7cd576a1da950c%252Fpa%252FKY70746_b28993e1857a631cf2a2a48c6a9b2424.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/6b/8f6b0c83d8ef22390c7cd576a1da950c/pa/KY70746_b28993e1857a631cf2a2a48c6a9b2424.jpg already downloaded
2026-01-28 20:07:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f17ccc5d-ba7e-51dd-9efb-5956620baa2e, identifier: KY70746
2026-01-28 20:07:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 98151db2-4aa4-5a40-84f5-bc81e535a501 with identifier: NZ23957
2026-01-28 20:07:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 98151db2-4aa4-5a40-84f5-bc81e535a501 with identifier: NZ23957
2026-01-28 20:07:16 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'silver', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'ssangyong tivoli 1.6 easy 4x2', 'price': 0, 'currency': 'eur', 'make': 'ssangyong', 'model': 'tivoli', 'transmission': 'manual', 'odometer': 97171, 'odometer_reading_unit': 'km', 'registration_date': '2018-10-15', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/nz23957', 'expiration_date': '2026-01-29t16:07:08z', 'origin_country_code': 'it', 'trim': 'easy 4x2', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 128, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.6l', 'location': 'it, milazzo', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6d-temp', 'c_o_2_emission_value': 166, 'id': '98151db2-4aa4-5a40-84f5-bc81e535a501', 'current_year_diff': 8, 'age_in_months': 87, 'make_model': 'ssangyong tivoli', 'sanitized_make': 'ssangyong', 'odometer_in_km': 97171}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 87,
     'auction_title': '',
     'c_o_2_emission_value': 166,
     'category': None,
     'color': 'silver',
     'currency': 'eur',
     'current_year_diff': 8,
     'doors_number': 5,
     'emission_standard': 'euro 6d-temp',
     'engine': '1.6l',
     'engine_horse_power': 128,
     'expiration_date': '2026-01-29t16:07:08z',
     'fuel_type': 'petrol',
     'id': '98151db2-4aa4-5a40-84f5-bc81e535a501',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/nz23957',
     'listing': 'auction',
     'location': 'it, milazzo',
     'make': 'ssangyong',
     'make_model': 'ssangyong tivoli',
     'model': 'tivoli',
     'odometer': 97171,
     'odometer_in_km': 97171,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'it',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2018-10-15',
     'sanitized_make': 'ssangyong',
     'seats_number': 5,
     'seller_name': None,
     'title': 'ssangyong tivoli 1.6 easy 4x2',
     'transmission': 'manual',
     'trim': 'easy 4x2',
     'year': 2018}
2026-01-28 20:07:16 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_NOT_ALLOWED failed for item: 98151db2-4aa4-5a40-84f5-bc81e535a501 spider: auto1.it
2026-01-28 20:07:16 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 98151db2-4aa4-5a40-84f5-bc81e535a501 due to rule: makes_not_allowed.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'silver', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'ssangyong tivoli 1.6 easy 4x2', 'price': 0, 'currency': 'eur', 'make': 'ssangyong', 'model': 'tivoli', 'transmission': 'manual', 'odometer': 97171, 'odometer_reading_unit': 'km', 'registration_date': '2018-10-15', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/nz23957', 'expiration_date': '2026-01-29t16:07:08z', 'origin_country_code': 'it', 'trim': 'easy 4x2', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 128, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': False, 'engine': '1.6l', 'location': 'it, milazzo', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6d-temp', 'c_o_2_emission_value': 166, 'id': '98151db2-4aa4-5a40-84f5-bc81e535a501', 'current_year_diff': 8, 'age_in_months': 87, 'make_model': 'ssangyong tivoli', 'sanitized_make': 'ssangyong', 'odometer_in_km': 97171}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 87,
     'auction_title': '',
     'c_o_2_emission_value': 166,
     'category': None,
     'color': 'silver',
     'currency': 'eur',
     'current_year_diff': 8,
     'doors_number': 5,
     'emission_standard': 'euro 6d-temp',
     'engine': '1.6l',
     'engine_horse_power': 128,
     'expiration_date': '2026-01-29t16:07:08z',
     'fuel_type': 'petrol',
     'id': '98151db2-4aa4-5a40-84f5-bc81e535a501',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/nz23957',
     'listing': 'auction',
     'location': 'it, milazzo',
     'make': 'ssangyong',
     'make_model': 'ssangyong tivoli',
     'model': 'tivoli',
     'odometer': 97171,
     'odometer_in_km': 97171,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'it',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2018-10-15',
     'sanitized_make': 'ssangyong',
     'seats_number': 5,
     'seller_name': None,
     'title': 'ssangyong tivoli 1.6 easy 4x2',
     'transmission': 'manual',
     'trim': 'easy 4x2',
     'year': 2018}
{'auction_title': '',
 'c_o_2_emission_value': 166,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.6L',
 'engine_horse_power': 128,
 'expiration_date': '2026-01-29T16:07:08Z',
 'fuel_type': 'petrol',
 'id': '98151db2-4aa4-5a40-84f5-bc81e535a501',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NZ23957',
 'listing': 'auction',
 'location': 'IT, Milazzo',
 'make': 'Ssangyong',
 'model': 'Tivoli',
 'odometer': 97171,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-10-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ssangyong Tivoli 1.6 Easy 4x2',
 'transmission': 'manual',
 'trim': 'Easy 4x2',
 'year': 2018}
2026-01-28 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NZ23957%27 HTTP/1.1" 200 None
2026-01-28 20:07:16 [auto1.it] INFO: Saving data for NZ23957: {'auction_closing_time': 1769702828.0, 'created_time': 1768471402.057364, 'last_price_update_time': 1769630836.333155}
2026-01-28 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NZ23957') HTTP/1.1" 204 0
2026-01-28 20:07:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a29707ce-c7f5-5813-a79a-b969c24a53c8 with identifier: NS14568
2026-01-28 20:07:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a29707ce-c7f5-5813-a79a-b969c24a53c8 with identifier: NS14568
2026-01-28 20:07:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a29707ce-c7f5-5813-a79a-b969c24a53c8 with identifier: NS14568 to the API
2026-01-28 20:07:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:07:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:07:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NS14568>
{'auction_title': '',
 'c_o_2_emission_value': 155,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '2.0L',
 'engine_horse_power': 210,
 'expiration_date': '2026-01-29T16:20:03Z',
 'fuel_type': 'petrol',
 'id': 'a29707ce-c7f5-5813-a79a-b969c24a53c8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NS14568',
 'listing': 'auction',
 'location': 'IT, Milazzo',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 44558,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-05-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 250 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2018}
2026-01-28 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NS14568%27 HTTP/1.1" 200 None
2026-01-28 20:07:16 [auto1.it] INFO: Saving data for NS14568: {'auction_closing_time': 1769703603.0, 'created_time': 1767953510.532434, 'last_price_update_time': 1769630836.884557}
2026-01-28 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NS14568') HTTP/1.1" 204 0
2026-01-28 20:07:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 43681869-9f06-5f9d-82ca-86d8f1244288 with identifier: SU23914
2026-01-28 20:07:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 43681869-9f06-5f9d-82ca-86d8f1244288 with identifier: SU23914
2026-01-28 20:07:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 43681869-9f06-5f9d-82ca-86d8f1244288 with identifier: SU23914 to the API
2026-01-28 20:07:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:07:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:07:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SU23914>
{'auction_title': '',
 'c_o_2_emission_value': 173,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 177,
 'expiration_date': '2026-01-29T16:55:54Z',
 'fuel_type': 'petrol',
 'id': '43681869-9f06-5f9d-82ca-86d8f1244288',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SU23914',
 'listing': 'auction',
 'location': 'IT, Milano',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 59344,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 14,
 'photo_urls': ['https://img-pa.auto1.com/img3c/dc/3cdc924cbe41dcbd9e4d8e2932cc3a1a/pa/SU23914_f789038f31443d11a903468716c53049.jpg',
                'https://img-pa.auto1.com/img3c/dc/3cdc924cbe41dcbd9e4d8e2932cc3a1a/pa/SU23914_b6cee0ed185f474061d8455461557aeb.jpg',
                'https://img-pa.auto1.com/img3c/dc/3cdc924cbe41dcbd9e4d8e2932cc3a1a/pa/SU23914_5d5a3e3879a74d9509c0843a227574ad.jpg',
                'https://img-pa.auto1.com/img3c/dc/3cdc924cbe41dcbd9e4d8e2932cc3a1a/pa/SU23914_8938b599db8039f5eeecb56785530279.jpg',
                'https://img-pa.auto1.com/img3c/dc/3cdc924cbe41dcbd9e4d8e2932cc3a1a/pa/SU23914_75dfe5cc59100160faabbcc7b438d636.jpg',
                'https://img-pa.auto1.com/img3c/dc/3cdc924cbe41dcbd9e4d8e2932cc3a1a/pa/SU23914_da25aa4128a6eea87fe8544ab622d797.jpg',
                'https://img-pa.auto1.com/img3c/dc/3cdc924cbe41dcbd9e4d8e2932cc3a1a/pa/SU23914_051bdc5c6a9daf756368b89831a1072f.jpg',
                'https://img-pa.auto1.com/img3c/dc/3cdc924cbe41dcbd9e4d8e2932cc3a1a/pa/SU23914_94848e7c2e55bb89b6e4a7ab0f0c5a89.jpg',
                'https://img-pa.auto1.com/img3c/dc/3cdc924cbe41dcbd9e4d8e2932cc3a1a/pa/SU23914_0ac56dbe9cb89bdf31232394b3532426.jpg',
                'https://img-pa.auto1.com/img3c/dc/3cdc924cbe41dcbd9e4d8e2932cc3a1a/pa/SU23914_c15f156714fb8f6cc7f8a9fb60001b4c.jpg',
                'https://img-pa.auto1.com/img3c/dc/3cdc924cbe41dcbd9e4d8e2932cc3a1a/pa/SU23914_35d866c2b7d3f6e5692041f893e3b33f.jpg',
                'https://img-pa.auto1.com/img3c/dc/3cdc924cbe41dcbd9e4d8e2932cc3a1a/pa/SU23914_078c8486bc3215b26a6112e182426a3e.jpg',
                'https://img-pa.auto1.com/img3c/dc/3cdc924cbe41dcbd9e4d8e2932cc3a1a/pa/SU23914_f1f04567e8315678883791110787ee89.jpg',
                'https://img-pa.auto1.com/img3c/dc/3cdc924cbe41dcbd9e4d8e2932cc3a1a/pa/SU23914_e8de94fd4ae5119db99b80e2a2abcd98.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43681869-9f06-5f9d-82ca-86d8f1244288/43681869-9f06-5f9d-82ca-86d8f1244288_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 123342,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/dc/3cdc924cbe41dcbd9e4d8e2932cc3a1a/pa/SU23914_f789038f31443d11a903468716c53049.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43681869-9f06-5f9d-82ca-86d8f1244288/43681869-9f06-5f9d-82ca-86d8f1244288_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 123342,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/dc/3cdc924cbe41dcbd9e4d8e2932cc3a1a/pa/SU23914_b6cee0ed185f474061d8455461557aeb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43681869-9f06-5f9d-82ca-86d8f1244288/43681869-9f06-5f9d-82ca-86d8f1244288_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 127090,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/dc/3cdc924cbe41dcbd9e4d8e2932cc3a1a/pa/SU23914_5d5a3e3879a74d9509c0843a227574ad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43681869-9f06-5f9d-82ca-86d8f1244288/43681869-9f06-5f9d-82ca-86d8f1244288_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112044,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/dc/3cdc924cbe41dcbd9e4d8e2932cc3a1a/pa/SU23914_8938b599db8039f5eeecb56785530279.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43681869-9f06-5f9d-82ca-86d8f1244288/43681869-9f06-5f9d-82ca-86d8f1244288_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 128468,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/dc/3cdc924cbe41dcbd9e4d8e2932cc3a1a/pa/SU23914_75dfe5cc59100160faabbcc7b438d636.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43681869-9f06-5f9d-82ca-86d8f1244288/43681869-9f06-5f9d-82ca-86d8f1244288_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 114067,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/dc/3cdc924cbe41dcbd9e4d8e2932cc3a1a/pa/SU23914_da25aa4128a6eea87fe8544ab622d797.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43681869-9f06-5f9d-82ca-86d8f1244288/43681869-9f06-5f9d-82ca-86d8f1244288_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102845,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/dc/3cdc924cbe41dcbd9e4d8e2932cc3a1a/pa/SU23914_051bdc5c6a9daf756368b89831a1072f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43681869-9f06-5f9d-82ca-86d8f1244288/43681869-9f06-5f9d-82ca-86d8f1244288_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86691,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/dc/3cdc924cbe41dcbd9e4d8e2932cc3a1a/pa/SU23914_94848e7c2e55bb89b6e4a7ab0f0c5a89.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43681869-9f06-5f9d-82ca-86d8f1244288/43681869-9f06-5f9d-82ca-86d8f1244288_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89439,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/dc/3cdc924cbe41dcbd9e4d8e2932cc3a1a/pa/SU23914_0ac56dbe9cb89bdf31232394b3532426.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43681869-9f06-5f9d-82ca-86d8f1244288/43681869-9f06-5f9d-82ca-86d8f1244288_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69555,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/dc/3cdc924cbe41dcbd9e4d8e2932cc3a1a/pa/SU23914_c15f156714fb8f6cc7f8a9fb60001b4c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43681869-9f06-5f9d-82ca-86d8f1244288/43681869-9f06-5f9d-82ca-86d8f1244288_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85226,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/dc/3cdc924cbe41dcbd9e4d8e2932cc3a1a/pa/SU23914_35d866c2b7d3f6e5692041f893e3b33f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43681869-9f06-5f9d-82ca-86d8f1244288/43681869-9f06-5f9d-82ca-86d8f1244288_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34859,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/dc/3cdc924cbe41dcbd9e4d8e2932cc3a1a/pa/SU23914_078c8486bc3215b26a6112e182426a3e.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43681869-9f06-5f9d-82ca-86d8f1244288/43681869-9f06-5f9d-82ca-86d8f1244288_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88801,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/dc/3cdc924cbe41dcbd9e4d8e2932cc3a1a/pa/SU23914_f1f04567e8315678883791110787ee89.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43681869-9f06-5f9d-82ca-86d8f1244288/43681869-9f06-5f9d-82ca-86d8f1244288_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60654,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/dc/3cdc924cbe41dcbd9e4d8e2932cc3a1a/pa/SU23914_e8de94fd4ae5119db99b80e2a2abcd98.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-02-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 TGDI Xprime ISG 2WD',
 'transmission': 'automatic',
 'trim': 'Xprime ISG 2WD',
 'year': 2020}
2026-01-28 20:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SU23914%27 HTTP/1.1" 200 None
2026-01-28 20:07:17 [auto1.it] INFO: Saving data for SU23914: {'created_time': 1769630837.257894, 'last_price_update_time': 1769630837.257904, 'auction_closing_time': 1769705754.0}
2026-01-28 20:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SU23914') HTTP/1.1" 204 0
2026-01-28 20:07:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 01b4aacc-e245-587e-a919-de55face0462 with identifier: XP38725
2026-01-28 20:07:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 01b4aacc-e245-587e-a919-de55face0462 with identifier: XP38725
2026-01-28 20:07:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 01b4aacc-e245-587e-a919-de55face0462 with identifier: XP38725 to the API
2026-01-28 20:07:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:07:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:07:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XP38725>
{'auction_title': '',
 'c_o_2_emission_value': 229,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 510,
 'expiration_date': '2026-01-29T16:33:44Z',
 'fuel_type': 'petrol',
 'id': '01b4aacc-e245-587e-a919-de55face0462',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XP38725',
 'listing': 'auction',
 'location': 'IT',
 'make': 'BMW',
 'model': '4er',
 'odometer': 22171,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-02-06',
 'seats_number': 4,
 'seller_name': None,
 'title': 'BMW 4er M4 xDrive Competition',
 'transmission': 'automatic',
 'trim': 'xDrive Competition',
 'year': 2024}
2026-01-28 20:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27XP38725%27 HTTP/1.1" 200 None
2026-01-28 20:07:17 [auto1.it] INFO: Saving data for XP38725: {'auction_closing_time': 1769704424.0, 'created_time': 1769458151.85409, 'last_price_update_time': 1769630837.58541}
2026-01-28 20:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='XP38725') HTTP/1.1" 204 0
2026-01-28 20:07:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 28de05d6-76f4-5f6a-86d4-546d77c72ce3 with identifier: MW21403
2026-01-28 20:07:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 28de05d6-76f4-5f6a-86d4-546d77c72ce3 with identifier: MW21403
2026-01-28 20:07:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 28de05d6-76f4-5f6a-86d4-546d77c72ce3 with identifier: MW21403 to the API
2026-01-28 20:07:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:07:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:07:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MW21403>
{'auction_title': '',
 'c_o_2_emission_value': 152,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.5L',
 'engine_horse_power': 197,
 'expiration_date': '2026-01-29T16:02:41Z',
 'fuel_type': 'hybrid',
 'id': '28de05d6-76f4-5f6a-86d4-546d77c72ce3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MW21403',
 'listing': 'auction',
 'location': 'IT',
 'make': 'Toyota',
 'model': 'RAV 4',
 'odometer': 114391,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-09-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota RAV 4 2.5 Hybrid Dynamic+',
 'transmission': 'automatic',
 'trim': 'Dynamic+',
 'year': 2018}
2026-01-28 20:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MW21403%27 HTTP/1.1" 200 None
2026-01-28 20:07:17 [auto1.it] INFO: Saving data for MW21403: {'auction_closing_time': 1769702561.0, 'created_time': 1769457989.150987, 'last_price_update_time': 1769630837.962988}
2026-01-28 20:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MW21403') HTTP/1.1" 204 0
2026-01-28 20:07:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f17ccc5d-ba7e-51dd-9efb-5956620baa2e with identifier: KY70746
2026-01-28 20:07:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f17ccc5d-ba7e-51dd-9efb-5956620baa2e with identifier: KY70746
2026-01-28 20:07:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f17ccc5d-ba7e-51dd-9efb-5956620baa2e with identifier: KY70746 to the API
2026-01-28 20:07:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:07:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:07:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KY70746>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.6L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:30:14Z',
 'fuel_type': 'diesel',
 'id': 'f17ccc5d-ba7e-51dd-9efb-5956620baa2e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KY70746',
 'listing': 'auction',
 'location': 'IT, Settimo Torinese',
 'make': 'Fiat',
 'model': 'Tipo',
 'odometer': 23213,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img8f/6b/8f6b0c83d8ef22390c7cd576a1da950c/pa/KY70746_216bbcdec046793eecc173bf37b2e64f.jpg',
                'https://img-pa.auto1.com/img8f/6b/8f6b0c83d8ef22390c7cd576a1da950c/pa/KY70746_f76ab1e1f3fe067b7aa1f8363db73db7.jpg',
                'https://img-pa.auto1.com/img8f/6b/8f6b0c83d8ef22390c7cd576a1da950c/pa/KY70746_28bb7a50c74e0a7d8af7fdbf40490194.jpg',
                'https://img-pa.auto1.com/img8f/6b/8f6b0c83d8ef22390c7cd576a1da950c/pa/KY70746_5ace3f71a697638019dd1f047d559ea6.jpg',
                'https://img-pa.auto1.com/img8f/6b/8f6b0c83d8ef22390c7cd576a1da950c/pa/KY70746_0f0768885151814889e03fe69816fa5d.jpg',
                'https://img-pa.auto1.com/img8f/6b/8f6b0c83d8ef22390c7cd576a1da950c/pa/KY70746_f20f93a3b25b208556a83849896ffe82.jpg',
                'https://img-pa.auto1.com/img8f/6b/8f6b0c83d8ef22390c7cd576a1da950c/pa/KY70746_abd938cf3f9c65b1ed539cfcbcfc58e7.jpg',
                'https://img-pa.auto1.com/img8f/6b/8f6b0c83d8ef22390c7cd576a1da950c/pa/KY70746_f031eef1922fbb4944d7d6832678c116.jpg',
                'https://img-pa.auto1.com/img8f/6b/8f6b0c83d8ef22390c7cd576a1da950c/pa/KY70746_b5200000a371af145c9de71ec9637b8e.jpg',
                'https://img-pa.auto1.com/img8f/6b/8f6b0c83d8ef22390c7cd576a1da950c/pa/KY70746_5bb75ed6a35c94469784dae5f905e0e3.jpg',
                'https://img-pa.auto1.com/img8f/6b/8f6b0c83d8ef22390c7cd576a1da950c/pa/KY70746_4191d9a5bf580b7c528fedb67f9c99ce.jpg',
                'https://img-pa.auto1.com/img8f/6b/8f6b0c83d8ef22390c7cd576a1da950c/pa/KY70746_2f1a3fc41419800092d6db9ad6f11af3.jpg',
                'https://img-pa.auto1.com/img8f/6b/8f6b0c83d8ef22390c7cd576a1da950c/pa/KY70746_d5044ca5511714895f3b365c30df7907.jpg',
                'https://img-pa.auto1.com/img8f/6b/8f6b0c83d8ef22390c7cd576a1da950c/pa/KY70746_faf219b59939c27d64d741736c7eb691.jpg',
                'https://img-pa.auto1.com/img8f/6b/8f6b0c83d8ef22390c7cd576a1da950c/pa/KY70746_dbece13f613428365cb73bee16f4a230.jpg',
                'https://img-pa.auto1.com/img8f/6b/8f6b0c83d8ef22390c7cd576a1da950c/pa/KY70746_b28993e1857a631cf2a2a48c6a9b2424.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f17ccc5d-ba7e-51dd-9efb-5956620baa2e/f17ccc5d-ba7e-51dd-9efb-5956620baa2e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2939610,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/6b/8f6b0c83d8ef22390c7cd576a1da950c/pa/KY70746_216bbcdec046793eecc173bf37b2e64f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f17ccc5d-ba7e-51dd-9efb-5956620baa2e/f17ccc5d-ba7e-51dd-9efb-5956620baa2e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2877083,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/6b/8f6b0c83d8ef22390c7cd576a1da950c/pa/KY70746_f76ab1e1f3fe067b7aa1f8363db73db7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f17ccc5d-ba7e-51dd-9efb-5956620baa2e/f17ccc5d-ba7e-51dd-9efb-5956620baa2e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2712345,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/6b/8f6b0c83d8ef22390c7cd576a1da950c/pa/KY70746_28bb7a50c74e0a7d8af7fdbf40490194.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f17ccc5d-ba7e-51dd-9efb-5956620baa2e/f17ccc5d-ba7e-51dd-9efb-5956620baa2e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2332794,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/6b/8f6b0c83d8ef22390c7cd576a1da950c/pa/KY70746_5ace3f71a697638019dd1f047d559ea6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f17ccc5d-ba7e-51dd-9efb-5956620baa2e/f17ccc5d-ba7e-51dd-9efb-5956620baa2e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2888797,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/6b/8f6b0c83d8ef22390c7cd576a1da950c/pa/KY70746_0f0768885151814889e03fe69816fa5d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f17ccc5d-ba7e-51dd-9efb-5956620baa2e/f17ccc5d-ba7e-51dd-9efb-5956620baa2e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2570401,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/6b/8f6b0c83d8ef22390c7cd576a1da950c/pa/KY70746_f20f93a3b25b208556a83849896ffe82.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f17ccc5d-ba7e-51dd-9efb-5956620baa2e/f17ccc5d-ba7e-51dd-9efb-5956620baa2e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2382283,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/6b/8f6b0c83d8ef22390c7cd576a1da950c/pa/KY70746_abd938cf3f9c65b1ed539cfcbcfc58e7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f17ccc5d-ba7e-51dd-9efb-5956620baa2e/f17ccc5d-ba7e-51dd-9efb-5956620baa2e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2739976,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/6b/8f6b0c83d8ef22390c7cd576a1da950c/pa/KY70746_f031eef1922fbb4944d7d6832678c116.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f17ccc5d-ba7e-51dd-9efb-5956620baa2e/f17ccc5d-ba7e-51dd-9efb-5956620baa2e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2935747,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/6b/8f6b0c83d8ef22390c7cd576a1da950c/pa/KY70746_b5200000a371af145c9de71ec9637b8e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f17ccc5d-ba7e-51dd-9efb-5956620baa2e/f17ccc5d-ba7e-51dd-9efb-5956620baa2e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2787236,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/6b/8f6b0c83d8ef22390c7cd576a1da950c/pa/KY70746_5bb75ed6a35c94469784dae5f905e0e3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f17ccc5d-ba7e-51dd-9efb-5956620baa2e/f17ccc5d-ba7e-51dd-9efb-5956620baa2e_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2451899,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/6b/8f6b0c83d8ef22390c7cd576a1da950c/pa/KY70746_4191d9a5bf580b7c528fedb67f9c99ce.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f17ccc5d-ba7e-51dd-9efb-5956620baa2e/f17ccc5d-ba7e-51dd-9efb-5956620baa2e_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2667975,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/6b/8f6b0c83d8ef22390c7cd576a1da950c/pa/KY70746_2f1a3fc41419800092d6db9ad6f11af3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f17ccc5d-ba7e-51dd-9efb-5956620baa2e/f17ccc5d-ba7e-51dd-9efb-5956620baa2e_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2824625,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/6b/8f6b0c83d8ef22390c7cd576a1da950c/pa/KY70746_d5044ca5511714895f3b365c30df7907.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f17ccc5d-ba7e-51dd-9efb-5956620baa2e/f17ccc5d-ba7e-51dd-9efb-5956620baa2e_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2395329,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/6b/8f6b0c83d8ef22390c7cd576a1da950c/pa/KY70746_faf219b59939c27d64d741736c7eb691.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f17ccc5d-ba7e-51dd-9efb-5956620baa2e/f17ccc5d-ba7e-51dd-9efb-5956620baa2e_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59148,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/6b/8f6b0c83d8ef22390c7cd576a1da950c/pa/KY70746_dbece13f613428365cb73bee16f4a230.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f17ccc5d-ba7e-51dd-9efb-5956620baa2e/f17ccc5d-ba7e-51dd-9efb-5956620baa2e_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62035,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/6b/8f6b0c83d8ef22390c7cd576a1da950c/pa/KY70746_b28993e1857a631cf2a2a48c6a9b2424.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2025-02-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat Tipo 1.6 M-Jet City',
 'transmission': 'manual',
 'trim': 'City',
 'year': 2025}
2026-01-28 20:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KY70746%27 HTTP/1.1" 200 None
2026-01-28 20:07:18 [auto1.it] INFO: Saving data for KY70746: {'created_time': 1769630838.312032, 'last_price_update_time': 1769630838.312045, 'auction_closing_time': 1769704214.0}
2026-01-28 20:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KY70746') HTTP/1.1" 204 0
2026-01-28 20:07:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08c8e510>
2026-01-28 20:07:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:07:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_952ac053-e29b-5def-9dce-861a2bf03e69/952ac053-e29b-5def-9dce-861a2bf03e69_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F1c%252Fe21cfb98a73e65a314352c3a1ce5c145%252Fpa%252FBM05081_5a63eea88f1d19a3e33e2d31b30d7061.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/1c/e21cfb98a73e65a314352c3a1ce5c145/pa/BM05081_5a63eea88f1d19a3e33e2d31b30d7061.jpg saved to cache
2026-01-28 20:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 952ac053-e29b-5def-9dce-861a2bf03e69
2026-01-28 20:07:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:07:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08b2ce50>
2026-01-28 20:07:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8f04c0b-f98d-50df-a365-6ef5b27ef7fc/d8f04c0b-f98d-50df-a365-6ef5b27ef7fc_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F0b%252F2c0bb7ccc201057468358464a15bb096%252Fpa%252FKX95898_acc48f0d82e32a50d57c6c1845fe6c60.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/0b/2c0bb7ccc201057468358464a15bb096/pa/KX95898_acc48f0d82e32a50d57c6c1845fe6c60.jpg saved to cache
2026-01-28 20:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d8f04c0b-f98d-50df-a365-6ef5b27ef7fc
2026-01-28 20:07:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09fe8cd0>
2026-01-28 20:07:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:07:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8f04c0b-f98d-50df-a365-6ef5b27ef7fc/d8f04c0b-f98d-50df-a365-6ef5b27ef7fc_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F0b%252F2c0bb7ccc201057468358464a15bb096%252Fpa%252FKX95898_daf747ba2233026e74d5f1cf7061fc4e.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/0b/2c0bb7ccc201057468358464a15bb096/pa/KX95898_daf747ba2233026e74d5f1cf7061fc4e.jpg saved to cache
2026-01-28 20:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d8f04c0b-f98d-50df-a365-6ef5b27ef7fc
2026-01-28 20:07:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0a0f43d0>
2026-01-28 20:07:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:07:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8f04c0b-f98d-50df-a365-6ef5b27ef7fc/d8f04c0b-f98d-50df-a365-6ef5b27ef7fc_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F0b%252F2c0bb7ccc201057468358464a15bb096%252Fpa%252FKX95898_846fd19f770610642df44b62d04776d8.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/0b/2c0bb7ccc201057468358464a15bb096/pa/KX95898_846fd19f770610642df44b62d04776d8.jpg saved to cache
2026-01-28 20:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d8f04c0b-f98d-50df-a365-6ef5b27ef7fc
2026-01-28 20:07:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d8f04c0b-f98d-50df-a365-6ef5b27ef7fc, skipping ID generation
2026-01-28 20:07:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8f04c0b-f98d-50df-a365-6ef5b27ef7fc with scrape type 1
2026-01-28 20:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Removing item d8f04c0b-f98d-50df-a365-6ef5b27ef7fc from tracking dictionaries
2026-01-28 20:07:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d8f04c0b-f98d-50df-a365-6ef5b27ef7fc sending to next pipeline
2026-01-28 20:07:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d8f04c0b-f98d-50df-a365-6ef5b27ef7fc, identifier: KX95898
2026-01-28 20:07:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08c06cd0>
2026-01-28 20:07:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_952ac053-e29b-5def-9dce-861a2bf03e69/952ac053-e29b-5def-9dce-861a2bf03e69_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F1c%252Fe21cfb98a73e65a314352c3a1ce5c145%252Fpa%252FBM05081_1f8ff955862e0330c0cd6126a93e977f.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/1c/e21cfb98a73e65a314352c3a1ce5c145/pa/BM05081_1f8ff955862e0330c0cd6126a93e977f.jpg saved to cache
2026-01-28 20:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 952ac053-e29b-5def-9dce-861a2bf03e69
2026-01-28 20:07:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d8f04c0b-f98d-50df-a365-6ef5b27ef7fc with identifier: KX95898
2026-01-28 20:07:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d8f04c0b-f98d-50df-a365-6ef5b27ef7fc with identifier: KX95898
2026-01-28 20:07:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d8f04c0b-f98d-50df-a365-6ef5b27ef7fc with identifier: KX95898 to the API
2026-01-28 20:07:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:07:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:07:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img2c/0b/2c0bb7ccc201057468358464a15bb096/pa/KX95898_846fd19f770610642df44b62d04776d8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:32:27Z',
 'fuel_type': 'hybrid',
 'id': 'd8f04c0b-f98d-50df-a365-6ef5b27ef7fc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KX95898',
 'listing': 'auction',
 'location': 'IT, Catania',
 'make': 'Honda',
 'model': 'HR-V',
 'odometer': 30296,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8f04c0b-f98d-50df-a365-6ef5b27ef7fc/d8f04c0b-f98d-50df-a365-6ef5b27ef7fc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66609,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/0b/2c0bb7ccc201057468358464a15bb096/pa/KX95898_846fd19f770610642df44b62d04776d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8f04c0b-f98d-50df-a365-6ef5b27ef7fc/d8f04c0b-f98d-50df-a365-6ef5b27ef7fc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63420,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/0b/2c0bb7ccc201057468358464a15bb096/pa/KX95898_daf747ba2233026e74d5f1cf7061fc4e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8f04c0b-f98d-50df-a365-6ef5b27ef7fc/d8f04c0b-f98d-50df-a365-6ef5b27ef7fc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2410026,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/0b/2c0bb7ccc201057468358464a15bb096/pa/KX95898_acc48f0d82e32a50d57c6c1845fe6c60.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8f04c0b-f98d-50df-a365-6ef5b27ef7fc/d8f04c0b-f98d-50df-a365-6ef5b27ef7fc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48250,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/0b/2c0bb7ccc201057468358464a15bb096/pa/KX95898_ba4ca12f41951c737780ca6c2582e63e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8f04c0b-f98d-50df-a365-6ef5b27ef7fc/d8f04c0b-f98d-50df-a365-6ef5b27ef7fc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62290,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/0b/2c0bb7ccc201057468358464a15bb096/pa/KX95898_7210d890d6ab0619f1e66cf376a39a8d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8f04c0b-f98d-50df-a365-6ef5b27ef7fc/d8f04c0b-f98d-50df-a365-6ef5b27ef7fc_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63228,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/0b/2c0bb7ccc201057468358464a15bb096/pa/KX95898_051b8a398b6a93e55f7e4112919efb41.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8f04c0b-f98d-50df-a365-6ef5b27ef7fc/d8f04c0b-f98d-50df-a365-6ef5b27ef7fc_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51961,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/0b/2c0bb7ccc201057468358464a15bb096/pa/KX95898_3c82398c417258fd1ad8706c3a0213ea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8f04c0b-f98d-50df-a365-6ef5b27ef7fc/d8f04c0b-f98d-50df-a365-6ef5b27ef7fc_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71619,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/0b/2c0bb7ccc201057468358464a15bb096/pa/KX95898_e7f8313fdbcee20d116121faba963a48.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8f04c0b-f98d-50df-a365-6ef5b27ef7fc/d8f04c0b-f98d-50df-a365-6ef5b27ef7fc_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66880,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/0b/2c0bb7ccc201057468358464a15bb096/pa/KX95898_e27dcb0e34f9fa92bf4ae0097b35941f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8f04c0b-f98d-50df-a365-6ef5b27ef7fc/d8f04c0b-f98d-50df-a365-6ef5b27ef7fc_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50526,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/0b/2c0bb7ccc201057468358464a15bb096/pa/KX95898_3bb1a046acfead663c566fa8d66021d0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8f04c0b-f98d-50df-a365-6ef5b27ef7fc/d8f04c0b-f98d-50df-a365-6ef5b27ef7fc_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2526512,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/0b/2c0bb7ccc201057468358464a15bb096/pa/KX95898_2f468249333264dcd954678733784ab1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8f04c0b-f98d-50df-a365-6ef5b27ef7fc/d8f04c0b-f98d-50df-a365-6ef5b27ef7fc_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56312,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/0b/2c0bb7ccc201057468358464a15bb096/pa/KX95898_e7c319bc45f3b05da5e2b98a57e50716.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8f04c0b-f98d-50df-a365-6ef5b27ef7fc/d8f04c0b-f98d-50df-a365-6ef5b27ef7fc_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42195,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/0b/2c0bb7ccc201057468358464a15bb096/pa/KX95898_9c5d2845c10c9c353e76abff916ed6d3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8f04c0b-f98d-50df-a365-6ef5b27ef7fc/d8f04c0b-f98d-50df-a365-6ef5b27ef7fc_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2580539,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/0b/2c0bb7ccc201057468358464a15bb096/pa/KX95898_79ee016fd542190eba35fae78069f4c5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8f04c0b-f98d-50df-a365-6ef5b27ef7fc/d8f04c0b-f98d-50df-a365-6ef5b27ef7fc_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53912,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/0b/2c0bb7ccc201057468358464a15bb096/pa/KX95898_4ddbb3ed8ef36e3e8462039038e7d51a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-07-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Honda HR-V 1.5 i-MMD Hybrid Elegance',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 2023}
2026-01-28 20:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KX95898%27 HTTP/1.1" 200 None
2026-01-28 20:07:20 [auto1.it] INFO: Saving data for KX95898: {'created_time': 1769630840.293993, 'last_price_update_time': 1769630840.294003, 'auction_closing_time': 1769704347.0}
2026-01-28 20:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KX95898') HTTP/1.1" 204 0
2026-01-28 20:07:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TU05159/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:07:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SB13925/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:07:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ME44881> (referer: https://www.auto1.com/v1/car-details-view/ME44881/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:07:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FN77058/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:07:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VH73112/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:07:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GV88147> (referer: https://www.auto1.com/v1/car-details-view/GV88147/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:07:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ML31196/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:07:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/1c/e21cfb98a73e65a314352c3a1ce5c145/pa/BM05081_1d83804e8454903afb78714766c7f201.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:07:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:07:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:07:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:07:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:07:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:07:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:07:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:07:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/1c/e21cfb98a73e65a314352c3a1ce5c145/pa/BM05081_354cd502d05ee8b9423025294f186afc.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:07:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c04edde-4be3-5f74-b0c2-968969e36d8d with identifier: ME44881
2026-01-28 20:07:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c04edde-4be3-5f74-b0c2-968969e36d8d with scrape type 2
2026-01-28 20:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4c04edde-4be3-5f74-b0c2-968969e36d8d with scrape type 2
2026-01-28 20:07:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4c04edde-4be3-5f74-b0c2-968969e36d8d, identifier: ME44881
2026-01-28 20:07:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4c04edde-4be3-5f74-b0c2-968969e36d8d with identifier: ME44881
2026-01-28 20:07:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4c04edde-4be3-5f74-b0c2-968969e36d8d with identifier: ME44881
2026-01-28 20:07:20 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'maserati grecale 2.0 turbo mild-hybrid gt awd', 'price': 0, 'currency': 'eur', 'make': 'maserati', 'model': 'grecale', 'transmission': 'automatic', 'odometer': 57729, 'odometer_reading_unit': 'km', 'registration_date': '2023-07-27', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/me44881', 'expiration_date': '2026-01-29t16:17:07z', 'origin_country_code': 'it', 'trim': 'gt awd', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 300, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '2.0l', 'location': 'it, capua', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6d', 'c_o_2_emission_value': 200, 'id': '4c04edde-4be3-5f74-b0c2-968969e36d8d', 'current_year_diff': 3, 'age_in_months': 30, 'make_model': 'maserati grecale', 'sanitized_make': 'maserati', 'odometer_in_km': 57729}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 30,
     'auction_title': '',
     'c_o_2_emission_value': 200,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6d',
     'engine': '2.0l',
     'engine_horse_power': 300,
     'expiration_date': '2026-01-29t16:17:07z',
     'fuel_type': 'petrol',
     'id': '4c04edde-4be3-5f74-b0c2-968969e36d8d',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/me44881',
     'listing': 'auction',
     'location': 'it, capua',
     'make': 'maserati',
     'make_model': 'maserati grecale',
     'model': 'grecale',
     'odometer': 57729,
     'odometer_in_km': 57729,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'it',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2023-07-27',
     'sanitized_make': 'maserati',
     'seats_number': 5,
     'seller_name': None,
     'title': 'maserati grecale 2.0 turbo mild-hybrid gt awd',
     'transmission': 'automatic',
     'trim': 'gt awd',
     'year': 2023}
2026-01-28 20:07:20 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_NOT_ALLOWED failed for item: 4c04edde-4be3-5f74-b0c2-968969e36d8d spider: auto1.it
2026-01-28 20:07:20 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 4c04edde-4be3-5f74-b0c2-968969e36d8d due to rule: makes_not_allowed.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'maserati grecale 2.0 turbo mild-hybrid gt awd', 'price': 0, 'currency': 'eur', 'make': 'maserati', 'model': 'grecale', 'transmission': 'automatic', 'odometer': 57729, 'odometer_reading_unit': 'km', 'registration_date': '2023-07-27', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/me44881', 'expiration_date': '2026-01-29t16:17:07z', 'origin_country_code': 'it', 'trim': 'gt awd', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 300, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '2.0l', 'location': 'it, capua', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6d', 'c_o_2_emission_value': 200, 'id': '4c04edde-4be3-5f74-b0c2-968969e36d8d', 'current_year_diff': 3, 'age_in_months': 30, 'make_model': 'maserati grecale', 'sanitized_make': 'maserati', 'odometer_in_km': 57729}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 30,
     'auction_title': '',
     'c_o_2_emission_value': 200,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6d',
     'engine': '2.0l',
     'engine_horse_power': 300,
     'expiration_date': '2026-01-29t16:17:07z',
     'fuel_type': 'petrol',
     'id': '4c04edde-4be3-5f74-b0c2-968969e36d8d',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/me44881',
     'listing': 'auction',
     'location': 'it, capua',
     'make': 'maserati',
     'make_model': 'maserati grecale',
     'model': 'grecale',
     'odometer': 57729,
     'odometer_in_km': 57729,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'it',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2023-07-27',
     'sanitized_make': 'maserati',
     'seats_number': 5,
     'seller_name': None,
     'title': 'maserati grecale 2.0 turbo mild-hybrid gt awd',
     'transmission': 'automatic',
     'trim': 'gt awd',
     'year': 2023}
{'auction_title': '',
 'c_o_2_emission_value': 200,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 300,
 'expiration_date': '2026-01-29T16:17:07Z',
 'fuel_type': 'petrol',
 'id': '4c04edde-4be3-5f74-b0c2-968969e36d8d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ME44881',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'Maserati',
 'model': 'Grecale',
 'odometer': 57729,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-07-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Maserati Grecale 2.0 Turbo Mild-Hybrid GT AWD',
 'transmission': 'automatic',
 'trim': 'GT AWD',
 'year': 2023}
2026-01-28 20:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ME44881%27 HTTP/1.1" 200 None
2026-01-28 20:07:20 [auto1.it] INFO: Saving data for ME44881: {'auction_closing_time': 1769703427.0, 'created_time': 1768817041.743056, 'last_price_update_time': 1769630840.785224}
2026-01-28 20:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ME44881') HTTP/1.1" 204 0
2026-01-28 20:07:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/58/bf584e0c6003bbd4bc54ee6710fb8f54/pa/YA96052_ddc765261cffbadbf9327b8f10b888f9.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:07:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b94a3930-95ad-5073-894e-3ea423bb1cdf with identifier: GV88147
2026-01-28 20:07:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b94a3930-95ad-5073-894e-3ea423bb1cdf with scrape type 1
2026-01-28 20:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item b94a3930-95ad-5073-894e-3ea423bb1cdf
2026-01-28 20:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Ff5%252F45f530bf4840c91b1a60444e24e2113c%252Fpa%252FGV88147_cadbf1a188261e0e439cd44a29eb3a59.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/f5/45f530bf4840c91b1a60444e24e2113c/pa/GV88147_cadbf1a188261e0e439cd44a29eb3a59.jpg already downloaded
2026-01-28 20:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Ff5%252F45f530bf4840c91b1a60444e24e2113c%252Fpa%252FGV88147_b67dbd17b00ebace522451d5e5ebc21c.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/f5/45f530bf4840c91b1a60444e24e2113c/pa/GV88147_b67dbd17b00ebace522451d5e5ebc21c.jpg already downloaded
2026-01-28 20:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Ff5%252F45f530bf4840c91b1a60444e24e2113c%252Fpa%252FGV88147_228733c5a684dd0418666c26b955db96.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/f5/45f530bf4840c91b1a60444e24e2113c/pa/GV88147_228733c5a684dd0418666c26b955db96.jpg already downloaded
2026-01-28 20:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Ff5%252F45f530bf4840c91b1a60444e24e2113c%252Fpa%252FGV88147_496e6bd182dcb7e48194aee13f0901e7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/f5/45f530bf4840c91b1a60444e24e2113c/pa/GV88147_496e6bd182dcb7e48194aee13f0901e7.jpg already downloaded
2026-01-28 20:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Ff5%252F45f530bf4840c91b1a60444e24e2113c%252Fpa%252FGV88147_c67c3abd41f4b320041eae626d312762.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/f5/45f530bf4840c91b1a60444e24e2113c/pa/GV88147_c67c3abd41f4b320041eae626d312762.jpg already downloaded
2026-01-28 20:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Ff5%252F45f530bf4840c91b1a60444e24e2113c%252Fpa%252FGV88147_b6dd196f994f2783e749c084fd594e67.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/f5/45f530bf4840c91b1a60444e24e2113c/pa/GV88147_b6dd196f994f2783e749c084fd594e67.jpg already downloaded
2026-01-28 20:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Ff5%252F45f530bf4840c91b1a60444e24e2113c%252Fpa%252FGV88147_c8e5acfe9a5b9c3953ecd9fc3d26fcf5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/f5/45f530bf4840c91b1a60444e24e2113c/pa/GV88147_c8e5acfe9a5b9c3953ecd9fc3d26fcf5.jpg already downloaded
2026-01-28 20:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Ff5%252F45f530bf4840c91b1a60444e24e2113c%252Fpa%252FGV88147_fca5b758bae6d6abb251a24926ef8877.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/f5/45f530bf4840c91b1a60444e24e2113c/pa/GV88147_fca5b758bae6d6abb251a24926ef8877.jpg already downloaded
2026-01-28 20:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Ff5%252F45f530bf4840c91b1a60444e24e2113c%252Fpa%252FGV88147_338b6fab0b20828baadc8dbd314d70e0.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/f5/45f530bf4840c91b1a60444e24e2113c/pa/GV88147_338b6fab0b20828baadc8dbd314d70e0.jpg already downloaded
2026-01-28 20:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Ff5%252F45f530bf4840c91b1a60444e24e2113c%252Fpa%252FGV88147_6712cf6dbb9d87144125c86e259dd279.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/f5/45f530bf4840c91b1a60444e24e2113c/pa/GV88147_6712cf6dbb9d87144125c86e259dd279.jpg already downloaded
2026-01-28 20:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Ff5%252F45f530bf4840c91b1a60444e24e2113c%252Fpa%252FGV88147_e92ad1a1d44baa31bd01db16be5c8d85.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/f5/45f530bf4840c91b1a60444e24e2113c/pa/GV88147_e92ad1a1d44baa31bd01db16be5c8d85.jpg already downloaded
2026-01-28 20:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Ff5%252F45f530bf4840c91b1a60444e24e2113c%252Fpa%252FGV88147_59e8e4437acd9beb40367fdca32a3cb0.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/f5/45f530bf4840c91b1a60444e24e2113c/pa/GV88147_59e8e4437acd9beb40367fdca32a3cb0.jpg already downloaded
2026-01-28 20:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Ff5%252F45f530bf4840c91b1a60444e24e2113c%252Fpa%252FGV88147_a59bc7252a9c097f557db70aa5cc756a.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/f5/45f530bf4840c91b1a60444e24e2113c/pa/GV88147_a59bc7252a9c097f557db70aa5cc756a.jpg already downloaded
2026-01-28 20:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Ff5%252F45f530bf4840c91b1a60444e24e2113c%252Fpa%252FGV88147_cae12c76a34a17ecb00ddfd5ec9397a7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/f5/45f530bf4840c91b1a60444e24e2113c/pa/GV88147_cae12c76a34a17ecb00ddfd5ec9397a7.jpg already downloaded
2026-01-28 20:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Ff5%252F45f530bf4840c91b1a60444e24e2113c%252Fpa%252FGV88147_fa0c49f81fa56803c10cf944c3e720d6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/f5/45f530bf4840c91b1a60444e24e2113c/pa/GV88147_fa0c49f81fa56803c10cf944c3e720d6.jpg already downloaded
2026-01-28 20:07:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b94a3930-95ad-5073-894e-3ea423bb1cdf, identifier: GV88147
2026-01-28 20:07:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08b2ded0>
2026-01-28 20:07:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_952ac053-e29b-5def-9dce-861a2bf03e69/952ac053-e29b-5def-9dce-861a2bf03e69_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F1c%252Fe21cfb98a73e65a314352c3a1ce5c145%252Fpa%252FBM05081_1d83804e8454903afb78714766c7f201.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/1c/e21cfb98a73e65a314352c3a1ce5c145/pa/BM05081_1d83804e8454903afb78714766c7f201.jpg saved to cache
2026-01-28 20:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 952ac053-e29b-5def-9dce-861a2bf03e69
2026-01-28 20:07:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08b01f90>
2026-01-28 20:07:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_952ac053-e29b-5def-9dce-861a2bf03e69/952ac053-e29b-5def-9dce-861a2bf03e69_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F1c%252Fe21cfb98a73e65a314352c3a1ce5c145%252Fpa%252FBM05081_354cd502d05ee8b9423025294f186afc.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/1c/e21cfb98a73e65a314352c3a1ce5c145/pa/BM05081_354cd502d05ee8b9423025294f186afc.jpg saved to cache
2026-01-28 20:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 952ac053-e29b-5def-9dce-861a2bf03e69
2026-01-28 20:07:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 952ac053-e29b-5def-9dce-861a2bf03e69, skipping ID generation
2026-01-28 20:07:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 952ac053-e29b-5def-9dce-861a2bf03e69 with scrape type 1
2026-01-28 20:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 952ac053-e29b-5def-9dce-861a2bf03e69 from tracking dictionaries
2026-01-28 20:07:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 952ac053-e29b-5def-9dce-861a2bf03e69 sending to next pipeline
2026-01-28 20:07:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 952ac053-e29b-5def-9dce-861a2bf03e69, identifier: BM05081
2026-01-28 20:07:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b94a3930-95ad-5073-894e-3ea423bb1cdf with identifier: GV88147
2026-01-28 20:07:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b94a3930-95ad-5073-894e-3ea423bb1cdf with identifier: GV88147
2026-01-28 20:07:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b94a3930-95ad-5073-894e-3ea423bb1cdf with identifier: GV88147 to the API
2026-01-28 20:07:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:07:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:07:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GV88147>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.0L',
 'engine_horse_power': 125,
 'expiration_date': '2026-01-29T16:47:15Z',
 'fuel_type': 'petrol',
 'id': 'b94a3930-95ad-5073-894e-3ea423bb1cdf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GV88147',
 'listing': 'auction',
 'location': 'IT, Bologna',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 67070,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img45/f5/45f530bf4840c91b1a60444e24e2113c/pa/GV88147_cadbf1a188261e0e439cd44a29eb3a59.jpg',
                'https://img-pa.auto1.com/img45/f5/45f530bf4840c91b1a60444e24e2113c/pa/GV88147_b67dbd17b00ebace522451d5e5ebc21c.jpg',
                'https://img-pa.auto1.com/img45/f5/45f530bf4840c91b1a60444e24e2113c/pa/GV88147_228733c5a684dd0418666c26b955db96.jpg',
                'https://img-pa.auto1.com/img45/f5/45f530bf4840c91b1a60444e24e2113c/pa/GV88147_496e6bd182dcb7e48194aee13f0901e7.jpg',
                'https://img-pa.auto1.com/img45/f5/45f530bf4840c91b1a60444e24e2113c/pa/GV88147_c67c3abd41f4b320041eae626d312762.jpg',
                'https://img-pa.auto1.com/img45/f5/45f530bf4840c91b1a60444e24e2113c/pa/GV88147_b6dd196f994f2783e749c084fd594e67.jpg',
                'https://img-pa.auto1.com/img45/f5/45f530bf4840c91b1a60444e24e2113c/pa/GV88147_c8e5acfe9a5b9c3953ecd9fc3d26fcf5.jpg',
                'https://img-pa.auto1.com/img45/f5/45f530bf4840c91b1a60444e24e2113c/pa/GV88147_fca5b758bae6d6abb251a24926ef8877.jpg',
                'https://img-pa.auto1.com/img45/f5/45f530bf4840c91b1a60444e24e2113c/pa/GV88147_338b6fab0b20828baadc8dbd314d70e0.jpg',
                'https://img-pa.auto1.com/img45/f5/45f530bf4840c91b1a60444e24e2113c/pa/GV88147_6712cf6dbb9d87144125c86e259dd279.jpg',
                'https://img-pa.auto1.com/img45/f5/45f530bf4840c91b1a60444e24e2113c/pa/GV88147_e92ad1a1d44baa31bd01db16be5c8d85.jpg',
                'https://img-pa.auto1.com/img45/f5/45f530bf4840c91b1a60444e24e2113c/pa/GV88147_59e8e4437acd9beb40367fdca32a3cb0.jpg',
                'https://img-pa.auto1.com/img45/f5/45f530bf4840c91b1a60444e24e2113c/pa/GV88147_a59bc7252a9c097f557db70aa5cc756a.jpg',
                'https://img-pa.auto1.com/img45/f5/45f530bf4840c91b1a60444e24e2113c/pa/GV88147_cae12c76a34a17ecb00ddfd5ec9397a7.jpg',
                'https://img-pa.auto1.com/img45/f5/45f530bf4840c91b1a60444e24e2113c/pa/GV88147_fa0c49f81fa56803c10cf944c3e720d6.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b94a3930-95ad-5073-894e-3ea423bb1cdf/b94a3930-95ad-5073-894e-3ea423bb1cdf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3686721,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img45/f5/45f530bf4840c91b1a60444e24e2113c/pa/GV88147_cadbf1a188261e0e439cd44a29eb3a59.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b94a3930-95ad-5073-894e-3ea423bb1cdf/b94a3930-95ad-5073-894e-3ea423bb1cdf_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3414881,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img45/f5/45f530bf4840c91b1a60444e24e2113c/pa/GV88147_b67dbd17b00ebace522451d5e5ebc21c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b94a3930-95ad-5073-894e-3ea423bb1cdf/b94a3930-95ad-5073-894e-3ea423bb1cdf_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110500,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img45/f5/45f530bf4840c91b1a60444e24e2113c/pa/GV88147_228733c5a684dd0418666c26b955db96.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b94a3930-95ad-5073-894e-3ea423bb1cdf/b94a3930-95ad-5073-894e-3ea423bb1cdf_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3552301,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img45/f5/45f530bf4840c91b1a60444e24e2113c/pa/GV88147_496e6bd182dcb7e48194aee13f0901e7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b94a3930-95ad-5073-894e-3ea423bb1cdf/b94a3930-95ad-5073-894e-3ea423bb1cdf_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113650,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img45/f5/45f530bf4840c91b1a60444e24e2113c/pa/GV88147_c67c3abd41f4b320041eae626d312762.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b94a3930-95ad-5073-894e-3ea423bb1cdf/b94a3930-95ad-5073-894e-3ea423bb1cdf_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3753182,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img45/f5/45f530bf4840c91b1a60444e24e2113c/pa/GV88147_b6dd196f994f2783e749c084fd594e67.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b94a3930-95ad-5073-894e-3ea423bb1cdf/b94a3930-95ad-5073-894e-3ea423bb1cdf_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90976,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img45/f5/45f530bf4840c91b1a60444e24e2113c/pa/GV88147_c8e5acfe9a5b9c3953ecd9fc3d26fcf5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b94a3930-95ad-5073-894e-3ea423bb1cdf/b94a3930-95ad-5073-894e-3ea423bb1cdf_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3164101,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img45/f5/45f530bf4840c91b1a60444e24e2113c/pa/GV88147_fca5b758bae6d6abb251a24926ef8877.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b94a3930-95ad-5073-894e-3ea423bb1cdf/b94a3930-95ad-5073-894e-3ea423bb1cdf_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3169953,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img45/f5/45f530bf4840c91b1a60444e24e2113c/pa/GV88147_338b6fab0b20828baadc8dbd314d70e0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b94a3930-95ad-5073-894e-3ea423bb1cdf/b94a3930-95ad-5073-894e-3ea423bb1cdf_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98011,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img45/f5/45f530bf4840c91b1a60444e24e2113c/pa/GV88147_6712cf6dbb9d87144125c86e259dd279.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b94a3930-95ad-5073-894e-3ea423bb1cdf/b94a3930-95ad-5073-894e-3ea423bb1cdf_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3083475,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img45/f5/45f530bf4840c91b1a60444e24e2113c/pa/GV88147_e92ad1a1d44baa31bd01db16be5c8d85.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b94a3930-95ad-5073-894e-3ea423bb1cdf/b94a3930-95ad-5073-894e-3ea423bb1cdf_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3330618,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img45/f5/45f530bf4840c91b1a60444e24e2113c/pa/GV88147_59e8e4437acd9beb40367fdca32a3cb0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b94a3930-95ad-5073-894e-3ea423bb1cdf/b94a3930-95ad-5073-894e-3ea423bb1cdf_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73506,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img45/f5/45f530bf4840c91b1a60444e24e2113c/pa/GV88147_a59bc7252a9c097f557db70aa5cc756a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b94a3930-95ad-5073-894e-3ea423bb1cdf/b94a3930-95ad-5073-894e-3ea423bb1cdf_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3099927,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img45/f5/45f530bf4840c91b1a60444e24e2113c/pa/GV88147_cae12c76a34a17ecb00ddfd5ec9397a7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b94a3930-95ad-5073-894e-3ea423bb1cdf/b94a3930-95ad-5073-894e-3ea423bb1cdf_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37326,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img45/f5/45f530bf4840c91b1a60444e24e2113c/pa/GV88147_fa0c49f81fa56803c10cf944c3e720d6.jpg',
             'Width': 450}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-09-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost Mild-Hybrid Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2021}
2026-01-28 20:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27GV88147%27 HTTP/1.1" 200 None
2026-01-28 20:07:22 [auto1.it] INFO: Saving data for GV88147: {'created_time': 1769630842.302563, 'last_price_update_time': 1769630842.302576, 'auction_closing_time': 1769705235.0}
2026-01-28 20:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='GV88147') HTTP/1.1" 204 0
2026-01-28 20:07:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 952ac053-e29b-5def-9dce-861a2bf03e69 with identifier: BM05081
2026-01-28 20:07:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 952ac053-e29b-5def-9dce-861a2bf03e69 with identifier: BM05081
2026-01-28 20:07:22 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 151017 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    151017
2026-01-28 20:07:22 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 952ac053-e29b-5def-9dce-861a2bf03e69 spider: auto1.it
2026-01-28 20:07:22 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 952ac053-e29b-5def-9dce-861a2bf03e69 due to rule: high_mileage_for_country.json, error: 151017 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    151017
{'auction_title': '',
 'c_o_2_emission_value': 148,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 140,
 'expiration_date': '2026-01-29T16:05:45Z',
 'fuel_type': 'diesel',
 'id': '952ac053-e29b-5def-9dce-861a2bf03e69',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BM05081',
 'listing': 'auction',
 'location': 'IT',
 'make': 'Jeep',
 'model': 'Compass',
 'odometer': 151017,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_952ac053-e29b-5def-9dce-861a2bf03e69/952ac053-e29b-5def-9dce-861a2bf03e69_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 133251,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/1c/e21cfb98a73e65a314352c3a1ce5c145/pa/BM05081_1f8ff955862e0330c0cd6126a93e977f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_952ac053-e29b-5def-9dce-861a2bf03e69/952ac053-e29b-5def-9dce-861a2bf03e69_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 962607,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/1c/e21cfb98a73e65a314352c3a1ce5c145/pa/BM05081_1d83804e8454903afb78714766c7f201.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_952ac053-e29b-5def-9dce-861a2bf03e69/952ac053-e29b-5def-9dce-861a2bf03e69_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 952738,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/1c/e21cfb98a73e65a314352c3a1ce5c145/pa/BM05081_354cd502d05ee8b9423025294f186afc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_952ac053-e29b-5def-9dce-861a2bf03e69/952ac053-e29b-5def-9dce-861a2bf03e69_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 797769,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/1c/e21cfb98a73e65a314352c3a1ce5c145/pa/BM05081_5a63eea88f1d19a3e33e2d31b30d7061.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_952ac053-e29b-5def-9dce-861a2bf03e69/952ac053-e29b-5def-9dce-861a2bf03e69_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 887870,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/1c/e21cfb98a73e65a314352c3a1ce5c145/pa/BM05081_080259e96a3b8eb3051f459a4456132d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_952ac053-e29b-5def-9dce-861a2bf03e69/952ac053-e29b-5def-9dce-861a2bf03e69_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 858591,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/1c/e21cfb98a73e65a314352c3a1ce5c145/pa/BM05081_9a876060d7a98b7390eabfe9169d810c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_952ac053-e29b-5def-9dce-861a2bf03e69/952ac053-e29b-5def-9dce-861a2bf03e69_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 882566,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/1c/e21cfb98a73e65a314352c3a1ce5c145/pa/BM05081_e7be5509c9c3b09ad5ce3e27add3e301.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_952ac053-e29b-5def-9dce-861a2bf03e69/952ac053-e29b-5def-9dce-861a2bf03e69_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 914767,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/1c/e21cfb98a73e65a314352c3a1ce5c145/pa/BM05081_c78f7541bb3996d8ba9be7f4cb21956b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_952ac053-e29b-5def-9dce-861a2bf03e69/952ac053-e29b-5def-9dce-861a2bf03e69_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 763798,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/1c/e21cfb98a73e65a314352c3a1ce5c145/pa/BM05081_5128151f31bb0cac1936d377a8cbfc19.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_952ac053-e29b-5def-9dce-861a2bf03e69/952ac053-e29b-5def-9dce-861a2bf03e69_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 836367,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/1c/e21cfb98a73e65a314352c3a1ce5c145/pa/BM05081_2a8a9563b1f574aa55d7588677180781.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_952ac053-e29b-5def-9dce-861a2bf03e69/952ac053-e29b-5def-9dce-861a2bf03e69_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 135715,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/1c/e21cfb98a73e65a314352c3a1ce5c145/pa/BM05081_56f9c15ea78a889aaec8b9d0d226f3c8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_952ac053-e29b-5def-9dce-861a2bf03e69/952ac053-e29b-5def-9dce-861a2bf03e69_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 503159,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/1c/e21cfb98a73e65a314352c3a1ce5c145/pa/BM05081_a5b7ac33b48aeedb1c306ecdbf998d6a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_952ac053-e29b-5def-9dce-861a2bf03e69/952ac053-e29b-5def-9dce-861a2bf03e69_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 752318,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/1c/e21cfb98a73e65a314352c3a1ce5c145/pa/BM05081_1afa7bc2808a2d4410faefd424b5ef67.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-09-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jeep Compass 2.0 M-Jet Limited 4WD',
 'transmission': 'automatic',
 'trim': 'Limited 4WD',
 'year': 2018}
2026-01-28 20:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BM05081%27 HTTP/1.1" 200 None
2026-01-28 20:07:22 [auto1.it] INFO: Saving data for BM05081: {'created_time': 1769630842.547332, 'last_price_update_time': 1769630842.547341, 'auction_closing_time': 1769702745.0}
2026-01-28 20:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BM05081') HTTP/1.1" 204 0
2026-01-28 20:07:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08a79dd0>
2026-01-28 20:07:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3536b64e-adcb-5ddd-8bd0-eb3c9d1d0d25/3536b64e-adcb-5ddd-8bd0-eb3c9d1d0d25_image_19.jpg HTTP/1.1" 201 0
2026-01-28 20:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F58%252Fbf584e0c6003bbd4bc54ee6710fb8f54%252Fpa%252FYA96052_ddc765261cffbadbf9327b8f10b888f9.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/58/bf584e0c6003bbd4bc54ee6710fb8f54/pa/YA96052_ddc765261cffbadbf9327b8f10b888f9.jpg saved to cache
2026-01-28 20:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 3536b64e-adcb-5ddd-8bd0-eb3c9d1d0d25
2026-01-28 20:07:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/88/a9886c8c428fd9ace2871b067ea0c3ef/pa/FP41040_b805b529baec07590ab41f24b1fb9bf9.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:07:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/88/a9886c8c428fd9ace2871b067ea0c3ef/pa/FP41040_cabd983989e48e752cca9ebd4dedddcb.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:07:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/88/a9886c8c428fd9ace2871b067ea0c3ef/pa/FP41040_d2a3377ec9452346f4d9367d7c842a4c.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:07:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:07:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09de5f50>
2026-01-28 20:07:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_42f57244-9ce1-548c-80f9-ba4fc624de0c/42f57244-9ce1-548c-80f9-ba4fc624de0c_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F88%252Fa9886c8c428fd9ace2871b067ea0c3ef%252Fpa%252FFP41040_b805b529baec07590ab41f24b1fb9bf9.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/88/a9886c8c428fd9ace2871b067ea0c3ef/pa/FP41040_b805b529baec07590ab41f24b1fb9bf9.jpg saved to cache
2026-01-28 20:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 42f57244-9ce1-548c-80f9-ba4fc624de0c
2026-01-28 20:07:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0a026f50>
2026-01-28 20:07:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:07:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_42f57244-9ce1-548c-80f9-ba4fc624de0c/42f57244-9ce1-548c-80f9-ba4fc624de0c_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F88%252Fa9886c8c428fd9ace2871b067ea0c3ef%252Fpa%252FFP41040_cabd983989e48e752cca9ebd4dedddcb.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/88/a9886c8c428fd9ace2871b067ea0c3ef/pa/FP41040_cabd983989e48e752cca9ebd4dedddcb.jpg saved to cache
2026-01-28 20:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 42f57244-9ce1-548c-80f9-ba4fc624de0c
2026-01-28 20:07:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09f34750>
2026-01-28 20:07:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_42f57244-9ce1-548c-80f9-ba4fc624de0c/42f57244-9ce1-548c-80f9-ba4fc624de0c_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F88%252Fa9886c8c428fd9ace2871b067ea0c3ef%252Fpa%252FFP41040_d2a3377ec9452346f4d9367d7c842a4c.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/88/a9886c8c428fd9ace2871b067ea0c3ef/pa/FP41040_d2a3377ec9452346f4d9367d7c842a4c.jpg saved to cache
2026-01-28 20:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 42f57244-9ce1-548c-80f9-ba4fc624de0c
2026-01-28 20:07:24 [scrapy.extensions.logstats] INFO: Crawled 417 pages (at 41 pages/min), scraped 144 items (at 28 items/min)
2026-01-28 20:07:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EZ33602/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:07:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CC90346/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:07:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MP18514/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:07:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EA92626/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:07:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YH36098/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:07:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:07:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:07:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:07:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:07:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:07:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HV34244> (referer: https://www.auto1.com/v1/car-details-view/HV34244/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:07:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:07:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NF00160> (referer: https://www.auto1.com/v1/car-details-view/NF00160/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:07:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:07:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/58/bf584e0c6003bbd4bc54ee6710fb8f54/pa/YA96052_5bde605eec838b59cfe63ef64b3cb7e6.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:07:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/58/bf584e0c6003bbd4bc54ee6710fb8f54/pa/YA96052_8f1f20ade584172a52c2298a06a10a9e.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:07:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c92258b1-e97a-5832-98d5-a80c20460663 with identifier: HV34244
2026-01-28 20:07:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c92258b1-e97a-5832-98d5-a80c20460663 with scrape type 1
2026-01-28 20:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item c92258b1-e97a-5832-98d5-a80c20460663
2026-01-28 20:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F4a%252Fe34a4a9b4cf0db3170094c62690a6e7c%252Fpa%252FHV34244_18b7156d0f749ef611470a9cc7e0712c.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/4a/e34a4a9b4cf0db3170094c62690a6e7c/pa/HV34244_18b7156d0f749ef611470a9cc7e0712c.jpg already downloaded
2026-01-28 20:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F4a%252Fe34a4a9b4cf0db3170094c62690a6e7c%252Fpa%252FHV34244_89995b1bdd45de4551cddb0cc55a7763.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/4a/e34a4a9b4cf0db3170094c62690a6e7c/pa/HV34244_89995b1bdd45de4551cddb0cc55a7763.jpg already downloaded
2026-01-28 20:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F4a%252Fe34a4a9b4cf0db3170094c62690a6e7c%252Fpa%252FHV34244_d45e86e6b40c6fa302d2dd329d8f1a84.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/4a/e34a4a9b4cf0db3170094c62690a6e7c/pa/HV34244_d45e86e6b40c6fa302d2dd329d8f1a84.jpg already downloaded
2026-01-28 20:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F4a%252Fe34a4a9b4cf0db3170094c62690a6e7c%252Fpa%252FHV34244_18b71018c31a9775d743710ff7c9c269.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/4a/e34a4a9b4cf0db3170094c62690a6e7c/pa/HV34244_18b71018c31a9775d743710ff7c9c269.jpg already downloaded
2026-01-28 20:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F4a%252Fe34a4a9b4cf0db3170094c62690a6e7c%252Fpa%252FHV34244_6e308531bba527594e1c9882c8b3ea59.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/4a/e34a4a9b4cf0db3170094c62690a6e7c/pa/HV34244_6e308531bba527594e1c9882c8b3ea59.jpg already downloaded
2026-01-28 20:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F4a%252Fe34a4a9b4cf0db3170094c62690a6e7c%252Fpa%252FHV34244_ba60e6a7b77fee1cb5b268857307a50b.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/4a/e34a4a9b4cf0db3170094c62690a6e7c/pa/HV34244_ba60e6a7b77fee1cb5b268857307a50b.jpg already downloaded
2026-01-28 20:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F4a%252Fe34a4a9b4cf0db3170094c62690a6e7c%252Fpa%252FHV34244_3583ae163ffc19d069fb4c1587f83105.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/4a/e34a4a9b4cf0db3170094c62690a6e7c/pa/HV34244_3583ae163ffc19d069fb4c1587f83105.jpg already downloaded
2026-01-28 20:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F4a%252Fe34a4a9b4cf0db3170094c62690a6e7c%252Fpa%252FHV34244_440b2f892cf46dd557eaa5533ba809df.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/4a/e34a4a9b4cf0db3170094c62690a6e7c/pa/HV34244_440b2f892cf46dd557eaa5533ba809df.jpg already downloaded
2026-01-28 20:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F4a%252Fe34a4a9b4cf0db3170094c62690a6e7c%252Fpa%252FHV34244_3f5008ec0070defb6ffd66d2d18f30bd.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/4a/e34a4a9b4cf0db3170094c62690a6e7c/pa/HV34244_3f5008ec0070defb6ffd66d2d18f30bd.jpg already downloaded
2026-01-28 20:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F4a%252Fe34a4a9b4cf0db3170094c62690a6e7c%252Fpa%252FHV34244_7fa23bd47d63b1d0e7aa881ef181b1b6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/4a/e34a4a9b4cf0db3170094c62690a6e7c/pa/HV34244_7fa23bd47d63b1d0e7aa881ef181b1b6.jpg already downloaded
2026-01-28 20:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F4a%252Fe34a4a9b4cf0db3170094c62690a6e7c%252Fpa%252FHV34244_4e8f87ee3d19ecfc198d05a41315540c.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/4a/e34a4a9b4cf0db3170094c62690a6e7c/pa/HV34244_4e8f87ee3d19ecfc198d05a41315540c.jpg already downloaded
2026-01-28 20:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F4a%252Fe34a4a9b4cf0db3170094c62690a6e7c%252Fpa%252FHV34244_942bec6e5fd489cdda8aab36969a5238.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/4a/e34a4a9b4cf0db3170094c62690a6e7c/pa/HV34244_942bec6e5fd489cdda8aab36969a5238.jpg already downloaded
2026-01-28 20:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F4a%252Fe34a4a9b4cf0db3170094c62690a6e7c%252Fpa%252FHV34244_1e7cd1727ff1b8d1b16155227d9fa049.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/4a/e34a4a9b4cf0db3170094c62690a6e7c/pa/HV34244_1e7cd1727ff1b8d1b16155227d9fa049.jpg already downloaded
2026-01-28 20:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F4a%252Fe34a4a9b4cf0db3170094c62690a6e7c%252Fpa%252FHV34244_f1d413ed9e051375aa5f3dcfb85d536e.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/4a/e34a4a9b4cf0db3170094c62690a6e7c/pa/HV34244_f1d413ed9e051375aa5f3dcfb85d536e.jpg already downloaded
2026-01-28 20:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F4a%252Fe34a4a9b4cf0db3170094c62690a6e7c%252Fpa%252FHV34244_fb4858ae7f701523e96427558f39e5e5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/4a/e34a4a9b4cf0db3170094c62690a6e7c/pa/HV34244_fb4858ae7f701523e96427558f39e5e5.jpg already downloaded
2026-01-28 20:07:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c92258b1-e97a-5832-98d5-a80c20460663, identifier: HV34244
2026-01-28 20:07:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c92258b1-e97a-5832-98d5-a80c20460663 with identifier: HV34244
2026-01-28 20:07:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c92258b1-e97a-5832-98d5-a80c20460663 with identifier: HV34244
2026-01-28 20:07:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c92258b1-e97a-5832-98d5-a80c20460663 with identifier: HV34244 to the API
2026-01-28 20:07:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:07:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:07:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HV34244>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6D',
 'engine': '1.3L',
 'engine_horse_power': 163,
 'expiration_date': '2026-01-29T16:49:40Z',
 'fuel_type': 'petrol',
 'id': 'c92258b1-e97a-5832-98d5-a80c20460663',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HV34244',
 'listing': 'auction',
 'location': 'IT, Roma',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 30504,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imge3/4a/e34a4a9b4cf0db3170094c62690a6e7c/pa/HV34244_18b7156d0f749ef611470a9cc7e0712c.jpg',
                'https://img-pa.auto1.com/imge3/4a/e34a4a9b4cf0db3170094c62690a6e7c/pa/HV34244_89995b1bdd45de4551cddb0cc55a7763.jpg',
                'https://img-pa.auto1.com/imge3/4a/e34a4a9b4cf0db3170094c62690a6e7c/pa/HV34244_d45e86e6b40c6fa302d2dd329d8f1a84.jpg',
                'https://img-pa.auto1.com/imge3/4a/e34a4a9b4cf0db3170094c62690a6e7c/pa/HV34244_18b71018c31a9775d743710ff7c9c269.jpg',
                'https://img-pa.auto1.com/imge3/4a/e34a4a9b4cf0db3170094c62690a6e7c/pa/HV34244_6e308531bba527594e1c9882c8b3ea59.jpg',
                'https://img-pa.auto1.com/imge3/4a/e34a4a9b4cf0db3170094c62690a6e7c/pa/HV34244_ba60e6a7b77fee1cb5b268857307a50b.jpg',
                'https://img-pa.auto1.com/imge3/4a/e34a4a9b4cf0db3170094c62690a6e7c/pa/HV34244_3583ae163ffc19d069fb4c1587f83105.jpg',
                'https://img-pa.auto1.com/imge3/4a/e34a4a9b4cf0db3170094c62690a6e7c/pa/HV34244_440b2f892cf46dd557eaa5533ba809df.jpg',
                'https://img-pa.auto1.com/imge3/4a/e34a4a9b4cf0db3170094c62690a6e7c/pa/HV34244_3f5008ec0070defb6ffd66d2d18f30bd.jpg',
                'https://img-pa.auto1.com/imge3/4a/e34a4a9b4cf0db3170094c62690a6e7c/pa/HV34244_7fa23bd47d63b1d0e7aa881ef181b1b6.jpg',
                'https://img-pa.auto1.com/imge3/4a/e34a4a9b4cf0db3170094c62690a6e7c/pa/HV34244_4e8f87ee3d19ecfc198d05a41315540c.jpg',
                'https://img-pa.auto1.com/imge3/4a/e34a4a9b4cf0db3170094c62690a6e7c/pa/HV34244_942bec6e5fd489cdda8aab36969a5238.jpg',
                'https://img-pa.auto1.com/imge3/4a/e34a4a9b4cf0db3170094c62690a6e7c/pa/HV34244_1e7cd1727ff1b8d1b16155227d9fa049.jpg',
                'https://img-pa.auto1.com/imge3/4a/e34a4a9b4cf0db3170094c62690a6e7c/pa/HV34244_f1d413ed9e051375aa5f3dcfb85d536e.jpg',
                'https://img-pa.auto1.com/imge3/4a/e34a4a9b4cf0db3170094c62690a6e7c/pa/HV34244_fb4858ae7f701523e96427558f39e5e5.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c92258b1-e97a-5832-98d5-a80c20460663/c92258b1-e97a-5832-98d5-a80c20460663_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3343992,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/4a/e34a4a9b4cf0db3170094c62690a6e7c/pa/HV34244_18b7156d0f749ef611470a9cc7e0712c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c92258b1-e97a-5832-98d5-a80c20460663/c92258b1-e97a-5832-98d5-a80c20460663_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84986,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/4a/e34a4a9b4cf0db3170094c62690a6e7c/pa/HV34244_89995b1bdd45de4551cddb0cc55a7763.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c92258b1-e97a-5832-98d5-a80c20460663/c92258b1-e97a-5832-98d5-a80c20460663_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90033,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/4a/e34a4a9b4cf0db3170094c62690a6e7c/pa/HV34244_d45e86e6b40c6fa302d2dd329d8f1a84.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c92258b1-e97a-5832-98d5-a80c20460663/c92258b1-e97a-5832-98d5-a80c20460663_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74331,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/4a/e34a4a9b4cf0db3170094c62690a6e7c/pa/HV34244_18b71018c31a9775d743710ff7c9c269.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c92258b1-e97a-5832-98d5-a80c20460663/c92258b1-e97a-5832-98d5-a80c20460663_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3395318,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/4a/e34a4a9b4cf0db3170094c62690a6e7c/pa/HV34244_6e308531bba527594e1c9882c8b3ea59.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c92258b1-e97a-5832-98d5-a80c20460663/c92258b1-e97a-5832-98d5-a80c20460663_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69156,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/4a/e34a4a9b4cf0db3170094c62690a6e7c/pa/HV34244_ba60e6a7b77fee1cb5b268857307a50b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c92258b1-e97a-5832-98d5-a80c20460663/c92258b1-e97a-5832-98d5-a80c20460663_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2090347,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/4a/e34a4a9b4cf0db3170094c62690a6e7c/pa/HV34244_3583ae163ffc19d069fb4c1587f83105.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c92258b1-e97a-5832-98d5-a80c20460663/c92258b1-e97a-5832-98d5-a80c20460663_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2387581,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/4a/e34a4a9b4cf0db3170094c62690a6e7c/pa/HV34244_440b2f892cf46dd557eaa5533ba809df.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c92258b1-e97a-5832-98d5-a80c20460663/c92258b1-e97a-5832-98d5-a80c20460663_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3045457,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/4a/e34a4a9b4cf0db3170094c62690a6e7c/pa/HV34244_3f5008ec0070defb6ffd66d2d18f30bd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c92258b1-e97a-5832-98d5-a80c20460663/c92258b1-e97a-5832-98d5-a80c20460663_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100612,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/4a/e34a4a9b4cf0db3170094c62690a6e7c/pa/HV34244_7fa23bd47d63b1d0e7aa881ef181b1b6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c92258b1-e97a-5832-98d5-a80c20460663/c92258b1-e97a-5832-98d5-a80c20460663_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1967057,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/4a/e34a4a9b4cf0db3170094c62690a6e7c/pa/HV34244_4e8f87ee3d19ecfc198d05a41315540c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c92258b1-e97a-5832-98d5-a80c20460663/c92258b1-e97a-5832-98d5-a80c20460663_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68432,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/4a/e34a4a9b4cf0db3170094c62690a6e7c/pa/HV34244_942bec6e5fd489cdda8aab36969a5238.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c92258b1-e97a-5832-98d5-a80c20460663/c92258b1-e97a-5832-98d5-a80c20460663_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77073,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/4a/e34a4a9b4cf0db3170094c62690a6e7c/pa/HV34244_1e7cd1727ff1b8d1b16155227d9fa049.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c92258b1-e97a-5832-98d5-a80c20460663/c92258b1-e97a-5832-98d5-a80c20460663_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43436,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/4a/e34a4a9b4cf0db3170094c62690a6e7c/pa/HV34244_f1d413ed9e051375aa5f3dcfb85d536e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c92258b1-e97a-5832-98d5-a80c20460663/c92258b1-e97a-5832-98d5-a80c20460663_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53155,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/4a/e34a4a9b4cf0db3170094c62690a6e7c/pa/HV34244_fb4858ae7f701523e96427558f39e5e5.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-01-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 200 AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2020}
2026-01-28 20:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HV34244%27 HTTP/1.1" 200 None
2026-01-28 20:07:27 [auto1.it] INFO: Saving data for HV34244: {'created_time': 1769630847.334493, 'last_price_update_time': 1769630847.334504, 'auction_closing_time': 1769705380.0}
2026-01-28 20:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HV34244') HTTP/1.1" 204 0
2026-01-28 20:07:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/58/bf584e0c6003bbd4bc54ee6710fb8f54/pa/YA96052_6f2ad617e623df0234cb1816bcaf3283.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:07:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/4b/df4bfd14ecccad2e28acc7936a8ce0e3/pa/WP90453_5eb44a84a27f959e88a9a4663d369ad6.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:07:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/58/bf584e0c6003bbd4bc54ee6710fb8f54/pa/YA96052_14077f44bacaaf6688b1aaacb345eca5.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:07:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/4b/df4bfd14ecccad2e28acc7936a8ce0e3/pa/WP90453_3c79d8ec805bb6743173939b52aa0f93.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:07:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1f86ee2-a86e-5681-9d4a-acf0324fc4ce with identifier: NF00160
2026-01-28 20:07:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1f86ee2-a86e-5681-9d4a-acf0324fc4ce with scrape type 1
2026-01-28 20:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 13 photos for item d1f86ee2-a86e-5681-9d4a-acf0324fc4ce
2026-01-28 20:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fbd%252F46bdb76093c6be862e79db975763678d%252Fpa%252FNF00160_d8e9055abafe89e49c3a66e581f1f3a1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/bd/46bdb76093c6be862e79db975763678d/pa/NF00160_d8e9055abafe89e49c3a66e581f1f3a1.jpg not downloaded yet
2026-01-28 20:07:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b088e39d0>
2026-01-28 20:07:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:07:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3536b64e-adcb-5ddd-8bd0-eb3c9d1d0d25/3536b64e-adcb-5ddd-8bd0-eb3c9d1d0d25_image_15.jpg HTTP/1.1" 201 0
2026-01-28 20:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F58%252Fbf584e0c6003bbd4bc54ee6710fb8f54%252Fpa%252FYA96052_5bde605eec838b59cfe63ef64b3cb7e6.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/58/bf584e0c6003bbd4bc54ee6710fb8f54/pa/YA96052_5bde605eec838b59cfe63ef64b3cb7e6.jpg saved to cache
2026-01-28 20:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 3536b64e-adcb-5ddd-8bd0-eb3c9d1d0d25
2026-01-28 20:07:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08bf55d0>
2026-01-28 20:07:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:07:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3536b64e-adcb-5ddd-8bd0-eb3c9d1d0d25/3536b64e-adcb-5ddd-8bd0-eb3c9d1d0d25_image_18.jpg HTTP/1.1" 201 0
2026-01-28 20:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F58%252Fbf584e0c6003bbd4bc54ee6710fb8f54%252Fpa%252FYA96052_8f1f20ade584172a52c2298a06a10a9e.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/58/bf584e0c6003bbd4bc54ee6710fb8f54/pa/YA96052_8f1f20ade584172a52c2298a06a10a9e.jpg saved to cache
2026-01-28 20:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 3536b64e-adcb-5ddd-8bd0-eb3c9d1d0d25
2026-01-28 20:07:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KT18742/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:07:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fbd%252F46bdb76093c6be862e79db975763678d%252Fpa%252FNF00160_7cb43a1327b97b5312f867bed4e29bef.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/bd/46bdb76093c6be862e79db975763678d/pa/NF00160_7cb43a1327b97b5312f867bed4e29bef.jpg not downloaded yet
2026-01-28 20:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fbd%252F46bdb76093c6be862e79db975763678d%252Fpa%252FNF00160_64261409a2a40ba88250504647f2b6fc.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/bd/46bdb76093c6be862e79db975763678d/pa/NF00160_64261409a2a40ba88250504647f2b6fc.jpg not downloaded yet
2026-01-28 20:07:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0a0269d0>
2026-01-28 20:07:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:07:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3536b64e-adcb-5ddd-8bd0-eb3c9d1d0d25/3536b64e-adcb-5ddd-8bd0-eb3c9d1d0d25_image_16.jpg HTTP/1.1" 201 0
2026-01-28 20:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F58%252Fbf584e0c6003bbd4bc54ee6710fb8f54%252Fpa%252FYA96052_6f2ad617e623df0234cb1816bcaf3283.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/58/bf584e0c6003bbd4bc54ee6710fb8f54/pa/YA96052_6f2ad617e623df0234cb1816bcaf3283.jpg saved to cache
2026-01-28 20:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 3536b64e-adcb-5ddd-8bd0-eb3c9d1d0d25
2026-01-28 20:07:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09d44c90>
2026-01-28 20:07:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:07:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_051ddf36-eff8-5c80-8634-fb09358064b3/051ddf36-eff8-5c80-8634-fb09358064b3_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F4b%252Fdf4bfd14ecccad2e28acc7936a8ce0e3%252Fpa%252FWP90453_5eb44a84a27f959e88a9a4663d369ad6.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/4b/df4bfd14ecccad2e28acc7936a8ce0e3/pa/WP90453_5eb44a84a27f959e88a9a4663d369ad6.jpg saved to cache
2026-01-28 20:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 051ddf36-eff8-5c80-8634-fb09358064b3
2026-01-28 20:07:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b088f56d0>
2026-01-28 20:07:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:07:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3536b64e-adcb-5ddd-8bd0-eb3c9d1d0d25/3536b64e-adcb-5ddd-8bd0-eb3c9d1d0d25_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F58%252Fbf584e0c6003bbd4bc54ee6710fb8f54%252Fpa%252FYA96052_14077f44bacaaf6688b1aaacb345eca5.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/58/bf584e0c6003bbd4bc54ee6710fb8f54/pa/YA96052_14077f44bacaaf6688b1aaacb345eca5.jpg saved to cache
2026-01-28 20:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 3536b64e-adcb-5ddd-8bd0-eb3c9d1d0d25
2026-01-28 20:07:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3536b64e-adcb-5ddd-8bd0-eb3c9d1d0d25, skipping ID generation
2026-01-28 20:07:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3536b64e-adcb-5ddd-8bd0-eb3c9d1d0d25 with scrape type 1
2026-01-28 20:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 3536b64e-adcb-5ddd-8bd0-eb3c9d1d0d25 from tracking dictionaries
2026-01-28 20:07:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3536b64e-adcb-5ddd-8bd0-eb3c9d1d0d25 sending to next pipeline
2026-01-28 20:07:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3536b64e-adcb-5ddd-8bd0-eb3c9d1d0d25, identifier: YA96052
2026-01-28 20:07:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09dfb050>
2026-01-28 20:07:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_051ddf36-eff8-5c80-8634-fb09358064b3/051ddf36-eff8-5c80-8634-fb09358064b3_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F4b%252Fdf4bfd14ecccad2e28acc7936a8ce0e3%252Fpa%252FWP90453_3c79d8ec805bb6743173939b52aa0f93.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/4b/df4bfd14ecccad2e28acc7936a8ce0e3/pa/WP90453_3c79d8ec805bb6743173939b52aa0f93.jpg saved to cache
2026-01-28 20:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 051ddf36-eff8-5c80-8634-fb09358064b3
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fbd%252F46bdb76093c6be862e79db975763678d%252Fpa%252FNF00160_2a58f4d149b290c31bb286c35fe4c828.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/bd/46bdb76093c6be862e79db975763678d/pa/NF00160_2a58f4d149b290c31bb286c35fe4c828.jpg not downloaded yet
2026-01-28 20:07:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3536b64e-adcb-5ddd-8bd0-eb3c9d1d0d25 with identifier: YA96052
2026-01-28 20:07:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3536b64e-adcb-5ddd-8bd0-eb3c9d1d0d25 with identifier: YA96052
2026-01-28 20:07:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3536b64e-adcb-5ddd-8bd0-eb3c9d1d0d25 with identifier: YA96052 to the API
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:07:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgbf/58/bf584e0c6003bbd4bc54ee6710fb8f54/pa/YA96052_14077f44bacaaf6688b1aaacb345eca5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 211,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 340,
 'expiration_date': '2026-01-29T16:50:09Z',
 'fuel_type': 'petrol',
 'id': '3536b64e-adcb-5ddd-8bd0-eb3c9d1d0d25',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YA96052',
 'listing': 'auction',
 'location': 'IT, Milano',
 'make': 'Audi',
 'model': 'A7',
 'odometer': 146826,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3536b64e-adcb-5ddd-8bd0-eb3c9d1d0d25/3536b64e-adcb-5ddd-8bd0-eb3c9d1d0d25_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 485574,
             'Height': 1080,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/58/bf584e0c6003bbd4bc54ee6710fb8f54/pa/YA96052_6669f5696383e9a7ff18fd5c64d45574.jpg',
             'Width': 1440},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3536b64e-adcb-5ddd-8bd0-eb3c9d1d0d25/3536b64e-adcb-5ddd-8bd0-eb3c9d1d0d25_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 369245,
             'Height': 1080,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/58/bf584e0c6003bbd4bc54ee6710fb8f54/pa/YA96052_a911078c9508bcd644a625b38c7f9310.jpg',
             'Width': 1440},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3536b64e-adcb-5ddd-8bd0-eb3c9d1d0d25/3536b64e-adcb-5ddd-8bd0-eb3c9d1d0d25_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 459805,
             'Height': 1080,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/58/bf584e0c6003bbd4bc54ee6710fb8f54/pa/YA96052_ff5ed6168cd1dadf033b492048493d8e.jpg',
             'Width': 1440},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3536b64e-adcb-5ddd-8bd0-eb3c9d1d0d25/3536b64e-adcb-5ddd-8bd0-eb3c9d1d0d25_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81487,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/58/bf584e0c6003bbd4bc54ee6710fb8f54/pa/YA96052_2703dddeb874c24ffbf28127347aecba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3536b64e-adcb-5ddd-8bd0-eb3c9d1d0d25/3536b64e-adcb-5ddd-8bd0-eb3c9d1d0d25_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86307,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/58/bf584e0c6003bbd4bc54ee6710fb8f54/pa/YA96052_efa9aaa7e78eebc73a297477482195cc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3536b64e-adcb-5ddd-8bd0-eb3c9d1d0d25/3536b64e-adcb-5ddd-8bd0-eb3c9d1d0d25_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 476155,
             'Height': 1080,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/58/bf584e0c6003bbd4bc54ee6710fb8f54/pa/YA96052_6d1dd40b21b52d772c17827f2b05436e.jpg',
             'Width': 1440},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3536b64e-adcb-5ddd-8bd0-eb3c9d1d0d25/3536b64e-adcb-5ddd-8bd0-eb3c9d1d0d25_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 413222,
             'Height': 1080,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/58/bf584e0c6003bbd4bc54ee6710fb8f54/pa/YA96052_d8879a8dbe4ce1a7ac1a74e41aa78276.jpg',
             'Width': 1440},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3536b64e-adcb-5ddd-8bd0-eb3c9d1d0d25/3536b64e-adcb-5ddd-8bd0-eb3c9d1d0d25_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108808,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/58/bf584e0c6003bbd4bc54ee6710fb8f54/pa/YA96052_350a0a128727ea44d7e56b54873f2b25.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3536b64e-adcb-5ddd-8bd0-eb3c9d1d0d25/3536b64e-adcb-5ddd-8bd0-eb3c9d1d0d25_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53734,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/58/bf584e0c6003bbd4bc54ee6710fb8f54/pa/YA96052_13a378052e837a3a7f3b2117c0812c15.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3536b64e-adcb-5ddd-8bd0-eb3c9d1d0d25/3536b64e-adcb-5ddd-8bd0-eb3c9d1d0d25_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 460807,
             'Height': 1080,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/58/bf584e0c6003bbd4bc54ee6710fb8f54/pa/YA96052_5a52e757234adc10da75c97a6624497b.jpg',
             'Width': 1440},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3536b64e-adcb-5ddd-8bd0-eb3c9d1d0d25/3536b64e-adcb-5ddd-8bd0-eb3c9d1d0d25_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 468274,
             'Height': 1080,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/58/bf584e0c6003bbd4bc54ee6710fb8f54/pa/YA96052_c4df9b1bf69588337db75ec082186d1b.jpg',
             'Width': 1440},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3536b64e-adcb-5ddd-8bd0-eb3c9d1d0d25/3536b64e-adcb-5ddd-8bd0-eb3c9d1d0d25_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78271,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/58/bf584e0c6003bbd4bc54ee6710fb8f54/pa/YA96052_d1b1b118ad07eece8a07939f832408d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3536b64e-adcb-5ddd-8bd0-eb3c9d1d0d25/3536b64e-adcb-5ddd-8bd0-eb3c9d1d0d25_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49034,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/58/bf584e0c6003bbd4bc54ee6710fb8f54/pa/YA96052_e267081895991f08dfae128524546baf.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3536b64e-adcb-5ddd-8bd0-eb3c9d1d0d25/3536b64e-adcb-5ddd-8bd0-eb3c9d1d0d25_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56370,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/58/bf584e0c6003bbd4bc54ee6710fb8f54/pa/YA96052_c047f84af94f77f149f674adc2fc4917.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3536b64e-adcb-5ddd-8bd0-eb3c9d1d0d25/3536b64e-adcb-5ddd-8bd0-eb3c9d1d0d25_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32078,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/58/bf584e0c6003bbd4bc54ee6710fb8f54/pa/YA96052_14077f44bacaaf6688b1aaacb345eca5.jpg',
             'Width': 338},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3536b64e-adcb-5ddd-8bd0-eb3c9d1d0d25/3536b64e-adcb-5ddd-8bd0-eb3c9d1d0d25_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41898,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/58/bf584e0c6003bbd4bc54ee6710fb8f54/pa/YA96052_5bde605eec838b59cfe63ef64b3cb7e6.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3536b64e-adcb-5ddd-8bd0-eb3c9d1d0d25/3536b64e-adcb-5ddd-8bd0-eb3c9d1d0d25_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39204,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/58/bf584e0c6003bbd4bc54ee6710fb8f54/pa/YA96052_6f2ad617e623df0234cb1816bcaf3283.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3536b64e-adcb-5ddd-8bd0-eb3c9d1d0d25/3536b64e-adcb-5ddd-8bd0-eb3c9d1d0d25_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34144,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/58/bf584e0c6003bbd4bc54ee6710fb8f54/pa/YA96052_ab88035feabb3836518d1bcf8c66dc93.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3536b64e-adcb-5ddd-8bd0-eb3c9d1d0d25/3536b64e-adcb-5ddd-8bd0-eb3c9d1d0d25_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69980,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/58/bf584e0c6003bbd4bc54ee6710fb8f54/pa/YA96052_8f1f20ade584172a52c2298a06a10a9e.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3536b64e-adcb-5ddd-8bd0-eb3c9d1d0d25/3536b64e-adcb-5ddd-8bd0-eb3c9d1d0d25_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39962,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/58/bf584e0c6003bbd4bc54ee6710fb8f54/pa/YA96052_ddc765261cffbadbf9327b8f10b888f9.jpg',
             'Width': 450}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-03-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A7 3.0 V6 TFSI quattro 55',
 'transmission': 'automatic',
 'trim': 'quattro 55',
 'year': 2020}
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YA96052%27 HTTP/1.1" 200 None
2026-01-28 20:07:29 [auto1.it] INFO: Saving data for YA96052: {'created_time': 1769630849.418024, 'last_price_update_time': 1769630849.418038, 'auction_closing_time': 1769705409.0}
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YA96052') HTTP/1.1" 204 0
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fbd%252F46bdb76093c6be862e79db975763678d%252Fpa%252FNF00160_c382e9b4b0759fc63aeb6b557984415f.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/bd/46bdb76093c6be862e79db975763678d/pa/NF00160_c382e9b4b0759fc63aeb6b557984415f.jpg not downloaded yet
2026-01-28 20:07:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ML31196> (referer: https://www.auto1.com/v1/car-details-view/ML31196/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:07:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FN77058> (referer: https://www.auto1.com/v1/car-details-view/FN77058/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:07:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ES54295> (referer: https://www.auto1.com/v1/car-details-view/ES54295/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:07:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZD98375/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:07:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YL06979> (referer: https://www.auto1.com/v1/car-details-view/YL06979/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:07:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EZ99930/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:07:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VH73112> (referer: https://www.auto1.com/v1/car-details-view/VH73112/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:07:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:07:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:07:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:07:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:07:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fbd%252F46bdb76093c6be862e79db975763678d%252Fpa%252FNF00160_da6490e88843fe764da68425eef00789.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/bd/46bdb76093c6be862e79db975763678d/pa/NF00160_da6490e88843fe764da68425eef00789.jpg not downloaded yet
2026-01-28 20:07:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fbd%252F46bdb76093c6be862e79db975763678d%252Fpa%252FNF00160_eaa1f049b4fa781a07ff88ad41612060.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/bd/46bdb76093c6be862e79db975763678d/pa/NF00160_eaa1f049b4fa781a07ff88ad41612060.jpg not downloaded yet
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fbd%252F46bdb76093c6be862e79db975763678d%252Fpa%252FNF00160_ff36d86c3803beaa7fc2cb7eb5f5b84d.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/bd/46bdb76093c6be862e79db975763678d/pa/NF00160_ff36d86c3803beaa7fc2cb7eb5f5b84d.jpg not downloaded yet
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fbd%252F46bdb76093c6be862e79db975763678d%252Fpa%252FNF00160_1387626c853564be69c0f1e020ffcbe2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/bd/46bdb76093c6be862e79db975763678d/pa/NF00160_1387626c853564be69c0f1e020ffcbe2.jpg not downloaded yet
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fbd%252F46bdb76093c6be862e79db975763678d%252Fpa%252FNF00160_f3ed1e0e3f8c02891a3be12a9023a4b5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/bd/46bdb76093c6be862e79db975763678d/pa/NF00160_f3ed1e0e3f8c02891a3be12a9023a4b5.jpg not downloaded yet
2026-01-28 20:07:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/bd/46bdb76093c6be862e79db975763678d/pa/NF00160_d8e9055abafe89e49c3a66e581f1f3a1.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fbd%252F46bdb76093c6be862e79db975763678d%252Fpa%252FNF00160_40e2c7e737dc19daf856a2b8390e3085.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/bd/46bdb76093c6be862e79db975763678d/pa/NF00160_40e2c7e737dc19daf856a2b8390e3085.jpg not downloaded yet
2026-01-28 20:07:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7f92148-4bb6-5bfb-a45a-243432f11ed3 with identifier: ML31196
2026-01-28 20:07:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7f92148-4bb6-5bfb-a45a-243432f11ed3 with scrape type 1
2026-01-28 20:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item b7f92148-4bb6-5bfb-a45a-243432f11ed3
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252Fa3%252F2aa38d38b2e91b2ccfdfcf7d1f393ca2%252Fpa%252FML31196_2af9f5a0896ce5af129f38122ea8566c.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/a3/2aa38d38b2e91b2ccfdfcf7d1f393ca2/pa/ML31196_2af9f5a0896ce5af129f38122ea8566c.jpg already downloaded
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252Fa3%252F2aa38d38b2e91b2ccfdfcf7d1f393ca2%252Fpa%252FML31196_bbffc12d19225c002ce19ec36fec09e9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/a3/2aa38d38b2e91b2ccfdfcf7d1f393ca2/pa/ML31196_bbffc12d19225c002ce19ec36fec09e9.jpg already downloaded
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252Fa3%252F2aa38d38b2e91b2ccfdfcf7d1f393ca2%252Fpa%252FML31196_a5e22b3826b1ea92e204aec8764c3b3c.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/a3/2aa38d38b2e91b2ccfdfcf7d1f393ca2/pa/ML31196_a5e22b3826b1ea92e204aec8764c3b3c.jpg already downloaded
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252Fa3%252F2aa38d38b2e91b2ccfdfcf7d1f393ca2%252Fpa%252FML31196_b57bf4de400198d6561a3edbabb3398a.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/a3/2aa38d38b2e91b2ccfdfcf7d1f393ca2/pa/ML31196_b57bf4de400198d6561a3edbabb3398a.jpg already downloaded
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252Fa3%252F2aa38d38b2e91b2ccfdfcf7d1f393ca2%252Fpa%252FML31196_4b3411bca1fd92c8c2b99e20804a78c4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/a3/2aa38d38b2e91b2ccfdfcf7d1f393ca2/pa/ML31196_4b3411bca1fd92c8c2b99e20804a78c4.jpg already downloaded
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252Fa3%252F2aa38d38b2e91b2ccfdfcf7d1f393ca2%252Fpa%252FML31196_fe1cb86417165a07019c454ed6ed540c.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/a3/2aa38d38b2e91b2ccfdfcf7d1f393ca2/pa/ML31196_fe1cb86417165a07019c454ed6ed540c.jpg already downloaded
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252Fa3%252F2aa38d38b2e91b2ccfdfcf7d1f393ca2%252Fpa%252FML31196_d4bd96055a4b29b6afb64eba85ab2040.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/a3/2aa38d38b2e91b2ccfdfcf7d1f393ca2/pa/ML31196_d4bd96055a4b29b6afb64eba85ab2040.jpg already downloaded
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252Fa3%252F2aa38d38b2e91b2ccfdfcf7d1f393ca2%252Fpa%252FML31196_4167b787d47e88d65406e6cc576f1994.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/a3/2aa38d38b2e91b2ccfdfcf7d1f393ca2/pa/ML31196_4167b787d47e88d65406e6cc576f1994.jpg already downloaded
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252Fa3%252F2aa38d38b2e91b2ccfdfcf7d1f393ca2%252Fpa%252FML31196_03d92ae3bae6c5dd4ab1ed5e04e5447c.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/a3/2aa38d38b2e91b2ccfdfcf7d1f393ca2/pa/ML31196_03d92ae3bae6c5dd4ab1ed5e04e5447c.jpg already downloaded
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252Fa3%252F2aa38d38b2e91b2ccfdfcf7d1f393ca2%252Fpa%252FML31196_80975b899304fb5ed3db398b9fc15141.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/a3/2aa38d38b2e91b2ccfdfcf7d1f393ca2/pa/ML31196_80975b899304fb5ed3db398b9fc15141.jpg already downloaded
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252Fa3%252F2aa38d38b2e91b2ccfdfcf7d1f393ca2%252Fpa%252FML31196_4b4eb1511dda669aaf608fb2bfc36ddb.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/a3/2aa38d38b2e91b2ccfdfcf7d1f393ca2/pa/ML31196_4b4eb1511dda669aaf608fb2bfc36ddb.jpg already downloaded
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252Fa3%252F2aa38d38b2e91b2ccfdfcf7d1f393ca2%252Fpa%252FML31196_0e7b38d0efb54fd053081ef7bc82f7c7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/a3/2aa38d38b2e91b2ccfdfcf7d1f393ca2/pa/ML31196_0e7b38d0efb54fd053081ef7bc82f7c7.jpg already downloaded
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252Fa3%252F2aa38d38b2e91b2ccfdfcf7d1f393ca2%252Fpa%252FML31196_dabd4bc5b40896963c8441954fed4572.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/a3/2aa38d38b2e91b2ccfdfcf7d1f393ca2/pa/ML31196_dabd4bc5b40896963c8441954fed4572.jpg already downloaded
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252Fa3%252F2aa38d38b2e91b2ccfdfcf7d1f393ca2%252Fpa%252FML31196_b3f489477f69bed316b15038c235f890.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/a3/2aa38d38b2e91b2ccfdfcf7d1f393ca2/pa/ML31196_b3f489477f69bed316b15038c235f890.jpg already downloaded
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252Fa3%252F2aa38d38b2e91b2ccfdfcf7d1f393ca2%252Fpa%252FML31196_eea30362897cce24920b3c4a5d7e4b07.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/a3/2aa38d38b2e91b2ccfdfcf7d1f393ca2/pa/ML31196_eea30362897cce24920b3c4a5d7e4b07.jpg already downloaded
2026-01-28 20:07:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b7f92148-4bb6-5bfb-a45a-243432f11ed3, identifier: ML31196
2026-01-28 20:07:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7ef435e-47a8-5eb5-94d7-68f0c9d2ab66 with identifier: FN77058
2026-01-28 20:07:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7ef435e-47a8-5eb5-94d7-68f0c9d2ab66 with scrape type 2
2026-01-28 20:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b7ef435e-47a8-5eb5-94d7-68f0c9d2ab66 with scrape type 2
2026-01-28 20:07:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b7ef435e-47a8-5eb5-94d7-68f0c9d2ab66, identifier: FN77058
2026-01-28 20:07:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0ac770d0-780a-5e38-9cdc-231ae3aa710b with identifier: ES54295
2026-01-28 20:07:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ac770d0-780a-5e38-9cdc-231ae3aa710b with scrape type 2
2026-01-28 20:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0ac770d0-780a-5e38-9cdc-231ae3aa710b with scrape type 2
2026-01-28 20:07:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0ac770d0-780a-5e38-9cdc-231ae3aa710b, identifier: ES54295
2026-01-28 20:07:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4b8099a6-e3af-5161-ace9-15dee63a7f65 with identifier: YL06979
2026-01-28 20:07:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b8099a6-e3af-5161-ace9-15dee63a7f65 with scrape type 2
2026-01-28 20:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4b8099a6-e3af-5161-ace9-15dee63a7f65 with scrape type 2
2026-01-28 20:07:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4b8099a6-e3af-5161-ace9-15dee63a7f65, identifier: YL06979
2026-01-28 20:07:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 88dde7a3-881f-5fcf-93ab-a2191142118a with identifier: VH73112
2026-01-28 20:07:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88dde7a3-881f-5fcf-93ab-a2191142118a with scrape type 1
2026-01-28 20:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 88dde7a3-881f-5fcf-93ab-a2191142118a
2026-01-28 20:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Fed%252F26ed52af68cb4e1df514c82ff695f986%252Fpa%252FVH73112_404d1af7f192c0962b78c56b3a5154c3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/ed/26ed52af68cb4e1df514c82ff695f986/pa/VH73112_404d1af7f192c0962b78c56b3a5154c3.jpg already downloaded
2026-01-28 20:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Fed%252F26ed52af68cb4e1df514c82ff695f986%252Fpa%252FVH73112_73dc8e2493f2fc8613ca9fe6c93d23f4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/ed/26ed52af68cb4e1df514c82ff695f986/pa/VH73112_73dc8e2493f2fc8613ca9fe6c93d23f4.jpg already downloaded
2026-01-28 20:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Fed%252F26ed52af68cb4e1df514c82ff695f986%252Fpa%252FVH73112_f22683b6bb365d4202900815ef60c6a5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/ed/26ed52af68cb4e1df514c82ff695f986/pa/VH73112_f22683b6bb365d4202900815ef60c6a5.jpg already downloaded
2026-01-28 20:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Fed%252F26ed52af68cb4e1df514c82ff695f986%252Fpa%252FVH73112_48bf6ffee062f85be7e08c0d0b425ee1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/ed/26ed52af68cb4e1df514c82ff695f986/pa/VH73112_48bf6ffee062f85be7e08c0d0b425ee1.jpg already downloaded
2026-01-28 20:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Fed%252F26ed52af68cb4e1df514c82ff695f986%252Fpa%252FVH73112_64043b15d6f7dd2f8222db4bf371a190.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/ed/26ed52af68cb4e1df514c82ff695f986/pa/VH73112_64043b15d6f7dd2f8222db4bf371a190.jpg already downloaded
2026-01-28 20:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Fed%252F26ed52af68cb4e1df514c82ff695f986%252Fpa%252FVH73112_a1c53e55318501625f9ac76690543f98.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/ed/26ed52af68cb4e1df514c82ff695f986/pa/VH73112_a1c53e55318501625f9ac76690543f98.jpg already downloaded
2026-01-28 20:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Fed%252F26ed52af68cb4e1df514c82ff695f986%252Fpa%252FVH73112_d6e67000f9293af45c8397945cb0fed4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/ed/26ed52af68cb4e1df514c82ff695f986/pa/VH73112_d6e67000f9293af45c8397945cb0fed4.jpg already downloaded
2026-01-28 20:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Fed%252F26ed52af68cb4e1df514c82ff695f986%252Fpa%252FVH73112_52f352c5e7a3ea8fd407a61df53dfc97.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/ed/26ed52af68cb4e1df514c82ff695f986/pa/VH73112_52f352c5e7a3ea8fd407a61df53dfc97.jpg already downloaded
2026-01-28 20:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Fed%252F26ed52af68cb4e1df514c82ff695f986%252Fpa%252FVH73112_b95c4c8cfda95642c06a222ab395449b.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/ed/26ed52af68cb4e1df514c82ff695f986/pa/VH73112_b95c4c8cfda95642c06a222ab395449b.jpg already downloaded
2026-01-28 20:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Fed%252F26ed52af68cb4e1df514c82ff695f986%252Fpa%252FVH73112_d7365fa37073e0fcc36537a65fee2127.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/ed/26ed52af68cb4e1df514c82ff695f986/pa/VH73112_d7365fa37073e0fcc36537a65fee2127.jpg already downloaded
2026-01-28 20:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Fed%252F26ed52af68cb4e1df514c82ff695f986%252Fpa%252FVH73112_9bce097157ff737c196fb09495eecf03.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/ed/26ed52af68cb4e1df514c82ff695f986/pa/VH73112_9bce097157ff737c196fb09495eecf03.jpg already downloaded
2026-01-28 20:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Fed%252F26ed52af68cb4e1df514c82ff695f986%252Fpa%252FVH73112_cbe5b8a7f266af212a04b7e29a5872c8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/ed/26ed52af68cb4e1df514c82ff695f986/pa/VH73112_cbe5b8a7f266af212a04b7e29a5872c8.jpg already downloaded
2026-01-28 20:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Fed%252F26ed52af68cb4e1df514c82ff695f986%252Fpa%252FVH73112_59b17971ef6c2e3c3db1a5a988c0f1b6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/ed/26ed52af68cb4e1df514c82ff695f986/pa/VH73112_59b17971ef6c2e3c3db1a5a988c0f1b6.jpg already downloaded
2026-01-28 20:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Fed%252F26ed52af68cb4e1df514c82ff695f986%252Fpa%252FVH73112_acc931f9876c920fedc8f677719c8c98.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/ed/26ed52af68cb4e1df514c82ff695f986/pa/VH73112_acc931f9876c920fedc8f677719c8c98.jpg already downloaded
2026-01-28 20:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Fed%252F26ed52af68cb4e1df514c82ff695f986%252Fpa%252FVH73112_d521a2f4f78cfcfdc4389c62f788099c.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/ed/26ed52af68cb4e1df514c82ff695f986/pa/VH73112_d521a2f4f78cfcfdc4389c62f788099c.jpg already downloaded
2026-01-28 20:07:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 88dde7a3-881f-5fcf-93ab-a2191142118a, identifier: VH73112
2026-01-28 20:07:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/88/a9886c8c428fd9ace2871b067ea0c3ef/pa/FP41040_37901c45050e8173d13520b45d2264e3.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fbd%252F46bdb76093c6be862e79db975763678d%252Fpa%252FNF00160_273a812bb1e2bb39329b5074e0e09c92.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/bd/46bdb76093c6be862e79db975763678d/pa/NF00160_273a812bb1e2bb39329b5074e0e09c92.jpg not downloaded yet
2026-01-28 20:07:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b7f92148-4bb6-5bfb-a45a-243432f11ed3 with identifier: ML31196
2026-01-28 20:07:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b7f92148-4bb6-5bfb-a45a-243432f11ed3 with identifier: ML31196
2026-01-28 20:07:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b7f92148-4bb6-5bfb-a45a-243432f11ed3 with identifier: ML31196 to the API
2026-01-28 20:07:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:07:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:07:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ML31196>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.0L',
 'engine_horse_power': 101,
 'expiration_date': '2026-01-29T16:37:41Z',
 'fuel_type': 'petrol',
 'id': 'b7f92148-4bb6-5bfb-a45a-243432f11ed3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ML31196',
 'listing': 'auction',
 'location': 'IT, Milazzo',
 'make': 'Fiat',
 'model': 'Tipo',
 'odometer': 52094,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img2a/a3/2aa38d38b2e91b2ccfdfcf7d1f393ca2/pa/ML31196_2af9f5a0896ce5af129f38122ea8566c.jpg',
                'https://img-pa.auto1.com/img2a/a3/2aa38d38b2e91b2ccfdfcf7d1f393ca2/pa/ML31196_bbffc12d19225c002ce19ec36fec09e9.jpg',
                'https://img-pa.auto1.com/img2a/a3/2aa38d38b2e91b2ccfdfcf7d1f393ca2/pa/ML31196_a5e22b3826b1ea92e204aec8764c3b3c.jpg',
                'https://img-pa.auto1.com/img2a/a3/2aa38d38b2e91b2ccfdfcf7d1f393ca2/pa/ML31196_b57bf4de400198d6561a3edbabb3398a.jpg',
                'https://img-pa.auto1.com/img2a/a3/2aa38d38b2e91b2ccfdfcf7d1f393ca2/pa/ML31196_4b3411bca1fd92c8c2b99e20804a78c4.jpg',
                'https://img-pa.auto1.com/img2a/a3/2aa38d38b2e91b2ccfdfcf7d1f393ca2/pa/ML31196_fe1cb86417165a07019c454ed6ed540c.jpg',
                'https://img-pa.auto1.com/img2a/a3/2aa38d38b2e91b2ccfdfcf7d1f393ca2/pa/ML31196_d4bd96055a4b29b6afb64eba85ab2040.jpg',
                'https://img-pa.auto1.com/img2a/a3/2aa38d38b2e91b2ccfdfcf7d1f393ca2/pa/ML31196_4167b787d47e88d65406e6cc576f1994.jpg',
                'https://img-pa.auto1.com/img2a/a3/2aa38d38b2e91b2ccfdfcf7d1f393ca2/pa/ML31196_03d92ae3bae6c5dd4ab1ed5e04e5447c.jpg',
                'https://img-pa.auto1.com/img2a/a3/2aa38d38b2e91b2ccfdfcf7d1f393ca2/pa/ML31196_80975b899304fb5ed3db398b9fc15141.jpg',
                'https://img-pa.auto1.com/img2a/a3/2aa38d38b2e91b2ccfdfcf7d1f393ca2/pa/ML31196_4b4eb1511dda669aaf608fb2bfc36ddb.jpg',
                'https://img-pa.auto1.com/img2a/a3/2aa38d38b2e91b2ccfdfcf7d1f393ca2/pa/ML31196_0e7b38d0efb54fd053081ef7bc82f7c7.jpg',
                'https://img-pa.auto1.com/img2a/a3/2aa38d38b2e91b2ccfdfcf7d1f393ca2/pa/ML31196_dabd4bc5b40896963c8441954fed4572.jpg',
                'https://img-pa.auto1.com/img2a/a3/2aa38d38b2e91b2ccfdfcf7d1f393ca2/pa/ML31196_b3f489477f69bed316b15038c235f890.jpg',
                'https://img-pa.auto1.com/img2a/a3/2aa38d38b2e91b2ccfdfcf7d1f393ca2/pa/ML31196_eea30362897cce24920b3c4a5d7e4b07.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7f92148-4bb6-5bfb-a45a-243432f11ed3/b7f92148-4bb6-5bfb-a45a-243432f11ed3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65003,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/a3/2aa38d38b2e91b2ccfdfcf7d1f393ca2/pa/ML31196_2af9f5a0896ce5af129f38122ea8566c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7f92148-4bb6-5bfb-a45a-243432f11ed3/b7f92148-4bb6-5bfb-a45a-243432f11ed3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65354,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/a3/2aa38d38b2e91b2ccfdfcf7d1f393ca2/pa/ML31196_bbffc12d19225c002ce19ec36fec09e9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7f92148-4bb6-5bfb-a45a-243432f11ed3/b7f92148-4bb6-5bfb-a45a-243432f11ed3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68561,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/a3/2aa38d38b2e91b2ccfdfcf7d1f393ca2/pa/ML31196_a5e22b3826b1ea92e204aec8764c3b3c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7f92148-4bb6-5bfb-a45a-243432f11ed3/b7f92148-4bb6-5bfb-a45a-243432f11ed3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59267,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/a3/2aa38d38b2e91b2ccfdfcf7d1f393ca2/pa/ML31196_b57bf4de400198d6561a3edbabb3398a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7f92148-4bb6-5bfb-a45a-243432f11ed3/b7f92148-4bb6-5bfb-a45a-243432f11ed3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64348,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/a3/2aa38d38b2e91b2ccfdfcf7d1f393ca2/pa/ML31196_4b3411bca1fd92c8c2b99e20804a78c4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7f92148-4bb6-5bfb-a45a-243432f11ed3/b7f92148-4bb6-5bfb-a45a-243432f11ed3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70029,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/a3/2aa38d38b2e91b2ccfdfcf7d1f393ca2/pa/ML31196_fe1cb86417165a07019c454ed6ed540c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7f92148-4bb6-5bfb-a45a-243432f11ed3/b7f92148-4bb6-5bfb-a45a-243432f11ed3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57525,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/a3/2aa38d38b2e91b2ccfdfcf7d1f393ca2/pa/ML31196_d4bd96055a4b29b6afb64eba85ab2040.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7f92148-4bb6-5bfb-a45a-243432f11ed3/b7f92148-4bb6-5bfb-a45a-243432f11ed3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75507,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/a3/2aa38d38b2e91b2ccfdfcf7d1f393ca2/pa/ML31196_4167b787d47e88d65406e6cc576f1994.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7f92148-4bb6-5bfb-a45a-243432f11ed3/b7f92148-4bb6-5bfb-a45a-243432f11ed3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68351,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/a3/2aa38d38b2e91b2ccfdfcf7d1f393ca2/pa/ML31196_03d92ae3bae6c5dd4ab1ed5e04e5447c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7f92148-4bb6-5bfb-a45a-243432f11ed3/b7f92148-4bb6-5bfb-a45a-243432f11ed3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62238,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/a3/2aa38d38b2e91b2ccfdfcf7d1f393ca2/pa/ML31196_80975b899304fb5ed3db398b9fc15141.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7f92148-4bb6-5bfb-a45a-243432f11ed3/b7f92148-4bb6-5bfb-a45a-243432f11ed3_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52247,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/a3/2aa38d38b2e91b2ccfdfcf7d1f393ca2/pa/ML31196_4b4eb1511dda669aaf608fb2bfc36ddb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7f92148-4bb6-5bfb-a45a-243432f11ed3/b7f92148-4bb6-5bfb-a45a-243432f11ed3_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63087,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/a3/2aa38d38b2e91b2ccfdfcf7d1f393ca2/pa/ML31196_0e7b38d0efb54fd053081ef7bc82f7c7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7f92148-4bb6-5bfb-a45a-243432f11ed3/b7f92148-4bb6-5bfb-a45a-243432f11ed3_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69697,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/a3/2aa38d38b2e91b2ccfdfcf7d1f393ca2/pa/ML31196_dabd4bc5b40896963c8441954fed4572.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7f92148-4bb6-5bfb-a45a-243432f11ed3/b7f92148-4bb6-5bfb-a45a-243432f11ed3_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61625,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/a3/2aa38d38b2e91b2ccfdfcf7d1f393ca2/pa/ML31196_b3f489477f69bed316b15038c235f890.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7f92148-4bb6-5bfb-a45a-243432f11ed3/b7f92148-4bb6-5bfb-a45a-243432f11ed3_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50879,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/a3/2aa38d38b2e91b2ccfdfcf7d1f393ca2/pa/ML31196_eea30362897cce24920b3c4a5d7e4b07.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-09-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat Tipo 1.0',
 'transmission': 'manual',
 'trim': '',
 'year': 2022}
2026-01-28 20:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ML31196%27 HTTP/1.1" 200 None
2026-01-28 20:07:31 [auto1.it] INFO: Saving data for ML31196: {'created_time': 1769630851.297317, 'last_price_update_time': 1769630851.29733, 'auction_closing_time': 1769704661.0}
2026-01-28 20:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ML31196') HTTP/1.1" 204 0
2026-01-28 20:07:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b7ef435e-47a8-5eb5-94d7-68f0c9d2ab66 with identifier: FN77058
2026-01-28 20:07:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b7ef435e-47a8-5eb5-94d7-68f0c9d2ab66 with identifier: FN77058
2026-01-28 20:07:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b7ef435e-47a8-5eb5-94d7-68f0c9d2ab66 with identifier: FN77058 to the API
2026-01-28 20:07:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:07:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:07:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FN77058>
{'auction_title': '',
 'c_o_2_emission_value': 141,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:09:49Z',
 'fuel_type': 'diesel',
 'id': 'b7ef435e-47a8-5eb5-94d7-68f0c9d2ab66',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FN77058',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 114111,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-12-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q3 35 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2021}
2026-01-28 20:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FN77058%27 HTTP/1.1" 200 None
2026-01-28 20:07:31 [auto1.it] INFO: Saving data for FN77058: {'auction_closing_time': 1769702989.0, 'created_time': 1766433978.274889, 'last_price_update_time': 1769630851.694054}
2026-01-28 20:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FN77058') HTTP/1.1" 204 0
2026-01-28 20:07:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0ac770d0-780a-5e38-9cdc-231ae3aa710b with identifier: ES54295
2026-01-28 20:07:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0ac770d0-780a-5e38-9cdc-231ae3aa710b with identifier: ES54295
2026-01-28 20:07:31 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 194540 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    194540
2026-01-28 20:07:31 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 0ac770d0-780a-5e38-9cdc-231ae3aa710b spider: auto1.it
2026-01-28 20:07:31 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 0ac770d0-780a-5e38-9cdc-231ae3aa710b due to rule: high_mileage_for_country.json, error: 194540 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    194540
{'auction_title': '',
 'c_o_2_emission_value': 157,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.9L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:57:42Z',
 'fuel_type': 'diesel',
 'id': '0ac770d0-780a-5e38-9cdc-231ae3aa710b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ES54295',
 'listing': 'auction',
 'location': 'IT, Milano',
 'make': 'Mercedes-Benz',
 'model': 'GLB-Klasse',
 'odometer': 194540,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-03-25',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Mercedes-Benz GLB-Klasse GLB 200 d 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2021}
2026-01-28 20:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ES54295%27 HTTP/1.1" 200 None
2026-01-28 20:07:31 [auto1.it] INFO: Saving data for ES54295: {'auction_closing_time': 1769705862.0, 'created_time': 1769544045.206009, 'last_price_update_time': 1769630851.929392}
2026-01-28 20:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ES54295') HTTP/1.1" 204 0
2026-01-28 20:07:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4b8099a6-e3af-5161-ace9-15dee63a7f65 with identifier: YL06979
2026-01-28 20:07:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4b8099a6-e3af-5161-ace9-15dee63a7f65 with identifier: YL06979
2026-01-28 20:07:32 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 162873 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    162873
2026-01-28 20:07:32 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 4b8099a6-e3af-5161-ace9-15dee63a7f65 spider: auto1.it
2026-01-28 20:07:32 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 4b8099a6-e3af-5161-ace9-15dee63a7f65 due to rule: high_mileage_for_country.json, error: 162873 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    162873
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:11:07Z',
 'fuel_type': 'diesel',
 'id': '4b8099a6-e3af-5161-ace9-15dee63a7f65',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YL06979',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 162873,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-04-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.5 Blue-HDi GT Pack',
 'transmission': 'automatic',
 'trim': 'GT Pack',
 'year': 2021}
2026-01-28 20:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YL06979%27 HTTP/1.1" 200 None
2026-01-28 20:07:32 [auto1.it] INFO: Saving data for YL06979: {'auction_closing_time': 1769703067.0, 'created_time': 1769544042.703766, 'last_price_update_time': 1769630852.165691}
2026-01-28 20:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YL06979') HTTP/1.1" 204 0
2026-01-28 20:07:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 88dde7a3-881f-5fcf-93ab-a2191142118a with identifier: VH73112
2026-01-28 20:07:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 88dde7a3-881f-5fcf-93ab-a2191142118a with identifier: VH73112
2026-01-28 20:07:32 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'fiat' containing 'fiat' and model 'panda' containing 'panda'
2026-01-28 20:07:32 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 88dde7a3-881f-5fcf-93ab-a2191142118a spider: auto1.it
2026-01-28 20:07:32 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 88dde7a3-881f-5fcf-93ab-a2191142118a due to rule: makes_models_not_allowed.json, error: Rejected due to make 'fiat' containing 'fiat' and model 'panda' containing 'panda'
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2026-01-29T16:02:00Z',
 'fuel_type': 'petrol',
 'id': '88dde7a3-881f-5fcf-93ab-a2191142118a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VH73112',
 'listing': 'auction',
 'location': 'IT, Settimo Torinese',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 21558,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img26/ed/26ed52af68cb4e1df514c82ff695f986/pa/VH73112_404d1af7f192c0962b78c56b3a5154c3.jpg',
                'https://img-pa.auto1.com/img26/ed/26ed52af68cb4e1df514c82ff695f986/pa/VH73112_73dc8e2493f2fc8613ca9fe6c93d23f4.jpg',
                'https://img-pa.auto1.com/img26/ed/26ed52af68cb4e1df514c82ff695f986/pa/VH73112_f22683b6bb365d4202900815ef60c6a5.jpg',
                'https://img-pa.auto1.com/img26/ed/26ed52af68cb4e1df514c82ff695f986/pa/VH73112_48bf6ffee062f85be7e08c0d0b425ee1.jpg',
                'https://img-pa.auto1.com/img26/ed/26ed52af68cb4e1df514c82ff695f986/pa/VH73112_64043b15d6f7dd2f8222db4bf371a190.jpg',
                'https://img-pa.auto1.com/img26/ed/26ed52af68cb4e1df514c82ff695f986/pa/VH73112_a1c53e55318501625f9ac76690543f98.jpg',
                'https://img-pa.auto1.com/img26/ed/26ed52af68cb4e1df514c82ff695f986/pa/VH73112_d6e67000f9293af45c8397945cb0fed4.jpg',
                'https://img-pa.auto1.com/img26/ed/26ed52af68cb4e1df514c82ff695f986/pa/VH73112_52f352c5e7a3ea8fd407a61df53dfc97.jpg',
                'https://img-pa.auto1.com/img26/ed/26ed52af68cb4e1df514c82ff695f986/pa/VH73112_b95c4c8cfda95642c06a222ab395449b.jpg',
                'https://img-pa.auto1.com/img26/ed/26ed52af68cb4e1df514c82ff695f986/pa/VH73112_d7365fa37073e0fcc36537a65fee2127.jpg',
                'https://img-pa.auto1.com/img26/ed/26ed52af68cb4e1df514c82ff695f986/pa/VH73112_9bce097157ff737c196fb09495eecf03.jpg',
                'https://img-pa.auto1.com/img26/ed/26ed52af68cb4e1df514c82ff695f986/pa/VH73112_cbe5b8a7f266af212a04b7e29a5872c8.jpg',
                'https://img-pa.auto1.com/img26/ed/26ed52af68cb4e1df514c82ff695f986/pa/VH73112_59b17971ef6c2e3c3db1a5a988c0f1b6.jpg',
                'https://img-pa.auto1.com/img26/ed/26ed52af68cb4e1df514c82ff695f986/pa/VH73112_acc931f9876c920fedc8f677719c8c98.jpg',
                'https://img-pa.auto1.com/img26/ed/26ed52af68cb4e1df514c82ff695f986/pa/VH73112_d521a2f4f78cfcfdc4389c62f788099c.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88dde7a3-881f-5fcf-93ab-a2191142118a/88dde7a3-881f-5fcf-93ab-a2191142118a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2215500,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img26/ed/26ed52af68cb4e1df514c82ff695f986/pa/VH73112_404d1af7f192c0962b78c56b3a5154c3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88dde7a3-881f-5fcf-93ab-a2191142118a/88dde7a3-881f-5fcf-93ab-a2191142118a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80925,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/ed/26ed52af68cb4e1df514c82ff695f986/pa/VH73112_73dc8e2493f2fc8613ca9fe6c93d23f4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88dde7a3-881f-5fcf-93ab-a2191142118a/88dde7a3-881f-5fcf-93ab-a2191142118a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68864,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/ed/26ed52af68cb4e1df514c82ff695f986/pa/VH73112_f22683b6bb365d4202900815ef60c6a5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88dde7a3-881f-5fcf-93ab-a2191142118a/88dde7a3-881f-5fcf-93ab-a2191142118a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55946,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/ed/26ed52af68cb4e1df514c82ff695f986/pa/VH73112_48bf6ffee062f85be7e08c0d0b425ee1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88dde7a3-881f-5fcf-93ab-a2191142118a/88dde7a3-881f-5fcf-93ab-a2191142118a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2328676,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img26/ed/26ed52af68cb4e1df514c82ff695f986/pa/VH73112_64043b15d6f7dd2f8222db4bf371a190.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88dde7a3-881f-5fcf-93ab-a2191142118a/88dde7a3-881f-5fcf-93ab-a2191142118a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2234199,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img26/ed/26ed52af68cb4e1df514c82ff695f986/pa/VH73112_a1c53e55318501625f9ac76690543f98.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88dde7a3-881f-5fcf-93ab-a2191142118a/88dde7a3-881f-5fcf-93ab-a2191142118a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54149,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/ed/26ed52af68cb4e1df514c82ff695f986/pa/VH73112_d6e67000f9293af45c8397945cb0fed4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88dde7a3-881f-5fcf-93ab-a2191142118a/88dde7a3-881f-5fcf-93ab-a2191142118a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73684,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/ed/26ed52af68cb4e1df514c82ff695f986/pa/VH73112_52f352c5e7a3ea8fd407a61df53dfc97.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88dde7a3-881f-5fcf-93ab-a2191142118a/88dde7a3-881f-5fcf-93ab-a2191142118a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77095,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/ed/26ed52af68cb4e1df514c82ff695f986/pa/VH73112_b95c4c8cfda95642c06a222ab395449b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88dde7a3-881f-5fcf-93ab-a2191142118a/88dde7a3-881f-5fcf-93ab-a2191142118a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2481667,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img26/ed/26ed52af68cb4e1df514c82ff695f986/pa/VH73112_d7365fa37073e0fcc36537a65fee2127.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88dde7a3-881f-5fcf-93ab-a2191142118a/88dde7a3-881f-5fcf-93ab-a2191142118a_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63097,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/ed/26ed52af68cb4e1df514c82ff695f986/pa/VH73112_9bce097157ff737c196fb09495eecf03.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88dde7a3-881f-5fcf-93ab-a2191142118a/88dde7a3-881f-5fcf-93ab-a2191142118a_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60346,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/ed/26ed52af68cb4e1df514c82ff695f986/pa/VH73112_cbe5b8a7f266af212a04b7e29a5872c8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88dde7a3-881f-5fcf-93ab-a2191142118a/88dde7a3-881f-5fcf-93ab-a2191142118a_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52771,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/ed/26ed52af68cb4e1df514c82ff695f986/pa/VH73112_59b17971ef6c2e3c3db1a5a988c0f1b6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88dde7a3-881f-5fcf-93ab-a2191142118a/88dde7a3-881f-5fcf-93ab-a2191142118a_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57178,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/ed/26ed52af68cb4e1df514c82ff695f986/pa/VH73112_acc931f9876c920fedc8f677719c8c98.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88dde7a3-881f-5fcf-93ab-a2191142118a/88dde7a3-881f-5fcf-93ab-a2191142118a_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64984,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/ed/26ed52af68cb4e1df514c82ff695f986/pa/VH73112_d521a2f4f78cfcfdc4389c62f788099c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-10-15',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat Panda 1.2 Easy',
 'transmission': 'manual',
 'trim': 'Easy',
 'year': 2020}
2026-01-28 20:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VH73112%27 HTTP/1.1" 200 None
2026-01-28 20:07:32 [auto1.it] INFO: Saving data for VH73112: {'created_time': 1769630852.395928, 'last_price_update_time': 1769630852.395938, 'auction_closing_time': 1769702520.0}
2026-01-28 20:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VH73112') HTTP/1.1" 204 0
2026-01-28 20:07:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:07:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/4b/df4bfd14ecccad2e28acc7936a8ce0e3/pa/WP90453_dfb1e70fadcb2a19438a01fe0f85e092.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:07:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/bd/46bdb76093c6be862e79db975763678d/pa/NF00160_2a58f4d149b290c31bb286c35fe4c828.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fbd%252F46bdb76093c6be862e79db975763678d%252Fpa%252FNF00160_cf1198d68a123c853db48751160f96bc.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/bd/46bdb76093c6be862e79db975763678d/pa/NF00160_cf1198d68a123c853db48751160f96bc.jpg not downloaded yet
2026-01-28 20:07:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/bd/46bdb76093c6be862e79db975763678d/pa/NF00160_7cb43a1327b97b5312f867bed4e29bef.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:07:32 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 22 - Data Location: 110 - value: b'SONY\x00'
2026-01-28 20:07:32 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 34 - Data Location: 116 - value: b'ILCE-7M3\x00'
2026-01-28 20:07:32 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 126 - value: b',\x01\x00\x00\x01\x00\x00\x00'
2026-01-28 20:07:32 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 134 - value: b',\x01\x00\x00\x01\x00\x00\x00'
2026-01-28 20:07:32 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-01-28 20:07:32 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 82 - Data Location: 142 - value: <table: 42 bytes>
2026-01-28 20:07:32 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 94 - Data Location: 184 - value: b'2026:01:28 11:12:35\x00'
2026-01-28 20:07:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\xcc\x00\x00\x00'
2026-01-28 20:07:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09d61e90>
2026-01-28 20:07:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:07:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1f86ee2-a86e-5681-9d4a-acf0324fc4ce/d1f86ee2-a86e-5681-9d4a-acf0324fc4ce_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fbd%252F46bdb76093c6be862e79db975763678d%252Fpa%252FNF00160_d8e9055abafe89e49c3a66e581f1f3a1.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/bd/46bdb76093c6be862e79db975763678d/pa/NF00160_d8e9055abafe89e49c3a66e581f1f3a1.jpg saved to cache
2026-01-28 20:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d1f86ee2-a86e-5681-9d4a-acf0324fc4ce
2026-01-28 20:07:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09d9cb10>
2026-01-28 20:07:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:07:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_42f57244-9ce1-548c-80f9-ba4fc624de0c/42f57244-9ce1-548c-80f9-ba4fc624de0c_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F88%252Fa9886c8c428fd9ace2871b067ea0c3ef%252Fpa%252FFP41040_37901c45050e8173d13520b45d2264e3.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/88/a9886c8c428fd9ace2871b067ea0c3ef/pa/FP41040_37901c45050e8173d13520b45d2264e3.jpg saved to cache
2026-01-28 20:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 42f57244-9ce1-548c-80f9-ba4fc624de0c
2026-01-28 20:07:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 42f57244-9ce1-548c-80f9-ba4fc624de0c, skipping ID generation
2026-01-28 20:07:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 42f57244-9ce1-548c-80f9-ba4fc624de0c with scrape type 1
2026-01-28 20:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 42f57244-9ce1-548c-80f9-ba4fc624de0c from tracking dictionaries
2026-01-28 20:07:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 42f57244-9ce1-548c-80f9-ba4fc624de0c sending to next pipeline
2026-01-28 20:07:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 42f57244-9ce1-548c-80f9-ba4fc624de0c, identifier: FP41040
2026-01-28 20:07:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 42f57244-9ce1-548c-80f9-ba4fc624de0c with identifier: FP41040
2026-01-28 20:07:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 42f57244-9ce1-548c-80f9-ba4fc624de0c with identifier: FP41040
2026-01-28 20:07:33 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 194476 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    194476
2026-01-28 20:07:33 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 42f57244-9ce1-548c-80f9-ba4fc624de0c spider: auto1.it
2026-01-28 20:07:33 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 42f57244-9ce1-548c-80f9-ba4fc624de0c due to rule: high_mileage_for_country.json, error: 194476 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    194476
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 116,
 'expiration_date': '2026-01-29T16:02:15Z',
 'fuel_type': 'diesel',
 'id': '42f57244-9ce1-548c-80f9-ba4fc624de0c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FP41040',
 'listing': 'auction',
 'location': 'IT',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 194476,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42f57244-9ce1-548c-80f9-ba4fc624de0c/42f57244-9ce1-548c-80f9-ba4fc624de0c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2061479,
             'Height': 1966,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/88/a9886c8c428fd9ace2871b067ea0c3ef/pa/FP41040_37901c45050e8173d13520b45d2264e3.jpg',
             'Width': 2621},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42f57244-9ce1-548c-80f9-ba4fc624de0c/42f57244-9ce1-548c-80f9-ba4fc624de0c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2061479,
             'Height': 1966,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/88/a9886c8c428fd9ace2871b067ea0c3ef/pa/FP41040_9068be76c77a0a4645361fc7d795c3f3.jpg',
             'Width': 2621},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42f57244-9ce1-548c-80f9-ba4fc624de0c/42f57244-9ce1-548c-80f9-ba4fc624de0c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1957118,
             'Height': 1966,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/88/a9886c8c428fd9ace2871b067ea0c3ef/pa/FP41040_68d92b776a58a3e4fc5227a814ce03f7.jpg',
             'Width': 2621},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42f57244-9ce1-548c-80f9-ba4fc624de0c/42f57244-9ce1-548c-80f9-ba4fc624de0c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1797732,
             'Height': 1966,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/88/a9886c8c428fd9ace2871b067ea0c3ef/pa/FP41040_cabd983989e48e752cca9ebd4dedddcb.jpg',
             'Width': 2621},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42f57244-9ce1-548c-80f9-ba4fc624de0c/42f57244-9ce1-548c-80f9-ba4fc624de0c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2040433,
             'Height': 1966,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/88/a9886c8c428fd9ace2871b067ea0c3ef/pa/FP41040_75273429baf6089aea1e0b5c6284c9a2.jpg',
             'Width': 2621},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42f57244-9ce1-548c-80f9-ba4fc624de0c/42f57244-9ce1-548c-80f9-ba4fc624de0c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2032645,
             'Height': 1966,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/88/a9886c8c428fd9ace2871b067ea0c3ef/pa/FP41040_d2a3377ec9452346f4d9367d7c842a4c.jpg',
             'Width': 2621},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42f57244-9ce1-548c-80f9-ba4fc624de0c/42f57244-9ce1-548c-80f9-ba4fc624de0c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1744286,
             'Height': 1966,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/88/a9886c8c428fd9ace2871b067ea0c3ef/pa/FP41040_ff78557f924ba202ac80175ad01f9872.jpg',
             'Width': 2621},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42f57244-9ce1-548c-80f9-ba4fc624de0c/42f57244-9ce1-548c-80f9-ba4fc624de0c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1090158,
             'Height': 1966,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/88/a9886c8c428fd9ace2871b067ea0c3ef/pa/FP41040_b805b529baec07590ab41f24b1fb9bf9.jpg',
             'Width': 2621},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42f57244-9ce1-548c-80f9-ba4fc624de0c/42f57244-9ce1-548c-80f9-ba4fc624de0c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1246676,
             'Height': 1966,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/88/a9886c8c428fd9ace2871b067ea0c3ef/pa/FP41040_b9a0b3efd0bf9ea9494f9586915a3c68.jpg',
             'Width': 2621},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42f57244-9ce1-548c-80f9-ba4fc624de0c/42f57244-9ce1-548c-80f9-ba4fc624de0c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1169774,
             'Height': 1966,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/88/a9886c8c428fd9ace2871b067ea0c3ef/pa/FP41040_b73370070eb1cf24a9a7194f0042c7bc.jpg',
             'Width': 2621},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42f57244-9ce1-548c-80f9-ba4fc624de0c/42f57244-9ce1-548c-80f9-ba4fc624de0c_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1310842,
             'Height': 1966,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/88/a9886c8c428fd9ace2871b067ea0c3ef/pa/FP41040_c3b5359dbfeb085b0df0700cb01cca02.jpg',
             'Width': 2621},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42f57244-9ce1-548c-80f9-ba4fc624de0c/42f57244-9ce1-548c-80f9-ba4fc624de0c_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 690292,
             'Height': 1966,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/88/a9886c8c428fd9ace2871b067ea0c3ef/pa/FP41040_067a155e5189a89b3b484b00785c924f.jpg',
             'Width': 2621},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42f57244-9ce1-548c-80f9-ba4fc624de0c/42f57244-9ce1-548c-80f9-ba4fc624de0c_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85067,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/88/a9886c8c428fd9ace2871b067ea0c3ef/pa/FP41040_94b77a43da9ebe9f8012e9409d492402.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-07-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 2.0 TDI Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2022}
2026-01-28 20:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FP41040%27 HTTP/1.1" 200 None
2026-01-28 20:07:33 [auto1.it] INFO: Saving data for FP41040: {'created_time': 1769630853.446479, 'last_price_update_time': 1769630853.44649, 'auction_closing_time': 1769702535.0}
2026-01-28 20:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FP41040') HTTP/1.1" 204 0
2026-01-28 20:07:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SB13925> (referer: https://www.auto1.com/v1/car-details-view/SB13925/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:07:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EA92626> (referer: https://www.auto1.com/v1/car-details-view/EA92626/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:07:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YH36098> (referer: https://www.auto1.com/v1/car-details-view/YH36098/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:07:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MP18514> (referer: https://www.auto1.com/v1/car-details-view/MP18514/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:07:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CC90346> (referer: https://www.auto1.com/v1/car-details-view/CC90346/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:07:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09d9c990>
2026-01-28 20:07:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_051ddf36-eff8-5c80-8634-fb09358064b3/051ddf36-eff8-5c80-8634-fb09358064b3_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F4b%252Fdf4bfd14ecccad2e28acc7936a8ce0e3%252Fpa%252FWP90453_dfb1e70fadcb2a19438a01fe0f85e092.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/4b/df4bfd14ecccad2e28acc7936a8ce0e3/pa/WP90453_dfb1e70fadcb2a19438a01fe0f85e092.jpg saved to cache
2026-01-28 20:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 051ddf36-eff8-5c80-8634-fb09358064b3
2026-01-28 20:07:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08b28310>
2026-01-28 20:07:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1f86ee2-a86e-5681-9d4a-acf0324fc4ce/d1f86ee2-a86e-5681-9d4a-acf0324fc4ce_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fbd%252F46bdb76093c6be862e79db975763678d%252Fpa%252FNF00160_2a58f4d149b290c31bb286c35fe4c828.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/bd/46bdb76093c6be862e79db975763678d/pa/NF00160_2a58f4d149b290c31bb286c35fe4c828.jpg saved to cache
2026-01-28 20:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d1f86ee2-a86e-5681-9d4a-acf0324fc4ce
2026-01-28 20:07:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08bf1d10>
2026-01-28 20:07:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1f86ee2-a86e-5681-9d4a-acf0324fc4ce/d1f86ee2-a86e-5681-9d4a-acf0324fc4ce_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fbd%252F46bdb76093c6be862e79db975763678d%252Fpa%252FNF00160_7cb43a1327b97b5312f867bed4e29bef.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/bd/46bdb76093c6be862e79db975763678d/pa/NF00160_7cb43a1327b97b5312f867bed4e29bef.jpg saved to cache
2026-01-28 20:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d1f86ee2-a86e-5681-9d4a-acf0324fc4ce
2026-01-28 20:07:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:07:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:07:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/bd/46bdb76093c6be862e79db975763678d/pa/NF00160_40e2c7e737dc19daf856a2b8390e3085.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:07:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TU05159> (referer: https://www.auto1.com/v1/car-details-view/TU05159/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:07:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EZ33602> (referer: https://www.auto1.com/v1/car-details-view/EZ33602/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:07:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 07e6e290-030a-52db-ae13-9d05a5ed649e with identifier: SB13925
2026-01-28 20:07:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 07e6e290-030a-52db-ae13-9d05a5ed649e with scrape type 2
2026-01-28 20:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 07e6e290-030a-52db-ae13-9d05a5ed649e with scrape type 2
2026-01-28 20:07:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 07e6e290-030a-52db-ae13-9d05a5ed649e, identifier: SB13925
2026-01-28 20:07:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 074bad8b-7b0f-5589-8140-2ce9d0bafe51 with identifier: EA92626
2026-01-28 20:07:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 074bad8b-7b0f-5589-8140-2ce9d0bafe51 with scrape type 2
2026-01-28 20:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 074bad8b-7b0f-5589-8140-2ce9d0bafe51 with scrape type 2
2026-01-28 20:07:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 074bad8b-7b0f-5589-8140-2ce9d0bafe51, identifier: EA92626
2026-01-28 20:07:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc55a665-c512-574c-8eac-d633b455321d with identifier: YH36098
2026-01-28 20:07:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc55a665-c512-574c-8eac-d633b455321d with scrape type 2
2026-01-28 20:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bc55a665-c512-574c-8eac-d633b455321d with scrape type 2
2026-01-28 20:07:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: bc55a665-c512-574c-8eac-d633b455321d, identifier: YH36098
2026-01-28 20:07:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d90eef50-4032-5410-835f-30e841c2906d with identifier: MP18514
2026-01-28 20:07:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d90eef50-4032-5410-835f-30e841c2906d with scrape type 2
2026-01-28 20:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d90eef50-4032-5410-835f-30e841c2906d with scrape type 2
2026-01-28 20:07:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d90eef50-4032-5410-835f-30e841c2906d, identifier: MP18514
2026-01-28 20:07:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 434d1f45-bb44-5b68-86e9-399667d42a7a with identifier: CC90346
2026-01-28 20:07:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 434d1f45-bb44-5b68-86e9-399667d42a7a with scrape type 2
2026-01-28 20:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 434d1f45-bb44-5b68-86e9-399667d42a7a with scrape type 2
2026-01-28 20:07:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 434d1f45-bb44-5b68-86e9-399667d42a7a, identifier: CC90346
2026-01-28 20:07:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 07e6e290-030a-52db-ae13-9d05a5ed649e with identifier: SB13925
2026-01-28 20:07:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 07e6e290-030a-52db-ae13-9d05a5ed649e with identifier: SB13925
2026-01-28 20:07:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 07e6e290-030a-52db-ae13-9d05a5ed649e with identifier: SB13925 to the API
2026-01-28 20:07:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:07:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:07:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SB13925>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.6L',
 'engine_horse_power': 115,
 'expiration_date': '2026-01-29T16:28:24Z',
 'fuel_type': 'diesel',
 'id': '07e6e290-030a-52db-ae13-9d05a5ed649e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SB13925',
 'listing': 'auction',
 'location': 'IT, Milazzo',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 51569,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-11-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Trendline BlueMotion',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion',
 'year': 2018}
2026-01-28 20:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27SB13925%27 HTTP/1.1" 200 None
2026-01-28 20:07:35 [auto1.it] INFO: Saving data for SB13925: {'auction_closing_time': 1769704104.0, 'created_time': 1768471447.072911, 'last_price_update_time': 1769630855.28384}
2026-01-28 20:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='SB13925') HTTP/1.1" 204 0
2026-01-28 20:07:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 074bad8b-7b0f-5589-8140-2ce9d0bafe51 with identifier: EA92626
2026-01-28 20:07:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 074bad8b-7b0f-5589-8140-2ce9d0bafe51 with identifier: EA92626
2026-01-28 20:07:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 074bad8b-7b0f-5589-8140-2ce9d0bafe51 with identifier: EA92626 to the API
2026-01-28 20:07:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:07:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:07:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EA92626>
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.6L',
 'engine_horse_power': 230,
 'expiration_date': '2026-01-29T16:11:37Z',
 'fuel_type': 'hybrid',
 'id': '074bad8b-7b0f-5589-8140-2ce9d0bafe51',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EA92626',
 'listing': 'auction',
 'location': 'IT, Roma',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 24660,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-10-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 T-GDI Hybrid N Line 2WD',
 'transmission': 'automatic',
 'trim': 'N Line 2WD',
 'year': 2022}
2026-01-28 20:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EA92626%27 HTTP/1.1" 200 None
2026-01-28 20:07:35 [auto1.it] INFO: Saving data for EA92626: {'auction_closing_time': 1769703097.0, 'created_time': 1767609953.563786, 'last_price_update_time': 1769630855.662262}
2026-01-28 20:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EA92626') HTTP/1.1" 204 0
2026-01-28 20:07:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: bc55a665-c512-574c-8eac-d633b455321d with identifier: YH36098
2026-01-28 20:07:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: bc55a665-c512-574c-8eac-d633b455321d with identifier: YH36098
2026-01-28 20:07:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: bc55a665-c512-574c-8eac-d633b455321d with identifier: YH36098 to the API
2026-01-28 20:07:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:07:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:07:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YH36098>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.3L',
 'engine_horse_power': 102,
 'expiration_date': '2026-01-29T16:29:26Z',
 'fuel_type': 'petrol',
 'id': 'bc55a665-c512-574c-8eac-d633b455321d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YH36098',
 'listing': 'auction',
 'location': 'IT, Roma',
 'make': 'Honda',
 'model': 'Jazz',
 'odometer': 40322,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-01-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Honda Jazz 1.3 i-VTEC Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2018}
2026-01-28 20:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YH36098%27 HTTP/1.1" 200 None
2026-01-28 20:07:36 [auto1.it] INFO: Saving data for YH36098: {'auction_closing_time': 1769704166.0, 'created_time': 1767866545.417924, 'last_price_update_time': 1769630856.01387}
2026-01-28 20:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YH36098') HTTP/1.1" 204 0
2026-01-28 20:07:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d90eef50-4032-5410-835f-30e841c2906d with identifier: MP18514
2026-01-28 20:07:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d90eef50-4032-5410-835f-30e841c2906d with identifier: MP18514
2026-01-28 20:07:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d90eef50-4032-5410-835f-30e841c2906d with identifier: MP18514 to the API
2026-01-28 20:07:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:07:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:07:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MP18514>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:58:06Z',
 'fuel_type': 'diesel',
 'id': 'd90eef50-4032-5410-835f-30e841c2906d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MP18514',
 'listing': 'auction',
 'location': 'IT, Roma',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 50916,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-03-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.5 Blue-HDi Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2023}
2026-01-28 20:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MP18514%27 HTTP/1.1" 200 None
2026-01-28 20:07:36 [auto1.it] INFO: Saving data for MP18514: {'auction_closing_time': 1769705886.0, 'created_time': 1767607328.795909, 'last_price_update_time': 1769630856.367104}
2026-01-28 20:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MP18514') HTTP/1.1" 204 0
2026-01-28 20:07:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 434d1f45-bb44-5b68-86e9-399667d42a7a with identifier: CC90346
2026-01-28 20:07:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 434d1f45-bb44-5b68-86e9-399667d42a7a with identifier: CC90346
2026-01-28 20:07:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 434d1f45-bb44-5b68-86e9-399667d42a7a with identifier: CC90346 to the API
2026-01-28 20:07:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:07:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:07:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CC90346>
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.9L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:00:28Z',
 'fuel_type': 'diesel',
 'id': '434d1f45-bb44-5b68-86e9-399667d42a7a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CC90346',
 'listing': 'auction',
 'location': 'IT, Senago (MI)',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 90702,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-05-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 200 d Progressive',
 'transmission': 'automatic',
 'trim': 'Progressive',
 'year': 2022}
2026-01-28 20:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27CC90346%27 HTTP/1.1" 200 None
2026-01-28 20:07:36 [auto1.it] INFO: Saving data for CC90346: {'auction_closing_time': 1769702428.0, 'created_time': 1766692976.02281, 'last_price_update_time': 1769630856.76597}
2026-01-28 20:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='CC90346') HTTP/1.1" 204 0
2026-01-28 20:07:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/bd/46bdb76093c6be862e79db975763678d/pa/NF00160_c382e9b4b0759fc63aeb6b557984415f.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:07:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/bd/46bdb76093c6be862e79db975763678d/pa/NF00160_64261409a2a40ba88250504647f2b6fc.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:07:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:07:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:07:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/bd/46bdb76093c6be862e79db975763678d/pa/NF00160_cf1198d68a123c853db48751160f96bc.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:07:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EZ99930> (referer: https://www.auto1.com/v1/car-details-view/EZ99930/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:07:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/bd/46bdb76093c6be862e79db975763678d/pa/NF00160_1387626c853564be69c0f1e020ffcbe2.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:07:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:07:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:07:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:07:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09e30e90>
2026-01-28 20:07:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:07:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1f86ee2-a86e-5681-9d4a-acf0324fc4ce/d1f86ee2-a86e-5681-9d4a-acf0324fc4ce_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fbd%252F46bdb76093c6be862e79db975763678d%252Fpa%252FNF00160_40e2c7e737dc19daf856a2b8390e3085.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/bd/46bdb76093c6be862e79db975763678d/pa/NF00160_40e2c7e737dc19daf856a2b8390e3085.jpg saved to cache
2026-01-28 20:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item d1f86ee2-a86e-5681-9d4a-acf0324fc4ce
2026-01-28 20:07:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d4af6dec-189a-5b90-9f20-90539a7373c5 with identifier: TU05159
2026-01-28 20:07:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4af6dec-189a-5b90-9f20-90539a7373c5 with scrape type 2
2026-01-28 20:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d4af6dec-189a-5b90-9f20-90539a7373c5 with scrape type 2
2026-01-28 20:07:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d4af6dec-189a-5b90-9f20-90539a7373c5, identifier: TU05159
2026-01-28 20:07:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ea7eee0-47c6-5d29-bf16-7537ddfa2b5c with identifier: EZ33602
2026-01-28 20:07:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ea7eee0-47c6-5d29-bf16-7537ddfa2b5c with scrape type 2
2026-01-28 20:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5ea7eee0-47c6-5d29-bf16-7537ddfa2b5c with scrape type 2
2026-01-28 20:07:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5ea7eee0-47c6-5d29-bf16-7537ddfa2b5c, identifier: EZ33602
2026-01-28 20:07:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/bd/46bdb76093c6be862e79db975763678d/pa/NF00160_f3ed1e0e3f8c02891a3be12a9023a4b5.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:07:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/bd/46bdb76093c6be862e79db975763678d/pa/NF00160_273a812bb1e2bb39329b5074e0e09c92.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:07:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d4af6dec-189a-5b90-9f20-90539a7373c5 with identifier: TU05159
2026-01-28 20:07:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d4af6dec-189a-5b90-9f20-90539a7373c5 with identifier: TU05159
2026-01-28 20:07:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d4af6dec-189a-5b90-9f20-90539a7373c5 with identifier: TU05159 to the API
2026-01-28 20:07:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:07:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:07:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TU05159>
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '2.0L',
 'engine_horse_power': 122,
 'expiration_date': '2026-01-29T16:58:39Z',
 'fuel_type': 'petrol',
 'id': 'd4af6dec-189a-5b90-9f20-90539a7373c5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TU05159',
 'listing': 'auction',
 'location': 'IT, Senago (MI)',
 'make': 'Volvo',
 'model': 'V40',
 'odometer': 51487,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-12-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo V40 2.0 T2 Plus',
 'transmission': 'manual',
 'trim': 'Plus',
 'year': 2018}
2026-01-28 20:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27TU05159%27 HTTP/1.1" 200 None
2026-01-28 20:07:37 [auto1.it] INFO: Saving data for TU05159: {'auction_closing_time': 1769705919.0, 'created_time': 1768248668.135143, 'last_price_update_time': 1769630857.674151}
2026-01-28 20:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='TU05159') HTTP/1.1" 204 0
2026-01-28 20:07:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5ea7eee0-47c6-5d29-bf16-7537ddfa2b5c with identifier: EZ33602
2026-01-28 20:07:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5ea7eee0-47c6-5d29-bf16-7537ddfa2b5c with identifier: EZ33602
2026-01-28 20:07:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5ea7eee0-47c6-5d29-bf16-7537ddfa2b5c with identifier: EZ33602 to the API
2026-01-28 20:07:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:07:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:07:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EZ33602>
{'auction_title': '',
 'c_o_2_emission_value': 107,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.6L',
 'engine_horse_power': 143,
 'expiration_date': '2026-01-29T16:12:00Z',
 'fuel_type': 'hybrid',
 'id': '5ea7eee0-47c6-5d29-bf16-7537ddfa2b5c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EZ33602',
 'listing': 'auction',
 'location': 'IT, Milano',
 'make': 'Renault',
 'model': 'Arkana',
 'odometer': 22132,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-06-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Arkana 1.6 Hybrid E-Tech Techno',
 'transmission': 'automatic',
 'trim': 'Techno',
 'year': 2024}
2026-01-28 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EZ33602%27 HTTP/1.1" 200 None
2026-01-28 20:07:38 [auto1.it] INFO: Saving data for EZ33602: {'auction_closing_time': 1769703120.0, 'created_time': 1767384144.627934, 'last_price_update_time': 1769630858.012049}
2026-01-28 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EZ33602') HTTP/1.1" 204 0
2026-01-28 20:07:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08ce46d0>
2026-01-28 20:07:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:07:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1f86ee2-a86e-5681-9d4a-acf0324fc4ce/d1f86ee2-a86e-5681-9d4a-acf0324fc4ce_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fbd%252F46bdb76093c6be862e79db975763678d%252Fpa%252FNF00160_c382e9b4b0759fc63aeb6b557984415f.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/bd/46bdb76093c6be862e79db975763678d/pa/NF00160_c382e9b4b0759fc63aeb6b557984415f.jpg saved to cache
2026-01-28 20:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d1f86ee2-a86e-5681-9d4a-acf0324fc4ce
2026-01-28 20:07:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b086f8650>
2026-01-28 20:07:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1f86ee2-a86e-5681-9d4a-acf0324fc4ce/d1f86ee2-a86e-5681-9d4a-acf0324fc4ce_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fbd%252F46bdb76093c6be862e79db975763678d%252Fpa%252FNF00160_64261409a2a40ba88250504647f2b6fc.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/bd/46bdb76093c6be862e79db975763678d/pa/NF00160_64261409a2a40ba88250504647f2b6fc.jpg saved to cache
2026-01-28 20:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d1f86ee2-a86e-5681-9d4a-acf0324fc4ce
2026-01-28 20:07:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b087304d0>
2026-01-28 20:07:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1f86ee2-a86e-5681-9d4a-acf0324fc4ce/d1f86ee2-a86e-5681-9d4a-acf0324fc4ce_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fbd%252F46bdb76093c6be862e79db975763678d%252Fpa%252FNF00160_cf1198d68a123c853db48751160f96bc.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/bd/46bdb76093c6be862e79db975763678d/pa/NF00160_cf1198d68a123c853db48751160f96bc.jpg saved to cache
2026-01-28 20:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item d1f86ee2-a86e-5681-9d4a-acf0324fc4ce
2026-01-28 20:07:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ffe3bca-a9d4-5461-8814-d57bf5d64a39 with identifier: EZ99930
2026-01-28 20:07:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ffe3bca-a9d4-5461-8814-d57bf5d64a39 with scrape type 1
2026-01-28 20:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 5ffe3bca-a9d4-5461-8814-d57bf5d64a39
2026-01-28 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F30%252Fc8302715b984962028bc1fd36d504d26%252Fpa%252FEZ99930_f6c03dbe12f72b34842e8ece6d748fdc.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/30/c8302715b984962028bc1fd36d504d26/pa/EZ99930_f6c03dbe12f72b34842e8ece6d748fdc.jpg already downloaded
2026-01-28 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F30%252Fc8302715b984962028bc1fd36d504d26%252Fpa%252FEZ99930_6b2da694bb73e1f4a197647e9be1eda3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/30/c8302715b984962028bc1fd36d504d26/pa/EZ99930_6b2da694bb73e1f4a197647e9be1eda3.jpg already downloaded
2026-01-28 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F30%252Fc8302715b984962028bc1fd36d504d26%252Fpa%252FEZ99930_371033899beef37cf97ed8efdc034df7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/30/c8302715b984962028bc1fd36d504d26/pa/EZ99930_371033899beef37cf97ed8efdc034df7.jpg already downloaded
2026-01-28 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F30%252Fc8302715b984962028bc1fd36d504d26%252Fpa%252FEZ99930_f4f148f8de5e97104bbdb7d7a617310c.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/30/c8302715b984962028bc1fd36d504d26/pa/EZ99930_f4f148f8de5e97104bbdb7d7a617310c.jpg already downloaded
2026-01-28 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F30%252Fc8302715b984962028bc1fd36d504d26%252Fpa%252FEZ99930_463514f9e9b56ed20527af8148943b59.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/30/c8302715b984962028bc1fd36d504d26/pa/EZ99930_463514f9e9b56ed20527af8148943b59.jpg already downloaded
2026-01-28 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F30%252Fc8302715b984962028bc1fd36d504d26%252Fpa%252FEZ99930_8d6c05314a4fd86816bb6b1f0b6c6cf9.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/30/c8302715b984962028bc1fd36d504d26/pa/EZ99930_8d6c05314a4fd86816bb6b1f0b6c6cf9.jpg already downloaded
2026-01-28 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F30%252Fc8302715b984962028bc1fd36d504d26%252Fpa%252FEZ99930_5d8383646280c82be6aa60ed1036a847.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/30/c8302715b984962028bc1fd36d504d26/pa/EZ99930_5d8383646280c82be6aa60ed1036a847.jpg already downloaded
2026-01-28 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F30%252Fc8302715b984962028bc1fd36d504d26%252Fpa%252FEZ99930_112e67f518c12c965e5a6dcc44c337be.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/30/c8302715b984962028bc1fd36d504d26/pa/EZ99930_112e67f518c12c965e5a6dcc44c337be.jpg already downloaded
2026-01-28 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F30%252Fc8302715b984962028bc1fd36d504d26%252Fpa%252FEZ99930_7ccd9533815ddac80c494566c1e98796.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/30/c8302715b984962028bc1fd36d504d26/pa/EZ99930_7ccd9533815ddac80c494566c1e98796.jpg already downloaded
2026-01-28 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F30%252Fc8302715b984962028bc1fd36d504d26%252Fpa%252FEZ99930_a6d3c573549a404e291405f2597c0b1e.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/30/c8302715b984962028bc1fd36d504d26/pa/EZ99930_a6d3c573549a404e291405f2597c0b1e.jpg already downloaded
2026-01-28 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F30%252Fc8302715b984962028bc1fd36d504d26%252Fpa%252FEZ99930_d2c5722cd7a36ea52946ede616b2212a.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/30/c8302715b984962028bc1fd36d504d26/pa/EZ99930_d2c5722cd7a36ea52946ede616b2212a.jpg already downloaded
2026-01-28 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F30%252Fc8302715b984962028bc1fd36d504d26%252Fpa%252FEZ99930_8bf2dd7b4cf41bea91c24375a86dfc5c.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/30/c8302715b984962028bc1fd36d504d26/pa/EZ99930_8bf2dd7b4cf41bea91c24375a86dfc5c.jpg already downloaded
2026-01-28 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F30%252Fc8302715b984962028bc1fd36d504d26%252Fpa%252FEZ99930_4d24804db4abef27a02e61ea2378708d.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/30/c8302715b984962028bc1fd36d504d26/pa/EZ99930_4d24804db4abef27a02e61ea2378708d.jpg already downloaded
2026-01-28 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F30%252Fc8302715b984962028bc1fd36d504d26%252Fpa%252FEZ99930_96567a3dc65f3207bfb3678b8e7d84f6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/30/c8302715b984962028bc1fd36d504d26/pa/EZ99930_96567a3dc65f3207bfb3678b8e7d84f6.jpg already downloaded
2026-01-28 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F30%252Fc8302715b984962028bc1fd36d504d26%252Fpa%252FEZ99930_e63740735e8c29e4bdb21d47c6ec6b8f.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/30/c8302715b984962028bc1fd36d504d26/pa/EZ99930_e63740735e8c29e4bdb21d47c6ec6b8f.jpg already downloaded
2026-01-28 20:07:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5ffe3bca-a9d4-5461-8814-d57bf5d64a39, identifier: EZ99930
2026-01-28 20:07:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08ab66d0>
2026-01-28 20:07:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1f86ee2-a86e-5681-9d4a-acf0324fc4ce/d1f86ee2-a86e-5681-9d4a-acf0324fc4ce_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fbd%252F46bdb76093c6be862e79db975763678d%252Fpa%252FNF00160_1387626c853564be69c0f1e020ffcbe2.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/bd/46bdb76093c6be862e79db975763678d/pa/NF00160_1387626c853564be69c0f1e020ffcbe2.jpg saved to cache
2026-01-28 20:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d1f86ee2-a86e-5681-9d4a-acf0324fc4ce
2026-01-28 20:07:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/02/0902ecd716da7e9c1590d287d6183135/pa/BS57464_8c47502173140b0ee15658cce1ae7adf.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:07:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/bd/46bdb76093c6be862e79db975763678d/pa/NF00160_da6490e88843fe764da68425eef00789.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:07:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5ffe3bca-a9d4-5461-8814-d57bf5d64a39 with identifier: EZ99930
2026-01-28 20:07:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5ffe3bca-a9d4-5461-8814-d57bf5d64a39 with identifier: EZ99930
2026-01-28 20:07:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5ffe3bca-a9d4-5461-8814-d57bf5d64a39 with identifier: EZ99930 to the API
2026-01-28 20:07:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:07:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:07:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EZ99930>
{'auction_title': '',
 'c_o_2_emission_value': 189,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.5L',
 'engine_horse_power': 116,
 'expiration_date': '2026-01-29T16:05:54Z',
 'fuel_type': 'petrol',
 'id': '5ffe3bca-a9d4-5461-8814-d57bf5d64a39',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EZ99930',
 'listing': 'auction',
 'location': 'IT, Castelnuovo del Garda (VR)',
 'make': 'DR',
 'model': 'DR 4.0',
 'odometer': 8940,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgc8/30/c8302715b984962028bc1fd36d504d26/pa/EZ99930_f6c03dbe12f72b34842e8ece6d748fdc.jpg',
                'https://img-pa.auto1.com/imgc8/30/c8302715b984962028bc1fd36d504d26/pa/EZ99930_6b2da694bb73e1f4a197647e9be1eda3.jpg',
                'https://img-pa.auto1.com/imgc8/30/c8302715b984962028bc1fd36d504d26/pa/EZ99930_371033899beef37cf97ed8efdc034df7.jpg',
                'https://img-pa.auto1.com/imgc8/30/c8302715b984962028bc1fd36d504d26/pa/EZ99930_f4f148f8de5e97104bbdb7d7a617310c.jpg',
                'https://img-pa.auto1.com/imgc8/30/c8302715b984962028bc1fd36d504d26/pa/EZ99930_463514f9e9b56ed20527af8148943b59.jpg',
                'https://img-pa.auto1.com/imgc8/30/c8302715b984962028bc1fd36d504d26/pa/EZ99930_8d6c05314a4fd86816bb6b1f0b6c6cf9.jpg',
                'https://img-pa.auto1.com/imgc8/30/c8302715b984962028bc1fd36d504d26/pa/EZ99930_5d8383646280c82be6aa60ed1036a847.jpg',
                'https://img-pa.auto1.com/imgc8/30/c8302715b984962028bc1fd36d504d26/pa/EZ99930_112e67f518c12c965e5a6dcc44c337be.jpg',
                'https://img-pa.auto1.com/imgc8/30/c8302715b984962028bc1fd36d504d26/pa/EZ99930_7ccd9533815ddac80c494566c1e98796.jpg',
                'https://img-pa.auto1.com/imgc8/30/c8302715b984962028bc1fd36d504d26/pa/EZ99930_a6d3c573549a404e291405f2597c0b1e.jpg',
                'https://img-pa.auto1.com/imgc8/30/c8302715b984962028bc1fd36d504d26/pa/EZ99930_d2c5722cd7a36ea52946ede616b2212a.jpg',
                'https://img-pa.auto1.com/imgc8/30/c8302715b984962028bc1fd36d504d26/pa/EZ99930_8bf2dd7b4cf41bea91c24375a86dfc5c.jpg',
                'https://img-pa.auto1.com/imgc8/30/c8302715b984962028bc1fd36d504d26/pa/EZ99930_4d24804db4abef27a02e61ea2378708d.jpg',
                'https://img-pa.auto1.com/imgc8/30/c8302715b984962028bc1fd36d504d26/pa/EZ99930_96567a3dc65f3207bfb3678b8e7d84f6.jpg',
                'https://img-pa.auto1.com/imgc8/30/c8302715b984962028bc1fd36d504d26/pa/EZ99930_e63740735e8c29e4bdb21d47c6ec6b8f.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ffe3bca-a9d4-5461-8814-d57bf5d64a39/5ffe3bca-a9d4-5461-8814-d57bf5d64a39_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2860279,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/30/c8302715b984962028bc1fd36d504d26/pa/EZ99930_f6c03dbe12f72b34842e8ece6d748fdc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ffe3bca-a9d4-5461-8814-d57bf5d64a39/5ffe3bca-a9d4-5461-8814-d57bf5d64a39_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2626425,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/30/c8302715b984962028bc1fd36d504d26/pa/EZ99930_6b2da694bb73e1f4a197647e9be1eda3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ffe3bca-a9d4-5461-8814-d57bf5d64a39/5ffe3bca-a9d4-5461-8814-d57bf5d64a39_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2674327,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/30/c8302715b984962028bc1fd36d504d26/pa/EZ99930_371033899beef37cf97ed8efdc034df7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ffe3bca-a9d4-5461-8814-d57bf5d64a39/5ffe3bca-a9d4-5461-8814-d57bf5d64a39_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2142772,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/30/c8302715b984962028bc1fd36d504d26/pa/EZ99930_f4f148f8de5e97104bbdb7d7a617310c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ffe3bca-a9d4-5461-8814-d57bf5d64a39/5ffe3bca-a9d4-5461-8814-d57bf5d64a39_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2772660,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/30/c8302715b984962028bc1fd36d504d26/pa/EZ99930_463514f9e9b56ed20527af8148943b59.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ffe3bca-a9d4-5461-8814-d57bf5d64a39/5ffe3bca-a9d4-5461-8814-d57bf5d64a39_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2610094,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/30/c8302715b984962028bc1fd36d504d26/pa/EZ99930_8d6c05314a4fd86816bb6b1f0b6c6cf9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ffe3bca-a9d4-5461-8814-d57bf5d64a39/5ffe3bca-a9d4-5461-8814-d57bf5d64a39_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2114788,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/30/c8302715b984962028bc1fd36d504d26/pa/EZ99930_5d8383646280c82be6aa60ed1036a847.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ffe3bca-a9d4-5461-8814-d57bf5d64a39/5ffe3bca-a9d4-5461-8814-d57bf5d64a39_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2745336,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/30/c8302715b984962028bc1fd36d504d26/pa/EZ99930_112e67f518c12c965e5a6dcc44c337be.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ffe3bca-a9d4-5461-8814-d57bf5d64a39/5ffe3bca-a9d4-5461-8814-d57bf5d64a39_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3100945,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/30/c8302715b984962028bc1fd36d504d26/pa/EZ99930_7ccd9533815ddac80c494566c1e98796.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ffe3bca-a9d4-5461-8814-d57bf5d64a39/5ffe3bca-a9d4-5461-8814-d57bf5d64a39_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2726315,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/30/c8302715b984962028bc1fd36d504d26/pa/EZ99930_a6d3c573549a404e291405f2597c0b1e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ffe3bca-a9d4-5461-8814-d57bf5d64a39/5ffe3bca-a9d4-5461-8814-d57bf5d64a39_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2449449,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/30/c8302715b984962028bc1fd36d504d26/pa/EZ99930_d2c5722cd7a36ea52946ede616b2212a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ffe3bca-a9d4-5461-8814-d57bf5d64a39/5ffe3bca-a9d4-5461-8814-d57bf5d64a39_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2481819,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/30/c8302715b984962028bc1fd36d504d26/pa/EZ99930_8bf2dd7b4cf41bea91c24375a86dfc5c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ffe3bca-a9d4-5461-8814-d57bf5d64a39/5ffe3bca-a9d4-5461-8814-d57bf5d64a39_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59219,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/30/c8302715b984962028bc1fd36d504d26/pa/EZ99930_4d24804db4abef27a02e61ea2378708d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ffe3bca-a9d4-5461-8814-d57bf5d64a39/5ffe3bca-a9d4-5461-8814-d57bf5d64a39_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2287199,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/30/c8302715b984962028bc1fd36d504d26/pa/EZ99930_96567a3dc65f3207bfb3678b8e7d84f6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ffe3bca-a9d4-5461-8814-d57bf5d64a39/5ffe3bca-a9d4-5461-8814-d57bf5d64a39_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57827,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/30/c8302715b984962028bc1fd36d504d26/pa/EZ99930_e63740735e8c29e4bdb21d47c6ec6b8f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-01-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DR DR 4.0 1.5',
 'transmission': 'manual',
 'trim': '',
 'year': 2024}
2026-01-28 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EZ99930%27 HTTP/1.1" 200 None
2026-01-28 20:07:39 [auto1.it] INFO: Saving data for EZ99930: {'created_time': 1769630859.874703, 'last_price_update_time': 1769630859.874721, 'auction_closing_time': 1769702754.0}
2026-01-28 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EZ99930') HTTP/1.1" 204 0
2026-01-28 20:07:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/4b/df4bfd14ecccad2e28acc7936a8ce0e3/pa/WP90453_93a4dafe946475f3bb4535183e6f5343.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:07:39 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 22 - Data Location: 110 - value: b'SONY\x00'
2026-01-28 20:07:39 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 34 - Data Location: 116 - value: b'ILCE-7M3\x00'
2026-01-28 20:07:39 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 126 - value: b',\x01\x00\x00\x01\x00\x00\x00'
2026-01-28 20:07:39 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 134 - value: b',\x01\x00\x00\x01\x00\x00\x00'
2026-01-28 20:07:39 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-01-28 20:07:39 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 82 - Data Location: 142 - value: <table: 42 bytes>
2026-01-28 20:07:39 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 94 - Data Location: 184 - value: b'2026:01:28 11:11:43\x00'
2026-01-28 20:07:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\xcc\x00\x00\x00'
2026-01-28 20:07:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09d34f90>
2026-01-28 20:07:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:07:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1f86ee2-a86e-5681-9d4a-acf0324fc4ce/d1f86ee2-a86e-5681-9d4a-acf0324fc4ce_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fbd%252F46bdb76093c6be862e79db975763678d%252Fpa%252FNF00160_f3ed1e0e3f8c02891a3be12a9023a4b5.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/bd/46bdb76093c6be862e79db975763678d/pa/NF00160_f3ed1e0e3f8c02891a3be12a9023a4b5.jpg saved to cache
2026-01-28 20:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d1f86ee2-a86e-5681-9d4a-acf0324fc4ce
2026-01-28 20:07:40 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 22 - Data Location: 110 - value: b'SONY\x00'
2026-01-28 20:07:40 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 34 - Data Location: 116 - value: b'ILCE-7M3\x00'
2026-01-28 20:07:40 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 126 - value: b',\x01\x00\x00\x01\x00\x00\x00'
2026-01-28 20:07:40 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 134 - value: b',\x01\x00\x00\x01\x00\x00\x00'
2026-01-28 20:07:40 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-01-28 20:07:40 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 82 - Data Location: 142 - value: <table: 42 bytes>
2026-01-28 20:07:40 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 94 - Data Location: 184 - value: b'2026:01:28 11:11:19\x00'
2026-01-28 20:07:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\xcc\x00\x00\x00'
2026-01-28 20:07:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0a032c50>
2026-01-28 20:07:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:07:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1f86ee2-a86e-5681-9d4a-acf0324fc4ce/d1f86ee2-a86e-5681-9d4a-acf0324fc4ce_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fbd%252F46bdb76093c6be862e79db975763678d%252Fpa%252FNF00160_273a812bb1e2bb39329b5074e0e09c92.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/bd/46bdb76093c6be862e79db975763678d/pa/NF00160_273a812bb1e2bb39329b5074e0e09c92.jpg saved to cache
2026-01-28 20:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item d1f86ee2-a86e-5681-9d4a-acf0324fc4ce
2026-01-28 20:07:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KT18742> (referer: https://www.auto1.com/v1/car-details-view/KT18742/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:07:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZD98375> (referer: https://www.auto1.com/v1/car-details-view/ZD98375/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:07:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08a5ea90>
2026-01-28 20:07:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab2b9426-2a4e-5843-bea9-eeabb5e12b74/ab2b9426-2a4e-5843-bea9-eeabb5e12b74_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F02%252F0902ecd716da7e9c1590d287d6183135%252Fpa%252FBS57464_8c47502173140b0ee15658cce1ae7adf.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/02/0902ecd716da7e9c1590d287d6183135/pa/BS57464_8c47502173140b0ee15658cce1ae7adf.jpg saved to cache
2026-01-28 20:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ab2b9426-2a4e-5843-bea9-eeabb5e12b74
2026-01-28 20:07:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08c29250>
2026-01-28 20:07:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1f86ee2-a86e-5681-9d4a-acf0324fc4ce/d1f86ee2-a86e-5681-9d4a-acf0324fc4ce_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fbd%252F46bdb76093c6be862e79db975763678d%252Fpa%252FNF00160_da6490e88843fe764da68425eef00789.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/bd/46bdb76093c6be862e79db975763678d/pa/NF00160_da6490e88843fe764da68425eef00789.jpg saved to cache
2026-01-28 20:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d1f86ee2-a86e-5681-9d4a-acf0324fc4ce
2026-01-28 20:07:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0871f590>
2026-01-28 20:07:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_051ddf36-eff8-5c80-8634-fb09358064b3/051ddf36-eff8-5c80-8634-fb09358064b3_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F4b%252Fdf4bfd14ecccad2e28acc7936a8ce0e3%252Fpa%252FWP90453_93a4dafe946475f3bb4535183e6f5343.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/4b/df4bfd14ecccad2e28acc7936a8ce0e3/pa/WP90453_93a4dafe946475f3bb4535183e6f5343.jpg saved to cache
2026-01-28 20:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 051ddf36-eff8-5c80-8634-fb09358064b3
2026-01-28 20:07:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 051ddf36-eff8-5c80-8634-fb09358064b3, skipping ID generation
2026-01-28 20:07:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 051ddf36-eff8-5c80-8634-fb09358064b3 with scrape type 1
2026-01-28 20:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 051ddf36-eff8-5c80-8634-fb09358064b3 from tracking dictionaries
2026-01-28 20:07:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 051ddf36-eff8-5c80-8634-fb09358064b3 sending to next pipeline
2026-01-28 20:07:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 051ddf36-eff8-5c80-8634-fb09358064b3, identifier: WP90453
2026-01-28 20:07:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 051ddf36-eff8-5c80-8634-fb09358064b3 with identifier: WP90453
2026-01-28 20:07:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 051ddf36-eff8-5c80-8634-fb09358064b3 with identifier: WP90453
2026-01-28 20:07:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 051ddf36-eff8-5c80-8634-fb09358064b3 with identifier: WP90453 to the API
2026-01-28 20:07:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:07:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:07:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgdf/4b/df4bfd14ecccad2e28acc7936a8ce0e3/pa/WP90453_93a4dafe946475f3bb4535183e6f5343.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.2L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:03:01Z',
 'fuel_type': 'petrol',
 'id': '051ddf36-eff8-5c80-8634-fb09358064b3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WP90453',
 'listing': 'auction',
 'location': 'IT, Pavia',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 17647,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_051ddf36-eff8-5c80-8634-fb09358064b3/051ddf36-eff8-5c80-8634-fb09358064b3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57523,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/4b/df4bfd14ecccad2e28acc7936a8ce0e3/pa/WP90453_93a4dafe946475f3bb4535183e6f5343.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_051ddf36-eff8-5c80-8634-fb09358064b3/051ddf36-eff8-5c80-8634-fb09358064b3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50605,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/4b/df4bfd14ecccad2e28acc7936a8ce0e3/pa/WP90453_dfb1e70fadcb2a19438a01fe0f85e092.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_051ddf36-eff8-5c80-8634-fb09358064b3/051ddf36-eff8-5c80-8634-fb09358064b3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52476,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/4b/df4bfd14ecccad2e28acc7936a8ce0e3/pa/WP90453_3c79d8ec805bb6743173939b52aa0f93.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_051ddf36-eff8-5c80-8634-fb09358064b3/051ddf36-eff8-5c80-8634-fb09358064b3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3155941,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/4b/df4bfd14ecccad2e28acc7936a8ce0e3/pa/WP90453_cd4ae1c953a019779a5647319e95d14d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_051ddf36-eff8-5c80-8634-fb09358064b3/051ddf36-eff8-5c80-8634-fb09358064b3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40278,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/4b/df4bfd14ecccad2e28acc7936a8ce0e3/pa/WP90453_5eb44a84a27f959e88a9a4663d369ad6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_051ddf36-eff8-5c80-8634-fb09358064b3/051ddf36-eff8-5c80-8634-fb09358064b3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3020706,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/4b/df4bfd14ecccad2e28acc7936a8ce0e3/pa/WP90453_a5aae7f7740956d281e94fcbe9f7cb97.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_051ddf36-eff8-5c80-8634-fb09358064b3/051ddf36-eff8-5c80-8634-fb09358064b3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44978,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/4b/df4bfd14ecccad2e28acc7936a8ce0e3/pa/WP90453_a5bca5bc69063a238a8e72798e72ade8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_051ddf36-eff8-5c80-8634-fb09358064b3/051ddf36-eff8-5c80-8634-fb09358064b3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63354,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/4b/df4bfd14ecccad2e28acc7936a8ce0e3/pa/WP90453_93b110262fd9a10dc7b9c6b4fbac7272.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_051ddf36-eff8-5c80-8634-fb09358064b3/051ddf36-eff8-5c80-8634-fb09358064b3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70502,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/4b/df4bfd14ecccad2e28acc7936a8ce0e3/pa/WP90453_5164512a0e4869a656b3f1948f45a465.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_051ddf36-eff8-5c80-8634-fb09358064b3/051ddf36-eff8-5c80-8634-fb09358064b3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2480432,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/4b/df4bfd14ecccad2e28acc7936a8ce0e3/pa/WP90453_ccca9d71508fcd7d57abdbce4b6c6fef.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_051ddf36-eff8-5c80-8634-fb09358064b3/051ddf36-eff8-5c80-8634-fb09358064b3_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3020799,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/4b/df4bfd14ecccad2e28acc7936a8ce0e3/pa/WP90453_5b07f13bcb01c664301ec1a6275802a6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_051ddf36-eff8-5c80-8634-fb09358064b3/051ddf36-eff8-5c80-8634-fb09358064b3_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36437,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/4b/df4bfd14ecccad2e28acc7936a8ce0e3/pa/WP90453_519a5d84b8f8eb2abf29378e0d8e5659.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_051ddf36-eff8-5c80-8634-fb09358064b3/051ddf36-eff8-5c80-8634-fb09358064b3_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36677,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/4b/df4bfd14ecccad2e28acc7936a8ce0e3/pa/WP90453_5692ea7a29194d6b76bdb33e983dfd10.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_051ddf36-eff8-5c80-8634-fb09358064b3/051ddf36-eff8-5c80-8634-fb09358064b3_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41091,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/4b/df4bfd14ecccad2e28acc7936a8ce0e3/pa/WP90453_88b89d76751978fa70ee331dcffbb01f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_051ddf36-eff8-5c80-8634-fb09358064b3/051ddf36-eff8-5c80-8634-fb09358064b3_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57491,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/4b/df4bfd14ecccad2e28acc7936a8ce0e3/pa/WP90453_c1480a6f33c6e3eaf9adc39daec1f61b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-07-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 PureTech Allure Pack',
 'transmission': 'automatic',
 'trim': 'Allure Pack',
 'year': 2023}
2026-01-28 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27WP90453%27 HTTP/1.1" 200 None
2026-01-28 20:07:41 [auto1.it] INFO: Saving data for WP90453: {'created_time': 1769630861.861908, 'last_price_update_time': 1769630861.861918, 'auction_closing_time': 1769702581.0}
2026-01-28 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='WP90453') HTTP/1.1" 204 0
2026-01-28 20:07:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/02/0902ecd716da7e9c1590d287d6183135/pa/BS57464_5e0e3f2d669b247d044e56b60a41490e.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:07:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/a6/27a657fee4c38facf349d22de315ad81/pa/DJ22210_b1add6775a0ac1f0194239ca8673d9c1.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:07:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/52/265278f2bef552d5057c2293e62259ec/pa/VP25370_7ae6085fc949de64f2f3a7101d9ffcc7.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:07:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VP20298> (referer: https://www.auto1.com/v1/car-details-view/VP20298/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:07:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AL26589> (referer: https://www.auto1.com/v1/car-details-view/AL26589/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:07:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YS06791> (referer: https://www.auto1.com/v1/car-details-view/YS06791/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:07:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KW99798> (referer: https://www.auto1.com/v1/car-details-view/KW99798/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:07:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HF12865> (referer: https://www.auto1.com/v1/car-details-view/HF12865/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:07:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:07:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cad25720-24d2-5e8b-8d9a-6f2a82f24e2f with identifier: KT18742
2026-01-28 20:07:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cad25720-24d2-5e8b-8d9a-6f2a82f24e2f with scrape type 2
2026-01-28 20:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cad25720-24d2-5e8b-8d9a-6f2a82f24e2f with scrape type 2
2026-01-28 20:07:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: cad25720-24d2-5e8b-8d9a-6f2a82f24e2f, identifier: KT18742
2026-01-28 20:07:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4369c20-f0e9-5274-8e13-0c0bb0145f18 with identifier: ZD98375
2026-01-28 20:07:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4369c20-f0e9-5274-8e13-0c0bb0145f18 with scrape type 2
2026-01-28 20:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a4369c20-f0e9-5274-8e13-0c0bb0145f18 with scrape type 2
2026-01-28 20:07:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a4369c20-f0e9-5274-8e13-0c0bb0145f18, identifier: ZD98375
2026-01-28 20:07:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: cad25720-24d2-5e8b-8d9a-6f2a82f24e2f with identifier: KT18742
2026-01-28 20:07:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: cad25720-24d2-5e8b-8d9a-6f2a82f24e2f with identifier: KT18742
2026-01-28 20:07:42 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 135143 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    135143
2026-01-28 20:07:42 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: cad25720-24d2-5e8b-8d9a-6f2a82f24e2f spider: auto1.it
2026-01-28 20:07:42 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: cad25720-24d2-5e8b-8d9a-6f2a82f24e2f due to rule: high_mileage_for_make.json, error: 135143 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    135143
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.0L',
 'engine_horse_power': 70,
 'expiration_date': '2026-01-29T16:55:42Z',
 'fuel_type': 'petrol',
 'id': 'cad25720-24d2-5e8b-8d9a-6f2a82f24e2f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KT18742',
 'listing': 'auction',
 'location': 'IT, Milazzo',
 'make': 'Smart',
 'model': 'fortwo',
 'odometer': 135143,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-09-29',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Smart fortwo 1.0 Basis passion',
 'transmission': 'automatic',
 'trim': 'Basis passion',
 'year': 2019}
2026-01-28 20:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KT18742%27 HTTP/1.1" 200 None
2026-01-28 20:07:42 [auto1.it] INFO: Saving data for KT18742: {'auction_closing_time': 1769705742.0, 'created_time': 1769457942.934847, 'last_price_update_time': 1769630862.337295}
2026-01-28 20:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KT18742') HTTP/1.1" 204 0
2026-01-28 20:07:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a4369c20-f0e9-5274-8e13-0c0bb0145f18 with identifier: ZD98375
2026-01-28 20:07:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a4369c20-f0e9-5274-8e13-0c0bb0145f18 with identifier: ZD98375
2026-01-28 20:07:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a4369c20-f0e9-5274-8e13-0c0bb0145f18 with identifier: ZD98375 to the API
2026-01-28 20:07:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:07:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:07:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZD98375>
{'auction_title': '',
 'c_o_2_emission_value': 7,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:11:57Z',
 'fuel_type': 'diesel',
 'id': 'a4369c20-f0e9-5274-8e13-0c0bb0145f18',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZD98375',
 'listing': 'auction',
 'location': 'IT, Milano',
 'make': 'Audi',
 'model': 'Q3 Sportback',
 'odometer': 112236,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-07-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q3 Sportback 35 TDI quattro S line',
 'transmission': 'automatic',
 'trim': 'quattro S line',
 'year': 2021}
2026-01-28 20:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27ZD98375%27 HTTP/1.1" 200 None
2026-01-28 20:07:42 [auto1.it] INFO: Saving data for ZD98375: {'auction_closing_time': 1769703117.0, 'created_time': 1767040965.616007, 'last_price_update_time': 1769630862.710033}
2026-01-28 20:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='ZD98375') HTTP/1.1" 204 0
2026-01-28 20:07:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:07:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:07:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:07:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:07:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/bd/46bdb76093c6be862e79db975763678d/pa/NF00160_ff36d86c3803beaa7fc2cb7eb5f5b84d.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:07:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/bd/46bdb76093c6be862e79db975763678d/pa/NF00160_eaa1f049b4fa781a07ff88ad41612060.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:07:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/a6/27a657fee4c38facf349d22de315ad81/pa/DJ22210_69cf42e9465bc533269626054e497f6a.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:07:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/52/265278f2bef552d5057c2293e62259ec/pa/VP25370_cef630487eae6b67a5a0a7955dcb1d8e.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:07:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/52/265278f2bef552d5057c2293e62259ec/pa/VP25370_cca1b8e58a28fe2b3a0fbfa9d296f028.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:07:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09dd1f50>
2026-01-28 20:07:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:07:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab2b9426-2a4e-5843-bea9-eeabb5e12b74/ab2b9426-2a4e-5843-bea9-eeabb5e12b74_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F02%252F0902ecd716da7e9c1590d287d6183135%252Fpa%252FBS57464_5e0e3f2d669b247d044e56b60a41490e.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/02/0902ecd716da7e9c1590d287d6183135/pa/BS57464_5e0e3f2d669b247d044e56b60a41490e.jpg saved to cache
2026-01-28 20:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ab2b9426-2a4e-5843-bea9-eeabb5e12b74
2026-01-28 20:07:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08a83310>
2026-01-28 20:07:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8aea567-3ec2-586f-8165-3ba50fde04ea/e8aea567-3ec2-586f-8165-3ba50fde04ea_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252Fa6%252F27a657fee4c38facf349d22de315ad81%252Fpa%252FDJ22210_b1add6775a0ac1f0194239ca8673d9c1.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/a6/27a657fee4c38facf349d22de315ad81/pa/DJ22210_b1add6775a0ac1f0194239ca8673d9c1.jpg saved to cache
2026-01-28 20:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e8aea567-3ec2-586f-8165-3ba50fde04ea
2026-01-28 20:07:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08bdfe10>
2026-01-28 20:07:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:07:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_191bba90-0f82-54b1-88fa-cbe17ff9a5a0/191bba90-0f82-54b1-88fa-cbe17ff9a5a0_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F52%252F265278f2bef552d5057c2293e62259ec%252Fpa%252FVP25370_7ae6085fc949de64f2f3a7101d9ffcc7.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/52/265278f2bef552d5057c2293e62259ec/pa/VP25370_7ae6085fc949de64f2f3a7101d9ffcc7.jpg saved to cache
2026-01-28 20:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 191bba90-0f82-54b1-88fa-cbe17ff9a5a0
2026-01-28 20:07:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f425c026-9d6b-597c-a5ae-c40076eae924 with identifier: VP20298
2026-01-28 20:07:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f425c026-9d6b-597c-a5ae-c40076eae924 with scrape type 1
2026-01-28 20:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 14 photos for item f425c026-9d6b-597c-a5ae-c40076eae924
2026-01-28 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F21%252F2221ab80cad6a1b68502057ee1474d79%252Fpa%252FVP20298_3d0ec905534bc2ce7244ced3c610ca2d.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/21/2221ab80cad6a1b68502057ee1474d79/pa/VP20298_3d0ec905534bc2ce7244ced3c610ca2d.jpg not downloaded yet
2026-01-28 20:07:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a752d5cb-7aca-5619-8cb1-a9705f3c00dd with identifier: AL26589
2026-01-28 20:07:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a752d5cb-7aca-5619-8cb1-a9705f3c00dd with scrape type 1
2026-01-28 20:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item a752d5cb-7aca-5619-8cb1-a9705f3c00dd
2026-01-28 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F37%252Fcd37a1ad3f3c4caf426a4590e0cfac06%252Fpa%252FAL26589_525dfaba25b83d2bd4e729eda51af226.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/37/cd37a1ad3f3c4caf426a4590e0cfac06/pa/AL26589_525dfaba25b83d2bd4e729eda51af226.jpg not downloaded yet
2026-01-28 20:07:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ec452de-abf4-5f66-a676-2b0cc618dedc with identifier: YS06791
2026-01-28 20:07:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ec452de-abf4-5f66-a676-2b0cc618dedc with scrape type 1
2026-01-28 20:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 4ec452de-abf4-5f66-a676-2b0cc618dedc
2026-01-28 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F19%252Fab19b6956bab66a97a6783ef85209e30%252Fpa%252FYS06791_4482a159592e18878e70cdf6a02269ee.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/19/ab19b6956bab66a97a6783ef85209e30/pa/YS06791_4482a159592e18878e70cdf6a02269ee.jpg already downloaded
2026-01-28 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F19%252Fab19b6956bab66a97a6783ef85209e30%252Fpa%252FYS06791_2c602f3d66df8933378d8628dba42903.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/19/ab19b6956bab66a97a6783ef85209e30/pa/YS06791_2c602f3d66df8933378d8628dba42903.jpg already downloaded
2026-01-28 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F19%252Fab19b6956bab66a97a6783ef85209e30%252Fpa%252FYS06791_8db094ce3fb05286b465a76e95cdcc9b.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/19/ab19b6956bab66a97a6783ef85209e30/pa/YS06791_8db094ce3fb05286b465a76e95cdcc9b.jpg already downloaded
2026-01-28 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F19%252Fab19b6956bab66a97a6783ef85209e30%252Fpa%252FYS06791_0397084b71da4b4442644bc146554fae.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/19/ab19b6956bab66a97a6783ef85209e30/pa/YS06791_0397084b71da4b4442644bc146554fae.jpg already downloaded
2026-01-28 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F19%252Fab19b6956bab66a97a6783ef85209e30%252Fpa%252FYS06791_a4cff4b2247db3d8e366a8ef2fffa778.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/19/ab19b6956bab66a97a6783ef85209e30/pa/YS06791_a4cff4b2247db3d8e366a8ef2fffa778.jpg already downloaded
2026-01-28 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F19%252Fab19b6956bab66a97a6783ef85209e30%252Fpa%252FYS06791_970d23c385b26f78b57c004e70807f13.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/19/ab19b6956bab66a97a6783ef85209e30/pa/YS06791_970d23c385b26f78b57c004e70807f13.jpg already downloaded
2026-01-28 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F19%252Fab19b6956bab66a97a6783ef85209e30%252Fpa%252FYS06791_957e37cbbf96a894bb710c881ff35196.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/19/ab19b6956bab66a97a6783ef85209e30/pa/YS06791_957e37cbbf96a894bb710c881ff35196.jpg already downloaded
2026-01-28 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F19%252Fab19b6956bab66a97a6783ef85209e30%252Fpa%252FYS06791_e3911c35ab471840361e087f6d55421c.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/19/ab19b6956bab66a97a6783ef85209e30/pa/YS06791_e3911c35ab471840361e087f6d55421c.jpg already downloaded
2026-01-28 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F19%252Fab19b6956bab66a97a6783ef85209e30%252Fpa%252FYS06791_764710b2e9b4ff43de917d2ffb6210af.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/19/ab19b6956bab66a97a6783ef85209e30/pa/YS06791_764710b2e9b4ff43de917d2ffb6210af.jpg already downloaded
2026-01-28 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F19%252Fab19b6956bab66a97a6783ef85209e30%252Fpa%252FYS06791_2ae72a3778f6d01d6777b34250985724.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/19/ab19b6956bab66a97a6783ef85209e30/pa/YS06791_2ae72a3778f6d01d6777b34250985724.jpg already downloaded
2026-01-28 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F19%252Fab19b6956bab66a97a6783ef85209e30%252Fpa%252FYS06791_3eefb2ffa418d235a70e1d68125a3463.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/19/ab19b6956bab66a97a6783ef85209e30/pa/YS06791_3eefb2ffa418d235a70e1d68125a3463.jpg already downloaded
2026-01-28 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F19%252Fab19b6956bab66a97a6783ef85209e30%252Fpa%252FYS06791_136baa4b93707b8fa4d119b93633ee6e.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/19/ab19b6956bab66a97a6783ef85209e30/pa/YS06791_136baa4b93707b8fa4d119b93633ee6e.jpg already downloaded
2026-01-28 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F19%252Fab19b6956bab66a97a6783ef85209e30%252Fpa%252FYS06791_7cba93827311a2a1af37525a69c583b0.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/19/ab19b6956bab66a97a6783ef85209e30/pa/YS06791_7cba93827311a2a1af37525a69c583b0.jpg already downloaded
2026-01-28 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F19%252Fab19b6956bab66a97a6783ef85209e30%252Fpa%252FYS06791_db27355b2153816d8844c727cec4f72c.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/19/ab19b6956bab66a97a6783ef85209e30/pa/YS06791_db27355b2153816d8844c727cec4f72c.jpg already downloaded
2026-01-28 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F19%252Fab19b6956bab66a97a6783ef85209e30%252Fpa%252FYS06791_7991990aac2417c20e27628923e83523.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/19/ab19b6956bab66a97a6783ef85209e30/pa/YS06791_7991990aac2417c20e27628923e83523.jpg already downloaded
2026-01-28 20:07:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4ec452de-abf4-5f66-a676-2b0cc618dedc, identifier: YS06791
2026-01-28 20:07:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 680f16c0-96e2-5e7f-a758-14fa3e5ddc70 with identifier: KW99798
2026-01-28 20:07:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 680f16c0-96e2-5e7f-a758-14fa3e5ddc70 with scrape type 2
2026-01-28 20:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 680f16c0-96e2-5e7f-a758-14fa3e5ddc70 with scrape type 2
2026-01-28 20:07:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 680f16c0-96e2-5e7f-a758-14fa3e5ddc70, identifier: KW99798
2026-01-28 20:07:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aa05ad5a-a145-5c0a-91c5-be2e406f05a0 with identifier: HF12865
2026-01-28 20:07:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa05ad5a-a145-5c0a-91c5-be2e406f05a0 with scrape type 2
2026-01-28 20:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aa05ad5a-a145-5c0a-91c5-be2e406f05a0 with scrape type 2
2026-01-28 20:07:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: aa05ad5a-a145-5c0a-91c5-be2e406f05a0, identifier: HF12865
2026-01-28 20:07:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4ec452de-abf4-5f66-a676-2b0cc618dedc with identifier: YS06791
2026-01-28 20:07:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4ec452de-abf4-5f66-a676-2b0cc618dedc with identifier: YS06791
2026-01-28 20:07:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4ec452de-abf4-5f66-a676-2b0cc618dedc with identifier: YS06791 to the API
2026-01-28 20:07:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:07:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:07:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YS06791>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.2L',
 'engine_horse_power': 83,
 'expiration_date': '2026-01-29T16:15:11Z',
 'fuel_type': 'petrol',
 'id': '4ec452de-abf4-5f66-a676-2b0cc618dedc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YS06791',
 'listing': 'auction',
 'location': 'IT, Capua',
 'make': 'Suzuki',
 'model': 'Swift',
 'odometer': 10090,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgab/19/ab19b6956bab66a97a6783ef85209e30/pa/YS06791_4482a159592e18878e70cdf6a02269ee.jpg',
                'https://img-pa.auto1.com/imgab/19/ab19b6956bab66a97a6783ef85209e30/pa/YS06791_2c602f3d66df8933378d8628dba42903.jpg',
                'https://img-pa.auto1.com/imgab/19/ab19b6956bab66a97a6783ef85209e30/pa/YS06791_8db094ce3fb05286b465a76e95cdcc9b.jpg',
                'https://img-pa.auto1.com/imgab/19/ab19b6956bab66a97a6783ef85209e30/pa/YS06791_0397084b71da4b4442644bc146554fae.jpg',
                'https://img-pa.auto1.com/imgab/19/ab19b6956bab66a97a6783ef85209e30/pa/YS06791_a4cff4b2247db3d8e366a8ef2fffa778.jpg',
                'https://img-pa.auto1.com/imgab/19/ab19b6956bab66a97a6783ef85209e30/pa/YS06791_970d23c385b26f78b57c004e70807f13.jpg',
                'https://img-pa.auto1.com/imgab/19/ab19b6956bab66a97a6783ef85209e30/pa/YS06791_957e37cbbf96a894bb710c881ff35196.jpg',
                'https://img-pa.auto1.com/imgab/19/ab19b6956bab66a97a6783ef85209e30/pa/YS06791_e3911c35ab471840361e087f6d55421c.jpg',
                'https://img-pa.auto1.com/imgab/19/ab19b6956bab66a97a6783ef85209e30/pa/YS06791_764710b2e9b4ff43de917d2ffb6210af.jpg',
                'https://img-pa.auto1.com/imgab/19/ab19b6956bab66a97a6783ef85209e30/pa/YS06791_2ae72a3778f6d01d6777b34250985724.jpg',
                'https://img-pa.auto1.com/imgab/19/ab19b6956bab66a97a6783ef85209e30/pa/YS06791_3eefb2ffa418d235a70e1d68125a3463.jpg',
                'https://img-pa.auto1.com/imgab/19/ab19b6956bab66a97a6783ef85209e30/pa/YS06791_136baa4b93707b8fa4d119b93633ee6e.jpg',
                'https://img-pa.auto1.com/imgab/19/ab19b6956bab66a97a6783ef85209e30/pa/YS06791_7cba93827311a2a1af37525a69c583b0.jpg',
                'https://img-pa.auto1.com/imgab/19/ab19b6956bab66a97a6783ef85209e30/pa/YS06791_db27355b2153816d8844c727cec4f72c.jpg',
                'https://img-pa.auto1.com/imgab/19/ab19b6956bab66a97a6783ef85209e30/pa/YS06791_7991990aac2417c20e27628923e83523.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ec452de-abf4-5f66-a676-2b0cc618dedc/4ec452de-abf4-5f66-a676-2b0cc618dedc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3087333,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/19/ab19b6956bab66a97a6783ef85209e30/pa/YS06791_4482a159592e18878e70cdf6a02269ee.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ec452de-abf4-5f66-a676-2b0cc618dedc/4ec452de-abf4-5f66-a676-2b0cc618dedc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78506,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/19/ab19b6956bab66a97a6783ef85209e30/pa/YS06791_2c602f3d66df8933378d8628dba42903.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ec452de-abf4-5f66-a676-2b0cc618dedc/4ec452de-abf4-5f66-a676-2b0cc618dedc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75957,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/19/ab19b6956bab66a97a6783ef85209e30/pa/YS06791_8db094ce3fb05286b465a76e95cdcc9b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ec452de-abf4-5f66-a676-2b0cc618dedc/4ec452de-abf4-5f66-a676-2b0cc618dedc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65424,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/19/ab19b6956bab66a97a6783ef85209e30/pa/YS06791_0397084b71da4b4442644bc146554fae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ec452de-abf4-5f66-a676-2b0cc618dedc/4ec452de-abf4-5f66-a676-2b0cc618dedc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65840,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/19/ab19b6956bab66a97a6783ef85209e30/pa/YS06791_a4cff4b2247db3d8e366a8ef2fffa778.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ec452de-abf4-5f66-a676-2b0cc618dedc/4ec452de-abf4-5f66-a676-2b0cc618dedc_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78905,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/19/ab19b6956bab66a97a6783ef85209e30/pa/YS06791_970d23c385b26f78b57c004e70807f13.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ec452de-abf4-5f66-a676-2b0cc618dedc/4ec452de-abf4-5f66-a676-2b0cc618dedc_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71600,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/19/ab19b6956bab66a97a6783ef85209e30/pa/YS06791_957e37cbbf96a894bb710c881ff35196.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ec452de-abf4-5f66-a676-2b0cc618dedc/4ec452de-abf4-5f66-a676-2b0cc618dedc_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85117,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/19/ab19b6956bab66a97a6783ef85209e30/pa/YS06791_e3911c35ab471840361e087f6d55421c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ec452de-abf4-5f66-a676-2b0cc618dedc/4ec452de-abf4-5f66-a676-2b0cc618dedc_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77545,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/19/ab19b6956bab66a97a6783ef85209e30/pa/YS06791_764710b2e9b4ff43de917d2ffb6210af.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ec452de-abf4-5f66-a676-2b0cc618dedc/4ec452de-abf4-5f66-a676-2b0cc618dedc_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46869,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/19/ab19b6956bab66a97a6783ef85209e30/pa/YS06791_2ae72a3778f6d01d6777b34250985724.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ec452de-abf4-5f66-a676-2b0cc618dedc/4ec452de-abf4-5f66-a676-2b0cc618dedc_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3147095,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/19/ab19b6956bab66a97a6783ef85209e30/pa/YS06791_3eefb2ffa418d235a70e1d68125a3463.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ec452de-abf4-5f66-a676-2b0cc618dedc/4ec452de-abf4-5f66-a676-2b0cc618dedc_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2794878,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/19/ab19b6956bab66a97a6783ef85209e30/pa/YS06791_136baa4b93707b8fa4d119b93633ee6e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ec452de-abf4-5f66-a676-2b0cc618dedc/4ec452de-abf4-5f66-a676-2b0cc618dedc_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79919,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/19/ab19b6956bab66a97a6783ef85209e30/pa/YS06791_7cba93827311a2a1af37525a69c583b0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ec452de-abf4-5f66-a676-2b0cc618dedc/4ec452de-abf4-5f66-a676-2b0cc618dedc_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60193,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/19/ab19b6956bab66a97a6783ef85209e30/pa/YS06791_db27355b2153816d8844c727cec4f72c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ec452de-abf4-5f66-a676-2b0cc618dedc/4ec452de-abf4-5f66-a676-2b0cc618dedc_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48484,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/19/ab19b6956bab66a97a6783ef85209e30/pa/YS06791_7991990aac2417c20e27628923e83523.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-01-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Suzuki Swift 1.2 DualJet Mild-Hybrid Top',
 'transmission': 'manual',
 'trim': 'Top',
 'year': 2024}
2026-01-28 20:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27YS06791%27 HTTP/1.1" 200 None
2026-01-28 20:07:45 [auto1.it] INFO: Saving data for YS06791: {'created_time': 1769630865.013379, 'last_price_update_time': 1769630865.01339, 'auction_closing_time': 1769703311.0}
2026-01-28 20:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='YS06791') HTTP/1.1" 204 0
2026-01-28 20:07:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 680f16c0-96e2-5e7f-a758-14fa3e5ddc70 with identifier: KW99798
2026-01-28 20:07:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 680f16c0-96e2-5e7f-a758-14fa3e5ddc70 with identifier: KW99798
2026-01-28 20:07:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 680f16c0-96e2-5e7f-a758-14fa3e5ddc70 with identifier: KW99798 to the API
2026-01-28 20:07:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:07:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:07:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KW99798>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:04:16Z',
 'fuel_type': 'diesel',
 'id': '680f16c0-96e2-5e7f-a758-14fa3e5ddc70',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KW99798',
 'listing': 'auction',
 'location': 'IT',
 'make': 'Alfa Romeo',
 'model': 'Tonale',
 'odometer': 54111,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-04-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Alfa Romeo Tonale 1.6 VGT-D Sprint',
 'transmission': 'automatic',
 'trim': 'Sprint',
 'year': 2023}
2026-01-28 20:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27KW99798%27 HTTP/1.1" 200 None
2026-01-28 20:07:45 [auto1.it] INFO: Saving data for KW99798: {'auction_closing_time': 1769702656.0, 'created_time': 1769458399.520759, 'last_price_update_time': 1769630865.362059}
2026-01-28 20:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='KW99798') HTTP/1.1" 204 0
2026-01-28 20:07:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: aa05ad5a-a145-5c0a-91c5-be2e406f05a0 with identifier: HF12865
2026-01-28 20:07:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: aa05ad5a-a145-5c0a-91c5-be2e406f05a0 with identifier: HF12865
2026-01-28 20:07:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: aa05ad5a-a145-5c0a-91c5-be2e406f05a0 with identifier: HF12865 to the API
2026-01-28 20:07:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:07:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:07:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HF12865>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.0L',
 'engine_horse_power': 101,
 'expiration_date': '2026-01-29T16:27:57Z',
 'fuel_type': 'gas',
 'id': 'aa05ad5a-a145-5c0a-91c5-be2e406f05a0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HF12865',
 'listing': 'auction',
 'location': 'IT, Milazzo',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 13459,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-01-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Dacia Sandero 1.0 TCe LPG Stepway Comfort',
 'transmission': 'manual',
 'trim': 'Stepway Comfort',
 'year': 2022}
2026-01-28 20:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HF12865%27 HTTP/1.1" 200 None
2026-01-28 20:07:45 [auto1.it] INFO: Saving data for HF12865: {'auction_closing_time': 1769704077.0, 'created_time': 1768816902.576082, 'last_price_update_time': 1769630865.739711}
2026-01-28 20:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HF12865') HTTP/1.1" 204 0
2026-01-28 20:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F21%252F2221ab80cad6a1b68502057ee1474d79%252Fpa%252FVP20298_8c97300552fb01cfb160b77fd965d698.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/21/2221ab80cad6a1b68502057ee1474d79/pa/VP20298_8c97300552fb01cfb160b77fd965d698.jpg not downloaded yet
2026-01-28 20:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F37%252Fcd37a1ad3f3c4caf426a4590e0cfac06%252Fpa%252FAL26589_5a9ffdeec660a24455b273085d4b5f8f.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/37/cd37a1ad3f3c4caf426a4590e0cfac06/pa/AL26589_5a9ffdeec660a24455b273085d4b5f8f.jpg not downloaded yet
2026-01-28 20:07:45 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 22 - Data Location: 110 - value: b'SONY\x00'
2026-01-28 20:07:45 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 34 - Data Location: 116 - value: b'ILCE-7M3\x00'
2026-01-28 20:07:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 126 - value: b',\x01\x00\x00\x01\x00\x00\x00'
2026-01-28 20:07:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 134 - value: b',\x01\x00\x00\x01\x00\x00\x00'
2026-01-28 20:07:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-01-28 20:07:45 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 82 - Data Location: 142 - value: <table: 42 bytes>
2026-01-28 20:07:45 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 94 - Data Location: 184 - value: b'2026:01:28 11:12:21\x00'
2026-01-28 20:07:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\xcc\x00\x00\x00'
2026-01-28 20:07:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b087117d0>
2026-01-28 20:07:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1f86ee2-a86e-5681-9d4a-acf0324fc4ce/d1f86ee2-a86e-5681-9d4a-acf0324fc4ce_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fbd%252F46bdb76093c6be862e79db975763678d%252Fpa%252FNF00160_ff36d86c3803beaa7fc2cb7eb5f5b84d.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/bd/46bdb76093c6be862e79db975763678d/pa/NF00160_ff36d86c3803beaa7fc2cb7eb5f5b84d.jpg saved to cache
2026-01-28 20:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d1f86ee2-a86e-5681-9d4a-acf0324fc4ce
2026-01-28 20:07:46 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 22 - Data Location: 110 - value: b'SONY\x00'
2026-01-28 20:07:46 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 34 - Data Location: 116 - value: b'ILCE-7M3\x00'
2026-01-28 20:07:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 126 - value: b',\x01\x00\x00\x01\x00\x00\x00'
2026-01-28 20:07:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 134 - value: b',\x01\x00\x00\x01\x00\x00\x00'
2026-01-28 20:07:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-01-28 20:07:46 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 82 - Data Location: 142 - value: <table: 42 bytes>
2026-01-28 20:07:46 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 94 - Data Location: 184 - value: b'2026:01:28 11:12:35\x00'
2026-01-28 20:07:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\xcc\x00\x00\x00'
2026-01-28 20:07:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09f16450>
2026-01-28 20:07:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1f86ee2-a86e-5681-9d4a-acf0324fc4ce/d1f86ee2-a86e-5681-9d4a-acf0324fc4ce_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fbd%252F46bdb76093c6be862e79db975763678d%252Fpa%252FNF00160_eaa1f049b4fa781a07ff88ad41612060.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/bd/46bdb76093c6be862e79db975763678d/pa/NF00160_eaa1f049b4fa781a07ff88ad41612060.jpg saved to cache
2026-01-28 20:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d1f86ee2-a86e-5681-9d4a-acf0324fc4ce
2026-01-28 20:07:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d1f86ee2-a86e-5681-9d4a-acf0324fc4ce, skipping ID generation
2026-01-28 20:07:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1f86ee2-a86e-5681-9d4a-acf0324fc4ce with scrape type 1
2026-01-28 20:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Removing item d1f86ee2-a86e-5681-9d4a-acf0324fc4ce from tracking dictionaries
2026-01-28 20:07:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d1f86ee2-a86e-5681-9d4a-acf0324fc4ce sending to next pipeline
2026-01-28 20:07:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d1f86ee2-a86e-5681-9d4a-acf0324fc4ce, identifier: NF00160
2026-01-28 20:07:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b088e15d0>
2026-01-28 20:07:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:07:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8aea567-3ec2-586f-8165-3ba50fde04ea/e8aea567-3ec2-586f-8165-3ba50fde04ea_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252Fa6%252F27a657fee4c38facf349d22de315ad81%252Fpa%252FDJ22210_69cf42e9465bc533269626054e497f6a.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/a6/27a657fee4c38facf349d22de315ad81/pa/DJ22210_69cf42e9465bc533269626054e497f6a.jpg saved to cache
2026-01-28 20:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e8aea567-3ec2-586f-8165-3ba50fde04ea
2026-01-28 20:07:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08713a50>
2026-01-28 20:07:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_191bba90-0f82-54b1-88fa-cbe17ff9a5a0/191bba90-0f82-54b1-88fa-cbe17ff9a5a0_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F52%252F265278f2bef552d5057c2293e62259ec%252Fpa%252FVP25370_cef630487eae6b67a5a0a7955dcb1d8e.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/52/265278f2bef552d5057c2293e62259ec/pa/VP25370_cef630487eae6b67a5a0a7955dcb1d8e.jpg saved to cache
2026-01-28 20:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 191bba90-0f82-54b1-88fa-cbe17ff9a5a0
2026-01-28 20:07:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09f15850>
2026-01-28 20:07:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:07:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_191bba90-0f82-54b1-88fa-cbe17ff9a5a0/191bba90-0f82-54b1-88fa-cbe17ff9a5a0_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F52%252F265278f2bef552d5057c2293e62259ec%252Fpa%252FVP25370_cca1b8e58a28fe2b3a0fbfa9d296f028.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/52/265278f2bef552d5057c2293e62259ec/pa/VP25370_cca1b8e58a28fe2b3a0fbfa9d296f028.jpg saved to cache
2026-01-28 20:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 191bba90-0f82-54b1-88fa-cbe17ff9a5a0
2026-01-28 20:07:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img26/52/265278f2bef552d5057c2293e62259ec/pa/VP25370_8a3efa5fe1f112814f62107c36c25449.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F21%252F2221ab80cad6a1b68502057ee1474d79%252Fpa%252FVP20298_cca09da2660656a317c62ff01ab0f8fc.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/21/2221ab80cad6a1b68502057ee1474d79/pa/VP20298_cca09da2660656a317c62ff01ab0f8fc.jpg not downloaded yet
2026-01-28 20:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F37%252Fcd37a1ad3f3c4caf426a4590e0cfac06%252Fpa%252FAL26589_e8e9267a44e3df9c9d2355cdb485c94e.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/37/cd37a1ad3f3c4caf426a4590e0cfac06/pa/AL26589_e8e9267a44e3df9c9d2355cdb485c94e.jpg not downloaded yet
2026-01-28 20:07:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d1f86ee2-a86e-5681-9d4a-acf0324fc4ce with identifier: NF00160
2026-01-28 20:07:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d1f86ee2-a86e-5681-9d4a-acf0324fc4ce with identifier: NF00160
2026-01-28 20:07:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d1f86ee2-a86e-5681-9d4a-acf0324fc4ce with identifier: NF00160 to the API
2026-01-28 20:07:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:07:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:07:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img46/bd/46bdb76093c6be862e79db975763678d/pa/NF00160_eaa1f049b4fa781a07ff88ad41612060.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 151,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 116,
 'expiration_date': '2026-01-29T16:14:53Z',
 'fuel_type': 'diesel',
 'id': 'd1f86ee2-a86e-5681-9d4a-acf0324fc4ce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NF00160',
 'listing': 'auction',
 'location': 'IT',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 67077,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1f86ee2-a86e-5681-9d4a-acf0324fc4ce/d1f86ee2-a86e-5681-9d4a-acf0324fc4ce_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 863872,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img46/bd/46bdb76093c6be862e79db975763678d/pa/NF00160_d8e9055abafe89e49c3a66e581f1f3a1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1f86ee2-a86e-5681-9d4a-acf0324fc4ce/d1f86ee2-a86e-5681-9d4a-acf0324fc4ce_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 137240,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/bd/46bdb76093c6be862e79db975763678d/pa/NF00160_7cb43a1327b97b5312f867bed4e29bef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1f86ee2-a86e-5681-9d4a-acf0324fc4ce/d1f86ee2-a86e-5681-9d4a-acf0324fc4ce_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 841573,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img46/bd/46bdb76093c6be862e79db975763678d/pa/NF00160_64261409a2a40ba88250504647f2b6fc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1f86ee2-a86e-5681-9d4a-acf0324fc4ce/d1f86ee2-a86e-5681-9d4a-acf0324fc4ce_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108669,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/bd/46bdb76093c6be862e79db975763678d/pa/NF00160_2a58f4d149b290c31bb286c35fe4c828.jpg',
             'Width': 682},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1f86ee2-a86e-5681-9d4a-acf0324fc4ce/d1f86ee2-a86e-5681-9d4a-acf0324fc4ce_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 907605,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img46/bd/46bdb76093c6be862e79db975763678d/pa/NF00160_c382e9b4b0759fc63aeb6b557984415f.jpg',
             'Width': 1931},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1f86ee2-a86e-5681-9d4a-acf0324fc4ce/d1f86ee2-a86e-5681-9d4a-acf0324fc4ce_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 116795,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/bd/46bdb76093c6be862e79db975763678d/pa/NF00160_da6490e88843fe764da68425eef00789.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1f86ee2-a86e-5681-9d4a-acf0324fc4ce/d1f86ee2-a86e-5681-9d4a-acf0324fc4ce_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 863872,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img46/bd/46bdb76093c6be862e79db975763678d/pa/NF00160_eaa1f049b4fa781a07ff88ad41612060.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1f86ee2-a86e-5681-9d4a-acf0324fc4ce/d1f86ee2-a86e-5681-9d4a-acf0324fc4ce_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 884466,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img46/bd/46bdb76093c6be862e79db975763678d/pa/NF00160_ff36d86c3803beaa7fc2cb7eb5f5b84d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1f86ee2-a86e-5681-9d4a-acf0324fc4ce/d1f86ee2-a86e-5681-9d4a-acf0324fc4ce_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 120926,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/bd/46bdb76093c6be862e79db975763678d/pa/NF00160_1387626c853564be69c0f1e020ffcbe2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1f86ee2-a86e-5681-9d4a-acf0324fc4ce/d1f86ee2-a86e-5681-9d4a-acf0324fc4ce_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 646226,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img46/bd/46bdb76093c6be862e79db975763678d/pa/NF00160_f3ed1e0e3f8c02891a3be12a9023a4b5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1f86ee2-a86e-5681-9d4a-acf0324fc4ce/d1f86ee2-a86e-5681-9d4a-acf0324fc4ce_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117497,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/bd/46bdb76093c6be862e79db975763678d/pa/NF00160_40e2c7e737dc19daf856a2b8390e3085.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1f86ee2-a86e-5681-9d4a-acf0324fc4ce/d1f86ee2-a86e-5681-9d4a-acf0324fc4ce_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 432709,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img46/bd/46bdb76093c6be862e79db975763678d/pa/NF00160_273a812bb1e2bb39329b5074e0e09c92.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1f86ee2-a86e-5681-9d4a-acf0324fc4ce/d1f86ee2-a86e-5681-9d4a-acf0324fc4ce_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110297,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/bd/46bdb76093c6be862e79db975763678d/pa/NF00160_cf1198d68a123c853db48751160f96bc.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-04-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Kia Sportage 1.6 CRDi Energy 2WD',
 'transmission': 'manual',
 'trim': 'Energy 2WD',
 'year': 2019}
2026-01-28 20:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27NF00160%27 HTTP/1.1" 200 None
2026-01-28 20:07:47 [auto1.it] INFO: Saving data for NF00160: {'created_time': 1769630867.936209, 'last_price_update_time': 1769630867.936221, 'auction_closing_time': 1769703293.0}
2026-01-28 20:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='NF00160') HTTP/1.1" 204 0
2026-01-28 20:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F21%252F2221ab80cad6a1b68502057ee1474d79%252Fpa%252FVP20298_3d0efe7a7241f31a4e9950b1b0c0a487.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/21/2221ab80cad6a1b68502057ee1474d79/pa/VP20298_3d0efe7a7241f31a4e9950b1b0c0a487.jpg not downloaded yet
2026-01-28 20:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F37%252Fcd37a1ad3f3c4caf426a4590e0cfac06%252Fpa%252FAL26589_5dadcc41154365c2bdbce79831b03994.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/37/cd37a1ad3f3c4caf426a4590e0cfac06/pa/AL26589_5dadcc41154365c2bdbce79831b03994.jpg not downloaded yet
2026-01-28 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F21%252F2221ab80cad6a1b68502057ee1474d79%252Fpa%252FVP20298_70eaff2c15aa28c37b8339e32372bfd2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/21/2221ab80cad6a1b68502057ee1474d79/pa/VP20298_70eaff2c15aa28c37b8339e32372bfd2.jpg not downloaded yet
2026-01-28 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F37%252Fcd37a1ad3f3c4caf426a4590e0cfac06%252Fpa%252FAL26589_5578a4f8e1969064e44a8232d3f05659.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/37/cd37a1ad3f3c4caf426a4590e0cfac06/pa/AL26589_5578a4f8e1969064e44a8232d3f05659.jpg not downloaded yet
2026-01-28 20:07:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0c034990>
2026-01-28 20:07:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_191bba90-0f82-54b1-88fa-cbe17ff9a5a0/191bba90-0f82-54b1-88fa-cbe17ff9a5a0_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F52%252F265278f2bef552d5057c2293e62259ec%252Fpa%252FVP25370_8a3efa5fe1f112814f62107c36c25449.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/52/265278f2bef552d5057c2293e62259ec/pa/VP25370_8a3efa5fe1f112814f62107c36c25449.jpg saved to cache
2026-01-28 20:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 191bba90-0f82-54b1-88fa-cbe17ff9a5a0
2026-01-28 20:07:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 191bba90-0f82-54b1-88fa-cbe17ff9a5a0, skipping ID generation
2026-01-28 20:07:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 191bba90-0f82-54b1-88fa-cbe17ff9a5a0 with scrape type 1
2026-01-28 20:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 191bba90-0f82-54b1-88fa-cbe17ff9a5a0 from tracking dictionaries
2026-01-28 20:07:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 191bba90-0f82-54b1-88fa-cbe17ff9a5a0 sending to next pipeline
2026-01-28 20:07:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 191bba90-0f82-54b1-88fa-cbe17ff9a5a0, identifier: VP25370
2026-01-28 20:07:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/37/cd37a1ad3f3c4caf426a4590e0cfac06/pa/AL26589_525dfaba25b83d2bd4e729eda51af226.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:07:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 191bba90-0f82-54b1-88fa-cbe17ff9a5a0 with identifier: VP25370
2026-01-28 20:07:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 191bba90-0f82-54b1-88fa-cbe17ff9a5a0 with identifier: VP25370
2026-01-28 20:07:48 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 175981 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    175981
2026-01-28 20:07:48 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 191bba90-0f82-54b1-88fa-cbe17ff9a5a0 spider: auto1.it
2026-01-28 20:07:48 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: 191bba90-0f82-54b1-88fa-cbe17ff9a5a0 due to rule: high_mileage_for_country.json, error: 175981 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    175981
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2026-01-29T16:21:41Z',
 'fuel_type': 'diesel',
 'id': '191bba90-0f82-54b1-88fa-cbe17ff9a5a0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VP25370',
 'listing': 'auction',
 'location': 'IT, Fasano BR',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 175981,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_191bba90-0f82-54b1-88fa-cbe17ff9a5a0/191bba90-0f82-54b1-88fa-cbe17ff9a5a0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78710,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/52/265278f2bef552d5057c2293e62259ec/pa/VP25370_8a3efa5fe1f112814f62107c36c25449.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_191bba90-0f82-54b1-88fa-cbe17ff9a5a0/191bba90-0f82-54b1-88fa-cbe17ff9a5a0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81878,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/52/265278f2bef552d5057c2293e62259ec/pa/VP25370_36080cd7e735b14c341bcf02ffe429af.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_191bba90-0f82-54b1-88fa-cbe17ff9a5a0/191bba90-0f82-54b1-88fa-cbe17ff9a5a0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83931,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/52/265278f2bef552d5057c2293e62259ec/pa/VP25370_6334ec9fd14f4db6d94965152a8caae2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_191bba90-0f82-54b1-88fa-cbe17ff9a5a0/191bba90-0f82-54b1-88fa-cbe17ff9a5a0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76374,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/52/265278f2bef552d5057c2293e62259ec/pa/VP25370_cd9a55e4161699c14fe1880718aaed03.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_191bba90-0f82-54b1-88fa-cbe17ff9a5a0/191bba90-0f82-54b1-88fa-cbe17ff9a5a0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75549,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/52/265278f2bef552d5057c2293e62259ec/pa/VP25370_925f2117809b5dc69a3e5774f88324b6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_191bba90-0f82-54b1-88fa-cbe17ff9a5a0/191bba90-0f82-54b1-88fa-cbe17ff9a5a0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83465,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/52/265278f2bef552d5057c2293e62259ec/pa/VP25370_cca1b8e58a28fe2b3a0fbfa9d296f028.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_191bba90-0f82-54b1-88fa-cbe17ff9a5a0/191bba90-0f82-54b1-88fa-cbe17ff9a5a0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61201,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/52/265278f2bef552d5057c2293e62259ec/pa/VP25370_cef630487eae6b67a5a0a7955dcb1d8e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_191bba90-0f82-54b1-88fa-cbe17ff9a5a0/191bba90-0f82-54b1-88fa-cbe17ff9a5a0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79515,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/52/265278f2bef552d5057c2293e62259ec/pa/VP25370_7ae6085fc949de64f2f3a7101d9ffcc7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_191bba90-0f82-54b1-88fa-cbe17ff9a5a0/191bba90-0f82-54b1-88fa-cbe17ff9a5a0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74532,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/52/265278f2bef552d5057c2293e62259ec/pa/VP25370_13a8b1a6ea2218aeade93584634a52f7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_191bba90-0f82-54b1-88fa-cbe17ff9a5a0/191bba90-0f82-54b1-88fa-cbe17ff9a5a0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62742,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/52/265278f2bef552d5057c2293e62259ec/pa/VP25370_4a1f6abd760e56d0f6d294851824b664.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_191bba90-0f82-54b1-88fa-cbe17ff9a5a0/191bba90-0f82-54b1-88fa-cbe17ff9a5a0_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55762,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/52/265278f2bef552d5057c2293e62259ec/pa/VP25370_532fa6ebe0065f087ce41ffb856d7178.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_191bba90-0f82-54b1-88fa-cbe17ff9a5a0/191bba90-0f82-54b1-88fa-cbe17ff9a5a0_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65723,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/52/265278f2bef552d5057c2293e62259ec/pa/VP25370_877c875e691a261dcd823c8c3b0b2b8c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_191bba90-0f82-54b1-88fa-cbe17ff9a5a0/191bba90-0f82-54b1-88fa-cbe17ff9a5a0_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76955,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/52/265278f2bef552d5057c2293e62259ec/pa/VP25370_acfe9f3b5878fd56961e8143073f4f42.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_191bba90-0f82-54b1-88fa-cbe17ff9a5a0/191bba90-0f82-54b1-88fa-cbe17ff9a5a0_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51809,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/52/265278f2bef552d5057c2293e62259ec/pa/VP25370_e645300d98e44f48b4f58d06f5cc1b03.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_191bba90-0f82-54b1-88fa-cbe17ff9a5a0/191bba90-0f82-54b1-88fa-cbe17ff9a5a0_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49944,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/52/265278f2bef552d5057c2293e62259ec/pa/VP25370_825fc72eb9671996a5703a3bf7fec756.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-12-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.6 Blue-HDi GT Line',
 'transmission': 'automatic',
 'trim': 'GT Line',
 'year': 2017}
2026-01-28 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VP25370%27 HTTP/1.1" 200 None
2026-01-28 20:07:48 [auto1.it] INFO: Saving data for VP25370: {'created_time': 1769630868.625163, 'last_price_update_time': 1769630868.625174, 'auction_closing_time': 1769703701.0}
2026-01-28 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VP25370') HTTP/1.1" 204 0
2026-01-28 20:07:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/37/cd37a1ad3f3c4caf426a4590e0cfac06/pa/AL26589_5a9ffdeec660a24455b273085d4b5f8f.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F21%252F2221ab80cad6a1b68502057ee1474d79%252Fpa%252FVP20298_836ff3502bb178052cc0d45f441d6d63.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/21/2221ab80cad6a1b68502057ee1474d79/pa/VP20298_836ff3502bb178052cc0d45f441d6d63.jpg not downloaded yet
2026-01-28 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F37%252Fcd37a1ad3f3c4caf426a4590e0cfac06%252Fpa%252FAL26589_200503488b3083741263f65f1d6b43fc.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/37/cd37a1ad3f3c4caf426a4590e0cfac06/pa/AL26589_200503488b3083741263f65f1d6b43fc.jpg not downloaded yet
2026-01-28 20:07:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/21/2221ab80cad6a1b68502057ee1474d79/pa/VP20298_3d0ec905534bc2ce7244ced3c610ca2d.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:07:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/21/2221ab80cad6a1b68502057ee1474d79/pa/VP20298_8c97300552fb01cfb160b77fd965d698.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F21%252F2221ab80cad6a1b68502057ee1474d79%252Fpa%252FVP20298_4302736c0703e6fe123da7a10f122155.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/21/2221ab80cad6a1b68502057ee1474d79/pa/VP20298_4302736c0703e6fe123da7a10f122155.jpg not downloaded yet
2026-01-28 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F37%252Fcd37a1ad3f3c4caf426a4590e0cfac06%252Fpa%252FAL26589_c36d6071b23b817c7af0f01dba0bcad5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/37/cd37a1ad3f3c4caf426a4590e0cfac06/pa/AL26589_c36d6071b23b817c7af0f01dba0bcad5.jpg not downloaded yet
2026-01-28 20:07:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08cd4390>
2026-01-28 20:07:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a752d5cb-7aca-5619-8cb1-a9705f3c00dd/a752d5cb-7aca-5619-8cb1-a9705f3c00dd_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F37%252Fcd37a1ad3f3c4caf426a4590e0cfac06%252Fpa%252FAL26589_525dfaba25b83d2bd4e729eda51af226.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/37/cd37a1ad3f3c4caf426a4590e0cfac06/pa/AL26589_525dfaba25b83d2bd4e729eda51af226.jpg saved to cache
2026-01-28 20:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a752d5cb-7aca-5619-8cb1-a9705f3c00dd
2026-01-28 20:07:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/37/cd37a1ad3f3c4caf426a4590e0cfac06/pa/AL26589_e8e9267a44e3df9c9d2355cdb485c94e.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F21%252F2221ab80cad6a1b68502057ee1474d79%252Fpa%252FVP20298_266e4eb20ec8a0b989f3062269709553.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/21/2221ab80cad6a1b68502057ee1474d79/pa/VP20298_266e4eb20ec8a0b989f3062269709553.jpg not downloaded yet
2026-01-28 20:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F37%252Fcd37a1ad3f3c4caf426a4590e0cfac06%252Fpa%252FAL26589_72f7fc883760409e73e9633b9f2cd2ea.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/37/cd37a1ad3f3c4caf426a4590e0cfac06/pa/AL26589_72f7fc883760409e73e9633b9f2cd2ea.jpg not downloaded yet
2026-01-28 20:07:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/02/0902ecd716da7e9c1590d287d6183135/pa/BS57464_a0a58758a4b55f2e0c30fa759ae302c4.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:07:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EA99584/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:07:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0cda8dd0>
2026-01-28 20:07:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a752d5cb-7aca-5619-8cb1-a9705f3c00dd/a752d5cb-7aca-5619-8cb1-a9705f3c00dd_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F37%252Fcd37a1ad3f3c4caf426a4590e0cfac06%252Fpa%252FAL26589_5a9ffdeec660a24455b273085d4b5f8f.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/37/cd37a1ad3f3c4caf426a4590e0cfac06/pa/AL26589_5a9ffdeec660a24455b273085d4b5f8f.jpg saved to cache
2026-01-28 20:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a752d5cb-7aca-5619-8cb1-a9705f3c00dd
2026-01-28 20:07:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08a6fb10>
2026-01-28 20:07:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:07:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f425c026-9d6b-597c-a5ae-c40076eae924/f425c026-9d6b-597c-a5ae-c40076eae924_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F21%252F2221ab80cad6a1b68502057ee1474d79%252Fpa%252FVP20298_3d0ec905534bc2ce7244ced3c610ca2d.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/21/2221ab80cad6a1b68502057ee1474d79/pa/VP20298_3d0ec905534bc2ce7244ced3c610ca2d.jpg saved to cache
2026-01-28 20:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f425c026-9d6b-597c-a5ae-c40076eae924
2026-01-28 20:07:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09da0d10>
2026-01-28 20:07:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:07:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f425c026-9d6b-597c-a5ae-c40076eae924/f425c026-9d6b-597c-a5ae-c40076eae924_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F21%252F2221ab80cad6a1b68502057ee1474d79%252Fpa%252FVP20298_8c97300552fb01cfb160b77fd965d698.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/21/2221ab80cad6a1b68502057ee1474d79/pa/VP20298_8c97300552fb01cfb160b77fd965d698.jpg saved to cache
2026-01-28 20:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f425c026-9d6b-597c-a5ae-c40076eae924
2026-01-28 20:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F21%252F2221ab80cad6a1b68502057ee1474d79%252Fpa%252FVP20298_44b589f49876ef59bab6fe9ec565b612.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/21/2221ab80cad6a1b68502057ee1474d79/pa/VP20298_44b589f49876ef59bab6fe9ec565b612.jpg not downloaded yet
2026-01-28 20:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F37%252Fcd37a1ad3f3c4caf426a4590e0cfac06%252Fpa%252FAL26589_a0977c7a02584cc34c18b9086684918d.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/37/cd37a1ad3f3c4caf426a4590e0cfac06/pa/AL26589_a0977c7a02584cc34c18b9086684918d.jpg not downloaded yet
2026-01-28 20:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F21%252F2221ab80cad6a1b68502057ee1474d79%252Fpa%252FVP20298_37f209cf365d2cb69a971f0b07d6de24.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/21/2221ab80cad6a1b68502057ee1474d79/pa/VP20298_37f209cf365d2cb69a971f0b07d6de24.jpg not downloaded yet
2026-01-28 20:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F37%252Fcd37a1ad3f3c4caf426a4590e0cfac06%252Fpa%252FAL26589_742a9e08a3e29f45cfcbcaad7aa163dc.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/37/cd37a1ad3f3c4caf426a4590e0cfac06/pa/AL26589_742a9e08a3e29f45cfcbcaad7aa163dc.jpg not downloaded yet
2026-01-28 20:07:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HN05440/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:07:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FM26794/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:07:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LM12647/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:07:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MW66167/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F21%252F2221ab80cad6a1b68502057ee1474d79%252Fpa%252FVP20298_9166493548f9c1e443510545447d92c4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/21/2221ab80cad6a1b68502057ee1474d79/pa/VP20298_9166493548f9c1e443510545447d92c4.jpg not downloaded yet
2026-01-28 20:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F37%252Fcd37a1ad3f3c4caf426a4590e0cfac06%252Fpa%252FAL26589_e1e24d725afe81dc392af7101ebc333e.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/37/cd37a1ad3f3c4caf426a4590e0cfac06/pa/AL26589_e1e24d725afe81dc392af7101ebc333e.jpg not downloaded yet
2026-01-28 20:07:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09d8f390>
2026-01-28 20:07:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:07:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a752d5cb-7aca-5619-8cb1-a9705f3c00dd/a752d5cb-7aca-5619-8cb1-a9705f3c00dd_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F37%252Fcd37a1ad3f3c4caf426a4590e0cfac06%252Fpa%252FAL26589_e8e9267a44e3df9c9d2355cdb485c94e.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/37/cd37a1ad3f3c4caf426a4590e0cfac06/pa/AL26589_e8e9267a44e3df9c9d2355cdb485c94e.jpg saved to cache
2026-01-28 20:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a752d5cb-7aca-5619-8cb1-a9705f3c00dd
2026-01-28 20:07:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08c459d0>
2026-01-28 20:07:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab2b9426-2a4e-5843-bea9-eeabb5e12b74/ab2b9426-2a4e-5843-bea9-eeabb5e12b74_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F02%252F0902ecd716da7e9c1590d287d6183135%252Fpa%252FBS57464_a0a58758a4b55f2e0c30fa759ae302c4.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/02/0902ecd716da7e9c1590d287d6183135/pa/BS57464_a0a58758a4b55f2e0c30fa759ae302c4.jpg saved to cache
2026-01-28 20:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ab2b9426-2a4e-5843-bea9-eeabb5e12b74
2026-01-28 20:07:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ab2b9426-2a4e-5843-bea9-eeabb5e12b74, skipping ID generation
2026-01-28 20:07:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab2b9426-2a4e-5843-bea9-eeabb5e12b74 with scrape type 1
2026-01-28 20:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Removing item ab2b9426-2a4e-5843-bea9-eeabb5e12b74 from tracking dictionaries
2026-01-28 20:07:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ab2b9426-2a4e-5843-bea9-eeabb5e12b74 sending to next pipeline
2026-01-28 20:07:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ab2b9426-2a4e-5843-bea9-eeabb5e12b74, identifier: BS57464
2026-01-28 20:07:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ab2b9426-2a4e-5843-bea9-eeabb5e12b74 with identifier: BS57464
2026-01-28 20:07:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ab2b9426-2a4e-5843-bea9-eeabb5e12b74 with identifier: BS57464
2026-01-28 20:07:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ab2b9426-2a4e-5843-bea9-eeabb5e12b74 with identifier: BS57464 to the API
2026-01-28 20:07:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:07:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:07:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img09/02/0902ecd716da7e9c1590d287d6183135/pa/BS57464_a0a58758a4b55f2e0c30fa759ae302c4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 237,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 455,
 'expiration_date': '2026-01-29T16:19:09Z',
 'fuel_type': 'petrol',
 'id': 'ab2b9426-2a4e-5843-bea9-eeabb5e12b74',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BS57464',
 'listing': 'auction',
 'location': 'IT',
 'make': 'Mercedes-Benz',
 'model': 'GLE-Klasse',
 'odometer': 10232,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab2b9426-2a4e-5843-bea9-eeabb5e12b74/ab2b9426-2a4e-5843-bea9-eeabb5e12b74_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73034,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img09/02/0902ecd716da7e9c1590d287d6183135/pa/BS57464_8c47502173140b0ee15658cce1ae7adf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab2b9426-2a4e-5843-bea9-eeabb5e12b74/ab2b9426-2a4e-5843-bea9-eeabb5e12b74_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3059213,
             'Height': 3024,
             'OriginUrl': 'https://img-pa.auto1.com/img09/02/0902ecd716da7e9c1590d287d6183135/pa/BS57464_a0a58758a4b55f2e0c30fa759ae302c4.jpg',
             'Width': 4032},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab2b9426-2a4e-5843-bea9-eeabb5e12b74/ab2b9426-2a4e-5843-bea9-eeabb5e12b74_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3020131,
             'Height': 3024,
             'OriginUrl': 'https://img-pa.auto1.com/img09/02/0902ecd716da7e9c1590d287d6183135/pa/BS57464_5e0e3f2d669b247d044e56b60a41490e.jpg',
             'Width': 4032},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab2b9426-2a4e-5843-bea9-eeabb5e12b74/ab2b9426-2a4e-5843-bea9-eeabb5e12b74_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64393,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img09/02/0902ecd716da7e9c1590d287d6183135/pa/BS57464_daeb323d5d299421c411d03473aa4470.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab2b9426-2a4e-5843-bea9-eeabb5e12b74/ab2b9426-2a4e-5843-bea9-eeabb5e12b74_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2860050,
             'Height': 3024,
             'OriginUrl': 'https://img-pa.auto1.com/img09/02/0902ecd716da7e9c1590d287d6183135/pa/BS57464_ec60430e4516f5cc54b2f908b8073105.jpg',
             'Width': 4032},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab2b9426-2a4e-5843-bea9-eeabb5e12b74/ab2b9426-2a4e-5843-bea9-eeabb5e12b74_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2878743,
             'Height': 3024,
             'OriginUrl': 'https://img-pa.auto1.com/img09/02/0902ecd716da7e9c1590d287d6183135/pa/BS57464_163865abeb1170b2d8b9b95d51ae1483.jpg',
             'Width': 4032},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab2b9426-2a4e-5843-bea9-eeabb5e12b74/ab2b9426-2a4e-5843-bea9-eeabb5e12b74_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2869761,
             'Height': 3024,
             'OriginUrl': 'https://img-pa.auto1.com/img09/02/0902ecd716da7e9c1590d287d6183135/pa/BS57464_c1b70dbbb06b6e666d45e02d6851c3c7.jpg',
             'Width': 4032},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab2b9426-2a4e-5843-bea9-eeabb5e12b74/ab2b9426-2a4e-5843-bea9-eeabb5e12b74_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3617974,
             'Height': 3024,
             'OriginUrl': 'https://img-pa.auto1.com/img09/02/0902ecd716da7e9c1590d287d6183135/pa/BS57464_302398b64755b6ca6907b589f779f9e7.jpg',
             'Width': 4032},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab2b9426-2a4e-5843-bea9-eeabb5e12b74/ab2b9426-2a4e-5843-bea9-eeabb5e12b74_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2945622,
             'Height': 3024,
             'OriginUrl': 'https://img-pa.auto1.com/img09/02/0902ecd716da7e9c1590d287d6183135/pa/BS57464_3ff61e0f1aa47ff8b1ff339c847d1df4.jpg',
             'Width': 4032},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab2b9426-2a4e-5843-bea9-eeabb5e12b74/ab2b9426-2a4e-5843-bea9-eeabb5e12b74_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3297933,
             'Height': 3024,
             'OriginUrl': 'https://img-pa.auto1.com/img09/02/0902ecd716da7e9c1590d287d6183135/pa/BS57464_cc7d9af4ba3e94dc77983939a6ed99e5.jpg',
             'Width': 4032},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab2b9426-2a4e-5843-bea9-eeabb5e12b74/ab2b9426-2a4e-5843-bea9-eeabb5e12b74_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3383914,
             'Height': 3024,
             'OriginUrl': 'https://img-pa.auto1.com/img09/02/0902ecd716da7e9c1590d287d6183135/pa/BS57464_f1460c21492cd74c610c7d629e277945.jpg',
             'Width': 4032},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab2b9426-2a4e-5843-bea9-eeabb5e12b74/ab2b9426-2a4e-5843-bea9-eeabb5e12b74_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63344,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img09/02/0902ecd716da7e9c1590d287d6183135/pa/BS57464_eaf0156791ad4ad12adf6a9dd987298c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab2b9426-2a4e-5843-bea9-eeabb5e12b74/ab2b9426-2a4e-5843-bea9-eeabb5e12b74_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3217359,
             'Height': 3024,
             'OriginUrl': 'https://img-pa.auto1.com/img09/02/0902ecd716da7e9c1590d287d6183135/pa/BS57464_2d2be8bde02b767e2dc0fb7624bba0c0.jpg',
             'Width': 4032},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab2b9426-2a4e-5843-bea9-eeabb5e12b74/ab2b9426-2a4e-5843-bea9-eeabb5e12b74_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56360,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img09/02/0902ecd716da7e9c1590d287d6183135/pa/BS57464_b8c7211807b44ef8b62482d8a517d517.jpg',
             'Width': 444}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-03-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLE-Klasse GLE 53 AMG Mild-Hybrid 4Matic+',
 'transmission': 'automatic',
 'trim': '4Matic+',
 'year': 2024}
2026-01-28 20:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27BS57464%27 HTTP/1.1" 200 None
2026-01-28 20:07:51 [auto1.it] INFO: Saving data for BS57464: {'created_time': 1769630871.835281, 'last_price_update_time': 1769630871.835293, 'auction_closing_time': 1769703549.0}
2026-01-28 20:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='BS57464') HTTP/1.1" 204 0
2026-01-28 20:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F21%252F2221ab80cad6a1b68502057ee1474d79%252Fpa%252FVP20298_f77fc4c4b3bb6db28306c970e5325e7e.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/21/2221ab80cad6a1b68502057ee1474d79/pa/VP20298_f77fc4c4b3bb6db28306c970e5325e7e.jpg not downloaded yet
2026-01-28 20:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F37%252Fcd37a1ad3f3c4caf426a4590e0cfac06%252Fpa%252FAL26589_c1983e2c43951069069b916ce09696db.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/37/cd37a1ad3f3c4caf426a4590e0cfac06/pa/AL26589_c1983e2c43951069069b916ce09696db.jpg not downloaded yet
2026-01-28 20:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F21%252F2221ab80cad6a1b68502057ee1474d79%252Fpa%252FVP20298_d0b9f638062ec36c54cd4d624375d4c4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/21/2221ab80cad6a1b68502057ee1474d79/pa/VP20298_d0b9f638062ec36c54cd4d624375d4c4.jpg not downloaded yet
2026-01-28 20:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F37%252Fcd37a1ad3f3c4caf426a4590e0cfac06%252Fpa%252FAL26589_494a20e32d8a9f2c584616ac38a74a81.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/37/cd37a1ad3f3c4caf426a4590e0cfac06/pa/AL26589_494a20e32d8a9f2c584616ac38a74a81.jpg not downloaded yet
2026-01-28 20:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F21%252F2221ab80cad6a1b68502057ee1474d79%252Fpa%252FVP20298_022f571412fb0f95a35d61e9c20f072c.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/21/2221ab80cad6a1b68502057ee1474d79/pa/VP20298_022f571412fb0f95a35d61e9c20f072c.jpg not downloaded yet
2026-01-28 20:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F37%252Fcd37a1ad3f3c4caf426a4590e0cfac06%252Fpa%252FAL26589_a3a27eedcdada80464d61e0da7537f9c.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/37/cd37a1ad3f3c4caf426a4590e0cfac06/pa/AL26589_a3a27eedcdada80464d61e0da7537f9c.jpg not downloaded yet
2026-01-28 20:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F37%252Fcd37a1ad3f3c4caf426a4590e0cfac06%252Fpa%252FAL26589_34088ba2739b424a94b984c2853013cd.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/37/cd37a1ad3f3c4caf426a4590e0cfac06/pa/AL26589_34088ba2739b424a94b984c2853013cd.jpg not downloaded yet
2026-01-28 20:07:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/a6/27a657fee4c38facf349d22de315ad81/pa/DJ22210_860b41f9228b41f1d236804371f4d584.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:07:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/a6/27a657fee4c38facf349d22de315ad81/pa/DJ22210_ac8e09de710cebb7cb2bf30d90bb5997.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:07:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/21/2221ab80cad6a1b68502057ee1474d79/pa/VP20298_cca09da2660656a317c62ff01ab0f8fc.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:07:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/a6/27a657fee4c38facf349d22de315ad81/pa/DJ22210_4cf77547272c72daf5d67c0c0acc536f.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:07:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/21/2221ab80cad6a1b68502057ee1474d79/pa/VP20298_70eaff2c15aa28c37b8339e32372bfd2.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:07:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/37/cd37a1ad3f3c4caf426a4590e0cfac06/pa/AL26589_5dadcc41154365c2bdbce79831b03994.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:07:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/37/cd37a1ad3f3c4caf426a4590e0cfac06/pa/AL26589_5578a4f8e1969064e44a8232d3f05659.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:07:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/37/cd37a1ad3f3c4caf426a4590e0cfac06/pa/AL26589_200503488b3083741263f65f1d6b43fc.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:07:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/21/2221ab80cad6a1b68502057ee1474d79/pa/VP20298_836ff3502bb178052cc0d45f441d6d63.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:07:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/21/2221ab80cad6a1b68502057ee1474d79/pa/VP20298_37f209cf365d2cb69a971f0b07d6de24.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:07:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/21/2221ab80cad6a1b68502057ee1474d79/pa/VP20298_44b589f49876ef59bab6fe9ec565b612.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:07:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:07:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08aa6050>
2026-01-28 20:07:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:07:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8aea567-3ec2-586f-8165-3ba50fde04ea/e8aea567-3ec2-586f-8165-3ba50fde04ea_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252Fa6%252F27a657fee4c38facf349d22de315ad81%252Fpa%252FDJ22210_860b41f9228b41f1d236804371f4d584.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/a6/27a657fee4c38facf349d22de315ad81/pa/DJ22210_860b41f9228b41f1d236804371f4d584.jpg saved to cache
2026-01-28 20:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e8aea567-3ec2-586f-8165-3ba50fde04ea
2026-01-28 20:07:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/37/cd37a1ad3f3c4caf426a4590e0cfac06/pa/AL26589_742a9e08a3e29f45cfcbcaad7aa163dc.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:07:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/37/cd37a1ad3f3c4caf426a4590e0cfac06/pa/AL26589_34088ba2739b424a94b984c2853013cd.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:07:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:07:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09f20fd0>
2026-01-28 20:07:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:07:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8aea567-3ec2-586f-8165-3ba50fde04ea/e8aea567-3ec2-586f-8165-3ba50fde04ea_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252Fa6%252F27a657fee4c38facf349d22de315ad81%252Fpa%252FDJ22210_ac8e09de710cebb7cb2bf30d90bb5997.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/a6/27a657fee4c38facf349d22de315ad81/pa/DJ22210_ac8e09de710cebb7cb2bf30d90bb5997.jpg saved to cache
2026-01-28 20:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e8aea567-3ec2-586f-8165-3ba50fde04ea
2026-01-28 20:07:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08b67690>
2026-01-28 20:07:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:07:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f425c026-9d6b-597c-a5ae-c40076eae924/f425c026-9d6b-597c-a5ae-c40076eae924_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F21%252F2221ab80cad6a1b68502057ee1474d79%252Fpa%252FVP20298_cca09da2660656a317c62ff01ab0f8fc.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/21/2221ab80cad6a1b68502057ee1474d79/pa/VP20298_cca09da2660656a317c62ff01ab0f8fc.jpg saved to cache
2026-01-28 20:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f425c026-9d6b-597c-a5ae-c40076eae924
2026-01-28 20:07:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:07:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0899e150>
2026-01-28 20:07:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:07:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8aea567-3ec2-586f-8165-3ba50fde04ea/e8aea567-3ec2-586f-8165-3ba50fde04ea_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252Fa6%252F27a657fee4c38facf349d22de315ad81%252Fpa%252FDJ22210_4cf77547272c72daf5d67c0c0acc536f.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/a6/27a657fee4c38facf349d22de315ad81/pa/DJ22210_4cf77547272c72daf5d67c0c0acc536f.jpg saved to cache
2026-01-28 20:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e8aea567-3ec2-586f-8165-3ba50fde04ea
2026-01-28 20:07:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e8aea567-3ec2-586f-8165-3ba50fde04ea, skipping ID generation
2026-01-28 20:07:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8aea567-3ec2-586f-8165-3ba50fde04ea with scrape type 1
2026-01-28 20:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Removing item e8aea567-3ec2-586f-8165-3ba50fde04ea from tracking dictionaries
2026-01-28 20:07:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e8aea567-3ec2-586f-8165-3ba50fde04ea sending to next pipeline
2026-01-28 20:07:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e8aea567-3ec2-586f-8165-3ba50fde04ea, identifier: DJ22210
2026-01-28 20:07:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09f21890>
2026-01-28 20:07:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:07:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f425c026-9d6b-597c-a5ae-c40076eae924/f425c026-9d6b-597c-a5ae-c40076eae924_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F21%252F2221ab80cad6a1b68502057ee1474d79%252Fpa%252FVP20298_70eaff2c15aa28c37b8339e32372bfd2.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/21/2221ab80cad6a1b68502057ee1474d79/pa/VP20298_70eaff2c15aa28c37b8339e32372bfd2.jpg saved to cache
2026-01-28 20:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f425c026-9d6b-597c-a5ae-c40076eae924
2026-01-28 20:07:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:07:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08bd9f10>
2026-01-28 20:07:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a752d5cb-7aca-5619-8cb1-a9705f3c00dd/a752d5cb-7aca-5619-8cb1-a9705f3c00dd_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F37%252Fcd37a1ad3f3c4caf426a4590e0cfac06%252Fpa%252FAL26589_5dadcc41154365c2bdbce79831b03994.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/37/cd37a1ad3f3c4caf426a4590e0cfac06/pa/AL26589_5dadcc41154365c2bdbce79831b03994.jpg saved to cache
2026-01-28 20:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a752d5cb-7aca-5619-8cb1-a9705f3c00dd
2026-01-28 20:07:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:07:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08710290>
2026-01-28 20:07:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:07:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a752d5cb-7aca-5619-8cb1-a9705f3c00dd/a752d5cb-7aca-5619-8cb1-a9705f3c00dd_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F37%252Fcd37a1ad3f3c4caf426a4590e0cfac06%252Fpa%252FAL26589_5578a4f8e1969064e44a8232d3f05659.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/37/cd37a1ad3f3c4caf426a4590e0cfac06/pa/AL26589_5578a4f8e1969064e44a8232d3f05659.jpg saved to cache
2026-01-28 20:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a752d5cb-7aca-5619-8cb1-a9705f3c00dd
2026-01-28 20:07:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:07:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0a0ebd90>
2026-01-28 20:07:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a752d5cb-7aca-5619-8cb1-a9705f3c00dd/a752d5cb-7aca-5619-8cb1-a9705f3c00dd_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F37%252Fcd37a1ad3f3c4caf426a4590e0cfac06%252Fpa%252FAL26589_200503488b3083741263f65f1d6b43fc.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/37/cd37a1ad3f3c4caf426a4590e0cfac06/pa/AL26589_200503488b3083741263f65f1d6b43fc.jpg saved to cache
2026-01-28 20:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a752d5cb-7aca-5619-8cb1-a9705f3c00dd
2026-01-28 20:07:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b089a2550>
2026-01-28 20:07:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f425c026-9d6b-597c-a5ae-c40076eae924/f425c026-9d6b-597c-a5ae-c40076eae924_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F21%252F2221ab80cad6a1b68502057ee1474d79%252Fpa%252FVP20298_836ff3502bb178052cc0d45f441d6d63.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/21/2221ab80cad6a1b68502057ee1474d79/pa/VP20298_836ff3502bb178052cc0d45f441d6d63.jpg saved to cache
2026-01-28 20:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f425c026-9d6b-597c-a5ae-c40076eae924
2026-01-28 20:07:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09d911d0>
2026-01-28 20:07:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:07:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f425c026-9d6b-597c-a5ae-c40076eae924/f425c026-9d6b-597c-a5ae-c40076eae924_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F21%252F2221ab80cad6a1b68502057ee1474d79%252Fpa%252FVP20298_37f209cf365d2cb69a971f0b07d6de24.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/21/2221ab80cad6a1b68502057ee1474d79/pa/VP20298_37f209cf365d2cb69a971f0b07d6de24.jpg saved to cache
2026-01-28 20:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f425c026-9d6b-597c-a5ae-c40076eae924
2026-01-28 20:07:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09eb7210>
2026-01-28 20:07:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:07:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f425c026-9d6b-597c-a5ae-c40076eae924/f425c026-9d6b-597c-a5ae-c40076eae924_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F21%252F2221ab80cad6a1b68502057ee1474d79%252Fpa%252FVP20298_44b589f49876ef59bab6fe9ec565b612.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/21/2221ab80cad6a1b68502057ee1474d79/pa/VP20298_44b589f49876ef59bab6fe9ec565b612.jpg saved to cache
2026-01-28 20:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f425c026-9d6b-597c-a5ae-c40076eae924
2026-01-28 20:07:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e8aea567-3ec2-586f-8165-3ba50fde04ea with identifier: DJ22210
2026-01-28 20:07:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e8aea567-3ec2-586f-8165-3ba50fde04ea with identifier: DJ22210
2026-01-28 20:07:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e8aea567-3ec2-586f-8165-3ba50fde04ea with identifier: DJ22210 to the API
2026-01-28 20:07:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:07:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:07:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img27/a6/27a657fee4c38facf349d22de315ad81/pa/DJ22210_4cf77547272c72daf5d67c0c0acc536f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 159,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 265,
 'expiration_date': '2026-01-29T16:16:36Z',
 'fuel_type': 'petrol',
 'id': 'e8aea567-3ec2-586f-8165-3ba50fde04ea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DJ22210',
 'listing': 'auction',
 'location': 'IT, Brescia',
 'make': 'BMW',
 'model': '1er',
 'odometer': 47816,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8aea567-3ec2-586f-8165-3ba50fde04ea/e8aea567-3ec2-586f-8165-3ba50fde04ea_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3029584,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img27/a6/27a657fee4c38facf349d22de315ad81/pa/DJ22210_80874957cc4fe48b8c50bebc0a24e51a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8aea567-3ec2-586f-8165-3ba50fde04ea/e8aea567-3ec2-586f-8165-3ba50fde04ea_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3048745,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img27/a6/27a657fee4c38facf349d22de315ad81/pa/DJ22210_2b1607897a8d16f8a381268e1f6daf43.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8aea567-3ec2-586f-8165-3ba50fde04ea/e8aea567-3ec2-586f-8165-3ba50fde04ea_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3028203,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img27/a6/27a657fee4c38facf349d22de315ad81/pa/DJ22210_4cf77547272c72daf5d67c0c0acc536f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8aea567-3ec2-586f-8165-3ba50fde04ea/e8aea567-3ec2-586f-8165-3ba50fde04ea_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54119,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/a6/27a657fee4c38facf349d22de315ad81/pa/DJ22210_69cf42e9465bc533269626054e497f6a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8aea567-3ec2-586f-8165-3ba50fde04ea/e8aea567-3ec2-586f-8165-3ba50fde04ea_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2989136,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img27/a6/27a657fee4c38facf349d22de315ad81/pa/DJ22210_ac8e09de710cebb7cb2bf30d90bb5997.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8aea567-3ec2-586f-8165-3ba50fde04ea/e8aea567-3ec2-586f-8165-3ba50fde04ea_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66137,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/a6/27a657fee4c38facf349d22de315ad81/pa/DJ22210_b1add6775a0ac1f0194239ca8673d9c1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8aea567-3ec2-586f-8165-3ba50fde04ea/e8aea567-3ec2-586f-8165-3ba50fde04ea_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2912707,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img27/a6/27a657fee4c38facf349d22de315ad81/pa/DJ22210_860b41f9228b41f1d236804371f4d584.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8aea567-3ec2-586f-8165-3ba50fde04ea/e8aea567-3ec2-586f-8165-3ba50fde04ea_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74036,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/a6/27a657fee4c38facf349d22de315ad81/pa/DJ22210_1951b2dde5ee0d84f60ee58c7fed5528.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8aea567-3ec2-586f-8165-3ba50fde04ea/e8aea567-3ec2-586f-8165-3ba50fde04ea_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3031469,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img27/a6/27a657fee4c38facf349d22de315ad81/pa/DJ22210_2cc48d3de482b5f54f13a404e6d982c3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8aea567-3ec2-586f-8165-3ba50fde04ea/e8aea567-3ec2-586f-8165-3ba50fde04ea_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66599,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/a6/27a657fee4c38facf349d22de315ad81/pa/DJ22210_8f8b295f1b305e052decf49ae3b777e1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8aea567-3ec2-586f-8165-3ba50fde04ea/e8aea567-3ec2-586f-8165-3ba50fde04ea_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2968963,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img27/a6/27a657fee4c38facf349d22de315ad81/pa/DJ22210_b169544b95f9f50840b1952150fc64e5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8aea567-3ec2-586f-8165-3ba50fde04ea/e8aea567-3ec2-586f-8165-3ba50fde04ea_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2955742,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img27/a6/27a657fee4c38facf349d22de315ad81/pa/DJ22210_2dbd1ac3f3fc4b34aea2971653241d55.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8aea567-3ec2-586f-8165-3ba50fde04ea/e8aea567-3ec2-586f-8165-3ba50fde04ea_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53832,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/a6/27a657fee4c38facf349d22de315ad81/pa/DJ22210_84590d3e74fda22927037ac14b4750e2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8aea567-3ec2-586f-8165-3ba50fde04ea/e8aea567-3ec2-586f-8165-3ba50fde04ea_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2803369,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img27/a6/27a657fee4c38facf349d22de315ad81/pa/DJ22210_fe407c5608223d3a52d7ba3787172781.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8aea567-3ec2-586f-8165-3ba50fde04ea/e8aea567-3ec2-586f-8165-3ba50fde04ea_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47489,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/a6/27a657fee4c38facf349d22de315ad81/pa/DJ22210_b42d4b601783960f8a82db062c0fb5e5.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-06-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1er 128ti',
 'transmission': 'automatic',
 'trim': '',
 'year': 2023}
2026-01-28 20:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27DJ22210%27 HTTP/1.1" 200 None
2026-01-28 20:07:56 [auto1.it] INFO: Saving data for DJ22210: {'created_time': 1769630876.183084, 'last_price_update_time': 1769630876.183096, 'auction_closing_time': 1769703396.0}
2026-01-28 20:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='DJ22210') HTTP/1.1" 204 0
2026-01-28 20:07:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:07:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:07:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:07:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:07:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:07:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0893b990>
2026-01-28 20:07:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:07:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a752d5cb-7aca-5619-8cb1-a9705f3c00dd/a752d5cb-7aca-5619-8cb1-a9705f3c00dd_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F37%252Fcd37a1ad3f3c4caf426a4590e0cfac06%252Fpa%252FAL26589_742a9e08a3e29f45cfcbcaad7aa163dc.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/37/cd37a1ad3f3c4caf426a4590e0cfac06/pa/AL26589_742a9e08a3e29f45cfcbcaad7aa163dc.jpg saved to cache
2026-01-28 20:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a752d5cb-7aca-5619-8cb1-a9705f3c00dd
2026-01-28 20:07:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0be6f050>
2026-01-28 20:07:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:07:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a752d5cb-7aca-5619-8cb1-a9705f3c00dd/a752d5cb-7aca-5619-8cb1-a9705f3c00dd_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F37%252Fcd37a1ad3f3c4caf426a4590e0cfac06%252Fpa%252FAL26589_34088ba2739b424a94b984c2853013cd.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/37/cd37a1ad3f3c4caf426a4590e0cfac06/pa/AL26589_34088ba2739b424a94b984c2853013cd.jpg saved to cache
2026-01-28 20:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item a752d5cb-7aca-5619-8cb1-a9705f3c00dd
2026-01-28 20:07:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/21/2221ab80cad6a1b68502057ee1474d79/pa/VP20298_4302736c0703e6fe123da7a10f122155.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:07:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/37/cd37a1ad3f3c4caf426a4590e0cfac06/pa/AL26589_c36d6071b23b817c7af0f01dba0bcad5.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:07:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/37/cd37a1ad3f3c4caf426a4590e0cfac06/pa/AL26589_72f7fc883760409e73e9633b9f2cd2ea.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:07:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/37/cd37a1ad3f3c4caf426a4590e0cfac06/pa/AL26589_a0977c7a02584cc34c18b9086684918d.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:07:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/21/2221ab80cad6a1b68502057ee1474d79/pa/VP20298_022f571412fb0f95a35d61e9c20f072c.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:07:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/21/2221ab80cad6a1b68502057ee1474d79/pa/VP20298_d0b9f638062ec36c54cd4d624375d4c4.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:07:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/21/2221ab80cad6a1b68502057ee1474d79/pa/VP20298_f77fc4c4b3bb6db28306c970e5325e7e.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:07:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/21/2221ab80cad6a1b68502057ee1474d79/pa/VP20298_9166493548f9c1e443510545447d92c4.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:07:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/21/2221ab80cad6a1b68502057ee1474d79/pa/VP20298_266e4eb20ec8a0b989f3062269709553.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:07:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/37/cd37a1ad3f3c4caf426a4590e0cfac06/pa/AL26589_c1983e2c43951069069b916ce09696db.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:07:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0bfb3e90>
2026-01-28 20:07:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:07:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f425c026-9d6b-597c-a5ae-c40076eae924/f425c026-9d6b-597c-a5ae-c40076eae924_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F21%252F2221ab80cad6a1b68502057ee1474d79%252Fpa%252FVP20298_4302736c0703e6fe123da7a10f122155.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/21/2221ab80cad6a1b68502057ee1474d79/pa/VP20298_4302736c0703e6fe123da7a10f122155.jpg saved to cache
2026-01-28 20:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f425c026-9d6b-597c-a5ae-c40076eae924
2026-01-28 20:07:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/37/cd37a1ad3f3c4caf426a4590e0cfac06/pa/AL26589_494a20e32d8a9f2c584616ac38a74a81.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:07:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:07:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08b8e190>
2026-01-28 20:07:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a752d5cb-7aca-5619-8cb1-a9705f3c00dd/a752d5cb-7aca-5619-8cb1-a9705f3c00dd_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F37%252Fcd37a1ad3f3c4caf426a4590e0cfac06%252Fpa%252FAL26589_c36d6071b23b817c7af0f01dba0bcad5.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/37/cd37a1ad3f3c4caf426a4590e0cfac06/pa/AL26589_c36d6071b23b817c7af0f01dba0bcad5.jpg saved to cache
2026-01-28 20:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a752d5cb-7aca-5619-8cb1-a9705f3c00dd
2026-01-28 20:07:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:07:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08cd4090>
2026-01-28 20:07:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:07:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a752d5cb-7aca-5619-8cb1-a9705f3c00dd/a752d5cb-7aca-5619-8cb1-a9705f3c00dd_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F37%252Fcd37a1ad3f3c4caf426a4590e0cfac06%252Fpa%252FAL26589_72f7fc883760409e73e9633b9f2cd2ea.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/37/cd37a1ad3f3c4caf426a4590e0cfac06/pa/AL26589_72f7fc883760409e73e9633b9f2cd2ea.jpg saved to cache
2026-01-28 20:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a752d5cb-7aca-5619-8cb1-a9705f3c00dd
2026-01-28 20:07:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:07:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08a1e650>
2026-01-28 20:07:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:07:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a752d5cb-7aca-5619-8cb1-a9705f3c00dd/a752d5cb-7aca-5619-8cb1-a9705f3c00dd_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F37%252Fcd37a1ad3f3c4caf426a4590e0cfac06%252Fpa%252FAL26589_a0977c7a02584cc34c18b9086684918d.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/37/cd37a1ad3f3c4caf426a4590e0cfac06/pa/AL26589_a0977c7a02584cc34c18b9086684918d.jpg saved to cache
2026-01-28 20:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a752d5cb-7aca-5619-8cb1-a9705f3c00dd
2026-01-28 20:07:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09d47f50>
2026-01-28 20:07:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:07:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f425c026-9d6b-597c-a5ae-c40076eae924/f425c026-9d6b-597c-a5ae-c40076eae924_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F21%252F2221ab80cad6a1b68502057ee1474d79%252Fpa%252FVP20298_022f571412fb0f95a35d61e9c20f072c.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/21/2221ab80cad6a1b68502057ee1474d79/pa/VP20298_022f571412fb0f95a35d61e9c20f072c.jpg saved to cache
2026-01-28 20:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item f425c026-9d6b-597c-a5ae-c40076eae924
2026-01-28 20:07:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08cd70d0>
2026-01-28 20:07:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:07:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f425c026-9d6b-597c-a5ae-c40076eae924/f425c026-9d6b-597c-a5ae-c40076eae924_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F21%252F2221ab80cad6a1b68502057ee1474d79%252Fpa%252FVP20298_d0b9f638062ec36c54cd4d624375d4c4.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/21/2221ab80cad6a1b68502057ee1474d79/pa/VP20298_d0b9f638062ec36c54cd4d624375d4c4.jpg saved to cache
2026-01-28 20:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item f425c026-9d6b-597c-a5ae-c40076eae924
2026-01-28 20:07:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09d46250>
2026-01-28 20:07:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f425c026-9d6b-597c-a5ae-c40076eae924/f425c026-9d6b-597c-a5ae-c40076eae924_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F21%252F2221ab80cad6a1b68502057ee1474d79%252Fpa%252FVP20298_f77fc4c4b3bb6db28306c970e5325e7e.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/21/2221ab80cad6a1b68502057ee1474d79/pa/VP20298_f77fc4c4b3bb6db28306c970e5325e7e.jpg saved to cache
2026-01-28 20:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item f425c026-9d6b-597c-a5ae-c40076eae924
2026-01-28 20:07:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08cd6b90>
2026-01-28 20:07:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:07:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f425c026-9d6b-597c-a5ae-c40076eae924/f425c026-9d6b-597c-a5ae-c40076eae924_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F21%252F2221ab80cad6a1b68502057ee1474d79%252Fpa%252FVP20298_9166493548f9c1e443510545447d92c4.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/21/2221ab80cad6a1b68502057ee1474d79/pa/VP20298_9166493548f9c1e443510545447d92c4.jpg saved to cache
2026-01-28 20:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item f425c026-9d6b-597c-a5ae-c40076eae924
2026-01-28 20:07:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08b8e1d0>
2026-01-28 20:07:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:07:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f425c026-9d6b-597c-a5ae-c40076eae924/f425c026-9d6b-597c-a5ae-c40076eae924_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F21%252F2221ab80cad6a1b68502057ee1474d79%252Fpa%252FVP20298_266e4eb20ec8a0b989f3062269709553.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/21/2221ab80cad6a1b68502057ee1474d79/pa/VP20298_266e4eb20ec8a0b989f3062269709553.jpg saved to cache
2026-01-28 20:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f425c026-9d6b-597c-a5ae-c40076eae924
2026-01-28 20:07:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09d45390>
2026-01-28 20:07:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a752d5cb-7aca-5619-8cb1-a9705f3c00dd/a752d5cb-7aca-5619-8cb1-a9705f3c00dd_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F37%252Fcd37a1ad3f3c4caf426a4590e0cfac06%252Fpa%252FAL26589_c1983e2c43951069069b916ce09696db.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/37/cd37a1ad3f3c4caf426a4590e0cfac06/pa/AL26589_c1983e2c43951069069b916ce09696db.jpg saved to cache
2026-01-28 20:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item a752d5cb-7aca-5619-8cb1-a9705f3c00dd
2026-01-28 20:07:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LM12647> (referer: https://www.auto1.com/v1/car-details-view/LM12647/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:07:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HN05440> (referer: https://www.auto1.com/v1/car-details-view/HN05440/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:07:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EA99584> (referer: https://www.auto1.com/v1/car-details-view/EA99584/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:07:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09d9d4d0>
2026-01-28 20:07:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a752d5cb-7aca-5619-8cb1-a9705f3c00dd/a752d5cb-7aca-5619-8cb1-a9705f3c00dd_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F37%252Fcd37a1ad3f3c4caf426a4590e0cfac06%252Fpa%252FAL26589_494a20e32d8a9f2c584616ac38a74a81.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/37/cd37a1ad3f3c4caf426a4590e0cfac06/pa/AL26589_494a20e32d8a9f2c584616ac38a74a81.jpg saved to cache
2026-01-28 20:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item a752d5cb-7aca-5619-8cb1-a9705f3c00dd
2026-01-28 20:07:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MW66167> (referer: https://www.auto1.com/v1/car-details-view/MW66167/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:07:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34da1ce6-770f-5d46-a202-90f23a20a744 with identifier: LM12647
2026-01-28 20:07:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34da1ce6-770f-5d46-a202-90f23a20a744 with scrape type 2
2026-01-28 20:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 34da1ce6-770f-5d46-a202-90f23a20a744 with scrape type 2
2026-01-28 20:08:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 34da1ce6-770f-5d46-a202-90f23a20a744, identifier: LM12647
2026-01-28 20:08:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e97a0054-a317-50cb-b06f-e159bbbe54e4 with identifier: HN05440
2026-01-28 20:08:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e97a0054-a317-50cb-b06f-e159bbbe54e4 with scrape type 1
2026-01-28 20:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item e97a0054-a317-50cb-b06f-e159bbbe54e4
2026-01-28 20:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F8d%252F7a8da16cc145d0d5720921b0350170aa%252Fpa%252FHN05440_b914c1b8d9b06fc9499aac5ce1b1c575.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/8d/7a8da16cc145d0d5720921b0350170aa/pa/HN05440_b914c1b8d9b06fc9499aac5ce1b1c575.jpg already downloaded
2026-01-28 20:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F8d%252F7a8da16cc145d0d5720921b0350170aa%252Fpa%252FHN05440_e369a554a50f07cdaa3f74b13606b547.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/8d/7a8da16cc145d0d5720921b0350170aa/pa/HN05440_e369a554a50f07cdaa3f74b13606b547.jpg already downloaded
2026-01-28 20:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F8d%252F7a8da16cc145d0d5720921b0350170aa%252Fpa%252FHN05440_e48bb9f7cdbe52de01f89174556b556f.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/8d/7a8da16cc145d0d5720921b0350170aa/pa/HN05440_e48bb9f7cdbe52de01f89174556b556f.jpg already downloaded
2026-01-28 20:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F8d%252F7a8da16cc145d0d5720921b0350170aa%252Fpa%252FHN05440_f0d79513137ff12900a506e23cfe444f.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/8d/7a8da16cc145d0d5720921b0350170aa/pa/HN05440_f0d79513137ff12900a506e23cfe444f.jpg already downloaded
2026-01-28 20:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F8d%252F7a8da16cc145d0d5720921b0350170aa%252Fpa%252FHN05440_f5cf2bbd6c5d6a2e85c89c658c64cca8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/8d/7a8da16cc145d0d5720921b0350170aa/pa/HN05440_f5cf2bbd6c5d6a2e85c89c658c64cca8.jpg already downloaded
2026-01-28 20:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F8d%252F7a8da16cc145d0d5720921b0350170aa%252Fpa%252FHN05440_a51b4ea74b527600ad02ee8a48be69e3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/8d/7a8da16cc145d0d5720921b0350170aa/pa/HN05440_a51b4ea74b527600ad02ee8a48be69e3.jpg already downloaded
2026-01-28 20:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F8d%252F7a8da16cc145d0d5720921b0350170aa%252Fpa%252FHN05440_e69c0d802b29e5495440578b993a49f6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/8d/7a8da16cc145d0d5720921b0350170aa/pa/HN05440_e69c0d802b29e5495440578b993a49f6.jpg already downloaded
2026-01-28 20:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F8d%252F7a8da16cc145d0d5720921b0350170aa%252Fpa%252FHN05440_19fb684b52a5c0420c6e438f282458c2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/8d/7a8da16cc145d0d5720921b0350170aa/pa/HN05440_19fb684b52a5c0420c6e438f282458c2.jpg already downloaded
2026-01-28 20:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F8d%252F7a8da16cc145d0d5720921b0350170aa%252Fpa%252FHN05440_435f3854dcd921eb127fea5131312ca8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/8d/7a8da16cc145d0d5720921b0350170aa/pa/HN05440_435f3854dcd921eb127fea5131312ca8.jpg already downloaded
2026-01-28 20:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F8d%252F7a8da16cc145d0d5720921b0350170aa%252Fpa%252FHN05440_92276ddd798da628fe8060798ab96d26.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/8d/7a8da16cc145d0d5720921b0350170aa/pa/HN05440_92276ddd798da628fe8060798ab96d26.jpg already downloaded
2026-01-28 20:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F8d%252F7a8da16cc145d0d5720921b0350170aa%252Fpa%252FHN05440_6454205ab9fb17c344752eb1c976148c.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/8d/7a8da16cc145d0d5720921b0350170aa/pa/HN05440_6454205ab9fb17c344752eb1c976148c.jpg already downloaded
2026-01-28 20:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F8d%252F7a8da16cc145d0d5720921b0350170aa%252Fpa%252FHN05440_13f56283c177f94b6ca6321ef16971ce.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/8d/7a8da16cc145d0d5720921b0350170aa/pa/HN05440_13f56283c177f94b6ca6321ef16971ce.jpg already downloaded
2026-01-28 20:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F8d%252F7a8da16cc145d0d5720921b0350170aa%252Fpa%252FHN05440_fd6af8e28df8165394c11b14c488eaf3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/8d/7a8da16cc145d0d5720921b0350170aa/pa/HN05440_fd6af8e28df8165394c11b14c488eaf3.jpg already downloaded
2026-01-28 20:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F8d%252F7a8da16cc145d0d5720921b0350170aa%252Fpa%252FHN05440_5ae20440e768b0f99e712353587b4e3c.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/8d/7a8da16cc145d0d5720921b0350170aa/pa/HN05440_5ae20440e768b0f99e712353587b4e3c.jpg already downloaded
2026-01-28 20:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F8d%252F7a8da16cc145d0d5720921b0350170aa%252Fpa%252FHN05440_10398c22381350a2da00c4c89a66cf9a.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/8d/7a8da16cc145d0d5720921b0350170aa/pa/HN05440_10398c22381350a2da00c4c89a66cf9a.jpg already downloaded
2026-01-28 20:08:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e97a0054-a317-50cb-b06f-e159bbbe54e4, identifier: HN05440
2026-01-28 20:08:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 53a97774-5172-5acd-aade-ebf71722eee2 with identifier: EA99584
2026-01-28 20:08:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53a97774-5172-5acd-aade-ebf71722eee2 with scrape type 1
2026-01-28 20:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 53a97774-5172-5acd-aade-ebf71722eee2
2026-01-28 20:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F26%252F7e261531df0ff80082393f2b30ea3444%252Fpa%252FEA99584_171ac7d0def0271696017a4424e50320.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/26/7e261531df0ff80082393f2b30ea3444/pa/EA99584_171ac7d0def0271696017a4424e50320.jpg not downloaded yet
2026-01-28 20:08:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 34da1ce6-770f-5d46-a202-90f23a20a744 with identifier: LM12647
2026-01-28 20:08:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 34da1ce6-770f-5d46-a202-90f23a20a744 with identifier: LM12647
2026-01-28 20:08:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 34da1ce6-770f-5d46-a202-90f23a20a744 with identifier: LM12647 to the API
2026-01-28 20:08:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:08:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:08:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LM12647>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '2.1L',
 'engine_horse_power': 190,
 'expiration_date': '2026-01-29T16:25:21Z',
 'fuel_type': 'diesel',
 'id': '34da1ce6-770f-5d46-a202-90f23a20a744',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LM12647',
 'listing': 'auction',
 'location': 'IT, Varedo (MB)',
 'make': 'Alfa Romeo',
 'model': 'Stelvio',
 'odometer': 101480,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-06-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Alfa Romeo Stelvio 2.2 JTDM Q4 Business',
 'transmission': 'automatic',
 'trim': 'Q4 Business',
 'year': 2019}
2026-01-28 20:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27LM12647%27 HTTP/1.1" 200 None
2026-01-28 20:08:00 [auto1.it] INFO: Saving data for LM12647: {'auction_closing_time': 1769703921.0, 'created_time': 1769199526.805376, 'last_price_update_time': 1769630880.883324}
2026-01-28 20:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='LM12647') HTTP/1.1" 204 0
2026-01-28 20:08:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e97a0054-a317-50cb-b06f-e159bbbe54e4 with identifier: HN05440
2026-01-28 20:08:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e97a0054-a317-50cb-b06f-e159bbbe54e4 with identifier: HN05440
2026-01-28 20:08:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e97a0054-a317-50cb-b06f-e159bbbe54e4 with identifier: HN05440 to the API
2026-01-28 20:08:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:08:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:08:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HN05440>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.0L',
 'engine_horse_power': 101,
 'expiration_date': '2026-01-29T16:13:30Z',
 'fuel_type': 'petrol',
 'id': 'e97a0054-a317-50cb-b06f-e159bbbe54e4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HN05440',
 'listing': 'auction',
 'location': 'IT, Roma',
 'make': 'Kia',
 'model': 'Stonic',
 'odometer': 47830,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img7a/8d/7a8da16cc145d0d5720921b0350170aa/pa/HN05440_b914c1b8d9b06fc9499aac5ce1b1c575.jpg',
                'https://img-pa.auto1.com/img7a/8d/7a8da16cc145d0d5720921b0350170aa/pa/HN05440_e369a554a50f07cdaa3f74b13606b547.jpg',
                'https://img-pa.auto1.com/img7a/8d/7a8da16cc145d0d5720921b0350170aa/pa/HN05440_e48bb9f7cdbe52de01f89174556b556f.jpg',
                'https://img-pa.auto1.com/img7a/8d/7a8da16cc145d0d5720921b0350170aa/pa/HN05440_f0d79513137ff12900a506e23cfe444f.jpg',
                'https://img-pa.auto1.com/img7a/8d/7a8da16cc145d0d5720921b0350170aa/pa/HN05440_f5cf2bbd6c5d6a2e85c89c658c64cca8.jpg',
                'https://img-pa.auto1.com/img7a/8d/7a8da16cc145d0d5720921b0350170aa/pa/HN05440_a51b4ea74b527600ad02ee8a48be69e3.jpg',
                'https://img-pa.auto1.com/img7a/8d/7a8da16cc145d0d5720921b0350170aa/pa/HN05440_e69c0d802b29e5495440578b993a49f6.jpg',
                'https://img-pa.auto1.com/img7a/8d/7a8da16cc145d0d5720921b0350170aa/pa/HN05440_19fb684b52a5c0420c6e438f282458c2.jpg',
                'https://img-pa.auto1.com/img7a/8d/7a8da16cc145d0d5720921b0350170aa/pa/HN05440_435f3854dcd921eb127fea5131312ca8.jpg',
                'https://img-pa.auto1.com/img7a/8d/7a8da16cc145d0d5720921b0350170aa/pa/HN05440_92276ddd798da628fe8060798ab96d26.jpg',
                'https://img-pa.auto1.com/img7a/8d/7a8da16cc145d0d5720921b0350170aa/pa/HN05440_6454205ab9fb17c344752eb1c976148c.jpg',
                'https://img-pa.auto1.com/img7a/8d/7a8da16cc145d0d5720921b0350170aa/pa/HN05440_13f56283c177f94b6ca6321ef16971ce.jpg',
                'https://img-pa.auto1.com/img7a/8d/7a8da16cc145d0d5720921b0350170aa/pa/HN05440_fd6af8e28df8165394c11b14c488eaf3.jpg',
                'https://img-pa.auto1.com/img7a/8d/7a8da16cc145d0d5720921b0350170aa/pa/HN05440_5ae20440e768b0f99e712353587b4e3c.jpg',
                'https://img-pa.auto1.com/img7a/8d/7a8da16cc145d0d5720921b0350170aa/pa/HN05440_10398c22381350a2da00c4c89a66cf9a.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e97a0054-a317-50cb-b06f-e159bbbe54e4/e97a0054-a317-50cb-b06f-e159bbbe54e4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67436,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/8d/7a8da16cc145d0d5720921b0350170aa/pa/HN05440_b914c1b8d9b06fc9499aac5ce1b1c575.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e97a0054-a317-50cb-b06f-e159bbbe54e4/e97a0054-a317-50cb-b06f-e159bbbe54e4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2895788,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/8d/7a8da16cc145d0d5720921b0350170aa/pa/HN05440_e369a554a50f07cdaa3f74b13606b547.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e97a0054-a317-50cb-b06f-e159bbbe54e4/e97a0054-a317-50cb-b06f-e159bbbe54e4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69116,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/8d/7a8da16cc145d0d5720921b0350170aa/pa/HN05440_e48bb9f7cdbe52de01f89174556b556f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e97a0054-a317-50cb-b06f-e159bbbe54e4/e97a0054-a317-50cb-b06f-e159bbbe54e4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2908544,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/8d/7a8da16cc145d0d5720921b0350170aa/pa/HN05440_f0d79513137ff12900a506e23cfe444f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e97a0054-a317-50cb-b06f-e159bbbe54e4/e97a0054-a317-50cb-b06f-e159bbbe54e4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2995394,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/8d/7a8da16cc145d0d5720921b0350170aa/pa/HN05440_f5cf2bbd6c5d6a2e85c89c658c64cca8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e97a0054-a317-50cb-b06f-e159bbbe54e4/e97a0054-a317-50cb-b06f-e159bbbe54e4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2867951,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/8d/7a8da16cc145d0d5720921b0350170aa/pa/HN05440_a51b4ea74b527600ad02ee8a48be69e3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e97a0054-a317-50cb-b06f-e159bbbe54e4/e97a0054-a317-50cb-b06f-e159bbbe54e4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64246,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/8d/7a8da16cc145d0d5720921b0350170aa/pa/HN05440_e69c0d802b29e5495440578b993a49f6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e97a0054-a317-50cb-b06f-e159bbbe54e4/e97a0054-a317-50cb-b06f-e159bbbe54e4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2832969,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/8d/7a8da16cc145d0d5720921b0350170aa/pa/HN05440_19fb684b52a5c0420c6e438f282458c2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e97a0054-a317-50cb-b06f-e159bbbe54e4/e97a0054-a317-50cb-b06f-e159bbbe54e4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62347,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/8d/7a8da16cc145d0d5720921b0350170aa/pa/HN05440_435f3854dcd921eb127fea5131312ca8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e97a0054-a317-50cb-b06f-e159bbbe54e4/e97a0054-a317-50cb-b06f-e159bbbe54e4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3066916,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/8d/7a8da16cc145d0d5720921b0350170aa/pa/HN05440_92276ddd798da628fe8060798ab96d26.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e97a0054-a317-50cb-b06f-e159bbbe54e4/e97a0054-a317-50cb-b06f-e159bbbe54e4_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64265,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/8d/7a8da16cc145d0d5720921b0350170aa/pa/HN05440_6454205ab9fb17c344752eb1c976148c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e97a0054-a317-50cb-b06f-e159bbbe54e4/e97a0054-a317-50cb-b06f-e159bbbe54e4_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75925,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/8d/7a8da16cc145d0d5720921b0350170aa/pa/HN05440_13f56283c177f94b6ca6321ef16971ce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e97a0054-a317-50cb-b06f-e159bbbe54e4/e97a0054-a317-50cb-b06f-e159bbbe54e4_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64449,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/8d/7a8da16cc145d0d5720921b0350170aa/pa/HN05440_fd6af8e28df8165394c11b14c488eaf3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e97a0054-a317-50cb-b06f-e159bbbe54e4/e97a0054-a317-50cb-b06f-e159bbbe54e4_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68089,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/8d/7a8da16cc145d0d5720921b0350170aa/pa/HN05440_5ae20440e768b0f99e712353587b4e3c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e97a0054-a317-50cb-b06f-e159bbbe54e4/e97a0054-a317-50cb-b06f-e159bbbe54e4_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46504,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/8d/7a8da16cc145d0d5720921b0350170aa/pa/HN05440_10398c22381350a2da00c4c89a66cf9a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-02-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Kia Stonic 1.0 TGDI Mild-Hybrid Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2022}
2026-01-28 20:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27HN05440%27 HTTP/1.1" 200 None
2026-01-28 20:08:01 [auto1.it] INFO: Saving data for HN05440: {'created_time': 1769630881.284476, 'last_price_update_time': 1769630881.284487, 'auction_closing_time': 1769703210.0}
2026-01-28 20:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='HN05440') HTTP/1.1" 204 0
2026-01-28 20:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F26%252F7e261531df0ff80082393f2b30ea3444%252Fpa%252FEA99584_0c85c8c36872546f4fe096a13eb2f938.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/26/7e261531df0ff80082393f2b30ea3444/pa/EA99584_0c85c8c36872546f4fe096a13eb2f938.jpg not downloaded yet
2026-01-28 20:08:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/21/2221ab80cad6a1b68502057ee1474d79/pa/VP20298_3d0efe7a7241f31a4e9950b1b0c0a487.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:08:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FM26794> (referer: https://www.auto1.com/v1/car-details-view/FM26794/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 20:08:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 25d7a0a7-58a0-5ec1-9cd5-95b6e4c99480 with identifier: MW66167
2026-01-28 20:08:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25d7a0a7-58a0-5ec1-9cd5-95b6e4c99480 with scrape type 1
2026-01-28 20:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 25d7a0a7-58a0-5ec1-9cd5-95b6e4c99480
2026-01-28 20:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Fef%252F90ef2c860e34ce56299ccae709a84bd7%252Fpa%252FMW66167_e4581f9fa73a2c9e53cf0994a565b447.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/ef/90ef2c860e34ce56299ccae709a84bd7/pa/MW66167_e4581f9fa73a2c9e53cf0994a565b447.jpg already downloaded
2026-01-28 20:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Fef%252F90ef2c860e34ce56299ccae709a84bd7%252Fpa%252FMW66167_8c63f983f3a97b9b01f0594dd65eac40.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/ef/90ef2c860e34ce56299ccae709a84bd7/pa/MW66167_8c63f983f3a97b9b01f0594dd65eac40.jpg already downloaded
2026-01-28 20:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Fef%252F90ef2c860e34ce56299ccae709a84bd7%252Fpa%252FMW66167_48a847f508657cf6b12f314a4635d882.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/ef/90ef2c860e34ce56299ccae709a84bd7/pa/MW66167_48a847f508657cf6b12f314a4635d882.jpg already downloaded
2026-01-28 20:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Fef%252F90ef2c860e34ce56299ccae709a84bd7%252Fpa%252FMW66167_c66f10d70ad89ab1b7a96d593b1128bc.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/ef/90ef2c860e34ce56299ccae709a84bd7/pa/MW66167_c66f10d70ad89ab1b7a96d593b1128bc.jpg already downloaded
2026-01-28 20:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Fef%252F90ef2c860e34ce56299ccae709a84bd7%252Fpa%252FMW66167_cd1a8150dfb221c1c9ff29d11f278fa5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/ef/90ef2c860e34ce56299ccae709a84bd7/pa/MW66167_cd1a8150dfb221c1c9ff29d11f278fa5.jpg already downloaded
2026-01-28 20:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Fef%252F90ef2c860e34ce56299ccae709a84bd7%252Fpa%252FMW66167_15440bf37eda10ab9e17fd7c4363ff0e.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/ef/90ef2c860e34ce56299ccae709a84bd7/pa/MW66167_15440bf37eda10ab9e17fd7c4363ff0e.jpg already downloaded
2026-01-28 20:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Fef%252F90ef2c860e34ce56299ccae709a84bd7%252Fpa%252FMW66167_a27a2a79eebb4a67f37a814b96b6a4c6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/ef/90ef2c860e34ce56299ccae709a84bd7/pa/MW66167_a27a2a79eebb4a67f37a814b96b6a4c6.jpg already downloaded
2026-01-28 20:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Fef%252F90ef2c860e34ce56299ccae709a84bd7%252Fpa%252FMW66167_51023416090a17a3146cbe58fb9e98e2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/ef/90ef2c860e34ce56299ccae709a84bd7/pa/MW66167_51023416090a17a3146cbe58fb9e98e2.jpg already downloaded
2026-01-28 20:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Fef%252F90ef2c860e34ce56299ccae709a84bd7%252Fpa%252FMW66167_b25c18b81402718aa5e8ac61bcb6d2b8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/ef/90ef2c860e34ce56299ccae709a84bd7/pa/MW66167_b25c18b81402718aa5e8ac61bcb6d2b8.jpg already downloaded
2026-01-28 20:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Fef%252F90ef2c860e34ce56299ccae709a84bd7%252Fpa%252FMW66167_80c52fbb41445a0aff8710dea4e422ed.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/ef/90ef2c860e34ce56299ccae709a84bd7/pa/MW66167_80c52fbb41445a0aff8710dea4e422ed.jpg already downloaded
2026-01-28 20:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Fef%252F90ef2c860e34ce56299ccae709a84bd7%252Fpa%252FMW66167_2ccaa337a5f5b817ec4726f4f50a5a0b.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/ef/90ef2c860e34ce56299ccae709a84bd7/pa/MW66167_2ccaa337a5f5b817ec4726f4f50a5a0b.jpg already downloaded
2026-01-28 20:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Fef%252F90ef2c860e34ce56299ccae709a84bd7%252Fpa%252FMW66167_45fd6f2dadb9e7218c6a9c20089f3730.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/ef/90ef2c860e34ce56299ccae709a84bd7/pa/MW66167_45fd6f2dadb9e7218c6a9c20089f3730.jpg already downloaded
2026-01-28 20:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Fef%252F90ef2c860e34ce56299ccae709a84bd7%252Fpa%252FMW66167_ee4da390bc10b72212d756df3aaa4c81.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/ef/90ef2c860e34ce56299ccae709a84bd7/pa/MW66167_ee4da390bc10b72212d756df3aaa4c81.jpg already downloaded
2026-01-28 20:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Fef%252F90ef2c860e34ce56299ccae709a84bd7%252Fpa%252FMW66167_1d2207bf1ce129d84fcba8367bd1275c.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/ef/90ef2c860e34ce56299ccae709a84bd7/pa/MW66167_1d2207bf1ce129d84fcba8367bd1275c.jpg already downloaded
2026-01-28 20:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Fef%252F90ef2c860e34ce56299ccae709a84bd7%252Fpa%252FMW66167_9edeea36a25c54b50c45d85b170a3487.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/ef/90ef2c860e34ce56299ccae709a84bd7/pa/MW66167_9edeea36a25c54b50c45d85b170a3487.jpg already downloaded
2026-01-28 20:08:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 25d7a0a7-58a0-5ec1-9cd5-95b6e4c99480, identifier: MW66167
2026-01-28 20:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F26%252F7e261531df0ff80082393f2b30ea3444%252Fpa%252FEA99584_fc3ab34000eef94bcf15b4186b6754c6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/26/7e261531df0ff80082393f2b30ea3444/pa/EA99584_fc3ab34000eef94bcf15b4186b6754c6.jpg not downloaded yet
2026-01-28 20:08:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 25d7a0a7-58a0-5ec1-9cd5-95b6e4c99480 with identifier: MW66167
2026-01-28 20:08:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 25d7a0a7-58a0-5ec1-9cd5-95b6e4c99480 with identifier: MW66167
2026-01-28 20:08:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 25d7a0a7-58a0-5ec1-9cd5-95b6e4c99480 with identifier: MW66167 to the API
2026-01-28 20:08:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:08:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:08:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MW66167>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.6L',
 'engine_horse_power': 135,
 'expiration_date': '2026-01-29T16:10:55Z',
 'fuel_type': 'diesel',
 'id': '25d7a0a7-58a0-5ec1-9cd5-95b6e4c99480',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MW66167',
 'listing': 'auction',
 'location': 'IT, Milano',
 'make': 'Opel',
 'model': 'Mokka X',
 'odometer': 141733,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img90/ef/90ef2c860e34ce56299ccae709a84bd7/pa/MW66167_e4581f9fa73a2c9e53cf0994a565b447.jpg',
                'https://img-pa.auto1.com/img90/ef/90ef2c860e34ce56299ccae709a84bd7/pa/MW66167_8c63f983f3a97b9b01f0594dd65eac40.jpg',
                'https://img-pa.auto1.com/img90/ef/90ef2c860e34ce56299ccae709a84bd7/pa/MW66167_48a847f508657cf6b12f314a4635d882.jpg',
                'https://img-pa.auto1.com/img90/ef/90ef2c860e34ce56299ccae709a84bd7/pa/MW66167_c66f10d70ad89ab1b7a96d593b1128bc.jpg',
                'https://img-pa.auto1.com/img90/ef/90ef2c860e34ce56299ccae709a84bd7/pa/MW66167_cd1a8150dfb221c1c9ff29d11f278fa5.jpg',
                'https://img-pa.auto1.com/img90/ef/90ef2c860e34ce56299ccae709a84bd7/pa/MW66167_15440bf37eda10ab9e17fd7c4363ff0e.jpg',
                'https://img-pa.auto1.com/img90/ef/90ef2c860e34ce56299ccae709a84bd7/pa/MW66167_a27a2a79eebb4a67f37a814b96b6a4c6.jpg',
                'https://img-pa.auto1.com/img90/ef/90ef2c860e34ce56299ccae709a84bd7/pa/MW66167_51023416090a17a3146cbe58fb9e98e2.jpg',
                'https://img-pa.auto1.com/img90/ef/90ef2c860e34ce56299ccae709a84bd7/pa/MW66167_b25c18b81402718aa5e8ac61bcb6d2b8.jpg',
                'https://img-pa.auto1.com/img90/ef/90ef2c860e34ce56299ccae709a84bd7/pa/MW66167_80c52fbb41445a0aff8710dea4e422ed.jpg',
                'https://img-pa.auto1.com/img90/ef/90ef2c860e34ce56299ccae709a84bd7/pa/MW66167_2ccaa337a5f5b817ec4726f4f50a5a0b.jpg',
                'https://img-pa.auto1.com/img90/ef/90ef2c860e34ce56299ccae709a84bd7/pa/MW66167_45fd6f2dadb9e7218c6a9c20089f3730.jpg',
                'https://img-pa.auto1.com/img90/ef/90ef2c860e34ce56299ccae709a84bd7/pa/MW66167_ee4da390bc10b72212d756df3aaa4c81.jpg',
                'https://img-pa.auto1.com/img90/ef/90ef2c860e34ce56299ccae709a84bd7/pa/MW66167_1d2207bf1ce129d84fcba8367bd1275c.jpg',
                'https://img-pa.auto1.com/img90/ef/90ef2c860e34ce56299ccae709a84bd7/pa/MW66167_9edeea36a25c54b50c45d85b170a3487.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25d7a0a7-58a0-5ec1-9cd5-95b6e4c99480/25d7a0a7-58a0-5ec1-9cd5-95b6e4c99480_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2329675,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img90/ef/90ef2c860e34ce56299ccae709a84bd7/pa/MW66167_e4581f9fa73a2c9e53cf0994a565b447.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25d7a0a7-58a0-5ec1-9cd5-95b6e4c99480/25d7a0a7-58a0-5ec1-9cd5-95b6e4c99480_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2447934,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img90/ef/90ef2c860e34ce56299ccae709a84bd7/pa/MW66167_8c63f983f3a97b9b01f0594dd65eac40.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25d7a0a7-58a0-5ec1-9cd5-95b6e4c99480/25d7a0a7-58a0-5ec1-9cd5-95b6e4c99480_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2408083,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img90/ef/90ef2c860e34ce56299ccae709a84bd7/pa/MW66167_48a847f508657cf6b12f314a4635d882.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25d7a0a7-58a0-5ec1-9cd5-95b6e4c99480/25d7a0a7-58a0-5ec1-9cd5-95b6e4c99480_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49383,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/ef/90ef2c860e34ce56299ccae709a84bd7/pa/MW66167_c66f10d70ad89ab1b7a96d593b1128bc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25d7a0a7-58a0-5ec1-9cd5-95b6e4c99480/25d7a0a7-58a0-5ec1-9cd5-95b6e4c99480_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2450502,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img90/ef/90ef2c860e34ce56299ccae709a84bd7/pa/MW66167_cd1a8150dfb221c1c9ff29d11f278fa5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25d7a0a7-58a0-5ec1-9cd5-95b6e4c99480/25d7a0a7-58a0-5ec1-9cd5-95b6e4c99480_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56796,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/ef/90ef2c860e34ce56299ccae709a84bd7/pa/MW66167_15440bf37eda10ab9e17fd7c4363ff0e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25d7a0a7-58a0-5ec1-9cd5-95b6e4c99480/25d7a0a7-58a0-5ec1-9cd5-95b6e4c99480_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2319676,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img90/ef/90ef2c860e34ce56299ccae709a84bd7/pa/MW66167_a27a2a79eebb4a67f37a814b96b6a4c6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25d7a0a7-58a0-5ec1-9cd5-95b6e4c99480/25d7a0a7-58a0-5ec1-9cd5-95b6e4c99480_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2402211,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img90/ef/90ef2c860e34ce56299ccae709a84bd7/pa/MW66167_51023416090a17a3146cbe58fb9e98e2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25d7a0a7-58a0-5ec1-9cd5-95b6e4c99480/25d7a0a7-58a0-5ec1-9cd5-95b6e4c99480_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2420314,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img90/ef/90ef2c860e34ce56299ccae709a84bd7/pa/MW66167_b25c18b81402718aa5e8ac61bcb6d2b8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25d7a0a7-58a0-5ec1-9cd5-95b6e4c99480/25d7a0a7-58a0-5ec1-9cd5-95b6e4c99480_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2791366,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img90/ef/90ef2c860e34ce56299ccae709a84bd7/pa/MW66167_80c52fbb41445a0aff8710dea4e422ed.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25d7a0a7-58a0-5ec1-9cd5-95b6e4c99480/25d7a0a7-58a0-5ec1-9cd5-95b6e4c99480_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3065201,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img90/ef/90ef2c860e34ce56299ccae709a84bd7/pa/MW66167_2ccaa337a5f5b817ec4726f4f50a5a0b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25d7a0a7-58a0-5ec1-9cd5-95b6e4c99480/25d7a0a7-58a0-5ec1-9cd5-95b6e4c99480_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60919,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/ef/90ef2c860e34ce56299ccae709a84bd7/pa/MW66167_45fd6f2dadb9e7218c6a9c20089f3730.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25d7a0a7-58a0-5ec1-9cd5-95b6e4c99480/25d7a0a7-58a0-5ec1-9cd5-95b6e4c99480_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64164,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/ef/90ef2c860e34ce56299ccae709a84bd7/pa/MW66167_ee4da390bc10b72212d756df3aaa4c81.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25d7a0a7-58a0-5ec1-9cd5-95b6e4c99480/25d7a0a7-58a0-5ec1-9cd5-95b6e4c99480_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2809798,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img90/ef/90ef2c860e34ce56299ccae709a84bd7/pa/MW66167_1d2207bf1ce129d84fcba8367bd1275c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25d7a0a7-58a0-5ec1-9cd5-95b6e4c99480/25d7a0a7-58a0-5ec1-9cd5-95b6e4c99480_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50249,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/ef/90ef2c860e34ce56299ccae709a84bd7/pa/MW66167_9edeea36a25c54b50c45d85b170a3487.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-03-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Mokka X 1.6 CDTI DPF B-Color',
 'transmission': 'automatic',
 'trim': 'B-Color',
 'year': 2019}
2026-01-28 20:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27MW66167%27 HTTP/1.1" 200 None
2026-01-28 20:08:02 [auto1.it] INFO: Saving data for MW66167: {'created_time': 1769630882.037695, 'last_price_update_time': 1769630882.037706, 'auction_closing_time': 1769703055.0}
2026-01-28 20:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='MW66167') HTTP/1.1" 204 0
2026-01-28 20:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F26%252F7e261531df0ff80082393f2b30ea3444%252Fpa%252FEA99584_0bda43a7206df4cd9da33a092fbdefca.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/26/7e261531df0ff80082393f2b30ea3444/pa/EA99584_0bda43a7206df4cd9da33a092fbdefca.jpg not downloaded yet
2026-01-28 20:08:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0a01e990>
2026-01-28 20:08:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:08:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f425c026-9d6b-597c-a5ae-c40076eae924/f425c026-9d6b-597c-a5ae-c40076eae924_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F21%252F2221ab80cad6a1b68502057ee1474d79%252Fpa%252FVP20298_3d0efe7a7241f31a4e9950b1b0c0a487.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/21/2221ab80cad6a1b68502057ee1474d79/pa/VP20298_3d0efe7a7241f31a4e9950b1b0c0a487.jpg saved to cache
2026-01-28 20:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f425c026-9d6b-597c-a5ae-c40076eae924
2026-01-28 20:08:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f425c026-9d6b-597c-a5ae-c40076eae924, skipping ID generation
2026-01-28 20:08:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f425c026-9d6b-597c-a5ae-c40076eae924 with scrape type 1
2026-01-28 20:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Removing item f425c026-9d6b-597c-a5ae-c40076eae924 from tracking dictionaries
2026-01-28 20:08:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f425c026-9d6b-597c-a5ae-c40076eae924 sending to next pipeline
2026-01-28 20:08:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f425c026-9d6b-597c-a5ae-c40076eae924, identifier: VP20298
2026-01-28 20:08:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8361fd4f-afb9-5e1d-8ce7-f260b44e7520 with identifier: FM26794
2026-01-28 20:08:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8361fd4f-afb9-5e1d-8ce7-f260b44e7520 with scrape type 1
2026-01-28 20:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 8361fd4f-afb9-5e1d-8ce7-f260b44e7520
2026-01-28 20:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F73%252F3f739cbec2b49d01f6c3990e04f16df7%252Fpa%252FFM26794_7060dbb50e8c4e274498b4818afb57bc.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/73/3f739cbec2b49d01f6c3990e04f16df7/pa/FM26794_7060dbb50e8c4e274498b4818afb57bc.jpg not downloaded yet
2026-01-28 20:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F26%252F7e261531df0ff80082393f2b30ea3444%252Fpa%252FEA99584_14c483453733ac3c389dcc7001073182.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/26/7e261531df0ff80082393f2b30ea3444/pa/EA99584_14c483453733ac3c389dcc7001073182.jpg not downloaded yet
2026-01-28 20:08:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f425c026-9d6b-597c-a5ae-c40076eae924 with identifier: VP20298
2026-01-28 20:08:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f425c026-9d6b-597c-a5ae-c40076eae924 with identifier: VP20298
2026-01-28 20:08:02 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 181383 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    181383
2026-01-28 20:08:02 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: f425c026-9d6b-597c-a5ae-c40076eae924 spider: auto1.it
2026-01-28 20:08:02 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.it, Dropping listing: f425c026-9d6b-597c-a5ae-c40076eae924 due to rule: high_mileage_for_country.json, error: 181383 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][5]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    181383
{'auction_title': '',
 'c_o_2_emission_value': 159,
 'category': None,
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:20:28Z',
 'fuel_type': 'diesel',
 'id': 'f425c026-9d6b-597c-a5ae-c40076eae924',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VP20298',
 'listing': 'auction',
 'location': 'IT',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 181383,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f425c026-9d6b-597c-a5ae-c40076eae924/f425c026-9d6b-597c-a5ae-c40076eae924_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 132296,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/21/2221ab80cad6a1b68502057ee1474d79/pa/VP20298_3d0ec905534bc2ce7244ced3c610ca2d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f425c026-9d6b-597c-a5ae-c40076eae924/f425c026-9d6b-597c-a5ae-c40076eae924_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 132296,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/21/2221ab80cad6a1b68502057ee1474d79/pa/VP20298_8c97300552fb01cfb160b77fd965d698.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f425c026-9d6b-597c-a5ae-c40076eae924/f425c026-9d6b-597c-a5ae-c40076eae924_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2008937,
             'Height': 1966,
             'OriginUrl': 'https://img-pa.auto1.com/img22/21/2221ab80cad6a1b68502057ee1474d79/pa/VP20298_cca09da2660656a317c62ff01ab0f8fc.jpg',
             'Width': 2403},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f425c026-9d6b-597c-a5ae-c40076eae924/f425c026-9d6b-597c-a5ae-c40076eae924_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 124551,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/21/2221ab80cad6a1b68502057ee1474d79/pa/VP20298_3d0efe7a7241f31a4e9950b1b0c0a487.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f425c026-9d6b-597c-a5ae-c40076eae924/f425c026-9d6b-597c-a5ae-c40076eae924_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2110536,
             'Height': 1966,
             'OriginUrl': 'https://img-pa.auto1.com/img22/21/2221ab80cad6a1b68502057ee1474d79/pa/VP20298_70eaff2c15aa28c37b8339e32372bfd2.jpg',
             'Width': 2621},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f425c026-9d6b-597c-a5ae-c40076eae924/f425c026-9d6b-597c-a5ae-c40076eae924_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 119173,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/21/2221ab80cad6a1b68502057ee1474d79/pa/VP20298_836ff3502bb178052cc0d45f441d6d63.jpg',
             'Width': 783},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f425c026-9d6b-597c-a5ae-c40076eae924/f425c026-9d6b-597c-a5ae-c40076eae924_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1611638,
             'Height': 1966,
             'OriginUrl': 'https://img-pa.auto1.com/img22/21/2221ab80cad6a1b68502057ee1474d79/pa/VP20298_4302736c0703e6fe123da7a10f122155.jpg',
             'Width': 2451},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f425c026-9d6b-597c-a5ae-c40076eae924/f425c026-9d6b-597c-a5ae-c40076eae924_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97562,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/21/2221ab80cad6a1b68502057ee1474d79/pa/VP20298_266e4eb20ec8a0b989f3062269709553.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f425c026-9d6b-597c-a5ae-c40076eae924/f425c026-9d6b-597c-a5ae-c40076eae924_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103586,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/21/2221ab80cad6a1b68502057ee1474d79/pa/VP20298_44b589f49876ef59bab6fe9ec565b612.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f425c026-9d6b-597c-a5ae-c40076eae924/f425c026-9d6b-597c-a5ae-c40076eae924_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89166,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/21/2221ab80cad6a1b68502057ee1474d79/pa/VP20298_37f209cf365d2cb69a971f0b07d6de24.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f425c026-9d6b-597c-a5ae-c40076eae924/f425c026-9d6b-597c-a5ae-c40076eae924_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84187,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/21/2221ab80cad6a1b68502057ee1474d79/pa/VP20298_9166493548f9c1e443510545447d92c4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f425c026-9d6b-597c-a5ae-c40076eae924/f425c026-9d6b-597c-a5ae-c40076eae924_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61179,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/21/2221ab80cad6a1b68502057ee1474d79/pa/VP20298_f77fc4c4b3bb6db28306c970e5325e7e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f425c026-9d6b-597c-a5ae-c40076eae924/f425c026-9d6b-597c-a5ae-c40076eae924_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69987,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/21/2221ab80cad6a1b68502057ee1474d79/pa/VP20298_d0b9f638062ec36c54cd4d624375d4c4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f425c026-9d6b-597c-a5ae-c40076eae924/f425c026-9d6b-597c-a5ae-c40076eae924_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90175,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/21/2221ab80cad6a1b68502057ee1474d79/pa/VP20298_022f571412fb0f95a35d61e9c20f072c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-11-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Elegance 4Motion',
 'transmission': 'automatic',
 'trim': 'Elegance 4Motion',
 'year': 2023}
2026-01-28 20:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27VP20298%27 HTTP/1.1" 200 None
2026-01-28 20:08:02 [auto1.it] INFO: Saving data for VP20298: {'created_time': 1769630882.807823, 'last_price_update_time': 1769630882.807834, 'auction_closing_time': 1769703628.0}
2026-01-28 20:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='VP20298') HTTP/1.1" 204 0
2026-01-28 20:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F73%252F3f739cbec2b49d01f6c3990e04f16df7%252Fpa%252FFM26794_d00b98674ca34909e2b843aa43d1380f.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/73/3f739cbec2b49d01f6c3990e04f16df7/pa/FM26794_d00b98674ca34909e2b843aa43d1380f.jpg not downloaded yet
2026-01-28 20:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F26%252F7e261531df0ff80082393f2b30ea3444%252Fpa%252FEA99584_01064febec9dcd9ed971aaf937606689.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/26/7e261531df0ff80082393f2b30ea3444/pa/EA99584_01064febec9dcd9ed971aaf937606689.jpg not downloaded yet
2026-01-28 20:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F73%252F3f739cbec2b49d01f6c3990e04f16df7%252Fpa%252FFM26794_55704f1ac81887bf0ec8df8d5928e735.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/73/3f739cbec2b49d01f6c3990e04f16df7/pa/FM26794_55704f1ac81887bf0ec8df8d5928e735.jpg not downloaded yet
2026-01-28 20:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F26%252F7e261531df0ff80082393f2b30ea3444%252Fpa%252FEA99584_0f900476d383b5f0491960c09201e35a.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/26/7e261531df0ff80082393f2b30ea3444/pa/EA99584_0f900476d383b5f0491960c09201e35a.jpg not downloaded yet
2026-01-28 20:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F73%252F3f739cbec2b49d01f6c3990e04f16df7%252Fpa%252FFM26794_2e2a2533ffb8d55280e6e24017278046.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/73/3f739cbec2b49d01f6c3990e04f16df7/pa/FM26794_2e2a2533ffb8d55280e6e24017278046.jpg not downloaded yet
2026-01-28 20:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F26%252F7e261531df0ff80082393f2b30ea3444%252Fpa%252FEA99584_1de5905be8ac700a28c907df0f2808ab.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/26/7e261531df0ff80082393f2b30ea3444/pa/EA99584_1de5905be8ac700a28c907df0f2808ab.jpg not downloaded yet
2026-01-28 20:08:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/73/3f739cbec2b49d01f6c3990e04f16df7/pa/FM26794_7060dbb50e8c4e274498b4818afb57bc.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F73%252F3f739cbec2b49d01f6c3990e04f16df7%252Fpa%252FFM26794_0c8301c06dfe0bdccbf1c8d7dbe2bd19.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/73/3f739cbec2b49d01f6c3990e04f16df7/pa/FM26794_0c8301c06dfe0bdccbf1c8d7dbe2bd19.jpg not downloaded yet
2026-01-28 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F26%252F7e261531df0ff80082393f2b30ea3444%252Fpa%252FEA99584_b489f5f30720683b6554bbfa74a62260.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/26/7e261531df0ff80082393f2b30ea3444/pa/EA99584_b489f5f30720683b6554bbfa74a62260.jpg not downloaded yet
2026-01-28 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F73%252F3f739cbec2b49d01f6c3990e04f16df7%252Fpa%252FFM26794_a8506ee73ec6524b5a329e1b6376480b.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/73/3f739cbec2b49d01f6c3990e04f16df7/pa/FM26794_a8506ee73ec6524b5a329e1b6376480b.jpg not downloaded yet
2026-01-28 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F26%252F7e261531df0ff80082393f2b30ea3444%252Fpa%252FEA99584_e92bcb09cab6108502012e17b796b0a2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/26/7e261531df0ff80082393f2b30ea3444/pa/EA99584_e92bcb09cab6108502012e17b796b0a2.jpg not downloaded yet
2026-01-28 20:08:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/26/7e261531df0ff80082393f2b30ea3444/pa/EA99584_0bda43a7206df4cd9da33a092fbdefca.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F73%252F3f739cbec2b49d01f6c3990e04f16df7%252Fpa%252FFM26794_7e556e3853685bebb971ad8017ac0e8e.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/73/3f739cbec2b49d01f6c3990e04f16df7/pa/FM26794_7e556e3853685bebb971ad8017ac0e8e.jpg not downloaded yet
2026-01-28 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F26%252F7e261531df0ff80082393f2b30ea3444%252Fpa%252FEA99584_f2ef6c7a58f1ca17177bf5d86d2171ac.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/26/7e261531df0ff80082393f2b30ea3444/pa/EA99584_f2ef6c7a58f1ca17177bf5d86d2171ac.jpg not downloaded yet
2026-01-28 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F73%252F3f739cbec2b49d01f6c3990e04f16df7%252Fpa%252FFM26794_13916f1088467f508d2e9f90e8c4188c.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/73/3f739cbec2b49d01f6c3990e04f16df7/pa/FM26794_13916f1088467f508d2e9f90e8c4188c.jpg not downloaded yet
2026-01-28 20:08:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09d0c990>
2026-01-28 20:08:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:08:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8361fd4f-afb9-5e1d-8ce7-f260b44e7520/8361fd4f-afb9-5e1d-8ce7-f260b44e7520_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F73%252F3f739cbec2b49d01f6c3990e04f16df7%252Fpa%252FFM26794_7060dbb50e8c4e274498b4818afb57bc.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/73/3f739cbec2b49d01f6c3990e04f16df7/pa/FM26794_7060dbb50e8c4e274498b4818afb57bc.jpg saved to cache
2026-01-28 20:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8361fd4f-afb9-5e1d-8ce7-f260b44e7520
2026-01-28 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F26%252F7e261531df0ff80082393f2b30ea3444%252Fpa%252FEA99584_1f30f93bd2b6b5841236c707dfd34de5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/26/7e261531df0ff80082393f2b30ea3444/pa/EA99584_1f30f93bd2b6b5841236c707dfd34de5.jpg not downloaded yet
2026-01-28 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F73%252F3f739cbec2b49d01f6c3990e04f16df7%252Fpa%252FFM26794_285e91210de99d5ced967bfaf546f258.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/73/3f739cbec2b49d01f6c3990e04f16df7/pa/FM26794_285e91210de99d5ced967bfaf546f258.jpg not downloaded yet
2026-01-28 20:08:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/37/cd37a1ad3f3c4caf426a4590e0cfac06/pa/AL26589_a3a27eedcdada80464d61e0da7537f9c.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:08:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/73/3f739cbec2b49d01f6c3990e04f16df7/pa/FM26794_d00b98674ca34909e2b843aa43d1380f.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F26%252F7e261531df0ff80082393f2b30ea3444%252Fpa%252FEA99584_bd2534d8e19556e4ba5df40b19c349ff.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/26/7e261531df0ff80082393f2b30ea3444/pa/EA99584_bd2534d8e19556e4ba5df40b19c349ff.jpg not downloaded yet
2026-01-28 20:08:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/37/cd37a1ad3f3c4caf426a4590e0cfac06/pa/AL26589_e1e24d725afe81dc392af7101ebc333e.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F73%252F3f739cbec2b49d01f6c3990e04f16df7%252Fpa%252FFM26794_5419e50c8af4354ccd70043c93e88d02.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/73/3f739cbec2b49d01f6c3990e04f16df7/pa/FM26794_5419e50c8af4354ccd70043c93e88d02.jpg not downloaded yet
2026-01-28 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F26%252F7e261531df0ff80082393f2b30ea3444%252Fpa%252FEA99584_ae39f76d0b3d524801af33db7311743d.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/26/7e261531df0ff80082393f2b30ea3444/pa/EA99584_ae39f76d0b3d524801af33db7311743d.jpg not downloaded yet
2026-01-28 20:08:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08a6d190>
2026-01-28 20:08:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:08:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53a97774-5172-5acd-aade-ebf71722eee2/53a97774-5172-5acd-aade-ebf71722eee2_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F26%252F7e261531df0ff80082393f2b30ea3444%252Fpa%252FEA99584_0bda43a7206df4cd9da33a092fbdefca.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/26/7e261531df0ff80082393f2b30ea3444/pa/EA99584_0bda43a7206df4cd9da33a092fbdefca.jpg saved to cache
2026-01-28 20:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 53a97774-5172-5acd-aade-ebf71722eee2
2026-01-28 20:08:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/73/3f739cbec2b49d01f6c3990e04f16df7/pa/FM26794_55704f1ac81887bf0ec8df8d5928e735.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F73%252F3f739cbec2b49d01f6c3990e04f16df7%252Fpa%252FFM26794_faf6544240f06ce262675ba6e840da02.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/73/3f739cbec2b49d01f6c3990e04f16df7/pa/FM26794_faf6544240f06ce262675ba6e840da02.jpg not downloaded yet
2026-01-28 20:08:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/73/3f739cbec2b49d01f6c3990e04f16df7/pa/FM26794_2e2a2533ffb8d55280e6e24017278046.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F26%252F7e261531df0ff80082393f2b30ea3444%252Fpa%252FEA99584_d8471861d4cabaaf1849b757ab0d6ede.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/26/7e261531df0ff80082393f2b30ea3444/pa/EA99584_d8471861d4cabaaf1849b757ab0d6ede.jpg not downloaded yet
2026-01-28 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F73%252F3f739cbec2b49d01f6c3990e04f16df7%252Fpa%252FFM26794_50e8f0b58ccc6ce700c0355d3b0743cb.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/73/3f739cbec2b49d01f6c3990e04f16df7/pa/FM26794_50e8f0b58ccc6ce700c0355d3b0743cb.jpg not downloaded yet
2026-01-28 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F73%252F3f739cbec2b49d01f6c3990e04f16df7%252Fpa%252FFM26794_f679ae802797dca176199fe0b8785db7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/73/3f739cbec2b49d01f6c3990e04f16df7/pa/FM26794_f679ae802797dca176199fe0b8785db7.jpg not downloaded yet
2026-01-28 20:08:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:08:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0a07d690>
2026-01-28 20:08:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:08:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a752d5cb-7aca-5619-8cb1-a9705f3c00dd/a752d5cb-7aca-5619-8cb1-a9705f3c00dd_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F37%252Fcd37a1ad3f3c4caf426a4590e0cfac06%252Fpa%252FAL26589_a3a27eedcdada80464d61e0da7537f9c.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/37/cd37a1ad3f3c4caf426a4590e0cfac06/pa/AL26589_a3a27eedcdada80464d61e0da7537f9c.jpg saved to cache
2026-01-28 20:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item a752d5cb-7aca-5619-8cb1-a9705f3c00dd
2026-01-28 20:08:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08cd5f90>
2026-01-28 20:08:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8361fd4f-afb9-5e1d-8ce7-f260b44e7520/8361fd4f-afb9-5e1d-8ce7-f260b44e7520_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F73%252F3f739cbec2b49d01f6c3990e04f16df7%252Fpa%252FFM26794_d00b98674ca34909e2b843aa43d1380f.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/73/3f739cbec2b49d01f6c3990e04f16df7/pa/FM26794_d00b98674ca34909e2b843aa43d1380f.jpg saved to cache
2026-01-28 20:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8361fd4f-afb9-5e1d-8ce7-f260b44e7520
2026-01-28 20:08:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:08:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b086e6a10>
2026-01-28 20:08:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a752d5cb-7aca-5619-8cb1-a9705f3c00dd/a752d5cb-7aca-5619-8cb1-a9705f3c00dd_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252F37%252Fcd37a1ad3f3c4caf426a4590e0cfac06%252Fpa%252FAL26589_e1e24d725afe81dc392af7101ebc333e.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/37/cd37a1ad3f3c4caf426a4590e0cfac06/pa/AL26589_e1e24d725afe81dc392af7101ebc333e.jpg saved to cache
2026-01-28 20:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item a752d5cb-7aca-5619-8cb1-a9705f3c00dd
2026-01-28 20:08:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a752d5cb-7aca-5619-8cb1-a9705f3c00dd, skipping ID generation
2026-01-28 20:08:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a752d5cb-7aca-5619-8cb1-a9705f3c00dd with scrape type 1
2026-01-28 20:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Removing item a752d5cb-7aca-5619-8cb1-a9705f3c00dd from tracking dictionaries
2026-01-28 20:08:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a752d5cb-7aca-5619-8cb1-a9705f3c00dd sending to next pipeline
2026-01-28 20:08:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a752d5cb-7aca-5619-8cb1-a9705f3c00dd, identifier: AL26589
2026-01-28 20:08:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a752d5cb-7aca-5619-8cb1-a9705f3c00dd with identifier: AL26589
2026-01-28 20:08:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a752d5cb-7aca-5619-8cb1-a9705f3c00dd with identifier: AL26589
2026-01-28 20:08:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a752d5cb-7aca-5619-8cb1-a9705f3c00dd with identifier: AL26589 to the API
2026-01-28 20:08:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:08:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:08:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgcd/37/cd37a1ad3f3c4caf426a4590e0cfac06/pa/AL26589_e1e24d725afe81dc392af7101ebc333e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 108,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.5L',
 'engine_horse_power': 130,
 'expiration_date': '2026-01-29T16:18:22Z',
 'fuel_type': 'diesel',
 'id': 'a752d5cb-7aca-5619-8cb1-a9705f3c00dd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AL26589',
 'listing': 'auction',
 'location': 'IT, Milano',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 102917,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a752d5cb-7aca-5619-8cb1-a9705f3c00dd/a752d5cb-7aca-5619-8cb1-a9705f3c00dd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64435,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/37/cd37a1ad3f3c4caf426a4590e0cfac06/pa/AL26589_525dfaba25b83d2bd4e729eda51af226.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a752d5cb-7aca-5619-8cb1-a9705f3c00dd/a752d5cb-7aca-5619-8cb1-a9705f3c00dd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59680,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/37/cd37a1ad3f3c4caf426a4590e0cfac06/pa/AL26589_5a9ffdeec660a24455b273085d4b5f8f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a752d5cb-7aca-5619-8cb1-a9705f3c00dd/a752d5cb-7aca-5619-8cb1-a9705f3c00dd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64472,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/37/cd37a1ad3f3c4caf426a4590e0cfac06/pa/AL26589_e8e9267a44e3df9c9d2355cdb485c94e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a752d5cb-7aca-5619-8cb1-a9705f3c00dd/a752d5cb-7aca-5619-8cb1-a9705f3c00dd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2269127,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/37/cd37a1ad3f3c4caf426a4590e0cfac06/pa/AL26589_5dadcc41154365c2bdbce79831b03994.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a752d5cb-7aca-5619-8cb1-a9705f3c00dd/a752d5cb-7aca-5619-8cb1-a9705f3c00dd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2451606,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/37/cd37a1ad3f3c4caf426a4590e0cfac06/pa/AL26589_5578a4f8e1969064e44a8232d3f05659.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a752d5cb-7aca-5619-8cb1-a9705f3c00dd/a752d5cb-7aca-5619-8cb1-a9705f3c00dd_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2444998,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/37/cd37a1ad3f3c4caf426a4590e0cfac06/pa/AL26589_200503488b3083741263f65f1d6b43fc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a752d5cb-7aca-5619-8cb1-a9705f3c00dd/a752d5cb-7aca-5619-8cb1-a9705f3c00dd_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2289717,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/37/cd37a1ad3f3c4caf426a4590e0cfac06/pa/AL26589_c36d6071b23b817c7af0f01dba0bcad5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a752d5cb-7aca-5619-8cb1-a9705f3c00dd/a752d5cb-7aca-5619-8cb1-a9705f3c00dd_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2324573,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/37/cd37a1ad3f3c4caf426a4590e0cfac06/pa/AL26589_72f7fc883760409e73e9633b9f2cd2ea.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a752d5cb-7aca-5619-8cb1-a9705f3c00dd/a752d5cb-7aca-5619-8cb1-a9705f3c00dd_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2471906,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/37/cd37a1ad3f3c4caf426a4590e0cfac06/pa/AL26589_a0977c7a02584cc34c18b9086684918d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a752d5cb-7aca-5619-8cb1-a9705f3c00dd/a752d5cb-7aca-5619-8cb1-a9705f3c00dd_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55903,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/37/cd37a1ad3f3c4caf426a4590e0cfac06/pa/AL26589_742a9e08a3e29f45cfcbcaad7aa163dc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a752d5cb-7aca-5619-8cb1-a9705f3c00dd/a752d5cb-7aca-5619-8cb1-a9705f3c00dd_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2537326,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/37/cd37a1ad3f3c4caf426a4590e0cfac06/pa/AL26589_e1e24d725afe81dc392af7101ebc333e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a752d5cb-7aca-5619-8cb1-a9705f3c00dd/a752d5cb-7aca-5619-8cb1-a9705f3c00dd_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64861,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/37/cd37a1ad3f3c4caf426a4590e0cfac06/pa/AL26589_c1983e2c43951069069b916ce09696db.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a752d5cb-7aca-5619-8cb1-a9705f3c00dd/a752d5cb-7aca-5619-8cb1-a9705f3c00dd_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56546,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/37/cd37a1ad3f3c4caf426a4590e0cfac06/pa/AL26589_494a20e32d8a9f2c584616ac38a74a81.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a752d5cb-7aca-5619-8cb1-a9705f3c00dd/a752d5cb-7aca-5619-8cb1-a9705f3c00dd_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2561417,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/37/cd37a1ad3f3c4caf426a4590e0cfac06/pa/AL26589_a3a27eedcdada80464d61e0da7537f9c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a752d5cb-7aca-5619-8cb1-a9705f3c00dd/a752d5cb-7aca-5619-8cb1-a9705f3c00dd_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85300,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/37/cd37a1ad3f3c4caf426a4590e0cfac06/pa/AL26589_34088ba2739b424a94b984c2853013cd.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-11-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.5 Blue-HDi GT Line',
 'transmission': 'automatic',
 'trim': 'GT Line',
 'year': 2018}
2026-01-28 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27AL26589%27 HTTP/1.1" 200 None
2026-01-28 20:08:05 [auto1.it] INFO: Saving data for AL26589: {'created_time': 1769630885.271211, 'last_price_update_time': 1769630885.271223, 'auction_closing_time': 1769703502.0}
2026-01-28 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='AL26589') HTTP/1.1" 204 0
2026-01-28 20:08:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/73/3f739cbec2b49d01f6c3990e04f16df7/pa/FM26794_0c8301c06dfe0bdccbf1c8d7dbe2bd19.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F73%252F3f739cbec2b49d01f6c3990e04f16df7%252Fpa%252FFM26794_a80ed22d828ec3206b27f8ad9c75ffd5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/73/3f739cbec2b49d01f6c3990e04f16df7/pa/FM26794_a80ed22d828ec3206b27f8ad9c75ffd5.jpg not downloaded yet
2026-01-28 20:08:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/26/7e261531df0ff80082393f2b30ea3444/pa/EA99584_1de5905be8ac700a28c907df0f2808ab.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F73%252F3f739cbec2b49d01f6c3990e04f16df7%252Fpa%252FFM26794_7f27b3ed70a464ea499c50b6f37c3042.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/73/3f739cbec2b49d01f6c3990e04f16df7/pa/FM26794_7f27b3ed70a464ea499c50b6f37c3042.jpg not downloaded yet
2026-01-28 20:08:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09e3c990>
2026-01-28 20:08:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:08:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8361fd4f-afb9-5e1d-8ce7-f260b44e7520/8361fd4f-afb9-5e1d-8ce7-f260b44e7520_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F73%252F3f739cbec2b49d01f6c3990e04f16df7%252Fpa%252FFM26794_55704f1ac81887bf0ec8df8d5928e735.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/73/3f739cbec2b49d01f6c3990e04f16df7/pa/FM26794_55704f1ac81887bf0ec8df8d5928e735.jpg saved to cache
2026-01-28 20:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8361fd4f-afb9-5e1d-8ce7-f260b44e7520
2026-01-28 20:08:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b087164d0>
2026-01-28 20:08:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:08:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8361fd4f-afb9-5e1d-8ce7-f260b44e7520/8361fd4f-afb9-5e1d-8ce7-f260b44e7520_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F73%252F3f739cbec2b49d01f6c3990e04f16df7%252Fpa%252FFM26794_2e2a2533ffb8d55280e6e24017278046.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/73/3f739cbec2b49d01f6c3990e04f16df7/pa/FM26794_2e2a2533ffb8d55280e6e24017278046.jpg saved to cache
2026-01-28 20:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8361fd4f-afb9-5e1d-8ce7-f260b44e7520
2026-01-28 20:08:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/73/3f739cbec2b49d01f6c3990e04f16df7/pa/FM26794_a8506ee73ec6524b5a329e1b6376480b.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:08:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/26/7e261531df0ff80082393f2b30ea3444/pa/EA99584_b489f5f30720683b6554bbfa74a62260.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:08:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b086e9850>
2026-01-28 20:08:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:08:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8361fd4f-afb9-5e1d-8ce7-f260b44e7520/8361fd4f-afb9-5e1d-8ce7-f260b44e7520_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F73%252F3f739cbec2b49d01f6c3990e04f16df7%252Fpa%252FFM26794_0c8301c06dfe0bdccbf1c8d7dbe2bd19.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/73/3f739cbec2b49d01f6c3990e04f16df7/pa/FM26794_0c8301c06dfe0bdccbf1c8d7dbe2bd19.jpg saved to cache
2026-01-28 20:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8361fd4f-afb9-5e1d-8ce7-f260b44e7520
2026-01-28 20:08:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09e4b390>
2026-01-28 20:08:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53a97774-5172-5acd-aade-ebf71722eee2/53a97774-5172-5acd-aade-ebf71722eee2_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F26%252F7e261531df0ff80082393f2b30ea3444%252Fpa%252FEA99584_1de5905be8ac700a28c907df0f2808ab.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/26/7e261531df0ff80082393f2b30ea3444/pa/EA99584_1de5905be8ac700a28c907df0f2808ab.jpg saved to cache
2026-01-28 20:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 53a97774-5172-5acd-aade-ebf71722eee2
2026-01-28 20:08:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08bc5590>
2026-01-28 20:08:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8361fd4f-afb9-5e1d-8ce7-f260b44e7520/8361fd4f-afb9-5e1d-8ce7-f260b44e7520_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F73%252F3f739cbec2b49d01f6c3990e04f16df7%252Fpa%252FFM26794_a8506ee73ec6524b5a329e1b6376480b.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/73/3f739cbec2b49d01f6c3990e04f16df7/pa/FM26794_a8506ee73ec6524b5a329e1b6376480b.jpg saved to cache
2026-01-28 20:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8361fd4f-afb9-5e1d-8ce7-f260b44e7520
2026-01-28 20:08:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08b89510>
2026-01-28 20:08:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53a97774-5172-5acd-aade-ebf71722eee2/53a97774-5172-5acd-aade-ebf71722eee2_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F26%252F7e261531df0ff80082393f2b30ea3444%252Fpa%252FEA99584_b489f5f30720683b6554bbfa74a62260.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/26/7e261531df0ff80082393f2b30ea3444/pa/EA99584_b489f5f30720683b6554bbfa74a62260.jpg saved to cache
2026-01-28 20:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 53a97774-5172-5acd-aade-ebf71722eee2
2026-01-28 20:08:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/26/7e261531df0ff80082393f2b30ea3444/pa/EA99584_1f30f93bd2b6b5841236c707dfd34de5.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:08:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/73/3f739cbec2b49d01f6c3990e04f16df7/pa/FM26794_7e556e3853685bebb971ad8017ac0e8e.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:08:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/26/7e261531df0ff80082393f2b30ea3444/pa/EA99584_0c85c8c36872546f4fe096a13eb2f938.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:08:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/26/7e261531df0ff80082393f2b30ea3444/pa/EA99584_171ac7d0def0271696017a4424e50320.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:08:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/26/7e261531df0ff80082393f2b30ea3444/pa/EA99584_fc3ab34000eef94bcf15b4186b6754c6.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:08:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/26/7e261531df0ff80082393f2b30ea3444/pa/EA99584_14c483453733ac3c389dcc7001073182.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:08:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/26/7e261531df0ff80082393f2b30ea3444/pa/EA99584_01064febec9dcd9ed971aaf937606689.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:08:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/26/7e261531df0ff80082393f2b30ea3444/pa/EA99584_0f900476d383b5f0491960c09201e35a.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:08:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/26/7e261531df0ff80082393f2b30ea3444/pa/EA99584_d8471861d4cabaaf1849b757ab0d6ede.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:08:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/73/3f739cbec2b49d01f6c3990e04f16df7/pa/FM26794_f679ae802797dca176199fe0b8785db7.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:08:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09e4fd90>
2026-01-28 20:08:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53a97774-5172-5acd-aade-ebf71722eee2/53a97774-5172-5acd-aade-ebf71722eee2_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F26%252F7e261531df0ff80082393f2b30ea3444%252Fpa%252FEA99584_1f30f93bd2b6b5841236c707dfd34de5.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/26/7e261531df0ff80082393f2b30ea3444/pa/EA99584_1f30f93bd2b6b5841236c707dfd34de5.jpg saved to cache
2026-01-28 20:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 53a97774-5172-5acd-aade-ebf71722eee2
2026-01-28 20:08:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/73/3f739cbec2b49d01f6c3990e04f16df7/pa/FM26794_7f27b3ed70a464ea499c50b6f37c3042.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:08:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/26/7e261531df0ff80082393f2b30ea3444/pa/EA99584_bd2534d8e19556e4ba5df40b19c349ff.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:08:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/73/3f739cbec2b49d01f6c3990e04f16df7/pa/FM26794_13916f1088467f508d2e9f90e8c4188c.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:08:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09d93bd0>
2026-01-28 20:08:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:08:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8361fd4f-afb9-5e1d-8ce7-f260b44e7520/8361fd4f-afb9-5e1d-8ce7-f260b44e7520_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F73%252F3f739cbec2b49d01f6c3990e04f16df7%252Fpa%252FFM26794_7e556e3853685bebb971ad8017ac0e8e.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/73/3f739cbec2b49d01f6c3990e04f16df7/pa/FM26794_7e556e3853685bebb971ad8017ac0e8e.jpg saved to cache
2026-01-28 20:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8361fd4f-afb9-5e1d-8ce7-f260b44e7520
2026-01-28 20:08:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:08:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08a19190>
2026-01-28 20:08:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53a97774-5172-5acd-aade-ebf71722eee2/53a97774-5172-5acd-aade-ebf71722eee2_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F26%252F7e261531df0ff80082393f2b30ea3444%252Fpa%252FEA99584_0c85c8c36872546f4fe096a13eb2f938.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/26/7e261531df0ff80082393f2b30ea3444/pa/EA99584_0c85c8c36872546f4fe096a13eb2f938.jpg saved to cache
2026-01-28 20:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 53a97774-5172-5acd-aade-ebf71722eee2
2026-01-28 20:08:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:08:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0a03ae50>
2026-01-28 20:08:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:08:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53a97774-5172-5acd-aade-ebf71722eee2/53a97774-5172-5acd-aade-ebf71722eee2_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F26%252F7e261531df0ff80082393f2b30ea3444%252Fpa%252FEA99584_171ac7d0def0271696017a4424e50320.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/26/7e261531df0ff80082393f2b30ea3444/pa/EA99584_171ac7d0def0271696017a4424e50320.jpg saved to cache
2026-01-28 20:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 53a97774-5172-5acd-aade-ebf71722eee2
2026-01-28 20:08:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:08:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b088f77d0>
2026-01-28 20:08:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53a97774-5172-5acd-aade-ebf71722eee2/53a97774-5172-5acd-aade-ebf71722eee2_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F26%252F7e261531df0ff80082393f2b30ea3444%252Fpa%252FEA99584_fc3ab34000eef94bcf15b4186b6754c6.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/26/7e261531df0ff80082393f2b30ea3444/pa/EA99584_fc3ab34000eef94bcf15b4186b6754c6.jpg saved to cache
2026-01-28 20:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 53a97774-5172-5acd-aade-ebf71722eee2
2026-01-28 20:08:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:08:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09d90e50>
2026-01-28 20:08:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53a97774-5172-5acd-aade-ebf71722eee2/53a97774-5172-5acd-aade-ebf71722eee2_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F26%252F7e261531df0ff80082393f2b30ea3444%252Fpa%252FEA99584_14c483453733ac3c389dcc7001073182.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/26/7e261531df0ff80082393f2b30ea3444/pa/EA99584_14c483453733ac3c389dcc7001073182.jpg saved to cache
2026-01-28 20:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 53a97774-5172-5acd-aade-ebf71722eee2
2026-01-28 20:08:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:08:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b0a038c10>
2026-01-28 20:08:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53a97774-5172-5acd-aade-ebf71722eee2/53a97774-5172-5acd-aade-ebf71722eee2_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F26%252F7e261531df0ff80082393f2b30ea3444%252Fpa%252FEA99584_01064febec9dcd9ed971aaf937606689.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/26/7e261531df0ff80082393f2b30ea3444/pa/EA99584_01064febec9dcd9ed971aaf937606689.jpg saved to cache
2026-01-28 20:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 53a97774-5172-5acd-aade-ebf71722eee2
2026-01-28 20:08:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:08:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09d45b50>
2026-01-28 20:08:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:08:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53a97774-5172-5acd-aade-ebf71722eee2/53a97774-5172-5acd-aade-ebf71722eee2_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F26%252F7e261531df0ff80082393f2b30ea3444%252Fpa%252FEA99584_0f900476d383b5f0491960c09201e35a.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/26/7e261531df0ff80082393f2b30ea3444/pa/EA99584_0f900476d383b5f0491960c09201e35a.jpg saved to cache
2026-01-28 20:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 53a97774-5172-5acd-aade-ebf71722eee2
2026-01-28 20:08:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08a1dbd0>
2026-01-28 20:08:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:08:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53a97774-5172-5acd-aade-ebf71722eee2/53a97774-5172-5acd-aade-ebf71722eee2_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F26%252F7e261531df0ff80082393f2b30ea3444%252Fpa%252FEA99584_d8471861d4cabaaf1849b757ab0d6ede.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/26/7e261531df0ff80082393f2b30ea3444/pa/EA99584_d8471861d4cabaaf1849b757ab0d6ede.jpg saved to cache
2026-01-28 20:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 53a97774-5172-5acd-aade-ebf71722eee2
2026-01-28 20:08:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b088f7cd0>
2026-01-28 20:08:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:08:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8361fd4f-afb9-5e1d-8ce7-f260b44e7520/8361fd4f-afb9-5e1d-8ce7-f260b44e7520_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F73%252F3f739cbec2b49d01f6c3990e04f16df7%252Fpa%252FFM26794_f679ae802797dca176199fe0b8785db7.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/73/3f739cbec2b49d01f6c3990e04f16df7/pa/FM26794_f679ae802797dca176199fe0b8785db7.jpg saved to cache
2026-01-28 20:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 8361fd4f-afb9-5e1d-8ce7-f260b44e7520
2026-01-28 20:08:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08cf6790>
2026-01-28 20:08:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:08:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8361fd4f-afb9-5e1d-8ce7-f260b44e7520/8361fd4f-afb9-5e1d-8ce7-f260b44e7520_image_14.jpg HTTP/1.1" 201 0
2026-01-28 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F73%252F3f739cbec2b49d01f6c3990e04f16df7%252Fpa%252FFM26794_7f27b3ed70a464ea499c50b6f37c3042.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/73/3f739cbec2b49d01f6c3990e04f16df7/pa/FM26794_7f27b3ed70a464ea499c50b6f37c3042.jpg saved to cache
2026-01-28 20:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 8361fd4f-afb9-5e1d-8ce7-f260b44e7520
2026-01-28 20:08:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08bde6d0>
2026-01-28 20:08:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:08:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53a97774-5172-5acd-aade-ebf71722eee2/53a97774-5172-5acd-aade-ebf71722eee2_image_12.jpg HTTP/1.1" 201 0
2026-01-28 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F26%252F7e261531df0ff80082393f2b30ea3444%252Fpa%252FEA99584_bd2534d8e19556e4ba5df40b19c349ff.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/26/7e261531df0ff80082393f2b30ea3444/pa/EA99584_bd2534d8e19556e4ba5df40b19c349ff.jpg saved to cache
2026-01-28 20:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 53a97774-5172-5acd-aade-ebf71722eee2
2026-01-28 20:08:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08bdd550>
2026-01-28 20:08:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8361fd4f-afb9-5e1d-8ce7-f260b44e7520/8361fd4f-afb9-5e1d-8ce7-f260b44e7520_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F73%252F3f739cbec2b49d01f6c3990e04f16df7%252Fpa%252FFM26794_13916f1088467f508d2e9f90e8c4188c.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/73/3f739cbec2b49d01f6c3990e04f16df7/pa/FM26794_13916f1088467f508d2e9f90e8c4188c.jpg saved to cache
2026-01-28 20:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8361fd4f-afb9-5e1d-8ce7-f260b44e7520
2026-01-28 20:08:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/73/3f739cbec2b49d01f6c3990e04f16df7/pa/FM26794_a80ed22d828ec3206b27f8ad9c75ffd5.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:08:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/73/3f739cbec2b49d01f6c3990e04f16df7/pa/FM26794_50e8f0b58ccc6ce700c0355d3b0743cb.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:08:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/73/3f739cbec2b49d01f6c3990e04f16df7/pa/FM26794_5419e50c8af4354ccd70043c93e88d02.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:08:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/26/7e261531df0ff80082393f2b30ea3444/pa/EA99584_ae39f76d0b3d524801af33db7311743d.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:08:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/73/3f739cbec2b49d01f6c3990e04f16df7/pa/FM26794_faf6544240f06ce262675ba6e840da02.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:08:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:08:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09e245d0>
2026-01-28 20:08:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:08:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8361fd4f-afb9-5e1d-8ce7-f260b44e7520/8361fd4f-afb9-5e1d-8ce7-f260b44e7520_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F73%252F3f739cbec2b49d01f6c3990e04f16df7%252Fpa%252FFM26794_a80ed22d828ec3206b27f8ad9c75ffd5.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/73/3f739cbec2b49d01f6c3990e04f16df7/pa/FM26794_a80ed22d828ec3206b27f8ad9c75ffd5.jpg saved to cache
2026-01-28 20:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 8361fd4f-afb9-5e1d-8ce7-f260b44e7520
2026-01-28 20:08:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/26/7e261531df0ff80082393f2b30ea3444/pa/EA99584_f2ef6c7a58f1ca17177bf5d86d2171ac.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:08:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7e/26/7e261531df0ff80082393f2b30ea3444/pa/EA99584_e92bcb09cab6108502012e17b796b0a2.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:08:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:08:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09f46d10>
2026-01-28 20:08:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8361fd4f-afb9-5e1d-8ce7-f260b44e7520/8361fd4f-afb9-5e1d-8ce7-f260b44e7520_image_11.jpg HTTP/1.1" 201 0
2026-01-28 20:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F73%252F3f739cbec2b49d01f6c3990e04f16df7%252Fpa%252FFM26794_50e8f0b58ccc6ce700c0355d3b0743cb.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/73/3f739cbec2b49d01f6c3990e04f16df7/pa/FM26794_50e8f0b58ccc6ce700c0355d3b0743cb.jpg saved to cache
2026-01-28 20:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 8361fd4f-afb9-5e1d-8ce7-f260b44e7520
2026-01-28 20:08:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:08:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08bf4510>
2026-01-28 20:08:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:08:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8361fd4f-afb9-5e1d-8ce7-f260b44e7520/8361fd4f-afb9-5e1d-8ce7-f260b44e7520_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F73%252F3f739cbec2b49d01f6c3990e04f16df7%252Fpa%252FFM26794_5419e50c8af4354ccd70043c93e88d02.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/73/3f739cbec2b49d01f6c3990e04f16df7/pa/FM26794_5419e50c8af4354ccd70043c93e88d02.jpg saved to cache
2026-01-28 20:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8361fd4f-afb9-5e1d-8ce7-f260b44e7520
2026-01-28 20:08:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:08:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08aaef90>
2026-01-28 20:08:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:08:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53a97774-5172-5acd-aade-ebf71722eee2/53a97774-5172-5acd-aade-ebf71722eee2_image_13.jpg HTTP/1.1" 201 0
2026-01-28 20:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F26%252F7e261531df0ff80082393f2b30ea3444%252Fpa%252FEA99584_ae39f76d0b3d524801af33db7311743d.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/26/7e261531df0ff80082393f2b30ea3444/pa/EA99584_ae39f76d0b3d524801af33db7311743d.jpg saved to cache
2026-01-28 20:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 53a97774-5172-5acd-aade-ebf71722eee2
2026-01-28 20:08:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:08:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09f23350>
2026-01-28 20:08:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8361fd4f-afb9-5e1d-8ce7-f260b44e7520/8361fd4f-afb9-5e1d-8ce7-f260b44e7520_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F73%252F3f739cbec2b49d01f6c3990e04f16df7%252Fpa%252FFM26794_faf6544240f06ce262675ba6e840da02.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/73/3f739cbec2b49d01f6c3990e04f16df7/pa/FM26794_faf6544240f06ce262675ba6e840da02.jpg saved to cache
2026-01-28 20:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 8361fd4f-afb9-5e1d-8ce7-f260b44e7520
2026-01-28 20:08:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09d78490>
2026-01-28 20:08:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:08:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53a97774-5172-5acd-aade-ebf71722eee2/53a97774-5172-5acd-aade-ebf71722eee2_image_10.jpg HTTP/1.1" 201 0
2026-01-28 20:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F26%252F7e261531df0ff80082393f2b30ea3444%252Fpa%252FEA99584_f2ef6c7a58f1ca17177bf5d86d2171ac.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/26/7e261531df0ff80082393f2b30ea3444/pa/EA99584_f2ef6c7a58f1ca17177bf5d86d2171ac.jpg saved to cache
2026-01-28 20:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 53a97774-5172-5acd-aade-ebf71722eee2
2026-01-28 20:08:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b09e186d0>
2026-01-28 20:08:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:08:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53a97774-5172-5acd-aade-ebf71722eee2/53a97774-5172-5acd-aade-ebf71722eee2_image_9.jpg HTTP/1.1" 201 0
2026-01-28 20:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F26%252F7e261531df0ff80082393f2b30ea3444%252Fpa%252FEA99584_e92bcb09cab6108502012e17b796b0a2.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/26/7e261531df0ff80082393f2b30ea3444/pa/EA99584_e92bcb09cab6108502012e17b796b0a2.jpg saved to cache
2026-01-28 20:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 53a97774-5172-5acd-aade-ebf71722eee2
2026-01-28 20:08:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 53a97774-5172-5acd-aade-ebf71722eee2, skipping ID generation
2026-01-28 20:08:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53a97774-5172-5acd-aade-ebf71722eee2 with scrape type 1
2026-01-28 20:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 53a97774-5172-5acd-aade-ebf71722eee2 from tracking dictionaries
2026-01-28 20:08:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 53a97774-5172-5acd-aade-ebf71722eee2 sending to next pipeline
2026-01-28 20:08:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 53a97774-5172-5acd-aade-ebf71722eee2, identifier: EA99584
2026-01-28 20:08:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 53a97774-5172-5acd-aade-ebf71722eee2 with identifier: EA99584
2026-01-28 20:08:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 53a97774-5172-5acd-aade-ebf71722eee2 with identifier: EA99584
2026-01-28 20:08:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 53a97774-5172-5acd-aade-ebf71722eee2 with identifier: EA99584 to the API
2026-01-28 20:08:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:08:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:08:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img7e/26/7e261531df0ff80082393f2b30ea3444/pa/EA99584_e92bcb09cab6108502012e17b796b0a2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.0L',
 'engine_horse_power': 101,
 'expiration_date': '2026-01-29T16:50:57Z',
 'fuel_type': 'gas',
 'id': '53a97774-5172-5acd-aade-ebf71722eee2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EA99584',
 'listing': 'auction',
 'location': 'IT, Agliana (PT)',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 78136,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53a97774-5172-5acd-aade-ebf71722eee2/53a97774-5172-5acd-aade-ebf71722eee2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2714651,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/26/7e261531df0ff80082393f2b30ea3444/pa/EA99584_171ac7d0def0271696017a4424e50320.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53a97774-5172-5acd-aade-ebf71722eee2/53a97774-5172-5acd-aade-ebf71722eee2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2622909,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/26/7e261531df0ff80082393f2b30ea3444/pa/EA99584_0c85c8c36872546f4fe096a13eb2f938.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53a97774-5172-5acd-aade-ebf71722eee2/53a97774-5172-5acd-aade-ebf71722eee2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2600719,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/26/7e261531df0ff80082393f2b30ea3444/pa/EA99584_fc3ab34000eef94bcf15b4186b6754c6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53a97774-5172-5acd-aade-ebf71722eee2/53a97774-5172-5acd-aade-ebf71722eee2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55563,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/26/7e261531df0ff80082393f2b30ea3444/pa/EA99584_0bda43a7206df4cd9da33a092fbdefca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53a97774-5172-5acd-aade-ebf71722eee2/53a97774-5172-5acd-aade-ebf71722eee2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2626117,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/26/7e261531df0ff80082393f2b30ea3444/pa/EA99584_14c483453733ac3c389dcc7001073182.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53a97774-5172-5acd-aade-ebf71722eee2/53a97774-5172-5acd-aade-ebf71722eee2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2589268,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/26/7e261531df0ff80082393f2b30ea3444/pa/EA99584_01064febec9dcd9ed971aaf937606689.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53a97774-5172-5acd-aade-ebf71722eee2/53a97774-5172-5acd-aade-ebf71722eee2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2536302,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/26/7e261531df0ff80082393f2b30ea3444/pa/EA99584_0f900476d383b5f0491960c09201e35a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53a97774-5172-5acd-aade-ebf71722eee2/53a97774-5172-5acd-aade-ebf71722eee2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73496,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/26/7e261531df0ff80082393f2b30ea3444/pa/EA99584_1de5905be8ac700a28c907df0f2808ab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53a97774-5172-5acd-aade-ebf71722eee2/53a97774-5172-5acd-aade-ebf71722eee2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71172,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/26/7e261531df0ff80082393f2b30ea3444/pa/EA99584_b489f5f30720683b6554bbfa74a62260.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53a97774-5172-5acd-aade-ebf71722eee2/53a97774-5172-5acd-aade-ebf71722eee2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65113,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/26/7e261531df0ff80082393f2b30ea3444/pa/EA99584_e92bcb09cab6108502012e17b796b0a2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53a97774-5172-5acd-aade-ebf71722eee2/53a97774-5172-5acd-aade-ebf71722eee2_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64524,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/26/7e261531df0ff80082393f2b30ea3444/pa/EA99584_f2ef6c7a58f1ca17177bf5d86d2171ac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53a97774-5172-5acd-aade-ebf71722eee2/53a97774-5172-5acd-aade-ebf71722eee2_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68205,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/26/7e261531df0ff80082393f2b30ea3444/pa/EA99584_1f30f93bd2b6b5841236c707dfd34de5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53a97774-5172-5acd-aade-ebf71722eee2/53a97774-5172-5acd-aade-ebf71722eee2_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40500,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/26/7e261531df0ff80082393f2b30ea3444/pa/EA99584_bd2534d8e19556e4ba5df40b19c349ff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53a97774-5172-5acd-aade-ebf71722eee2/53a97774-5172-5acd-aade-ebf71722eee2_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2425745,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/26/7e261531df0ff80082393f2b30ea3444/pa/EA99584_ae39f76d0b3d524801af33db7311743d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53a97774-5172-5acd-aade-ebf71722eee2/53a97774-5172-5acd-aade-ebf71722eee2_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60038,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/26/7e261531df0ff80082393f2b30ea3444/pa/EA99584_d8471861d4cabaaf1849b757ab0d6ede.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-12-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Captur 1.0 TCe LPG Intens',
 'transmission': 'manual',
 'trim': 'Intens',
 'year': 2021}
2026-01-28 20:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27EA99584%27 HTTP/1.1" 200 None
2026-01-28 20:08:14 [auto1.it] INFO: Saving data for EA99584: {'created_time': 1769630894.24356, 'last_price_update_time': 1769630894.24357, 'auction_closing_time': 1769705457.0}
2026-01-28 20:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='EA99584') HTTP/1.1" 204 0
2026-01-28 20:08:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/73/3f739cbec2b49d01f6c3990e04f16df7/pa/FM26794_285e91210de99d5ced967bfaf546f258.jpg> (referer: https://www.auto1.com/)
2026-01-28 20:08:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 20:08:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f8b08705f50>
2026-01-28 20:08:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:08:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8361fd4f-afb9-5e1d-8ce7-f260b44e7520/8361fd4f-afb9-5e1d-8ce7-f260b44e7520_image_8.jpg HTTP/1.1" 201 0
2026-01-28 20:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.it',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F73%252F3f739cbec2b49d01f6c3990e04f16df7%252Fpa%252FFM26794_285e91210de99d5ced967bfaf546f258.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/73/3f739cbec2b49d01f6c3990e04f16df7/pa/FM26794_285e91210de99d5ced967bfaf546f258.jpg saved to cache
2026-01-28 20:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8361fd4f-afb9-5e1d-8ce7-f260b44e7520
2026-01-28 20:08:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8361fd4f-afb9-5e1d-8ce7-f260b44e7520, skipping ID generation
2026-01-28 20:08:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8361fd4f-afb9-5e1d-8ce7-f260b44e7520 with scrape type 1
2026-01-28 20:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 8361fd4f-afb9-5e1d-8ce7-f260b44e7520 from tracking dictionaries
2026-01-28 20:08:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8361fd4f-afb9-5e1d-8ce7-f260b44e7520 sending to next pipeline
2026-01-28 20:08:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8361fd4f-afb9-5e1d-8ce7-f260b44e7520, identifier: FM26794
2026-01-28 20:08:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8361fd4f-afb9-5e1d-8ce7-f260b44e7520 with identifier: FM26794
2026-01-28 20:08:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8361fd4f-afb9-5e1d-8ce7-f260b44e7520 with identifier: FM26794
2026-01-28 20:08:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8361fd4f-afb9-5e1d-8ce7-f260b44e7520 with identifier: FM26794 to the API
2026-01-28 20:08:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:08:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:08:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3f/73/3f739cbec2b49d01f6c3990e04f16df7/pa/FM26794_285e91210de99d5ced967bfaf546f258.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 189,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '3.0L',
 'engine_horse_power': 325,
 'expiration_date': '2026-01-29T16:33:26Z',
 'fuel_type': 'petrol',
 'id': '8361fd4f-afb9-5e1d-8ce7-f260b44e7520',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FM26794',
 'listing': 'auction',
 'location': 'IT, Como',
 'make': 'BMW',
 'model': '3er',
 'odometer': 84658,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8361fd4f-afb9-5e1d-8ce7-f260b44e7520/8361fd4f-afb9-5e1d-8ce7-f260b44e7520_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76293,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/73/3f739cbec2b49d01f6c3990e04f16df7/pa/FM26794_7060dbb50e8c4e274498b4818afb57bc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8361fd4f-afb9-5e1d-8ce7-f260b44e7520/8361fd4f-afb9-5e1d-8ce7-f260b44e7520_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78054,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/73/3f739cbec2b49d01f6c3990e04f16df7/pa/FM26794_d00b98674ca34909e2b843aa43d1380f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8361fd4f-afb9-5e1d-8ce7-f260b44e7520/8361fd4f-afb9-5e1d-8ce7-f260b44e7520_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61164,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/73/3f739cbec2b49d01f6c3990e04f16df7/pa/FM26794_55704f1ac81887bf0ec8df8d5928e735.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8361fd4f-afb9-5e1d-8ce7-f260b44e7520/8361fd4f-afb9-5e1d-8ce7-f260b44e7520_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52175,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/73/3f739cbec2b49d01f6c3990e04f16df7/pa/FM26794_2e2a2533ffb8d55280e6e24017278046.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8361fd4f-afb9-5e1d-8ce7-f260b44e7520/8361fd4f-afb9-5e1d-8ce7-f260b44e7520_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58786,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/73/3f739cbec2b49d01f6c3990e04f16df7/pa/FM26794_0c8301c06dfe0bdccbf1c8d7dbe2bd19.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8361fd4f-afb9-5e1d-8ce7-f260b44e7520/8361fd4f-afb9-5e1d-8ce7-f260b44e7520_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63736,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/73/3f739cbec2b49d01f6c3990e04f16df7/pa/FM26794_a8506ee73ec6524b5a329e1b6376480b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8361fd4f-afb9-5e1d-8ce7-f260b44e7520/8361fd4f-afb9-5e1d-8ce7-f260b44e7520_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66131,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/73/3f739cbec2b49d01f6c3990e04f16df7/pa/FM26794_7e556e3853685bebb971ad8017ac0e8e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8361fd4f-afb9-5e1d-8ce7-f260b44e7520/8361fd4f-afb9-5e1d-8ce7-f260b44e7520_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72072,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/73/3f739cbec2b49d01f6c3990e04f16df7/pa/FM26794_13916f1088467f508d2e9f90e8c4188c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8361fd4f-afb9-5e1d-8ce7-f260b44e7520/8361fd4f-afb9-5e1d-8ce7-f260b44e7520_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2526886,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/73/3f739cbec2b49d01f6c3990e04f16df7/pa/FM26794_285e91210de99d5ced967bfaf546f258.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8361fd4f-afb9-5e1d-8ce7-f260b44e7520/8361fd4f-afb9-5e1d-8ce7-f260b44e7520_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2320673,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/73/3f739cbec2b49d01f6c3990e04f16df7/pa/FM26794_5419e50c8af4354ccd70043c93e88d02.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8361fd4f-afb9-5e1d-8ce7-f260b44e7520/8361fd4f-afb9-5e1d-8ce7-f260b44e7520_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2476340,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/73/3f739cbec2b49d01f6c3990e04f16df7/pa/FM26794_faf6544240f06ce262675ba6e840da02.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8361fd4f-afb9-5e1d-8ce7-f260b44e7520/8361fd4f-afb9-5e1d-8ce7-f260b44e7520_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2331368,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/73/3f739cbec2b49d01f6c3990e04f16df7/pa/FM26794_50e8f0b58ccc6ce700c0355d3b0743cb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8361fd4f-afb9-5e1d-8ce7-f260b44e7520/8361fd4f-afb9-5e1d-8ce7-f260b44e7520_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65087,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/73/3f739cbec2b49d01f6c3990e04f16df7/pa/FM26794_f679ae802797dca176199fe0b8785db7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8361fd4f-afb9-5e1d-8ce7-f260b44e7520/8361fd4f-afb9-5e1d-8ce7-f260b44e7520_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2156035,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/73/3f739cbec2b49d01f6c3990e04f16df7/pa/FM26794_a80ed22d828ec3206b27f8ad9c75ffd5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8361fd4f-afb9-5e1d-8ce7-f260b44e7520/8361fd4f-afb9-5e1d-8ce7-f260b44e7520_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56113,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/73/3f739cbec2b49d01f6c3990e04f16df7/pa/FM26794_7f27b3ed70a464ea499c50b6f37c3042.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-01-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3er 340i xDrive Luxury Line Purity',
 'transmission': 'automatic',
 'trim': 'xDrive Luxury Line Purity',
 'year': 2019}
2026-01-28 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20RowKey%20eq%20%27FM26794%27 HTTP/1.1" 200 None
2026-01-28 20:08:15 [auto1.it] INFO: Saving data for FM26794: {'created_time': 1769630895.194325, 'last_price_update_time': 1769630895.194335, 'auction_closing_time': 1769704406.0}
2026-01-28 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.it',RowKey='FM26794') HTTP/1.1" 204 0
2026-01-28 20:08:15 [scrapy.core.engine] INFO: Closing spider (finished)
2026-01-28 20:08:15 [auto1.it] INFO: auto1.it Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 6}
2026-01-28 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.it%27%20and%20last_price_update_time%20lt%201769198895 HTTP/1.1" 200 None
2026-01-28 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='BN59270') HTTP/1.1" 204 0
2026-01-28 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='BR84459') HTTP/1.1" 204 0
2026-01-28 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='CC49842') HTTP/1.1" 204 0
2026-01-28 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='CK88082') HTTP/1.1" 204 0
2026-01-28 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='CW45632') HTTP/1.1" 204 0
2026-01-28 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='DH17166') HTTP/1.1" 204 0
2026-01-28 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='DT00008') HTTP/1.1" 204 0
2026-01-28 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='ED34551') HTTP/1.1" 204 0
2026-01-28 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='EH76491') HTTP/1.1" 204 0
2026-01-28 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='FP20587') HTTP/1.1" 204 0
2026-01-28 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='GJ03043') HTTP/1.1" 204 0
2026-01-28 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='GW45341') HTTP/1.1" 204 0
2026-01-28 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='HK97432') HTTP/1.1" 204 0
2026-01-28 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='HT66587') HTTP/1.1" 204 0
2026-01-28 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='HU61809') HTTP/1.1" 204 0
2026-01-28 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='HY93389') HTTP/1.1" 204 0
2026-01-28 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='HZ21301') HTTP/1.1" 204 0
2026-01-28 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='JU71817') HTTP/1.1" 204 0
2026-01-28 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='KL91758') HTTP/1.1" 204 0
2026-01-28 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='KS04558') HTTP/1.1" 204 0
2026-01-28 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='KS44690') HTTP/1.1" 204 0
2026-01-28 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='KT36629') HTTP/1.1" 204 0
2026-01-28 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='KY07894') HTTP/1.1" 204 0
2026-01-28 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='ML53871') HTTP/1.1" 204 0
2026-01-28 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='MV61519') HTTP/1.1" 204 0
2026-01-28 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='MY94309') HTTP/1.1" 204 0
2026-01-28 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='NA77982') HTTP/1.1" 204 0
2026-01-28 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='NH75460') HTTP/1.1" 204 0
2026-01-28 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='NK66471') HTTP/1.1" 204 0
2026-01-28 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='NY26465') HTTP/1.1" 204 0
2026-01-28 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='RC03522') HTTP/1.1" 204 0
2026-01-28 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='RD40603') HTTP/1.1" 204 0
2026-01-28 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='RP08531') HTTP/1.1" 204 0
2026-01-28 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='RU33321') HTTP/1.1" 204 0
2026-01-28 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='SA26868') HTTP/1.1" 204 0
2026-01-28 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='SN18685') HTTP/1.1" 204 0
2026-01-28 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='TN44698') HTTP/1.1" 204 0
2026-01-28 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='TU27748') HTTP/1.1" 204 0
2026-01-28 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='TW27290') HTTP/1.1" 204 0
2026-01-28 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='TW66198') HTTP/1.1" 204 0
2026-01-28 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='TW68014') HTTP/1.1" 204 0
2026-01-28 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='UD96449') HTTP/1.1" 204 0
2026-01-28 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='UH71498') HTTP/1.1" 204 0
2026-01-28 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='VD89207') HTTP/1.1" 204 0
2026-01-28 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='VK90297') HTTP/1.1" 204 0
2026-01-28 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='VX80189') HTTP/1.1" 204 0
2026-01-28 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='VZ24936') HTTP/1.1" 204 0
2026-01-28 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='VZ52068') HTTP/1.1" 204 0
2026-01-28 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='WF15017') HTTP/1.1" 204 0
2026-01-28 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='WG32639') HTTP/1.1" 204 0
2026-01-28 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='WG90595') HTTP/1.1" 204 0
2026-01-28 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='WS74812') HTTP/1.1" 204 0
2026-01-28 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='XD52350') HTTP/1.1" 204 0
2026-01-28 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='XE78625') HTTP/1.1" 204 0
2026-01-28 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='XT61397') HTTP/1.1" 204 0
2026-01-28 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='XU94622') HTTP/1.1" 204 0
2026-01-28 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='XV39027') HTTP/1.1" 204 0
2026-01-28 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='YF80081') HTTP/1.1" 204 0
2026-01-28 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='YY87098') HTTP/1.1" 204 0
2026-01-28 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='ZF92307') HTTP/1.1" 204 0
2026-01-28 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='ZG54697') HTTP/1.1" 204 0
2026-01-28 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='ZS54303') HTTP/1.1" 204 0
2026-01-28 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.it',RowKey='ZT81804') HTTP/1.1" 204 0
2026-01-28 20:08:16 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (170 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto1.it/task_75_2026-01-28T20_00_01.jl
2026-01-28 20:08:16 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 2251360,
 'downloader/request_count': 1311,
 'downloader/request_method_count/GET': 1290,
 'downloader/request_method_count/POST': 21,
 'downloader/response_bytes': 614218064,
 'downloader/response_count': 1311,
 'downloader/response_status_count/200': 1311,
 'dupefilter/filtered': 32,
 'elapsed_time_seconds': 471.892292,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 1, 28, 20, 8, 15, 914719, tzinfo=datetime.timezone.utc),
 'item_dropped_count': 47,
 'item_dropped_reasons_count/DropItem': 47,
 'item_scraped_count': 170,
 'log_count/DEBUG': 14381,
 'log_count/INFO': 11969,
 'memusage/max': 192077824,
 'memusage/startup': 127598592,
 'photo_download_count': 854,
 'request_depth_max': 22,
 'response_received_count': 457,
 'scheduler/dequeued': 1311,
 'scheduler/dequeued/memory': 1311,
 'scheduler/enqueued': 1311,
 'scheduler/enqueued/memory': 1311,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 457,
 'scrapy-zyte-api/error_ratio': 0.0,
 'scrapy-zyte-api/errors': 0,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 3.883025378170192,
 'scrapy-zyte-api/mean_response_seconds': 3.9144540237491094,
 'scrapy-zyte-api/processed': 457,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 457,
 'scrapy-zyte-api/request_args/experimental.requestCookies': 456,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 457,
 'scrapy-zyte-api/request_args/httpRequestBody': 21,
 'scrapy-zyte-api/request_args/httpRequestMethod': 21,
 'scrapy-zyte-api/request_args/httpResponseBody': 457,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 457,
 'scrapy-zyte-api/request_args/sessionContext': 457,
 'scrapy-zyte-api/request_args/url': 457,
 'scrapy-zyte-api/status_codes/200': 457,
 'scrapy-zyte-api/success': 457,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'start_time': datetime.datetime(2026, 1, 28, 20, 0, 24, 22427, tzinfo=datetime.timezone.utc)}
2026-01-28 20:08:16 [scrapy.core.engine] INFO: Spider closed (finished)
2026-01-28 20:08:16 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f8b0c107e90>
2026-01-28 20:08:16 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f8b0be4d350>

PROJECT (sourcing_v2), SPIDER (auto1.it)