Desktop version Jobs Stats

PROJECT (sourcing_v2)
SPIDER (auto_selling_autoscout24.it)

2025-12-05 11:57:17 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2025-12-05 11:57:17 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2025-12-05 11:57:17 [auto_selling_autoscout24.it] INFO: Starting auto_selling_autoscout.it spider
2025-12-05 11:57:17 [auto_selling_autoscout24.it] INFO: _job: 30122efad1c111f0b120928152083da5, SCRAPY_JOB: None
2025-12-05 11:57:17 [scrapy.addons] INFO: Enabled addons:
[]
2025-12-05 11:57:17 [asyncio] DEBUG: Using selector: EpollSelector
2025-12-05 11:57:17 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2025-12-05 11:57:17 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2025-12-05 11:57:17 [scrapy.extensions.telnet] INFO: Telnet Password: 4ac74774004a187f
2025-12-05 11:57:17 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2025-12-05 11:57:17 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 3600,
 'CONCURRENT_REQUESTS': 5,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto_selling_autoscout24.it/30122efad1c111f0b120928152083da5.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2025-12-05 11:57:17 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2025-12-05 11:57:17 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2025-12-05 11:57:17 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2025-12-05 11:57:17 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware for auto_selling
2025-12-05 11:57:17 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.auto_selling.middlewares.id_gen_middleware.IdGenMiddleware']
2025-12-05 11:57:17 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.post_to_azurebus_auto_selling.AzureBusPipelineAutoSelling',
 'crawlers.pipelines.save_to_cdlq_db_auto_selling.SaveToCdlqDbAutoSelling']
2025-12-05 11:57:17 [scrapy.core.engine] INFO: Spider opened
2025-12-05 11:57:17 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2025-12-05 11:57:17 [common.service_bus.service_bus_client_factory] INFO: ServiceBusClient initialized via DefaultAzureCredential for alx-production-bus.servicebus.windows.net
2025-12-05 11:57:17 [crawlers.pipelines.base_azure_bus_pipeline] INFO: [AzureBusPipeline] Connected to topic auto.sourcing-v2
2025-12-05 11:57:17 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2025-12-05 11:57:17 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6025
2025-12-05 11:57:17 [scrapy-playwright] INFO: Starting download handler
2025-12-05 11:57:17 [scrapy-playwright] INFO: Starting download handler
2025-12-05 11:57:22 [auto_selling_autoscout24.it] INFO: Scraper started with URL: https://www.autoscout24.it/concessionari/viola-auto-solutions-srl/chi-siamo
2025-12-05 11:57:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 11:58:17 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2025-12-05 11:58:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.autoscout24.it/concessionari/viola-auto-solutions-srl/chi-siamo> (referer: None) ['zyte-api']
2025-12-05 11:58:29 [auto_selling_autoscout24.it] INFO: Parsing dealer homepage
2025-12-05 11:58:29 [auto_selling_autoscout24.it] INFO: Extracted customerId: 31910200
2025-12-05 11:58:29 [auto_selling_autoscout24.it] INFO: Fetching listings for customerId: 31910200, page: 1
2025-12-05 11:58:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 11:58:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autoscout24.it/api/dealer-detail/fetch-listings> (referer: https://www.autoscout24.it/concessionari/viola-auto-solutions-srl/chi-siamo) ['zyte-api']
2025-12-05 11:58:42 [auto_selling_autoscout24.it] INFO: Parsing listings response for page: 1
2025-12-05 11:58:42 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2025-12-05 11:58:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:58:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 11:58:42 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2025-12-05 11:58:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2025-12-05 11:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%275fcb3a2a-e0f6-47a5-b314-dcc1c4b4546a%27 HTTP/1.1" 200 None
2025-12-05 11:58:42 [auto_selling_autoscout24.it] INFO: Scrape type for 5fcb3a2a-e0f6-47a5-b314-dcc1c4b4546a: 1
2025-12-05 11:58:42 [auto_selling_autoscout24.it] INFO: Scraping new listing 5fcb3a2a-e0f6-47a5-b314-dcc1c4b4546a
2025-12-05 11:58:42 [auto_selling_autoscout24.it] INFO: Extracting item from listing ID: 5fcb3a2a-e0f6-47a5-b314-dcc1c4b4546a
2025-12-05 11:58:42 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f999190-f984-5f6c-837b-1302e8c1608e with identifier: 5fcb3a2a-e0f6-47a5-b314-dcc1c4b4546a
2025-12-05 11:58:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 4f999190-f984-5f6c-837b-1302e8c1608e
2025-12-05 11:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F5fcb3a2a-e0f6-47a5-b314-dcc1c4b4546a_66932690-3b7e-4b25-8ab5-951487fe9043.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/5fcb3a2a-e0f6-47a5-b314-dcc1c4b4546a_66932690-3b7e-4b25-8ab5-951487fe9043.jpg/250x188.webp already downloaded
2025-12-05 11:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F5fcb3a2a-e0f6-47a5-b314-dcc1c4b4546a_ca76dc69-23a3-44d2-a0d9-b6b06a5357c9.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/5fcb3a2a-e0f6-47a5-b314-dcc1c4b4546a_ca76dc69-23a3-44d2-a0d9-b6b06a5357c9.jpg/250x188.webp already downloaded
2025-12-05 11:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F5fcb3a2a-e0f6-47a5-b314-dcc1c4b4546a_7f1ffbda-c117-4ddf-ae76-5a701a4cecab.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/5fcb3a2a-e0f6-47a5-b314-dcc1c4b4546a_7f1ffbda-c117-4ddf-ae76-5a701a4cecab.jpg/250x188.webp already downloaded
2025-12-05 11:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F5fcb3a2a-e0f6-47a5-b314-dcc1c4b4546a_320d8766-596e-4d80-90a8-c91f8103fc4d.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/5fcb3a2a-e0f6-47a5-b314-dcc1c4b4546a_320d8766-596e-4d80-90a8-c91f8103fc4d.jpg/250x188.webp already downloaded
2025-12-05 11:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F5fcb3a2a-e0f6-47a5-b314-dcc1c4b4546a_0ad2adc0-543b-4036-9d1e-59bad2b21de6.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/5fcb3a2a-e0f6-47a5-b314-dcc1c4b4546a_0ad2adc0-543b-4036-9d1e-59bad2b21de6.jpg/250x188.webp already downloaded
2025-12-05 11:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F5fcb3a2a-e0f6-47a5-b314-dcc1c4b4546a_e0704548-7ea1-405c-98ee-de459c82d1fb.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/5fcb3a2a-e0f6-47a5-b314-dcc1c4b4546a_e0704548-7ea1-405c-98ee-de459c82d1fb.jpg/250x188.webp already downloaded
2025-12-05 11:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F5fcb3a2a-e0f6-47a5-b314-dcc1c4b4546a_e9158f17-ee19-419b-acbd-813fa45ef443.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/5fcb3a2a-e0f6-47a5-b314-dcc1c4b4546a_e9158f17-ee19-419b-acbd-813fa45ef443.jpg/250x188.webp already downloaded
2025-12-05 11:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F5fcb3a2a-e0f6-47a5-b314-dcc1c4b4546a_9d22143a-e79c-4d9a-8480-4c1e1442fcba.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/5fcb3a2a-e0f6-47a5-b314-dcc1c4b4546a_9d22143a-e79c-4d9a-8480-4c1e1442fcba.jpg/250x188.webp already downloaded
2025-12-05 11:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F5fcb3a2a-e0f6-47a5-b314-dcc1c4b4546a_3ff2c17f-8647-474d-83da-3239083a9642.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/5fcb3a2a-e0f6-47a5-b314-dcc1c4b4546a_3ff2c17f-8647-474d-83da-3239083a9642.jpg/250x188.webp already downloaded
2025-12-05 11:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F5fcb3a2a-e0f6-47a5-b314-dcc1c4b4546a_099527c8-77b4-497f-b433-c93f3a780350.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/5fcb3a2a-e0f6-47a5-b314-dcc1c4b4546a_099527c8-77b4-497f-b433-c93f3a780350.jpg/250x188.webp already downloaded
2025-12-05 11:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F5fcb3a2a-e0f6-47a5-b314-dcc1c4b4546a_184eb195-f0f1-4cb3-80ce-81ccd2cf7ee4.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/5fcb3a2a-e0f6-47a5-b314-dcc1c4b4546a_184eb195-f0f1-4cb3-80ce-81ccd2cf7ee4.jpg/250x188.webp already downloaded
2025-12-05 11:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F5fcb3a2a-e0f6-47a5-b314-dcc1c4b4546a_a39f4fbd-6350-44f6-a006-9b0a6ced7a66.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/5fcb3a2a-e0f6-47a5-b314-dcc1c4b4546a_a39f4fbd-6350-44f6-a006-9b0a6ced7a66.jpg/250x188.webp already downloaded
2025-12-05 11:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F5fcb3a2a-e0f6-47a5-b314-dcc1c4b4546a_5a5d0be8-5fb7-48c6-971f-28e1608b0e70.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/5fcb3a2a-e0f6-47a5-b314-dcc1c4b4546a_5a5d0be8-5fb7-48c6-971f-28e1608b0e70.jpg/250x188.webp already downloaded
2025-12-05 11:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F5fcb3a2a-e0f6-47a5-b314-dcc1c4b4546a_e34bb7f3-15b2-411a-8b4f-c38631186098.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/5fcb3a2a-e0f6-47a5-b314-dcc1c4b4546a_e34bb7f3-15b2-411a-8b4f-c38631186098.jpg/250x188.webp already downloaded
2025-12-05 11:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F5fcb3a2a-e0f6-47a5-b314-dcc1c4b4546a_73c806e7-9914-4071-8b5b-b161207bbd34.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/5fcb3a2a-e0f6-47a5-b314-dcc1c4b4546a_73c806e7-9914-4071-8b5b-b161207bbd34.jpg/250x188.webp already downloaded
2025-12-05 11:58:42 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 4f999190-f984-5f6c-837b-1302e8c1608e with identifier 5fcb3a2a-e0f6-47a5-b314-dcc1c4b4546a
2025-12-05 11:58:42 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: None -> <ConnectionState.START: 0>
2025-12-05 11:58:42 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.START: 0> -> <ConnectionState.HDR_SENT: 2>
2025-12-05 11:58:42 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.HDR_SENT: 2> -> <ConnectionState.HDR_SENT: 2>
2025-12-05 11:58:42 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.HDR_SENT: 2> -> <ConnectionState.OPEN_PIPE: 4>
2025-12-05 11:58:42 [azure.servicebus._pyamqp.session] INFO: Session state changed: <SessionState.UNMAPPED: 0> -> <SessionState.BEGIN_SENT: 1>
2025-12-05 11:58:42 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2025-12-05 11:58:42 [azure.servicebus._pyamqp.management_link] INFO: Management link receiver state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2025-12-05 11:58:42 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2025-12-05 11:58:42 [azure.servicebus._pyamqp.management_link] INFO: Management link sender state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2025-12-05 11:58:42 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.OPEN_PIPE: 4> -> <ConnectionState.OPEN_SENT: 7>
2025-12-05 11:58:43 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.OPEN_SENT: 7> -> <ConnectionState.OPENED: 9>
2025-12-05 11:58:43 [azure.servicebus._pyamqp.session] INFO: Session state changed: <SessionState.BEGIN_SENT: 1> -> <SessionState.MAPPED: 3>
2025-12-05 11:58:43 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2025-12-05 11:58:43 [azure.servicebus._pyamqp.management_link] INFO: Management link receiver state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2025-12-05 11:58:43 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2025-12-05 11:58:43 [azure.servicebus._pyamqp.management_link] INFO: Management link sender state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2025-12-05 11:58:43 [azure.servicebus._pyamqp.cbs] DEBUG: CBS completed opening with status: <ManagementOpenResult.OK: 1>
2025-12-05 11:58:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:58:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1947
2025-12-05 11:58:43 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2025-12-05 11:58:43 [azure.servicebus._pyamqp.cbs] DEBUG: CBS update in progress. Token put time: 1764935923
2025-12-05 11:58:43 [azure.servicebus._pyamqp.cbs] DEBUG: CBS update in progress. Token put time: 1764935923
2025-12-05 11:58:43 [azure.servicebus._pyamqp.cbs] DEBUG: CBS Put token result (<ManagementExecuteOperationResult.OK: 0>), status code: 202, status_description: b'Accepted'.
2025-12-05 11:58:43 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 11:58:43 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACHED: 0> -> <LinkState.ATTACH_SENT: 1>
2025-12-05 11:58:43 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACH_SENT: 1> -> <LinkState.ATTACHED: 3>
2025-12-05 11:58:43 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 11:58:43 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 11:58:43 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 11:58:43 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 11:58:43 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 4f999190-f984-5f6c-837b-1302e8c1608e
2025-12-05 11:58:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autoscout24.it/api/dealer-detail/fetch-listings>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'emission_standard': None,
 'engine': None,
 'engine_horse_power': 150,
 'expiration_date': None,
 'fuel_type': 'Electric/Gasoline',
 'id': '4f999190-f984-5f6c-837b-1302e8c1608e',
 'is_damaged': False,
 'is_operable': True,
 'license_plate': None,
 'link_to_web_offer': 'https://www.autoscout24.it/offers/volkswagen-golf-8-style-1-5-etsi-dsg-150cv-matrix-retrocam-promo-electric-gasoline-black-5fcb3a2a-e0f6-47a5-b314-dcc1c4b4546a',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf',
 'odometer': 60500,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://prod.pictures.autoscout24.net/listing-images/5fcb3a2a-e0f6-47a5-b314-dcc1c4b4546a_66932690-3b7e-4b25-8ab5-951487fe9043.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/5fcb3a2a-e0f6-47a5-b314-dcc1c4b4546a_ca76dc69-23a3-44d2-a0d9-b6b06a5357c9.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/5fcb3a2a-e0f6-47a5-b314-dcc1c4b4546a_7f1ffbda-c117-4ddf-ae76-5a701a4cecab.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/5fcb3a2a-e0f6-47a5-b314-dcc1c4b4546a_320d8766-596e-4d80-90a8-c91f8103fc4d.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/5fcb3a2a-e0f6-47a5-b314-dcc1c4b4546a_0ad2adc0-543b-4036-9d1e-59bad2b21de6.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/5fcb3a2a-e0f6-47a5-b314-dcc1c4b4546a_e0704548-7ea1-405c-98ee-de459c82d1fb.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/5fcb3a2a-e0f6-47a5-b314-dcc1c4b4546a_e9158f17-ee19-419b-acbd-813fa45ef443.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/5fcb3a2a-e0f6-47a5-b314-dcc1c4b4546a_9d22143a-e79c-4d9a-8480-4c1e1442fcba.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/5fcb3a2a-e0f6-47a5-b314-dcc1c4b4546a_3ff2c17f-8647-474d-83da-3239083a9642.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/5fcb3a2a-e0f6-47a5-b314-dcc1c4b4546a_099527c8-77b4-497f-b433-c93f3a780350.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/5fcb3a2a-e0f6-47a5-b314-dcc1c4b4546a_184eb195-f0f1-4cb3-80ce-81ccd2cf7ee4.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/5fcb3a2a-e0f6-47a5-b314-dcc1c4b4546a_a39f4fbd-6350-44f6-a006-9b0a6ced7a66.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/5fcb3a2a-e0f6-47a5-b314-dcc1c4b4546a_5a5d0be8-5fb7-48c6-971f-28e1608b0e70.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/5fcb3a2a-e0f6-47a5-b314-dcc1c4b4546a_e34bb7f3-15b2-411a-8b4f-c38631186098.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/5fcb3a2a-e0f6-47a5-b314-dcc1c4b4546a_73c806e7-9914-4071-8b5b-b161207bbd34.jpg/250x188.webp'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98013015-b25c-5405-8e65-c12e8f719332/98013015-b25c-5405-8e65-c12e8f719332_image_0.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4846,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/5fcb3a2a-e0f6-47a5-b314-dcc1c4b4546a_66932690-3b7e-4b25-8ab5-951487fe9043.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98013015-b25c-5405-8e65-c12e8f719332/98013015-b25c-5405-8e65-c12e8f719332_image_1.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4696,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/5fcb3a2a-e0f6-47a5-b314-dcc1c4b4546a_ca76dc69-23a3-44d2-a0d9-b6b06a5357c9.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98013015-b25c-5405-8e65-c12e8f719332/98013015-b25c-5405-8e65-c12e8f719332_image_2.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4696,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/5fcb3a2a-e0f6-47a5-b314-dcc1c4b4546a_7f1ffbda-c117-4ddf-ae76-5a701a4cecab.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98013015-b25c-5405-8e65-c12e8f719332/98013015-b25c-5405-8e65-c12e8f719332_image_3.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4352,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/5fcb3a2a-e0f6-47a5-b314-dcc1c4b4546a_320d8766-596e-4d80-90a8-c91f8103fc4d.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98013015-b25c-5405-8e65-c12e8f719332/98013015-b25c-5405-8e65-c12e8f719332_image_4.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4498,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/5fcb3a2a-e0f6-47a5-b314-dcc1c4b4546a_0ad2adc0-543b-4036-9d1e-59bad2b21de6.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98013015-b25c-5405-8e65-c12e8f719332/98013015-b25c-5405-8e65-c12e8f719332_image_5.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 8426,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/5fcb3a2a-e0f6-47a5-b314-dcc1c4b4546a_e0704548-7ea1-405c-98ee-de459c82d1fb.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98013015-b25c-5405-8e65-c12e8f719332/98013015-b25c-5405-8e65-c12e8f719332_image_6.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 6372,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/5fcb3a2a-e0f6-47a5-b314-dcc1c4b4546a_e9158f17-ee19-419b-acbd-813fa45ef443.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98013015-b25c-5405-8e65-c12e8f719332/98013015-b25c-5405-8e65-c12e8f719332_image_7.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 7116,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/5fcb3a2a-e0f6-47a5-b314-dcc1c4b4546a_9d22143a-e79c-4d9a-8480-4c1e1442fcba.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98013015-b25c-5405-8e65-c12e8f719332/98013015-b25c-5405-8e65-c12e8f719332_image_8.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 6520,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/5fcb3a2a-e0f6-47a5-b314-dcc1c4b4546a_3ff2c17f-8647-474d-83da-3239083a9642.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98013015-b25c-5405-8e65-c12e8f719332/98013015-b25c-5405-8e65-c12e8f719332_image_9.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5980,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/5fcb3a2a-e0f6-47a5-b314-dcc1c4b4546a_099527c8-77b4-497f-b433-c93f3a780350.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98013015-b25c-5405-8e65-c12e8f719332/98013015-b25c-5405-8e65-c12e8f719332_image_10.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5116,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/5fcb3a2a-e0f6-47a5-b314-dcc1c4b4546a_184eb195-f0f1-4cb3-80ce-81ccd2cf7ee4.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98013015-b25c-5405-8e65-c12e8f719332/98013015-b25c-5405-8e65-c12e8f719332_image_11.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 6524,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/5fcb3a2a-e0f6-47a5-b314-dcc1c4b4546a_a39f4fbd-6350-44f6-a006-9b0a6ced7a66.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98013015-b25c-5405-8e65-c12e8f719332/98013015-b25c-5405-8e65-c12e8f719332_image_12.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 6608,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/5fcb3a2a-e0f6-47a5-b314-dcc1c4b4546a_5a5d0be8-5fb7-48c6-971f-28e1608b0e70.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98013015-b25c-5405-8e65-c12e8f719332/98013015-b25c-5405-8e65-c12e8f719332_image_13.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 7136,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/5fcb3a2a-e0f6-47a5-b314-dcc1c4b4546a_e34bb7f3-15b2-411a-8b4f-c38631186098.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98013015-b25c-5405-8e65-c12e8f719332/98013015-b25c-5405-8e65-c12e8f719332_image_14.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 6586,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/5fcb3a2a-e0f6-47a5-b314-dcc1c4b4546a_73c806e7-9914-4071-8b5b-b161207bbd34.jpg/250x188.webp',
             'Width': 250}],
 'price': 23800,
 'price_includes_vat': False,
 'registration_date': '2021-05-01',
 'seller_name': None,
 'title': 'Volkswagen Golf 8 STYLE 1.5 eTSI DSG 150CV *MATRIX+RETROCAM* PROMO',
 'transmission': 'automatic',
 'trim': '8 STYLE 1.5 eTSI DSG 150CV *MATRIX+RETROCAM* PROMO',
 'vin': None,
 'year': 2021}
2025-12-05 11:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%275fcb3a2a-e0f6-47a5-b314-dcc1c4b4546a%27 HTTP/1.1" 200 None
2025-12-05 11:58:43 [auto_selling_autoscout24.it] INFO: Saving data for 5fcb3a2a-e0f6-47a5-b314-dcc1c4b4546a: {'created_time': 1764935923.628966, 'last_price_update_time': 1764935923.628977}
2025-12-05 11:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autoscout24.it',RowKey='5fcb3a2a-e0f6-47a5-b314-dcc1c4b4546a') HTTP/1.1" 204 0
2025-12-05 11:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27587e6d2f-619c-449d-a432-6c8fbc75c9d6%27 HTTP/1.1" 200 None
2025-12-05 11:58:43 [auto_selling_autoscout24.it] INFO: Scrape type for 587e6d2f-619c-449d-a432-6c8fbc75c9d6: 1
2025-12-05 11:58:43 [auto_selling_autoscout24.it] INFO: Scraping new listing 587e6d2f-619c-449d-a432-6c8fbc75c9d6
2025-12-05 11:58:43 [auto_selling_autoscout24.it] INFO: Extracting item from listing ID: 587e6d2f-619c-449d-a432-6c8fbc75c9d6
2025-12-05 11:58:43 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: b35ac938-d8e6-5c26-bc47-2b561f8049ff with identifier: 587e6d2f-619c-449d-a432-6c8fbc75c9d6
2025-12-05 11:58:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item b35ac938-d8e6-5c26-bc47-2b561f8049ff
2025-12-05 11:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F587e6d2f-619c-449d-a432-6c8fbc75c9d6_84a266af-932c-4ca7-a1e6-610b54dc0faf.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/587e6d2f-619c-449d-a432-6c8fbc75c9d6_84a266af-932c-4ca7-a1e6-610b54dc0faf.jpg/250x188.webp already downloaded
2025-12-05 11:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F587e6d2f-619c-449d-a432-6c8fbc75c9d6_6aee0df7-a3e3-44c6-9bdc-98d8e59e6522.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/587e6d2f-619c-449d-a432-6c8fbc75c9d6_6aee0df7-a3e3-44c6-9bdc-98d8e59e6522.jpg/250x188.webp already downloaded
2025-12-05 11:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F587e6d2f-619c-449d-a432-6c8fbc75c9d6_9b8a9ebd-f8a2-4a73-b8b6-fd94b66cbd94.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/587e6d2f-619c-449d-a432-6c8fbc75c9d6_9b8a9ebd-f8a2-4a73-b8b6-fd94b66cbd94.jpg/250x188.webp already downloaded
2025-12-05 11:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F587e6d2f-619c-449d-a432-6c8fbc75c9d6_55247ee7-88c1-4ad8-b8b2-461dbe6a3953.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/587e6d2f-619c-449d-a432-6c8fbc75c9d6_55247ee7-88c1-4ad8-b8b2-461dbe6a3953.jpg/250x188.webp already downloaded
2025-12-05 11:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F587e6d2f-619c-449d-a432-6c8fbc75c9d6_d012329f-d8c6-49ee-87e9-7b8e5685ffbe.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/587e6d2f-619c-449d-a432-6c8fbc75c9d6_d012329f-d8c6-49ee-87e9-7b8e5685ffbe.jpg/250x188.webp already downloaded
2025-12-05 11:58:43 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: b35ac938-d8e6-5c26-bc47-2b561f8049ff with identifier 587e6d2f-619c-449d-a432-6c8fbc75c9d6
2025-12-05 11:58:43 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 11:58:43 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 11:58:43 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item b35ac938-d8e6-5c26-bc47-2b561f8049ff
2025-12-05 11:58:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autoscout24.it/api/dealer-detail/fetch-listings>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'emission_standard': None,
 'engine': None,
 'engine_horse_power': 150,
 'expiration_date': None,
 'fuel_type': 'Gasoline',
 'id': 'b35ac938-d8e6-5c26-bc47-2b561f8049ff',
 'is_damaged': False,
 'is_operable': True,
 'license_plate': None,
 'link_to_web_offer': 'https://www.autoscout24.it/offers/audi-q3-spb-tfsi-s-tronic-business-nuovo-uff-italia-promo-gasoline-black-587e6d2f-619c-449d-a432-6c8fbc75c9d6',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 1,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 5,
 'photo_urls': ['https://prod.pictures.autoscout24.net/listing-images/587e6d2f-619c-449d-a432-6c8fbc75c9d6_84a266af-932c-4ca7-a1e6-610b54dc0faf.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/587e6d2f-619c-449d-a432-6c8fbc75c9d6_6aee0df7-a3e3-44c6-9bdc-98d8e59e6522.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/587e6d2f-619c-449d-a432-6c8fbc75c9d6_9b8a9ebd-f8a2-4a73-b8b6-fd94b66cbd94.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/587e6d2f-619c-449d-a432-6c8fbc75c9d6_55247ee7-88c1-4ad8-b8b2-461dbe6a3953.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/587e6d2f-619c-449d-a432-6c8fbc75c9d6_d012329f-d8c6-49ee-87e9-7b8e5685ffbe.jpg/250x188.webp'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6e61df1-8712-5216-ab08-603a0d04d2b1/b6e61df1-8712-5216-ab08-603a0d04d2b1_image_0.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3498,
             'Height': 146,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/587e6d2f-619c-449d-a432-6c8fbc75c9d6_84a266af-932c-4ca7-a1e6-610b54dc0faf.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6e61df1-8712-5216-ab08-603a0d04d2b1/b6e61df1-8712-5216-ab08-603a0d04d2b1_image_1.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 2770,
             'Height': 124,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/587e6d2f-619c-449d-a432-6c8fbc75c9d6_6aee0df7-a3e3-44c6-9bdc-98d8e59e6522.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6e61df1-8712-5216-ab08-603a0d04d2b1/b6e61df1-8712-5216-ab08-603a0d04d2b1_image_2.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3480,
             'Height': 152,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/587e6d2f-619c-449d-a432-6c8fbc75c9d6_9b8a9ebd-f8a2-4a73-b8b6-fd94b66cbd94.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6e61df1-8712-5216-ab08-603a0d04d2b1/b6e61df1-8712-5216-ab08-603a0d04d2b1_image_3.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 2618,
             'Height': 110,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/587e6d2f-619c-449d-a432-6c8fbc75c9d6_55247ee7-88c1-4ad8-b8b2-461dbe6a3953.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6e61df1-8712-5216-ab08-603a0d04d2b1/b6e61df1-8712-5216-ab08-603a0d04d2b1_image_4.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 2412,
             'Height': 110,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/587e6d2f-619c-449d-a432-6c8fbc75c9d6_d012329f-d8c6-49ee-87e9-7b8e5685ffbe.jpg/250x188.webp',
             'Width': 250}],
 'price': 43800,
 'price_includes_vat': False,
 'registration_date': '2025-10-01',
 'seller_name': None,
 'title': 'Audi Q3 SPB TFSI S-TRONIC BUSINESS NUOVO UFF.ITALIA PROMO',
 'transmission': 'automatic',
 'trim': 'SPB TFSI S-TRONIC BUSINESS NUOVO UFF.ITALIA PROMO',
 'vin': None,
 'year': 2025}
2025-12-05 11:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27587e6d2f-619c-449d-a432-6c8fbc75c9d6%27 HTTP/1.1" 200 None
2025-12-05 11:58:43 [auto_selling_autoscout24.it] INFO: Saving data for 587e6d2f-619c-449d-a432-6c8fbc75c9d6: {'created_time': 1764935923.784477, 'last_price_update_time': 1764935923.784486}
2025-12-05 11:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autoscout24.it',RowKey='587e6d2f-619c-449d-a432-6c8fbc75c9d6') HTTP/1.1" 204 0
2025-12-05 11:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%2714d9dd50-e2c2-49d9-a643-99fd4f1f9af2%27 HTTP/1.1" 200 None
2025-12-05 11:58:43 [auto_selling_autoscout24.it] INFO: Scrape type for 14d9dd50-e2c2-49d9-a643-99fd4f1f9af2: 1
2025-12-05 11:58:43 [auto_selling_autoscout24.it] INFO: Scraping new listing 14d9dd50-e2c2-49d9-a643-99fd4f1f9af2
2025-12-05 11:58:43 [auto_selling_autoscout24.it] INFO: Extracting item from listing ID: 14d9dd50-e2c2-49d9-a643-99fd4f1f9af2
2025-12-05 11:58:43 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: ab2bfca1-939c-544c-bea6-5b766883d370 with identifier: 14d9dd50-e2c2-49d9-a643-99fd4f1f9af2
2025-12-05 11:58:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item ab2bfca1-939c-544c-bea6-5b766883d370
2025-12-05 11:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F14d9dd50-e2c2-49d9-a643-99fd4f1f9af2_3d56723a-d80e-4fc9-8323-4b4d005dcfa6.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/14d9dd50-e2c2-49d9-a643-99fd4f1f9af2_3d56723a-d80e-4fc9-8323-4b4d005dcfa6.jpg/250x188.webp already downloaded
2025-12-05 11:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F14d9dd50-e2c2-49d9-a643-99fd4f1f9af2_9f88065e-dbfb-4119-afb4-ab9720a31015.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/14d9dd50-e2c2-49d9-a643-99fd4f1f9af2_9f88065e-dbfb-4119-afb4-ab9720a31015.jpg/250x188.webp already downloaded
2025-12-05 11:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F14d9dd50-e2c2-49d9-a643-99fd4f1f9af2_e3823768-7652-4847-8bd2-7142bf33b27b.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/14d9dd50-e2c2-49d9-a643-99fd4f1f9af2_e3823768-7652-4847-8bd2-7142bf33b27b.jpg/250x188.webp already downloaded
2025-12-05 11:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F14d9dd50-e2c2-49d9-a643-99fd4f1f9af2_3929dd69-d84c-41b9-b21f-0a9fc4b16249.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/14d9dd50-e2c2-49d9-a643-99fd4f1f9af2_3929dd69-d84c-41b9-b21f-0a9fc4b16249.jpg/250x188.webp already downloaded
2025-12-05 11:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F14d9dd50-e2c2-49d9-a643-99fd4f1f9af2_291765c0-8027-4212-a179-6bed18cf4b6e.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/14d9dd50-e2c2-49d9-a643-99fd4f1f9af2_291765c0-8027-4212-a179-6bed18cf4b6e.jpg/250x188.webp already downloaded
2025-12-05 11:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F14d9dd50-e2c2-49d9-a643-99fd4f1f9af2_4b298762-8864-4ed2-8321-ba8667190030.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/14d9dd50-e2c2-49d9-a643-99fd4f1f9af2_4b298762-8864-4ed2-8321-ba8667190030.jpg/250x188.webp already downloaded
2025-12-05 11:58:43 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: ab2bfca1-939c-544c-bea6-5b766883d370 with identifier 14d9dd50-e2c2-49d9-a643-99fd4f1f9af2
2025-12-05 11:58:43 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 11:58:43 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 11:58:43 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item ab2bfca1-939c-544c-bea6-5b766883d370
2025-12-05 11:58:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autoscout24.it/api/dealer-detail/fetch-listings>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'emission_standard': None,
 'engine': None,
 'engine_horse_power': 95,
 'expiration_date': None,
 'fuel_type': 'Gasoline',
 'id': 'ab2bfca1-939c-544c-bea6-5b766883d370',
 'is_damaged': False,
 'is_operable': True,
 'license_plate': None,
 'link_to_web_offer': 'https://www.autoscout24.it/offers/volkswagen-t-cross-1-0-tsi-edition-plus-95cv-nuovo-uff-italia-promo-gasoline-grey-14d9dd50-e2c2-49d9-a643-99fd4f1f9af2',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Cross',
 'odometer': 1,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 6,
 'photo_urls': ['https://prod.pictures.autoscout24.net/listing-images/14d9dd50-e2c2-49d9-a643-99fd4f1f9af2_3d56723a-d80e-4fc9-8323-4b4d005dcfa6.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/14d9dd50-e2c2-49d9-a643-99fd4f1f9af2_9f88065e-dbfb-4119-afb4-ab9720a31015.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/14d9dd50-e2c2-49d9-a643-99fd4f1f9af2_e3823768-7652-4847-8bd2-7142bf33b27b.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/14d9dd50-e2c2-49d9-a643-99fd4f1f9af2_3929dd69-d84c-41b9-b21f-0a9fc4b16249.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/14d9dd50-e2c2-49d9-a643-99fd4f1f9af2_291765c0-8027-4212-a179-6bed18cf4b6e.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/14d9dd50-e2c2-49d9-a643-99fd4f1f9af2_4b298762-8864-4ed2-8321-ba8667190030.jpg/250x188.webp'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f365ded6-92c7-57e6-acff-17ab6aac7847/f365ded6-92c7-57e6-acff-17ab6aac7847_image_0.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3792,
             'Height': 167,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/14d9dd50-e2c2-49d9-a643-99fd4f1f9af2_3d56723a-d80e-4fc9-8323-4b4d005dcfa6.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f365ded6-92c7-57e6-acff-17ab6aac7847/f365ded6-92c7-57e6-acff-17ab6aac7847_image_1.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 2838,
             'Height': 130,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/14d9dd50-e2c2-49d9-a643-99fd4f1f9af2_9f88065e-dbfb-4119-afb4-ab9720a31015.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f365ded6-92c7-57e6-acff-17ab6aac7847/f365ded6-92c7-57e6-acff-17ab6aac7847_image_2.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3640,
             'Height': 168,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/14d9dd50-e2c2-49d9-a643-99fd4f1f9af2_e3823768-7652-4847-8bd2-7142bf33b27b.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f365ded6-92c7-57e6-acff-17ab6aac7847/f365ded6-92c7-57e6-acff-17ab6aac7847_image_3.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3066,
             'Height': 140,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/14d9dd50-e2c2-49d9-a643-99fd4f1f9af2_3929dd69-d84c-41b9-b21f-0a9fc4b16249.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f365ded6-92c7-57e6-acff-17ab6aac7847/f365ded6-92c7-57e6-acff-17ab6aac7847_image_4.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 2876,
             'Height': 139,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/14d9dd50-e2c2-49d9-a643-99fd4f1f9af2_291765c0-8027-4212-a179-6bed18cf4b6e.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f365ded6-92c7-57e6-acff-17ab6aac7847/f365ded6-92c7-57e6-acff-17ab6aac7847_image_5.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 2120,
             'Height': 140,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/14d9dd50-e2c2-49d9-a643-99fd4f1f9af2_4b298762-8864-4ed2-8321-ba8667190030.jpg/250x188.webp',
             'Width': 250}],
 'price': 21900,
 'price_includes_vat': False,
 'registration_date': '2025-12-01',
 'seller_name': None,
 'title': 'Volkswagen T-Cross 1.0 TSI EDITION PLUS 95CV NUOVO UFF. ITALIA '
          'PROMO',
 'transmission': 'automatic',
 'trim': '1.0 TSI EDITION PLUS 95CV NUOVO UFF. ITALIA PROMO',
 'vin': None,
 'year': 2025}
2025-12-05 11:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%2714d9dd50-e2c2-49d9-a643-99fd4f1f9af2%27 HTTP/1.1" 200 None
2025-12-05 11:58:43 [auto_selling_autoscout24.it] INFO: Saving data for 14d9dd50-e2c2-49d9-a643-99fd4f1f9af2: {'created_time': 1764935923.939724, 'last_price_update_time': 1764935923.939739}
2025-12-05 11:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autoscout24.it',RowKey='14d9dd50-e2c2-49d9-a643-99fd4f1f9af2') HTTP/1.1" 204 0
2025-12-05 11:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%2772b1f3a4-82c2-4094-ae08-b4a719bd7be1%27 HTTP/1.1" 200 None
2025-12-05 11:58:43 [auto_selling_autoscout24.it] INFO: Scrape type for 72b1f3a4-82c2-4094-ae08-b4a719bd7be1: 1
2025-12-05 11:58:43 [auto_selling_autoscout24.it] INFO: Scraping new listing 72b1f3a4-82c2-4094-ae08-b4a719bd7be1
2025-12-05 11:58:43 [auto_selling_autoscout24.it] INFO: Extracting item from listing ID: 72b1f3a4-82c2-4094-ae08-b4a719bd7be1
2025-12-05 11:58:43 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: f3127c45-f0e4-5cdd-bf5f-7b00976bb994 with identifier: 72b1f3a4-82c2-4094-ae08-b4a719bd7be1
2025-12-05 11:58:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item f3127c45-f0e4-5cdd-bf5f-7b00976bb994
2025-12-05 11:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F72b1f3a4-82c2-4094-ae08-b4a719bd7be1_36891af6-1bba-41f3-b10e-47771333ccbc.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/72b1f3a4-82c2-4094-ae08-b4a719bd7be1_36891af6-1bba-41f3-b10e-47771333ccbc.jpg/250x188.webp already downloaded
2025-12-05 11:58:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F72b1f3a4-82c2-4094-ae08-b4a719bd7be1_b59a5550-76bd-474c-8005-639ed226c154.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/72b1f3a4-82c2-4094-ae08-b4a719bd7be1_b59a5550-76bd-474c-8005-639ed226c154.jpg/250x188.webp already downloaded
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F72b1f3a4-82c2-4094-ae08-b4a719bd7be1_157ffc2f-704e-4c79-992d-5dc9752d0c55.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/72b1f3a4-82c2-4094-ae08-b4a719bd7be1_157ffc2f-704e-4c79-992d-5dc9752d0c55.jpg/250x188.webp already downloaded
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F72b1f3a4-82c2-4094-ae08-b4a719bd7be1_d8c29d4a-919c-42e2-8fe6-1075087fda26.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/72b1f3a4-82c2-4094-ae08-b4a719bd7be1_d8c29d4a-919c-42e2-8fe6-1075087fda26.jpg/250x188.webp already downloaded
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F72b1f3a4-82c2-4094-ae08-b4a719bd7be1_592910f4-2ecc-4661-a965-ed815d8cd2ca.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/72b1f3a4-82c2-4094-ae08-b4a719bd7be1_592910f4-2ecc-4661-a965-ed815d8cd2ca.jpg/250x188.webp already downloaded
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F72b1f3a4-82c2-4094-ae08-b4a719bd7be1_d85888cb-cd07-4489-a23b-2ba20f131b11.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/72b1f3a4-82c2-4094-ae08-b4a719bd7be1_d85888cb-cd07-4489-a23b-2ba20f131b11.jpg/250x188.webp already downloaded
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F72b1f3a4-82c2-4094-ae08-b4a719bd7be1_71027530-d7b3-49c8-a3b1-f793742f8f80.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/72b1f3a4-82c2-4094-ae08-b4a719bd7be1_71027530-d7b3-49c8-a3b1-f793742f8f80.jpg/250x188.webp already downloaded
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F72b1f3a4-82c2-4094-ae08-b4a719bd7be1_b5503341-d030-405b-ac48-49774cb2bb40.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/72b1f3a4-82c2-4094-ae08-b4a719bd7be1_b5503341-d030-405b-ac48-49774cb2bb40.jpg/250x188.webp already downloaded
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F72b1f3a4-82c2-4094-ae08-b4a719bd7be1_ccbc4efe-8433-4f9d-b7d7-7d5ecbfb34c8.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/72b1f3a4-82c2-4094-ae08-b4a719bd7be1_ccbc4efe-8433-4f9d-b7d7-7d5ecbfb34c8.jpg/250x188.webp already downloaded
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F72b1f3a4-82c2-4094-ae08-b4a719bd7be1_7a2618d8-ea60-4cce-9248-6418f0785168.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/72b1f3a4-82c2-4094-ae08-b4a719bd7be1_7a2618d8-ea60-4cce-9248-6418f0785168.jpg/250x188.webp already downloaded
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F72b1f3a4-82c2-4094-ae08-b4a719bd7be1_20757fca-f5eb-4c69-bcd7-dc5395fae5e0.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/72b1f3a4-82c2-4094-ae08-b4a719bd7be1_20757fca-f5eb-4c69-bcd7-dc5395fae5e0.jpg/250x188.webp already downloaded
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F72b1f3a4-82c2-4094-ae08-b4a719bd7be1_94e26532-46a0-4210-b2ca-bce22f0449d5.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/72b1f3a4-82c2-4094-ae08-b4a719bd7be1_94e26532-46a0-4210-b2ca-bce22f0449d5.jpg/250x188.webp already downloaded
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F72b1f3a4-82c2-4094-ae08-b4a719bd7be1_8ab1ebff-9fd6-4662-a46d-e2a6ff55d4bf.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/72b1f3a4-82c2-4094-ae08-b4a719bd7be1_8ab1ebff-9fd6-4662-a46d-e2a6ff55d4bf.jpg/250x188.webp already downloaded
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F72b1f3a4-82c2-4094-ae08-b4a719bd7be1_24a5859a-26b2-4e17-bafa-878e4a6494ce.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/72b1f3a4-82c2-4094-ae08-b4a719bd7be1_24a5859a-26b2-4e17-bafa-878e4a6494ce.jpg/250x188.webp already downloaded
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F72b1f3a4-82c2-4094-ae08-b4a719bd7be1_39dec824-0123-4a56-93b3-eb806c181b37.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/72b1f3a4-82c2-4094-ae08-b4a719bd7be1_39dec824-0123-4a56-93b3-eb806c181b37.jpg/250x188.webp already downloaded
2025-12-05 11:58:44 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: f3127c45-f0e4-5cdd-bf5f-7b00976bb994 with identifier 72b1f3a4-82c2-4094-ae08-b4a719bd7be1
2025-12-05 11:58:44 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 11:58:44 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 11:58:44 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item f3127c45-f0e4-5cdd-bf5f-7b00976bb994
2025-12-05 11:58:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autoscout24.it/api/dealer-detail/fetch-listings>
{'auction_title': '',
 'c_o_2_emission_value': 89,
 'category': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'emission_standard': None,
 'engine': None,
 'engine_horse_power': 69,
 'expiration_date': None,
 'fuel_type': 'Electric/Gasoline',
 'id': 'f3127c45-f0e4-5cdd-bf5f-7b00976bb994',
 'is_damaged': False,
 'is_operable': True,
 'license_plate': None,
 'link_to_web_offer': 'https://www.autoscout24.it/offers/fiat-panda-cross-1-0-gse-firefly-hybrid-70cv-5posti-promo-electric-gasoline-black-72b1f3a4-82c2-4094-ae08-b4a719bd7be1',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 15300,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://prod.pictures.autoscout24.net/listing-images/72b1f3a4-82c2-4094-ae08-b4a719bd7be1_36891af6-1bba-41f3-b10e-47771333ccbc.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/72b1f3a4-82c2-4094-ae08-b4a719bd7be1_b59a5550-76bd-474c-8005-639ed226c154.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/72b1f3a4-82c2-4094-ae08-b4a719bd7be1_157ffc2f-704e-4c79-992d-5dc9752d0c55.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/72b1f3a4-82c2-4094-ae08-b4a719bd7be1_d8c29d4a-919c-42e2-8fe6-1075087fda26.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/72b1f3a4-82c2-4094-ae08-b4a719bd7be1_592910f4-2ecc-4661-a965-ed815d8cd2ca.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/72b1f3a4-82c2-4094-ae08-b4a719bd7be1_d85888cb-cd07-4489-a23b-2ba20f131b11.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/72b1f3a4-82c2-4094-ae08-b4a719bd7be1_71027530-d7b3-49c8-a3b1-f793742f8f80.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/72b1f3a4-82c2-4094-ae08-b4a719bd7be1_b5503341-d030-405b-ac48-49774cb2bb40.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/72b1f3a4-82c2-4094-ae08-b4a719bd7be1_ccbc4efe-8433-4f9d-b7d7-7d5ecbfb34c8.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/72b1f3a4-82c2-4094-ae08-b4a719bd7be1_7a2618d8-ea60-4cce-9248-6418f0785168.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/72b1f3a4-82c2-4094-ae08-b4a719bd7be1_20757fca-f5eb-4c69-bcd7-dc5395fae5e0.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/72b1f3a4-82c2-4094-ae08-b4a719bd7be1_94e26532-46a0-4210-b2ca-bce22f0449d5.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/72b1f3a4-82c2-4094-ae08-b4a719bd7be1_8ab1ebff-9fd6-4662-a46d-e2a6ff55d4bf.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/72b1f3a4-82c2-4094-ae08-b4a719bd7be1_24a5859a-26b2-4e17-bafa-878e4a6494ce.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/72b1f3a4-82c2-4094-ae08-b4a719bd7be1_39dec824-0123-4a56-93b3-eb806c181b37.jpg/250x188.webp'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_482df83c-fd2f-5f4f-bba2-33513eac657f/482df83c-fd2f-5f4f-bba2-33513eac657f_image_0.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4628,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/72b1f3a4-82c2-4094-ae08-b4a719bd7be1_36891af6-1bba-41f3-b10e-47771333ccbc.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_482df83c-fd2f-5f4f-bba2-33513eac657f/482df83c-fd2f-5f4f-bba2-33513eac657f_image_1.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4718,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/72b1f3a4-82c2-4094-ae08-b4a719bd7be1_b59a5550-76bd-474c-8005-639ed226c154.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_482df83c-fd2f-5f4f-bba2-33513eac657f/482df83c-fd2f-5f4f-bba2-33513eac657f_image_2.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4360,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/72b1f3a4-82c2-4094-ae08-b4a719bd7be1_157ffc2f-704e-4c79-992d-5dc9752d0c55.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_482df83c-fd2f-5f4f-bba2-33513eac657f/482df83c-fd2f-5f4f-bba2-33513eac657f_image_3.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4374,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/72b1f3a4-82c2-4094-ae08-b4a719bd7be1_d8c29d4a-919c-42e2-8fe6-1075087fda26.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_482df83c-fd2f-5f4f-bba2-33513eac657f/482df83c-fd2f-5f4f-bba2-33513eac657f_image_4.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5954,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/72b1f3a4-82c2-4094-ae08-b4a719bd7be1_592910f4-2ecc-4661-a965-ed815d8cd2ca.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_482df83c-fd2f-5f4f-bba2-33513eac657f/482df83c-fd2f-5f4f-bba2-33513eac657f_image_5.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4674,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/72b1f3a4-82c2-4094-ae08-b4a719bd7be1_d85888cb-cd07-4489-a23b-2ba20f131b11.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_482df83c-fd2f-5f4f-bba2-33513eac657f/482df83c-fd2f-5f4f-bba2-33513eac657f_image_6.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 7696,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/72b1f3a4-82c2-4094-ae08-b4a719bd7be1_71027530-d7b3-49c8-a3b1-f793742f8f80.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_482df83c-fd2f-5f4f-bba2-33513eac657f/482df83c-fd2f-5f4f-bba2-33513eac657f_image_7.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5678,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/72b1f3a4-82c2-4094-ae08-b4a719bd7be1_b5503341-d030-405b-ac48-49774cb2bb40.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_482df83c-fd2f-5f4f-bba2-33513eac657f/482df83c-fd2f-5f4f-bba2-33513eac657f_image_8.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 7036,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/72b1f3a4-82c2-4094-ae08-b4a719bd7be1_ccbc4efe-8433-4f9d-b7d7-7d5ecbfb34c8.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_482df83c-fd2f-5f4f-bba2-33513eac657f/482df83c-fd2f-5f4f-bba2-33513eac657f_image_9.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5904,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/72b1f3a4-82c2-4094-ae08-b4a719bd7be1_7a2618d8-ea60-4cce-9248-6418f0785168.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_482df83c-fd2f-5f4f-bba2-33513eac657f/482df83c-fd2f-5f4f-bba2-33513eac657f_image_10.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4434,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/72b1f3a4-82c2-4094-ae08-b4a719bd7be1_20757fca-f5eb-4c69-bcd7-dc5395fae5e0.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_482df83c-fd2f-5f4f-bba2-33513eac657f/482df83c-fd2f-5f4f-bba2-33513eac657f_image_11.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5326,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/72b1f3a4-82c2-4094-ae08-b4a719bd7be1_94e26532-46a0-4210-b2ca-bce22f0449d5.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_482df83c-fd2f-5f4f-bba2-33513eac657f/482df83c-fd2f-5f4f-bba2-33513eac657f_image_12.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5810,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/72b1f3a4-82c2-4094-ae08-b4a719bd7be1_8ab1ebff-9fd6-4662-a46d-e2a6ff55d4bf.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_482df83c-fd2f-5f4f-bba2-33513eac657f/482df83c-fd2f-5f4f-bba2-33513eac657f_image_13.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3860,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/72b1f3a4-82c2-4094-ae08-b4a719bd7be1_24a5859a-26b2-4e17-bafa-878e4a6494ce.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_482df83c-fd2f-5f4f-bba2-33513eac657f/482df83c-fd2f-5f4f-bba2-33513eac657f_image_14.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4480,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/72b1f3a4-82c2-4094-ae08-b4a719bd7be1_39dec824-0123-4a56-93b3-eb806c181b37.jpg/250x188.webp',
             'Width': 250}],
 'price': 12500,
 'price_includes_vat': False,
 'registration_date': '2023-02-01',
 'seller_name': None,
 'title': 'Fiat Panda CROSS 1.0 GSE FIREFLY HYBRID 70CV 5POSTI PROMO!',
 'transmission': 'automatic',
 'trim': 'CROSS 1.0 GSE FIREFLY HYBRID 70CV 5POSTI PROMO!',
 'vin': None,
 'year': 2023}
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%2772b1f3a4-82c2-4094-ae08-b4a719bd7be1%27 HTTP/1.1" 200 None
2025-12-05 11:58:44 [auto_selling_autoscout24.it] INFO: Saving data for 72b1f3a4-82c2-4094-ae08-b4a719bd7be1: {'created_time': 1764935924.264605, 'last_price_update_time': 1764935924.264615}
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autoscout24.it',RowKey='72b1f3a4-82c2-4094-ae08-b4a719bd7be1') HTTP/1.1" 204 0
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%278c6f2477-d7df-43d9-81df-1daf7912495b%27 HTTP/1.1" 200 None
2025-12-05 11:58:44 [auto_selling_autoscout24.it] INFO: Scrape type for 8c6f2477-d7df-43d9-81df-1daf7912495b: 1
2025-12-05 11:58:44 [auto_selling_autoscout24.it] INFO: Scraping new listing 8c6f2477-d7df-43d9-81df-1daf7912495b
2025-12-05 11:58:44 [auto_selling_autoscout24.it] INFO: Extracting item from listing ID: 8c6f2477-d7df-43d9-81df-1daf7912495b
2025-12-05 11:58:44 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: b84a8ee0-13b5-573a-ba4a-f3789e19e162 with identifier: 8c6f2477-d7df-43d9-81df-1daf7912495b
2025-12-05 11:58:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item b84a8ee0-13b5-573a-ba4a-f3789e19e162
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F8c6f2477-d7df-43d9-81df-1daf7912495b_fc61bb3d-3259-4cbf-9e59-9f218513a72b.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/8c6f2477-d7df-43d9-81df-1daf7912495b_fc61bb3d-3259-4cbf-9e59-9f218513a72b.jpg/250x188.webp already downloaded
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F8c6f2477-d7df-43d9-81df-1daf7912495b_db4f45da-0a61-4b67-b15c-a528fe1af7a1.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/8c6f2477-d7df-43d9-81df-1daf7912495b_db4f45da-0a61-4b67-b15c-a528fe1af7a1.jpg/250x188.webp already downloaded
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F8c6f2477-d7df-43d9-81df-1daf7912495b_51453449-f4cc-409a-aa4d-bee3df84fdb5.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/8c6f2477-d7df-43d9-81df-1daf7912495b_51453449-f4cc-409a-aa4d-bee3df84fdb5.jpg/250x188.webp already downloaded
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F8c6f2477-d7df-43d9-81df-1daf7912495b_1ab5a9dd-5610-4e87-b513-712895780f53.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/8c6f2477-d7df-43d9-81df-1daf7912495b_1ab5a9dd-5610-4e87-b513-712895780f53.jpg/250x188.webp already downloaded
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F8c6f2477-d7df-43d9-81df-1daf7912495b_16aa85f3-fb38-4417-a32e-98eda5cb70e6.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/8c6f2477-d7df-43d9-81df-1daf7912495b_16aa85f3-fb38-4417-a32e-98eda5cb70e6.jpg/250x188.webp already downloaded
2025-12-05 11:58:44 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: b84a8ee0-13b5-573a-ba4a-f3789e19e162 with identifier 8c6f2477-d7df-43d9-81df-1daf7912495b
2025-12-05 11:58:44 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 11:58:44 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 11:58:44 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item b84a8ee0-13b5-573a-ba4a-f3789e19e162
2025-12-05 11:58:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autoscout24.it/api/dealer-detail/fetch-listings>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'emission_standard': None,
 'engine': None,
 'engine_horse_power': 318,
 'expiration_date': None,
 'fuel_type': 'Gasoline',
 'id': 'b84a8ee0-13b5-573a-ba4a-f3789e19e162',
 'is_damaged': False,
 'is_operable': True,
 'license_plate': None,
 'link_to_web_offer': 'https://www.autoscout24.it/offers/genesis-gv60-sport-4wd-318cv-nuovo-modello-in-esclusiva-gasoline-black-8c6f2477-d7df-43d9-81df-1daf7912495b',
 'listing': 'auction',
 'make': 'Genesis',
 'model': 'GV60',
 'odometer': 1,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 5,
 'photo_urls': ['https://prod.pictures.autoscout24.net/listing-images/8c6f2477-d7df-43d9-81df-1daf7912495b_fc61bb3d-3259-4cbf-9e59-9f218513a72b.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/8c6f2477-d7df-43d9-81df-1daf7912495b_db4f45da-0a61-4b67-b15c-a528fe1af7a1.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/8c6f2477-d7df-43d9-81df-1daf7912495b_51453449-f4cc-409a-aa4d-bee3df84fdb5.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/8c6f2477-d7df-43d9-81df-1daf7912495b_1ab5a9dd-5610-4e87-b513-712895780f53.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/8c6f2477-d7df-43d9-81df-1daf7912495b_16aa85f3-fb38-4417-a32e-98eda5cb70e6.jpg/250x188.webp'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3061091f-6652-5095-a993-b40df451a5af/3061091f-6652-5095-a993-b40df451a5af_image_0.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4916,
             'Height': 169,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/8c6f2477-d7df-43d9-81df-1daf7912495b_fc61bb3d-3259-4cbf-9e59-9f218513a72b.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3061091f-6652-5095-a993-b40df451a5af/3061091f-6652-5095-a993-b40df451a5af_image_1.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4648,
             'Height': 179,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/8c6f2477-d7df-43d9-81df-1daf7912495b_db4f45da-0a61-4b67-b15c-a528fe1af7a1.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3061091f-6652-5095-a993-b40df451a5af/3061091f-6652-5095-a993-b40df451a5af_image_2.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 6214,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/8c6f2477-d7df-43d9-81df-1daf7912495b_51453449-f4cc-409a-aa4d-bee3df84fdb5.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3061091f-6652-5095-a993-b40df451a5af/3061091f-6652-5095-a993-b40df451a5af_image_3.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4886,
             'Height': 183,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/8c6f2477-d7df-43d9-81df-1daf7912495b_1ab5a9dd-5610-4e87-b513-712895780f53.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3061091f-6652-5095-a993-b40df451a5af/3061091f-6652-5095-a993-b40df451a5af_image_4.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3462,
             'Height': 188,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/8c6f2477-d7df-43d9-81df-1daf7912495b_16aa85f3-fb38-4417-a32e-98eda5cb70e6.jpg/250x188.webp',
             'Width': 249}],
 'price': 54800,
 'price_includes_vat': False,
 'registration_date': '2024-05-01',
 'seller_name': None,
 'title': 'Genesis GV60 SPORT 4WD 318CV NUOVO MODELLO IN ESCLUSIVA!',
 'transmission': 'automatic',
 'trim': 'SPORT 4WD 318CV NUOVO MODELLO IN ESCLUSIVA!',
 'vin': None,
 'year': 2024}
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%278c6f2477-d7df-43d9-81df-1daf7912495b%27 HTTP/1.1" 200 None
2025-12-05 11:58:44 [auto_selling_autoscout24.it] INFO: Saving data for 8c6f2477-d7df-43d9-81df-1daf7912495b: {'created_time': 1764935924.402268, 'last_price_update_time': 1764935924.402278}
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autoscout24.it',RowKey='8c6f2477-d7df-43d9-81df-1daf7912495b') HTTP/1.1" 204 0
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%2786eee66d-3a0a-4a9e-ae6e-78db6cc4d7f0%27 HTTP/1.1" 200 None
2025-12-05 11:58:44 [auto_selling_autoscout24.it] INFO: Scrape type for 86eee66d-3a0a-4a9e-ae6e-78db6cc4d7f0: 1
2025-12-05 11:58:44 [auto_selling_autoscout24.it] INFO: Scraping new listing 86eee66d-3a0a-4a9e-ae6e-78db6cc4d7f0
2025-12-05 11:58:44 [auto_selling_autoscout24.it] INFO: Extracting item from listing ID: 86eee66d-3a0a-4a9e-ae6e-78db6cc4d7f0
2025-12-05 11:58:44 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: a0dd769e-5156-59c4-a16d-c6d2da048e16 with identifier: 86eee66d-3a0a-4a9e-ae6e-78db6cc4d7f0
2025-12-05 11:58:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item a0dd769e-5156-59c4-a16d-c6d2da048e16
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F86eee66d-3a0a-4a9e-ae6e-78db6cc4d7f0_23e18cac-7508-4bf9-b73a-39b788593e1c.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/86eee66d-3a0a-4a9e-ae6e-78db6cc4d7f0_23e18cac-7508-4bf9-b73a-39b788593e1c.jpg/250x188.webp already downloaded
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F86eee66d-3a0a-4a9e-ae6e-78db6cc4d7f0_dfcff3ee-9a3a-4479-9a42-35aa24fa7066.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/86eee66d-3a0a-4a9e-ae6e-78db6cc4d7f0_dfcff3ee-9a3a-4479-9a42-35aa24fa7066.jpg/250x188.webp already downloaded
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F86eee66d-3a0a-4a9e-ae6e-78db6cc4d7f0_0dab92c4-f1f5-4f38-9e4a-91d2b901cae8.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/86eee66d-3a0a-4a9e-ae6e-78db6cc4d7f0_0dab92c4-f1f5-4f38-9e4a-91d2b901cae8.jpg/250x188.webp already downloaded
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F86eee66d-3a0a-4a9e-ae6e-78db6cc4d7f0_37ae4c45-4e34-48ab-974c-359c231e10f7.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/86eee66d-3a0a-4a9e-ae6e-78db6cc4d7f0_37ae4c45-4e34-48ab-974c-359c231e10f7.jpg/250x188.webp already downloaded
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F86eee66d-3a0a-4a9e-ae6e-78db6cc4d7f0_4906b6a2-11c4-4a95-b649-7ce4054363a4.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/86eee66d-3a0a-4a9e-ae6e-78db6cc4d7f0_4906b6a2-11c4-4a95-b649-7ce4054363a4.jpg/250x188.webp already downloaded
2025-12-05 11:58:44 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: a0dd769e-5156-59c4-a16d-c6d2da048e16 with identifier 86eee66d-3a0a-4a9e-ae6e-78db6cc4d7f0
2025-12-05 11:58:44 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 11:58:44 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 11:58:44 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item a0dd769e-5156-59c4-a16d-c6d2da048e16
2025-12-05 11:58:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autoscout24.it/api/dealer-detail/fetch-listings>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'emission_standard': None,
 'engine': None,
 'engine_horse_power': 305,
 'expiration_date': None,
 'fuel_type': 'Gasoline',
 'id': 'a0dd769e-5156-59c4-a16d-c6d2da048e16',
 'is_damaged': False,
 'is_operable': True,
 'license_plate': None,
 'link_to_web_offer': 'https://www.autoscout24.it/offers/genesis-gv70-2-5t-sport-4wd-305cv-nuovo-modello-in-esclusiva-gasoline-grey-86eee66d-3a0a-4a9e-ae6e-78db6cc4d7f0',
 'listing': 'auction',
 'make': 'Genesis',
 'model': 'GV70',
 'odometer': 1,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 5,
 'photo_urls': ['https://prod.pictures.autoscout24.net/listing-images/86eee66d-3a0a-4a9e-ae6e-78db6cc4d7f0_23e18cac-7508-4bf9-b73a-39b788593e1c.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/86eee66d-3a0a-4a9e-ae6e-78db6cc4d7f0_dfcff3ee-9a3a-4479-9a42-35aa24fa7066.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/86eee66d-3a0a-4a9e-ae6e-78db6cc4d7f0_0dab92c4-f1f5-4f38-9e4a-91d2b901cae8.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/86eee66d-3a0a-4a9e-ae6e-78db6cc4d7f0_37ae4c45-4e34-48ab-974c-359c231e10f7.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/86eee66d-3a0a-4a9e-ae6e-78db6cc4d7f0_4906b6a2-11c4-4a95-b649-7ce4054363a4.jpg/250x188.webp'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f13016f9-f89e-5579-b163-aadcf03b5b9b/f13016f9-f89e-5579-b163-aadcf03b5b9b_image_0.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4346,
             'Height': 179,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/86eee66d-3a0a-4a9e-ae6e-78db6cc4d7f0_23e18cac-7508-4bf9-b73a-39b788593e1c.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f13016f9-f89e-5579-b163-aadcf03b5b9b/f13016f9-f89e-5579-b163-aadcf03b5b9b_image_1.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 6662,
             'Height': 186,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/86eee66d-3a0a-4a9e-ae6e-78db6cc4d7f0_dfcff3ee-9a3a-4479-9a42-35aa24fa7066.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f13016f9-f89e-5579-b163-aadcf03b5b9b/f13016f9-f89e-5579-b163-aadcf03b5b9b_image_2.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5090,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/86eee66d-3a0a-4a9e-ae6e-78db6cc4d7f0_0dab92c4-f1f5-4f38-9e4a-91d2b901cae8.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f13016f9-f89e-5579-b163-aadcf03b5b9b/f13016f9-f89e-5579-b163-aadcf03b5b9b_image_3.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3196,
             'Height': 184,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/86eee66d-3a0a-4a9e-ae6e-78db6cc4d7f0_37ae4c45-4e34-48ab-974c-359c231e10f7.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f13016f9-f89e-5579-b163-aadcf03b5b9b/f13016f9-f89e-5579-b163-aadcf03b5b9b_image_4.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4872,
             'Height': 186,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/86eee66d-3a0a-4a9e-ae6e-78db6cc4d7f0_4906b6a2-11c4-4a95-b649-7ce4054363a4.jpg/250x188.webp',
             'Width': 250}],
 'price': 55800,
 'price_includes_vat': False,
 'registration_date': '2025-03-01',
 'seller_name': None,
 'title': 'Genesis GV70 2.5T SPORT 4WD 305CV NUOVO MODELLO IN ESCLUSIVA!',
 'transmission': 'automatic',
 'trim': '2.5T SPORT 4WD 305CV NUOVO MODELLO IN ESCLUSIVA!',
 'vin': None,
 'year': 2025}
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%2786eee66d-3a0a-4a9e-ae6e-78db6cc4d7f0%27 HTTP/1.1" 200 None
2025-12-05 11:58:44 [auto_selling_autoscout24.it] INFO: Saving data for 86eee66d-3a0a-4a9e-ae6e-78db6cc4d7f0: {'created_time': 1764935924.531383, 'last_price_update_time': 1764935924.531391}
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autoscout24.it',RowKey='86eee66d-3a0a-4a9e-ae6e-78db6cc4d7f0') HTTP/1.1" 204 0
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%273d353afe-e78e-4582-bf5a-d6fe449970ae%27 HTTP/1.1" 200 None
2025-12-05 11:58:44 [auto_selling_autoscout24.it] INFO: Scrape type for 3d353afe-e78e-4582-bf5a-d6fe449970ae: 1
2025-12-05 11:58:44 [auto_selling_autoscout24.it] INFO: Scraping new listing 3d353afe-e78e-4582-bf5a-d6fe449970ae
2025-12-05 11:58:44 [auto_selling_autoscout24.it] INFO: Extracting item from listing ID: 3d353afe-e78e-4582-bf5a-d6fe449970ae
2025-12-05 11:58:44 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: e30d62fe-2ead-5f1a-b839-064aa61eba0c with identifier: 3d353afe-e78e-4582-bf5a-d6fe449970ae
2025-12-05 11:58:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item e30d62fe-2ead-5f1a-b839-064aa61eba0c
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F3d353afe-e78e-4582-bf5a-d6fe449970ae_2e72c2b4-875e-4bcd-afc9-bcb5eb9c206a.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/3d353afe-e78e-4582-bf5a-d6fe449970ae_2e72c2b4-875e-4bcd-afc9-bcb5eb9c206a.jpg/250x188.webp not downloaded yet
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F3d353afe-e78e-4582-bf5a-d6fe449970ae_76279068-4ace-4a5f-9939-b09b0a9765cf.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/3d353afe-e78e-4582-bf5a-d6fe449970ae_76279068-4ace-4a5f-9939-b09b0a9765cf.jpg/250x188.webp not downloaded yet
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F3d353afe-e78e-4582-bf5a-d6fe449970ae_2b4ce521-1919-4484-9e48-a4ee9d27e887.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/3d353afe-e78e-4582-bf5a-d6fe449970ae_2b4ce521-1919-4484-9e48-a4ee9d27e887.jpg/250x188.webp not downloaded yet
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F3d353afe-e78e-4582-bf5a-d6fe449970ae_2e05b594-9be9-47c6-9dea-8cbcf5014ea1.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/3d353afe-e78e-4582-bf5a-d6fe449970ae_2e05b594-9be9-47c6-9dea-8cbcf5014ea1.jpg/250x188.webp not downloaded yet
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F3d353afe-e78e-4582-bf5a-d6fe449970ae_ab732d26-e6ba-48f5-9599-88c87717df19.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/3d353afe-e78e-4582-bf5a-d6fe449970ae_ab732d26-e6ba-48f5-9599-88c87717df19.jpg/250x188.webp not downloaded yet
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F3d353afe-e78e-4582-bf5a-d6fe449970ae_47d830c2-0a06-428b-945f-5f67790bd7cb.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/3d353afe-e78e-4582-bf5a-d6fe449970ae_47d830c2-0a06-428b-945f-5f67790bd7cb.jpg/250x188.webp not downloaded yet
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%273d168cd6-139c-4ebc-98a9-7c7678a651d5%27 HTTP/1.1" 200 None
2025-12-05 11:58:44 [auto_selling_autoscout24.it] INFO: Scrape type for 3d168cd6-139c-4ebc-98a9-7c7678a651d5: 1
2025-12-05 11:58:44 [auto_selling_autoscout24.it] INFO: Scraping new listing 3d168cd6-139c-4ebc-98a9-7c7678a651d5
2025-12-05 11:58:44 [auto_selling_autoscout24.it] INFO: Extracting item from listing ID: 3d168cd6-139c-4ebc-98a9-7c7678a651d5
2025-12-05 11:58:44 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ad7a47a-8da0-5f8d-93df-51ddb8c4064b with identifier: 3d168cd6-139c-4ebc-98a9-7c7678a651d5
2025-12-05 11:58:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 14 photos for item 4ad7a47a-8da0-5f8d-93df-51ddb8c4064b
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F3d168cd6-139c-4ebc-98a9-7c7678a651d5_4c604d5a-f71f-40de-877e-a355b5208add.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/3d168cd6-139c-4ebc-98a9-7c7678a651d5_4c604d5a-f71f-40de-877e-a355b5208add.jpg/250x188.webp not downloaded yet
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F3d168cd6-139c-4ebc-98a9-7c7678a651d5_825e5779-9cc2-4273-8974-2497a8db89e8.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/3d168cd6-139c-4ebc-98a9-7c7678a651d5_825e5779-9cc2-4273-8974-2497a8db89e8.jpg/250x188.webp not downloaded yet
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F3d168cd6-139c-4ebc-98a9-7c7678a651d5_4a74dbc1-aad4-4d86-b663-fc85ce65c6a2.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/3d168cd6-139c-4ebc-98a9-7c7678a651d5_4a74dbc1-aad4-4d86-b663-fc85ce65c6a2.jpg/250x188.webp not downloaded yet
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F3d168cd6-139c-4ebc-98a9-7c7678a651d5_6ba3a39a-b774-4c2f-bcb5-036ebc6749f8.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/3d168cd6-139c-4ebc-98a9-7c7678a651d5_6ba3a39a-b774-4c2f-bcb5-036ebc6749f8.jpg/250x188.webp not downloaded yet
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F3d168cd6-139c-4ebc-98a9-7c7678a651d5_931958ba-a5f9-43ac-8efb-19ac22ba72cb.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/3d168cd6-139c-4ebc-98a9-7c7678a651d5_931958ba-a5f9-43ac-8efb-19ac22ba72cb.jpg/250x188.webp not downloaded yet
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F3d168cd6-139c-4ebc-98a9-7c7678a651d5_014acf10-89f5-4243-9a02-ff24f0fd8fa9.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/3d168cd6-139c-4ebc-98a9-7c7678a651d5_014acf10-89f5-4243-9a02-ff24f0fd8fa9.jpg/250x188.webp not downloaded yet
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F3d168cd6-139c-4ebc-98a9-7c7678a651d5_0a563b85-145a-48af-b616-203956710a5d.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/3d168cd6-139c-4ebc-98a9-7c7678a651d5_0a563b85-145a-48af-b616-203956710a5d.jpg/250x188.webp not downloaded yet
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F3d168cd6-139c-4ebc-98a9-7c7678a651d5_12b0c2ea-685c-4452-bb69-8bef02f6ff04.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/3d168cd6-139c-4ebc-98a9-7c7678a651d5_12b0c2ea-685c-4452-bb69-8bef02f6ff04.jpg/250x188.webp not downloaded yet
2025-12-05 11:58:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/3d353afe-e78e-4582-bf5a-d6fe449970ae_2e72c2b4-875e-4bcd-afc9-bcb5eb9c206a.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F3d168cd6-139c-4ebc-98a9-7c7678a651d5_b741e95e-a7e1-4a80-b310-c35f793a656f.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/3d168cd6-139c-4ebc-98a9-7c7678a651d5_b741e95e-a7e1-4a80-b310-c35f793a656f.jpg/250x188.webp not downloaded yet
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F3d168cd6-139c-4ebc-98a9-7c7678a651d5_597200cb-b00f-4eef-9515-8d4b3f9beb7d.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/3d168cd6-139c-4ebc-98a9-7c7678a651d5_597200cb-b00f-4eef-9515-8d4b3f9beb7d.jpg/250x188.webp not downloaded yet
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F3d168cd6-139c-4ebc-98a9-7c7678a651d5_44aa481f-392f-4e45-a11e-7c629f0bf772.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/3d168cd6-139c-4ebc-98a9-7c7678a651d5_44aa481f-392f-4e45-a11e-7c629f0bf772.jpg/250x188.webp not downloaded yet
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F3d168cd6-139c-4ebc-98a9-7c7678a651d5_367b216e-6120-43c3-9c75-c45fdf45b57d.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/3d168cd6-139c-4ebc-98a9-7c7678a651d5_367b216e-6120-43c3-9c75-c45fdf45b57d.jpg/250x188.webp not downloaded yet
2025-12-05 11:58:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/3d168cd6-139c-4ebc-98a9-7c7678a651d5_12b0c2ea-685c-4452-bb69-8bef02f6ff04.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F3d168cd6-139c-4ebc-98a9-7c7678a651d5_6fbecf16-11e4-4cf3-b8da-e33741674b1c.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/3d168cd6-139c-4ebc-98a9-7c7678a651d5_6fbecf16-11e4-4cf3-b8da-e33741674b1c.jpg/250x188.webp not downloaded yet
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F3d168cd6-139c-4ebc-98a9-7c7678a651d5_4ef003d7-547d-40cb-8cf5-94c9f4523a95.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/3d168cd6-139c-4ebc-98a9-7c7678a651d5_4ef003d7-547d-40cb-8cf5-94c9f4523a95.jpg/250x188.webp not downloaded yet
2025-12-05 11:58:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/3d353afe-e78e-4582-bf5a-d6fe449970ae_2b4ce521-1919-4484-9e48-a4ee9d27e887.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:58:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/3d353afe-e78e-4582-bf5a-d6fe449970ae_76279068-4ace-4a5f-9939-b09b0a9765cf.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27b504080c-0aef-4786-bd19-e038b9406ca7%27 HTTP/1.1" 200 None
2025-12-05 11:58:44 [auto_selling_autoscout24.it] INFO: Scrape type for b504080c-0aef-4786-bd19-e038b9406ca7: 1
2025-12-05 11:58:44 [auto_selling_autoscout24.it] INFO: Scraping new listing b504080c-0aef-4786-bd19-e038b9406ca7
2025-12-05 11:58:44 [auto_selling_autoscout24.it] INFO: Extracting item from listing ID: b504080c-0aef-4786-bd19-e038b9406ca7
2025-12-05 11:58:44 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: aa4c9789-518c-5e71-8666-95c6e397fa64 with identifier: b504080c-0aef-4786-bd19-e038b9406ca7
2025-12-05 11:58:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 11 photos for item aa4c9789-518c-5e71-8666-95c6e397fa64
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fb504080c-0aef-4786-bd19-e038b9406ca7_28ed9476-daf8-40c6-904c-a3af26199850.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/b504080c-0aef-4786-bd19-e038b9406ca7_28ed9476-daf8-40c6-904c-a3af26199850.jpg/250x188.webp already downloaded
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fb504080c-0aef-4786-bd19-e038b9406ca7_b39b26b2-5c56-4844-ad29-26ae34143d55.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/b504080c-0aef-4786-bd19-e038b9406ca7_b39b26b2-5c56-4844-ad29-26ae34143d55.jpg/250x188.webp already downloaded
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fb504080c-0aef-4786-bd19-e038b9406ca7_b88b5043-adea-4f3a-801c-a481a372ae5d.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/b504080c-0aef-4786-bd19-e038b9406ca7_b88b5043-adea-4f3a-801c-a481a372ae5d.jpg/250x188.webp already downloaded
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fb504080c-0aef-4786-bd19-e038b9406ca7_49062b4b-81e2-4d8f-94ab-4d4bcce2780c.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/b504080c-0aef-4786-bd19-e038b9406ca7_49062b4b-81e2-4d8f-94ab-4d4bcce2780c.jpg/250x188.webp already downloaded
2025-12-05 11:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fb504080c-0aef-4786-bd19-e038b9406ca7_7239d8c1-0ca1-4529-ba80-43bb50329237.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/b504080c-0aef-4786-bd19-e038b9406ca7_7239d8c1-0ca1-4529-ba80-43bb50329237.jpg/250x188.webp already downloaded
2025-12-05 11:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fb504080c-0aef-4786-bd19-e038b9406ca7_abff15ec-2a42-46d1-afc8-ca9320d64723.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/b504080c-0aef-4786-bd19-e038b9406ca7_abff15ec-2a42-46d1-afc8-ca9320d64723.jpg/250x188.webp already downloaded
2025-12-05 11:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fb504080c-0aef-4786-bd19-e038b9406ca7_967b0c10-5b5f-4663-b56a-f425836c77a1.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/b504080c-0aef-4786-bd19-e038b9406ca7_967b0c10-5b5f-4663-b56a-f425836c77a1.jpg/250x188.webp already downloaded
2025-12-05 11:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fb504080c-0aef-4786-bd19-e038b9406ca7_ef987078-7e23-46d9-ab48-e1cf2b43eb5f.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/b504080c-0aef-4786-bd19-e038b9406ca7_ef987078-7e23-46d9-ab48-e1cf2b43eb5f.jpg/250x188.webp already downloaded
2025-12-05 11:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fb504080c-0aef-4786-bd19-e038b9406ca7_1ee682f2-eaa5-4e27-9721-6900a7943b04.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/b504080c-0aef-4786-bd19-e038b9406ca7_1ee682f2-eaa5-4e27-9721-6900a7943b04.jpg/250x188.webp already downloaded
2025-12-05 11:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fb504080c-0aef-4786-bd19-e038b9406ca7_2ee73ac8-d8e8-4799-9cc2-a89cc4be6c89.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/b504080c-0aef-4786-bd19-e038b9406ca7_2ee73ac8-d8e8-4799-9cc2-a89cc4be6c89.jpg/250x188.webp already downloaded
2025-12-05 11:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fb504080c-0aef-4786-bd19-e038b9406ca7_984dd954-c653-4420-ac1a-3785696ad24a.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/b504080c-0aef-4786-bd19-e038b9406ca7_984dd954-c653-4420-ac1a-3785696ad24a.jpg/250x188.webp already downloaded
2025-12-05 11:58:45 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: aa4c9789-518c-5e71-8666-95c6e397fa64 with identifier b504080c-0aef-4786-bd19-e038b9406ca7
2025-12-05 11:58:45 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 11:58:45 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 11:58:45 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item aa4c9789-518c-5e71-8666-95c6e397fa64
2025-12-05 11:58:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autoscout24.it/api/dealer-detail/fetch-listings>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'emission_standard': None,
 'engine': None,
 'engine_horse_power': 204,
 'expiration_date': None,
 'fuel_type': 'Electric/Gasoline',
 'id': 'aa4c9789-518c-5e71-8666-95c6e397fa64',
 'is_damaged': False,
 'is_operable': True,
 'license_plate': None,
 'link_to_web_offer': 'https://www.autoscout24.it/offers/audi-a5-avant-s-line-tfsi-s-tronic-204cv-my25-only-promo-electric-gasoline-grey-b504080c-0aef-4786-bd19-e038b9406ca7',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5',
 'odometer': 11000,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 11,
 'photo_urls': ['https://prod.pictures.autoscout24.net/listing-images/b504080c-0aef-4786-bd19-e038b9406ca7_28ed9476-daf8-40c6-904c-a3af26199850.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/b504080c-0aef-4786-bd19-e038b9406ca7_b39b26b2-5c56-4844-ad29-26ae34143d55.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/b504080c-0aef-4786-bd19-e038b9406ca7_b88b5043-adea-4f3a-801c-a481a372ae5d.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/b504080c-0aef-4786-bd19-e038b9406ca7_49062b4b-81e2-4d8f-94ab-4d4bcce2780c.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/b504080c-0aef-4786-bd19-e038b9406ca7_7239d8c1-0ca1-4529-ba80-43bb50329237.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/b504080c-0aef-4786-bd19-e038b9406ca7_abff15ec-2a42-46d1-afc8-ca9320d64723.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/b504080c-0aef-4786-bd19-e038b9406ca7_967b0c10-5b5f-4663-b56a-f425836c77a1.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/b504080c-0aef-4786-bd19-e038b9406ca7_ef987078-7e23-46d9-ab48-e1cf2b43eb5f.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/b504080c-0aef-4786-bd19-e038b9406ca7_1ee682f2-eaa5-4e27-9721-6900a7943b04.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/b504080c-0aef-4786-bd19-e038b9406ca7_2ee73ac8-d8e8-4799-9cc2-a89cc4be6c89.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/b504080c-0aef-4786-bd19-e038b9406ca7_984dd954-c653-4420-ac1a-3785696ad24a.jpg/250x188.webp'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3852abac-ccd3-576a-960f-a181b7bc2382/3852abac-ccd3-576a-960f-a181b7bc2382_image_0.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4898,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/b504080c-0aef-4786-bd19-e038b9406ca7_28ed9476-daf8-40c6-904c-a3af26199850.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3852abac-ccd3-576a-960f-a181b7bc2382/3852abac-ccd3-576a-960f-a181b7bc2382_image_1.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4074,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/b504080c-0aef-4786-bd19-e038b9406ca7_b39b26b2-5c56-4844-ad29-26ae34143d55.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3852abac-ccd3-576a-960f-a181b7bc2382/3852abac-ccd3-576a-960f-a181b7bc2382_image_2.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4768,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/b504080c-0aef-4786-bd19-e038b9406ca7_b88b5043-adea-4f3a-801c-a481a372ae5d.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3852abac-ccd3-576a-960f-a181b7bc2382/3852abac-ccd3-576a-960f-a181b7bc2382_image_3.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4438,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/b504080c-0aef-4786-bd19-e038b9406ca7_49062b4b-81e2-4d8f-94ab-4d4bcce2780c.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3852abac-ccd3-576a-960f-a181b7bc2382/3852abac-ccd3-576a-960f-a181b7bc2382_image_4.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 6660,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/b504080c-0aef-4786-bd19-e038b9406ca7_7239d8c1-0ca1-4529-ba80-43bb50329237.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3852abac-ccd3-576a-960f-a181b7bc2382/3852abac-ccd3-576a-960f-a181b7bc2382_image_5.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 8326,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/b504080c-0aef-4786-bd19-e038b9406ca7_abff15ec-2a42-46d1-afc8-ca9320d64723.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3852abac-ccd3-576a-960f-a181b7bc2382/3852abac-ccd3-576a-960f-a181b7bc2382_image_6.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5792,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/b504080c-0aef-4786-bd19-e038b9406ca7_967b0c10-5b5f-4663-b56a-f425836c77a1.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3852abac-ccd3-576a-960f-a181b7bc2382/3852abac-ccd3-576a-960f-a181b7bc2382_image_7.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 6808,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/b504080c-0aef-4786-bd19-e038b9406ca7_ef987078-7e23-46d9-ab48-e1cf2b43eb5f.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3852abac-ccd3-576a-960f-a181b7bc2382/3852abac-ccd3-576a-960f-a181b7bc2382_image_8.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 6070,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/b504080c-0aef-4786-bd19-e038b9406ca7_1ee682f2-eaa5-4e27-9721-6900a7943b04.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3852abac-ccd3-576a-960f-a181b7bc2382/3852abac-ccd3-576a-960f-a181b7bc2382_image_9.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5564,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/b504080c-0aef-4786-bd19-e038b9406ca7_2ee73ac8-d8e8-4799-9cc2-a89cc4be6c89.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3852abac-ccd3-576a-960f-a181b7bc2382/3852abac-ccd3-576a-960f-a181b7bc2382_image_10.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5398,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/b504080c-0aef-4786-bd19-e038b9406ca7_984dd954-c653-4420-ac1a-3785696ad24a.jpg/250x188.webp',
             'Width': 250}],
 'price': 52800,
 'price_includes_vat': False,
 'registration_date': '2025-01-01',
 'seller_name': None,
 'title': 'Audi A5 AVANT S-LINE TFSI S-TRONIC 204CV MY25 ONLY PROMO',
 'transmission': 'automatic',
 'trim': 'AVANT S-LINE TFSI S-TRONIC 204CV MY25 ONLY PROMO',
 'vin': None,
 'year': 2025}
2025-12-05 11:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27b504080c-0aef-4786-bd19-e038b9406ca7%27 HTTP/1.1" 200 None
2025-12-05 11:58:45 [auto_selling_autoscout24.it] INFO: Saving data for b504080c-0aef-4786-bd19-e038b9406ca7: {'created_time': 1764935925.151871, 'last_price_update_time': 1764935925.151882}
2025-12-05 11:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autoscout24.it',RowKey='b504080c-0aef-4786-bd19-e038b9406ca7') HTTP/1.1" 204 0
2025-12-05 11:58:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/3d353afe-e78e-4582-bf5a-d6fe449970ae_2e05b594-9be9-47c6-9dea-8cbcf5014ea1.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:58:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/3d353afe-e78e-4582-bf5a-d6fe449970ae_ab732d26-e6ba-48f5-9599-88c87717df19.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:58:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/3d168cd6-139c-4ebc-98a9-7c7678a651d5_367b216e-6120-43c3-9c75-c45fdf45b57d.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27d9704f4b-67c2-4a8b-8ba4-b393e7fa0d07%27 HTTP/1.1" 200 None
2025-12-05 11:58:45 [auto_selling_autoscout24.it] INFO: Scrape type for d9704f4b-67c2-4a8b-8ba4-b393e7fa0d07: 1
2025-12-05 11:58:45 [auto_selling_autoscout24.it] INFO: Scraping new listing d9704f4b-67c2-4a8b-8ba4-b393e7fa0d07
2025-12-05 11:58:45 [auto_selling_autoscout24.it] INFO: Extracting item from listing ID: d9704f4b-67c2-4a8b-8ba4-b393e7fa0d07
2025-12-05 11:58:45 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: c90685b5-e38d-50c3-8730-33149f7fda54 with identifier: d9704f4b-67c2-4a8b-8ba4-b393e7fa0d07
2025-12-05 11:58:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item c90685b5-e38d-50c3-8730-33149f7fda54
2025-12-05 11:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fd9704f4b-67c2-4a8b-8ba4-b393e7fa0d07_30d7db22-1fac-44ec-86ac-4f799f2e83d2.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/d9704f4b-67c2-4a8b-8ba4-b393e7fa0d07_30d7db22-1fac-44ec-86ac-4f799f2e83d2.jpg/250x188.webp already downloaded
2025-12-05 11:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fd9704f4b-67c2-4a8b-8ba4-b393e7fa0d07_ef2ae923-0b75-407d-9182-7a73848026f1.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/d9704f4b-67c2-4a8b-8ba4-b393e7fa0d07_ef2ae923-0b75-407d-9182-7a73848026f1.jpg/250x188.webp already downloaded
2025-12-05 11:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fd9704f4b-67c2-4a8b-8ba4-b393e7fa0d07_4bfb2f7b-2205-4365-8d39-bee418f09791.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/d9704f4b-67c2-4a8b-8ba4-b393e7fa0d07_4bfb2f7b-2205-4365-8d39-bee418f09791.jpg/250x188.webp already downloaded
2025-12-05 11:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fd9704f4b-67c2-4a8b-8ba4-b393e7fa0d07_4600f6e4-dc55-41ee-9cd3-ab7b65453ab7.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/d9704f4b-67c2-4a8b-8ba4-b393e7fa0d07_4600f6e4-dc55-41ee-9cd3-ab7b65453ab7.jpg/250x188.webp already downloaded
2025-12-05 11:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fd9704f4b-67c2-4a8b-8ba4-b393e7fa0d07_2a64cc42-86bb-46c0-8661-f290eed1d2d9.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/d9704f4b-67c2-4a8b-8ba4-b393e7fa0d07_2a64cc42-86bb-46c0-8661-f290eed1d2d9.jpg/250x188.webp already downloaded
2025-12-05 11:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fd9704f4b-67c2-4a8b-8ba4-b393e7fa0d07_0bab9d60-e0dd-4092-a23a-d502acef6192.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/d9704f4b-67c2-4a8b-8ba4-b393e7fa0d07_0bab9d60-e0dd-4092-a23a-d502acef6192.jpg/250x188.webp already downloaded
2025-12-05 11:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fd9704f4b-67c2-4a8b-8ba4-b393e7fa0d07_be3f9db1-1109-4bee-98e5-02e73fcc586d.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/d9704f4b-67c2-4a8b-8ba4-b393e7fa0d07_be3f9db1-1109-4bee-98e5-02e73fcc586d.jpg/250x188.webp already downloaded
2025-12-05 11:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fd9704f4b-67c2-4a8b-8ba4-b393e7fa0d07_3b6e2725-903a-470b-bcaf-c3e06da3947d.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/d9704f4b-67c2-4a8b-8ba4-b393e7fa0d07_3b6e2725-903a-470b-bcaf-c3e06da3947d.jpg/250x188.webp already downloaded
2025-12-05 11:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fd9704f4b-67c2-4a8b-8ba4-b393e7fa0d07_cfbc59a9-b2db-4185-b7dd-dbc1a605b537.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/d9704f4b-67c2-4a8b-8ba4-b393e7fa0d07_cfbc59a9-b2db-4185-b7dd-dbc1a605b537.jpg/250x188.webp already downloaded
2025-12-05 11:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fd9704f4b-67c2-4a8b-8ba4-b393e7fa0d07_8b20cea0-9d34-4619-ad7f-e169e6f688f6.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/d9704f4b-67c2-4a8b-8ba4-b393e7fa0d07_8b20cea0-9d34-4619-ad7f-e169e6f688f6.jpg/250x188.webp already downloaded
2025-12-05 11:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fd9704f4b-67c2-4a8b-8ba4-b393e7fa0d07_29dbb9ef-e04b-40c8-8448-792c5bd71d81.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/d9704f4b-67c2-4a8b-8ba4-b393e7fa0d07_29dbb9ef-e04b-40c8-8448-792c5bd71d81.jpg/250x188.webp already downloaded
2025-12-05 11:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fd9704f4b-67c2-4a8b-8ba4-b393e7fa0d07_345b097a-9002-425e-bc0b-7dafdb4d99d4.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/d9704f4b-67c2-4a8b-8ba4-b393e7fa0d07_345b097a-9002-425e-bc0b-7dafdb4d99d4.jpg/250x188.webp already downloaded
2025-12-05 11:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fd9704f4b-67c2-4a8b-8ba4-b393e7fa0d07_82428728-63c2-4beb-a04c-c63b66f3c44e.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/d9704f4b-67c2-4a8b-8ba4-b393e7fa0d07_82428728-63c2-4beb-a04c-c63b66f3c44e.jpg/250x188.webp already downloaded
2025-12-05 11:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fd9704f4b-67c2-4a8b-8ba4-b393e7fa0d07_fdb55a3f-7088-4f60-9758-e78d74dbc88d.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/d9704f4b-67c2-4a8b-8ba4-b393e7fa0d07_fdb55a3f-7088-4f60-9758-e78d74dbc88d.jpg/250x188.webp already downloaded
2025-12-05 11:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fd9704f4b-67c2-4a8b-8ba4-b393e7fa0d07_d8c8d209-dc55-41a9-8a29-3f53518048a6.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/d9704f4b-67c2-4a8b-8ba4-b393e7fa0d07_d8c8d209-dc55-41a9-8a29-3f53518048a6.jpg/250x188.webp already downloaded
2025-12-05 11:58:45 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: c90685b5-e38d-50c3-8730-33149f7fda54 with identifier d9704f4b-67c2-4a8b-8ba4-b393e7fa0d07
2025-12-05 11:58:45 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 11:58:45 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 11:58:45 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item c90685b5-e38d-50c3-8730-33149f7fda54
2025-12-05 11:58:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autoscout24.it/api/dealer-detail/fetch-listings>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'emission_standard': None,
 'engine': None,
 'engine_horse_power': 204,
 'expiration_date': None,
 'fuel_type': 'Electric/Diesel',
 'id': 'c90685b5-e38d-50c3-8730-33149f7fda54',
 'is_damaged': False,
 'is_operable': True,
 'license_plate': None,
 'link_to_web_offer': 'https://www.autoscout24.it/offers/audi-q5-spb-2-0-tdi-qtr-s-tr-s-line-204cv-facelift-promo-electric-diesel-black-d9704f4b-67c2-4a8b-8ba4-b393e7fa0d07',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 1,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://prod.pictures.autoscout24.net/listing-images/d9704f4b-67c2-4a8b-8ba4-b393e7fa0d07_30d7db22-1fac-44ec-86ac-4f799f2e83d2.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/d9704f4b-67c2-4a8b-8ba4-b393e7fa0d07_ef2ae923-0b75-407d-9182-7a73848026f1.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/d9704f4b-67c2-4a8b-8ba4-b393e7fa0d07_4bfb2f7b-2205-4365-8d39-bee418f09791.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/d9704f4b-67c2-4a8b-8ba4-b393e7fa0d07_4600f6e4-dc55-41ee-9cd3-ab7b65453ab7.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/d9704f4b-67c2-4a8b-8ba4-b393e7fa0d07_2a64cc42-86bb-46c0-8661-f290eed1d2d9.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/d9704f4b-67c2-4a8b-8ba4-b393e7fa0d07_0bab9d60-e0dd-4092-a23a-d502acef6192.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/d9704f4b-67c2-4a8b-8ba4-b393e7fa0d07_be3f9db1-1109-4bee-98e5-02e73fcc586d.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/d9704f4b-67c2-4a8b-8ba4-b393e7fa0d07_3b6e2725-903a-470b-bcaf-c3e06da3947d.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/d9704f4b-67c2-4a8b-8ba4-b393e7fa0d07_cfbc59a9-b2db-4185-b7dd-dbc1a605b537.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/d9704f4b-67c2-4a8b-8ba4-b393e7fa0d07_8b20cea0-9d34-4619-ad7f-e169e6f688f6.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/d9704f4b-67c2-4a8b-8ba4-b393e7fa0d07_29dbb9ef-e04b-40c8-8448-792c5bd71d81.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/d9704f4b-67c2-4a8b-8ba4-b393e7fa0d07_345b097a-9002-425e-bc0b-7dafdb4d99d4.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/d9704f4b-67c2-4a8b-8ba4-b393e7fa0d07_82428728-63c2-4beb-a04c-c63b66f3c44e.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/d9704f4b-67c2-4a8b-8ba4-b393e7fa0d07_fdb55a3f-7088-4f60-9758-e78d74dbc88d.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/d9704f4b-67c2-4a8b-8ba4-b393e7fa0d07_d8c8d209-dc55-41a9-8a29-3f53518048a6.jpg/250x188.webp'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_136efa46-e79b-5d2e-a4c6-95b3371933e9/136efa46-e79b-5d2e-a4c6-95b3371933e9_image_0.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5112,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/d9704f4b-67c2-4a8b-8ba4-b393e7fa0d07_30d7db22-1fac-44ec-86ac-4f799f2e83d2.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_136efa46-e79b-5d2e-a4c6-95b3371933e9/136efa46-e79b-5d2e-a4c6-95b3371933e9_image_1.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 6084,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/d9704f4b-67c2-4a8b-8ba4-b393e7fa0d07_ef2ae923-0b75-407d-9182-7a73848026f1.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_136efa46-e79b-5d2e-a4c6-95b3371933e9/136efa46-e79b-5d2e-a4c6-95b3371933e9_image_2.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4584,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/d9704f4b-67c2-4a8b-8ba4-b393e7fa0d07_4bfb2f7b-2205-4365-8d39-bee418f09791.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_136efa46-e79b-5d2e-a4c6-95b3371933e9/136efa46-e79b-5d2e-a4c6-95b3371933e9_image_3.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4748,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/d9704f4b-67c2-4a8b-8ba4-b393e7fa0d07_4600f6e4-dc55-41ee-9cd3-ab7b65453ab7.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_136efa46-e79b-5d2e-a4c6-95b3371933e9/136efa46-e79b-5d2e-a4c6-95b3371933e9_image_4.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4644,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/d9704f4b-67c2-4a8b-8ba4-b393e7fa0d07_2a64cc42-86bb-46c0-8661-f290eed1d2d9.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_136efa46-e79b-5d2e-a4c6-95b3371933e9/136efa46-e79b-5d2e-a4c6-95b3371933e9_image_5.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4526,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/d9704f4b-67c2-4a8b-8ba4-b393e7fa0d07_0bab9d60-e0dd-4092-a23a-d502acef6192.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_136efa46-e79b-5d2e-a4c6-95b3371933e9/136efa46-e79b-5d2e-a4c6-95b3371933e9_image_6.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5668,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/d9704f4b-67c2-4a8b-8ba4-b393e7fa0d07_be3f9db1-1109-4bee-98e5-02e73fcc586d.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_136efa46-e79b-5d2e-a4c6-95b3371933e9/136efa46-e79b-5d2e-a4c6-95b3371933e9_image_7.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 8554,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/d9704f4b-67c2-4a8b-8ba4-b393e7fa0d07_3b6e2725-903a-470b-bcaf-c3e06da3947d.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_136efa46-e79b-5d2e-a4c6-95b3371933e9/136efa46-e79b-5d2e-a4c6-95b3371933e9_image_8.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5642,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/d9704f4b-67c2-4a8b-8ba4-b393e7fa0d07_cfbc59a9-b2db-4185-b7dd-dbc1a605b537.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_136efa46-e79b-5d2e-a4c6-95b3371933e9/136efa46-e79b-5d2e-a4c6-95b3371933e9_image_9.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 7322,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/d9704f4b-67c2-4a8b-8ba4-b393e7fa0d07_8b20cea0-9d34-4619-ad7f-e169e6f688f6.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_136efa46-e79b-5d2e-a4c6-95b3371933e9/136efa46-e79b-5d2e-a4c6-95b3371933e9_image_10.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 6760,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/d9704f4b-67c2-4a8b-8ba4-b393e7fa0d07_29dbb9ef-e04b-40c8-8448-792c5bd71d81.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_136efa46-e79b-5d2e-a4c6-95b3371933e9/136efa46-e79b-5d2e-a4c6-95b3371933e9_image_11.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5668,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/d9704f4b-67c2-4a8b-8ba4-b393e7fa0d07_345b097a-9002-425e-bc0b-7dafdb4d99d4.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_136efa46-e79b-5d2e-a4c6-95b3371933e9/136efa46-e79b-5d2e-a4c6-95b3371933e9_image_12.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4824,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/d9704f4b-67c2-4a8b-8ba4-b393e7fa0d07_82428728-63c2-4beb-a04c-c63b66f3c44e.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_136efa46-e79b-5d2e-a4c6-95b3371933e9/136efa46-e79b-5d2e-a4c6-95b3371933e9_image_13.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 6176,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/d9704f4b-67c2-4a8b-8ba4-b393e7fa0d07_fdb55a3f-7088-4f60-9758-e78d74dbc88d.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_136efa46-e79b-5d2e-a4c6-95b3371933e9/136efa46-e79b-5d2e-a4c6-95b3371933e9_image_14.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4540,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/d9704f4b-67c2-4a8b-8ba4-b393e7fa0d07_d8c8d209-dc55-41a9-8a29-3f53518048a6.jpg/250x188.webp',
             'Width': 250}],
 'price': 61900,
 'price_includes_vat': False,
 'registration_date': '2025-08-01',
 'seller_name': None,
 'title': 'Audi Q5 SPB 2.0 TDI QTR. S-TR. S-LINE 204CV FACELIFT PROMO',
 'transmission': 'automatic',
 'trim': 'SPB 2.0 TDI QTR. S-TR. S-LINE 204CV FACELIFT PROMO',
 'vin': None,
 'year': 2025}
2025-12-05 11:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27d9704f4b-67c2-4a8b-8ba4-b393e7fa0d07%27 HTTP/1.1" 200 None
2025-12-05 11:58:45 [auto_selling_autoscout24.it] INFO: Saving data for d9704f4b-67c2-4a8b-8ba4-b393e7fa0d07: {'created_time': 1764935925.437454, 'last_price_update_time': 1764935925.437467}
2025-12-05 11:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autoscout24.it',RowKey='d9704f4b-67c2-4a8b-8ba4-b393e7fa0d07') HTTP/1.1" 204 0
2025-12-05 11:58:45 [PIL.Image] DEBUG: Importing BlpImagePlugin
2025-12-05 11:58:45 [PIL.Image] DEBUG: Importing BmpImagePlugin
2025-12-05 11:58:45 [PIL.Image] DEBUG: Importing BufrStubImagePlugin
2025-12-05 11:58:45 [PIL.Image] DEBUG: Importing CurImagePlugin
2025-12-05 11:58:45 [PIL.Image] DEBUG: Importing DcxImagePlugin
2025-12-05 11:58:45 [PIL.Image] DEBUG: Importing DdsImagePlugin
2025-12-05 11:58:45 [PIL.Image] DEBUG: Importing EpsImagePlugin
2025-12-05 11:58:45 [PIL.Image] DEBUG: Importing FitsImagePlugin
2025-12-05 11:58:45 [PIL.Image] DEBUG: Importing FliImagePlugin
2025-12-05 11:58:45 [PIL.Image] DEBUG: Importing FpxImagePlugin
2025-12-05 11:58:45 [PIL.Image] DEBUG: Importing FtexImagePlugin
2025-12-05 11:58:45 [PIL.Image] DEBUG: Importing GbrImagePlugin
2025-12-05 11:58:45 [PIL.Image] DEBUG: Importing GifImagePlugin
2025-12-05 11:58:45 [PIL.Image] DEBUG: Importing GribStubImagePlugin
2025-12-05 11:58:45 [PIL.Image] DEBUG: Importing Hdf5StubImagePlugin
2025-12-05 11:58:45 [PIL.Image] DEBUG: Importing IcnsImagePlugin
2025-12-05 11:58:45 [PIL.Image] DEBUG: Importing IcoImagePlugin
2025-12-05 11:58:45 [PIL.Image] DEBUG: Importing ImImagePlugin
2025-12-05 11:58:45 [PIL.Image] DEBUG: Importing ImtImagePlugin
2025-12-05 11:58:45 [PIL.Image] DEBUG: Importing IptcImagePlugin
2025-12-05 11:58:45 [PIL.Image] DEBUG: Importing JpegImagePlugin
2025-12-05 11:58:45 [PIL.Image] DEBUG: Importing Jpeg2KImagePlugin
2025-12-05 11:58:45 [PIL.Image] DEBUG: Importing McIdasImagePlugin
2025-12-05 11:58:45 [PIL.Image] DEBUG: Importing MicImagePlugin
2025-12-05 11:58:45 [PIL.Image] DEBUG: Importing MpegImagePlugin
2025-12-05 11:58:45 [PIL.Image] DEBUG: Importing MpoImagePlugin
2025-12-05 11:58:45 [PIL.Image] DEBUG: Importing MspImagePlugin
2025-12-05 11:58:45 [PIL.Image] DEBUG: Importing PalmImagePlugin
2025-12-05 11:58:45 [PIL.Image] DEBUG: Importing PcdImagePlugin
2025-12-05 11:58:45 [PIL.Image] DEBUG: Importing PcxImagePlugin
2025-12-05 11:58:45 [PIL.Image] DEBUG: Importing PdfImagePlugin
2025-12-05 11:58:45 [PIL.Image] DEBUG: Importing PixarImagePlugin
2025-12-05 11:58:45 [PIL.Image] DEBUG: Importing PngImagePlugin
2025-12-05 11:58:45 [PIL.Image] DEBUG: Importing PpmImagePlugin
2025-12-05 11:58:45 [PIL.Image] DEBUG: Importing PsdImagePlugin
2025-12-05 11:58:45 [PIL.Image] DEBUG: Importing QoiImagePlugin
2025-12-05 11:58:45 [PIL.Image] DEBUG: Importing SgiImagePlugin
2025-12-05 11:58:45 [PIL.Image] DEBUG: Importing SpiderImagePlugin
2025-12-05 11:58:45 [PIL.Image] DEBUG: Importing SunImagePlugin
2025-12-05 11:58:45 [PIL.Image] DEBUG: Importing TgaImagePlugin
2025-12-05 11:58:45 [PIL.Image] DEBUG: Importing TiffImagePlugin
2025-12-05 11:58:45 [PIL.Image] DEBUG: Importing WebPImagePlugin
2025-12-05 11:58:45 [PIL.Image] DEBUG: Importing WmfImagePlugin
2025-12-05 11:58:45 [PIL.Image] DEBUG: Importing XbmImagePlugin
2025-12-05 11:58:45 [PIL.Image] DEBUG: Importing XpmImagePlugin
2025-12-05 11:58:45 [PIL.Image] DEBUG: Importing XVThumbImagePlugin
2025-12-05 11:58:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:58:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:58:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:58:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5c1cc50>
2025-12-05 11:58:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:58:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:58:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 11:58:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:58:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:58:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:58:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e30d62fe-2ead-5f1a-b839-064aa61eba0c/e30d62fe-2ead-5f1a-b839-064aa61eba0c_image_0.webp HTTP/1.1" 201 0
2025-12-05 11:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F3d353afe-e78e-4582-bf5a-d6fe449970ae_2e72c2b4-875e-4bcd-afc9-bcb5eb9c206a.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:58:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/3d353afe-e78e-4582-bf5a-d6fe449970ae_2e72c2b4-875e-4bcd-afc9-bcb5eb9c206a.jpg/250x188.webp saved to cache
2025-12-05 11:58:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e30d62fe-2ead-5f1a-b839-064aa61eba0c
2025-12-05 11:58:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:58:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:58:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:58:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5c3a310>
2025-12-05 11:58:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:58:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:58:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 11:58:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:58:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:58:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:58:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ad7a47a-8da0-5f8d-93df-51ddb8c4064b/4ad7a47a-8da0-5f8d-93df-51ddb8c4064b_image_7.webp HTTP/1.1" 201 0
2025-12-05 11:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F3d168cd6-139c-4ebc-98a9-7c7678a651d5_12b0c2ea-685c-4452-bb69-8bef02f6ff04.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:58:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/3d168cd6-139c-4ebc-98a9-7c7678a651d5_12b0c2ea-685c-4452-bb69-8bef02f6ff04.jpg/250x188.webp saved to cache
2025-12-05 11:58:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4ad7a47a-8da0-5f8d-93df-51ddb8c4064b
2025-12-05 11:58:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:58:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:58:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:58:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5c45310>
2025-12-05 11:58:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:58:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:58:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 11:58:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:58:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:58:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:58:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e30d62fe-2ead-5f1a-b839-064aa61eba0c/e30d62fe-2ead-5f1a-b839-064aa61eba0c_image_2.webp HTTP/1.1" 201 0
2025-12-05 11:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F3d353afe-e78e-4582-bf5a-d6fe449970ae_2b4ce521-1919-4484-9e48-a4ee9d27e887.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:58:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/3d353afe-e78e-4582-bf5a-d6fe449970ae_2b4ce521-1919-4484-9e48-a4ee9d27e887.jpg/250x188.webp saved to cache
2025-12-05 11:58:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e30d62fe-2ead-5f1a-b839-064aa61eba0c
2025-12-05 11:58:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:58:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:58:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:58:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5c3b990>
2025-12-05 11:58:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:58:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:58:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 11:58:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:58:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:58:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:58:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e30d62fe-2ead-5f1a-b839-064aa61eba0c/e30d62fe-2ead-5f1a-b839-064aa61eba0c_image_1.webp HTTP/1.1" 201 0
2025-12-05 11:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F3d353afe-e78e-4582-bf5a-d6fe449970ae_76279068-4ace-4a5f-9939-b09b0a9765cf.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:58:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/3d353afe-e78e-4582-bf5a-d6fe449970ae_76279068-4ace-4a5f-9939-b09b0a9765cf.jpg/250x188.webp saved to cache
2025-12-05 11:58:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e30d62fe-2ead-5f1a-b839-064aa61eba0c
2025-12-05 11:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%272537cbc4-dba6-4e1d-b485-df61d4b534a6%27 HTTP/1.1" 200 None
2025-12-05 11:58:46 [auto_selling_autoscout24.it] INFO: Scrape type for 2537cbc4-dba6-4e1d-b485-df61d4b534a6: 1
2025-12-05 11:58:46 [auto_selling_autoscout24.it] INFO: Scraping new listing 2537cbc4-dba6-4e1d-b485-df61d4b534a6
2025-12-05 11:58:46 [auto_selling_autoscout24.it] INFO: Extracting item from listing ID: 2537cbc4-dba6-4e1d-b485-df61d4b534a6
2025-12-05 11:58:46 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 97538c30-565f-5e3a-b523-ff0863c3c1f3 with identifier: 2537cbc4-dba6-4e1d-b485-df61d4b534a6
2025-12-05 11:58:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 7 photos for item 97538c30-565f-5e3a-b523-ff0863c3c1f3
2025-12-05 11:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F2537cbc4-dba6-4e1d-b485-df61d4b534a6_d697195b-6aa7-47e0-85f8-f1f856d146a4.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/2537cbc4-dba6-4e1d-b485-df61d4b534a6_d697195b-6aa7-47e0-85f8-f1f856d146a4.jpg/250x188.webp not downloaded yet
2025-12-05 11:58:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/3d168cd6-139c-4ebc-98a9-7c7678a651d5_4ef003d7-547d-40cb-8cf5-94c9f4523a95.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:58:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/3d168cd6-139c-4ebc-98a9-7c7678a651d5_6fbecf16-11e4-4cf3-b8da-e33741674b1c.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:58:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:58:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:58:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:58:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e53850>
2025-12-05 11:58:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:58:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:58:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 11:58:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:58:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:58:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:58:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e30d62fe-2ead-5f1a-b839-064aa61eba0c/e30d62fe-2ead-5f1a-b839-064aa61eba0c_image_3.webp HTTP/1.1" 201 0
2025-12-05 11:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F3d353afe-e78e-4582-bf5a-d6fe449970ae_2e05b594-9be9-47c6-9dea-8cbcf5014ea1.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:58:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/3d353afe-e78e-4582-bf5a-d6fe449970ae_2e05b594-9be9-47c6-9dea-8cbcf5014ea1.jpg/250x188.webp saved to cache
2025-12-05 11:58:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e30d62fe-2ead-5f1a-b839-064aa61eba0c
2025-12-05 11:58:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:58:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:58:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:58:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d6fd8410>
2025-12-05 11:58:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:58:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:58:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 11:58:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:58:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:58:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:58:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e30d62fe-2ead-5f1a-b839-064aa61eba0c/e30d62fe-2ead-5f1a-b839-064aa61eba0c_image_4.webp HTTP/1.1" 201 0
2025-12-05 11:58:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F3d353afe-e78e-4582-bf5a-d6fe449970ae_ab732d26-e6ba-48f5-9599-88c87717df19.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:58:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/3d353afe-e78e-4582-bf5a-d6fe449970ae_ab732d26-e6ba-48f5-9599-88c87717df19.jpg/250x188.webp saved to cache
2025-12-05 11:58:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e30d62fe-2ead-5f1a-b839-064aa61eba0c
2025-12-05 11:58:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:58:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:58:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:58:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e48510>
2025-12-05 11:58:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:58:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:58:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 11:58:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:58:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:58:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:58:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ad7a47a-8da0-5f8d-93df-51ddb8c4064b/4ad7a47a-8da0-5f8d-93df-51ddb8c4064b_image_11.webp HTTP/1.1" 201 0
2025-12-05 11:58:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F3d168cd6-139c-4ebc-98a9-7c7678a651d5_367b216e-6120-43c3-9c75-c45fdf45b57d.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:58:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/3d168cd6-139c-4ebc-98a9-7c7678a651d5_367b216e-6120-43c3-9c75-c45fdf45b57d.jpg/250x188.webp saved to cache
2025-12-05 11:58:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 4ad7a47a-8da0-5f8d-93df-51ddb8c4064b
2025-12-05 11:58:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/3d168cd6-139c-4ebc-98a9-7c7678a651d5_b741e95e-a7e1-4a80-b310-c35f793a656f.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:58:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/3d168cd6-139c-4ebc-98a9-7c7678a651d5_44aa481f-392f-4e45-a11e-7c629f0bf772.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:58:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F2537cbc4-dba6-4e1d-b485-df61d4b534a6_c54ee054-35d9-451f-94b7-5ce45e79e820.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/2537cbc4-dba6-4e1d-b485-df61d4b534a6_c54ee054-35d9-451f-94b7-5ce45e79e820.jpg/250x188.webp not downloaded yet
2025-12-05 11:58:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/3d168cd6-139c-4ebc-98a9-7c7678a651d5_597200cb-b00f-4eef-9515-8d4b3f9beb7d.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:58:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F2537cbc4-dba6-4e1d-b485-df61d4b534a6_106097c5-8d12-462c-aadc-b69b9d7e0ccb.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/2537cbc4-dba6-4e1d-b485-df61d4b534a6_106097c5-8d12-462c-aadc-b69b9d7e0ccb.jpg/250x188.webp not downloaded yet
2025-12-05 11:58:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:58:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:58:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:58:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e43990>
2025-12-05 11:58:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:58:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:58:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 11:58:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:58:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:58:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:58:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ad7a47a-8da0-5f8d-93df-51ddb8c4064b/4ad7a47a-8da0-5f8d-93df-51ddb8c4064b_image_13.webp HTTP/1.1" 201 0
2025-12-05 11:58:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F3d168cd6-139c-4ebc-98a9-7c7678a651d5_4ef003d7-547d-40cb-8cf5-94c9f4523a95.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:58:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/3d168cd6-139c-4ebc-98a9-7c7678a651d5_4ef003d7-547d-40cb-8cf5-94c9f4523a95.jpg/250x188.webp saved to cache
2025-12-05 11:58:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 4ad7a47a-8da0-5f8d-93df-51ddb8c4064b
2025-12-05 11:58:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:58:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:58:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:58:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e89490>
2025-12-05 11:58:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:58:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:58:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 11:58:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:58:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:58:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:58:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ad7a47a-8da0-5f8d-93df-51ddb8c4064b/4ad7a47a-8da0-5f8d-93df-51ddb8c4064b_image_12.webp HTTP/1.1" 201 0
2025-12-05 11:58:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F3d168cd6-139c-4ebc-98a9-7c7678a651d5_6fbecf16-11e4-4cf3-b8da-e33741674b1c.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:58:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/3d168cd6-139c-4ebc-98a9-7c7678a651d5_6fbecf16-11e4-4cf3-b8da-e33741674b1c.jpg/250x188.webp saved to cache
2025-12-05 11:58:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 4ad7a47a-8da0-5f8d-93df-51ddb8c4064b
2025-12-05 11:58:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/3d168cd6-139c-4ebc-98a9-7c7678a651d5_0a563b85-145a-48af-b616-203956710a5d.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:58:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/2537cbc4-dba6-4e1d-b485-df61d4b534a6_d697195b-6aa7-47e0-85f8-f1f856d146a4.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:58:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/3d168cd6-139c-4ebc-98a9-7c7678a651d5_014acf10-89f5-4243-9a02-ff24f0fd8fa9.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:58:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/3d168cd6-139c-4ebc-98a9-7c7678a651d5_931958ba-a5f9-43ac-8efb-19ac22ba72cb.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:58:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F2537cbc4-dba6-4e1d-b485-df61d4b534a6_a496a2fa-3635-43fb-b2b5-531f28953d93.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/2537cbc4-dba6-4e1d-b485-df61d4b534a6_a496a2fa-3635-43fb-b2b5-531f28953d93.jpg/250x188.webp not downloaded yet
2025-12-05 11:58:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F2537cbc4-dba6-4e1d-b485-df61d4b534a6_ceaa1e6d-2c7c-438c-8651-2a3c9b33f0c6.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/2537cbc4-dba6-4e1d-b485-df61d4b534a6_ceaa1e6d-2c7c-438c-8651-2a3c9b33f0c6.jpg/250x188.webp not downloaded yet
2025-12-05 11:58:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:58:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:58:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:58:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d6f6bfd0>
2025-12-05 11:58:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:58:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:58:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 11:58:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:58:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:58:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:58:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ad7a47a-8da0-5f8d-93df-51ddb8c4064b/4ad7a47a-8da0-5f8d-93df-51ddb8c4064b_image_8.webp HTTP/1.1" 201 0
2025-12-05 11:58:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F3d168cd6-139c-4ebc-98a9-7c7678a651d5_b741e95e-a7e1-4a80-b310-c35f793a656f.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:58:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/3d168cd6-139c-4ebc-98a9-7c7678a651d5_b741e95e-a7e1-4a80-b310-c35f793a656f.jpg/250x188.webp saved to cache
2025-12-05 11:58:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4ad7a47a-8da0-5f8d-93df-51ddb8c4064b
2025-12-05 11:58:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:58:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:58:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:58:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e7e990>
2025-12-05 11:58:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:58:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:58:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 11:58:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:58:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:58:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:58:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ad7a47a-8da0-5f8d-93df-51ddb8c4064b/4ad7a47a-8da0-5f8d-93df-51ddb8c4064b_image_10.webp HTTP/1.1" 201 0
2025-12-05 11:58:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F3d168cd6-139c-4ebc-98a9-7c7678a651d5_44aa481f-392f-4e45-a11e-7c629f0bf772.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:58:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/3d168cd6-139c-4ebc-98a9-7c7678a651d5_44aa481f-392f-4e45-a11e-7c629f0bf772.jpg/250x188.webp saved to cache
2025-12-05 11:58:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 4ad7a47a-8da0-5f8d-93df-51ddb8c4064b
2025-12-05 11:58:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:58:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:58:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:58:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d6fcf690>
2025-12-05 11:58:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:58:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:58:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 11:58:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:58:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:58:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:58:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ad7a47a-8da0-5f8d-93df-51ddb8c4064b/4ad7a47a-8da0-5f8d-93df-51ddb8c4064b_image_9.webp HTTP/1.1" 201 0
2025-12-05 11:58:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F3d168cd6-139c-4ebc-98a9-7c7678a651d5_597200cb-b00f-4eef-9515-8d4b3f9beb7d.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:58:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/3d168cd6-139c-4ebc-98a9-7c7678a651d5_597200cb-b00f-4eef-9515-8d4b3f9beb7d.jpg/250x188.webp saved to cache
2025-12-05 11:58:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4ad7a47a-8da0-5f8d-93df-51ddb8c4064b
2025-12-05 11:58:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F2537cbc4-dba6-4e1d-b485-df61d4b534a6_b6e535de-767f-4c23-9afb-4578cdd24827.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/2537cbc4-dba6-4e1d-b485-df61d4b534a6_b6e535de-767f-4c23-9afb-4578cdd24827.jpg/250x188.webp not downloaded yet
2025-12-05 11:58:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/2537cbc4-dba6-4e1d-b485-df61d4b534a6_c54ee054-35d9-451f-94b7-5ce45e79e820.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:58:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/2537cbc4-dba6-4e1d-b485-df61d4b534a6_106097c5-8d12-462c-aadc-b69b9d7e0ccb.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:58:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/3d168cd6-139c-4ebc-98a9-7c7678a651d5_4a74dbc1-aad4-4d86-b663-fc85ce65c6a2.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:58:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/3d168cd6-139c-4ebc-98a9-7c7678a651d5_825e5779-9cc2-4273-8974-2497a8db89e8.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:58:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/3d168cd6-139c-4ebc-98a9-7c7678a651d5_6ba3a39a-b774-4c2f-bcb5-036ebc6749f8.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:58:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F2537cbc4-dba6-4e1d-b485-df61d4b534a6_d253cd3a-4371-49cb-884d-f607fea929a9.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/2537cbc4-dba6-4e1d-b485-df61d4b534a6_d253cd3a-4371-49cb-884d-f607fea929a9.jpg/250x188.webp not downloaded yet
2025-12-05 11:58:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:58:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:58:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:58:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e78310>
2025-12-05 11:58:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:58:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:58:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 11:58:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:58:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:58:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:58:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ad7a47a-8da0-5f8d-93df-51ddb8c4064b/4ad7a47a-8da0-5f8d-93df-51ddb8c4064b_image_6.webp HTTP/1.1" 201 0
2025-12-05 11:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F3d168cd6-139c-4ebc-98a9-7c7678a651d5_0a563b85-145a-48af-b616-203956710a5d.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:58:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/3d168cd6-139c-4ebc-98a9-7c7678a651d5_0a563b85-145a-48af-b616-203956710a5d.jpg/250x188.webp saved to cache
2025-12-05 11:58:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4ad7a47a-8da0-5f8d-93df-51ddb8c4064b
2025-12-05 11:58:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:58:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:58:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:58:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e04210>
2025-12-05 11:58:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:58:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:58:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 11:58:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:58:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:58:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:58:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97538c30-565f-5e3a-b523-ff0863c3c1f3/97538c30-565f-5e3a-b523-ff0863c3c1f3_image_0.webp HTTP/1.1" 201 0
2025-12-05 11:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F2537cbc4-dba6-4e1d-b485-df61d4b534a6_d697195b-6aa7-47e0-85f8-f1f856d146a4.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:58:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/2537cbc4-dba6-4e1d-b485-df61d4b534a6_d697195b-6aa7-47e0-85f8-f1f856d146a4.jpg/250x188.webp saved to cache
2025-12-05 11:58:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 97538c30-565f-5e3a-b523-ff0863c3c1f3
2025-12-05 11:58:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:58:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:58:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:58:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e6c390>
2025-12-05 11:58:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:58:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:58:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 11:58:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:58:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:58:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:58:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ad7a47a-8da0-5f8d-93df-51ddb8c4064b/4ad7a47a-8da0-5f8d-93df-51ddb8c4064b_image_5.webp HTTP/1.1" 201 0
2025-12-05 11:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F3d168cd6-139c-4ebc-98a9-7c7678a651d5_014acf10-89f5-4243-9a02-ff24f0fd8fa9.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:58:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/3d168cd6-139c-4ebc-98a9-7c7678a651d5_014acf10-89f5-4243-9a02-ff24f0fd8fa9.jpg/250x188.webp saved to cache
2025-12-05 11:58:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4ad7a47a-8da0-5f8d-93df-51ddb8c4064b
2025-12-05 11:58:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:58:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:58:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:58:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e37dd0>
2025-12-05 11:58:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:58:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:58:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 11:58:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:58:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:58:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:58:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ad7a47a-8da0-5f8d-93df-51ddb8c4064b/4ad7a47a-8da0-5f8d-93df-51ddb8c4064b_image_4.webp HTTP/1.1" 201 0
2025-12-05 11:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F3d168cd6-139c-4ebc-98a9-7c7678a651d5_931958ba-a5f9-43ac-8efb-19ac22ba72cb.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:58:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/3d168cd6-139c-4ebc-98a9-7c7678a651d5_931958ba-a5f9-43ac-8efb-19ac22ba72cb.jpg/250x188.webp saved to cache
2025-12-05 11:58:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4ad7a47a-8da0-5f8d-93df-51ddb8c4064b
2025-12-05 11:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%278402196c-a90f-4f3e-bedc-3995f9674d6c%27 HTTP/1.1" 200 None
2025-12-05 11:58:49 [auto_selling_autoscout24.it] INFO: Scrape type for 8402196c-a90f-4f3e-bedc-3995f9674d6c: 1
2025-12-05 11:58:49 [auto_selling_autoscout24.it] INFO: Scraping new listing 8402196c-a90f-4f3e-bedc-3995f9674d6c
2025-12-05 11:58:49 [auto_selling_autoscout24.it] INFO: Extracting item from listing ID: 8402196c-a90f-4f3e-bedc-3995f9674d6c
2025-12-05 11:58:49 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 7469ee25-88d3-50e5-9728-2fe5297e8cbe with identifier: 8402196c-a90f-4f3e-bedc-3995f9674d6c
2025-12-05 11:58:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 7469ee25-88d3-50e5-9728-2fe5297e8cbe
2025-12-05 11:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F8402196c-a90f-4f3e-bedc-3995f9674d6c_1a435f9a-e730-4098-a58f-82570e66ec3f.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/8402196c-a90f-4f3e-bedc-3995f9674d6c_1a435f9a-e730-4098-a58f-82570e66ec3f.jpg/250x188.webp already downloaded
2025-12-05 11:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F8402196c-a90f-4f3e-bedc-3995f9674d6c_db2949e4-77b4-467c-91a2-56334b83035e.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/8402196c-a90f-4f3e-bedc-3995f9674d6c_db2949e4-77b4-467c-91a2-56334b83035e.jpg/250x188.webp already downloaded
2025-12-05 11:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F8402196c-a90f-4f3e-bedc-3995f9674d6c_bb6fae74-3c8a-44e6-8cad-fc0e038544d6.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/8402196c-a90f-4f3e-bedc-3995f9674d6c_bb6fae74-3c8a-44e6-8cad-fc0e038544d6.jpg/250x188.webp already downloaded
2025-12-05 11:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F8402196c-a90f-4f3e-bedc-3995f9674d6c_678e890e-aaf2-4cea-b242-e87e42134c45.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/8402196c-a90f-4f3e-bedc-3995f9674d6c_678e890e-aaf2-4cea-b242-e87e42134c45.jpg/250x188.webp already downloaded
2025-12-05 11:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F8402196c-a90f-4f3e-bedc-3995f9674d6c_eba31268-f5a9-4941-8337-3ea6d305e0bd.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/8402196c-a90f-4f3e-bedc-3995f9674d6c_eba31268-f5a9-4941-8337-3ea6d305e0bd.jpg/250x188.webp already downloaded
2025-12-05 11:58:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/2537cbc4-dba6-4e1d-b485-df61d4b534a6_a496a2fa-3635-43fb-b2b5-531f28953d93.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:58:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/2537cbc4-dba6-4e1d-b485-df61d4b534a6_ceaa1e6d-2c7c-438c-8651-2a3c9b33f0c6.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:58:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/3d168cd6-139c-4ebc-98a9-7c7678a651d5_4c604d5a-f71f-40de-877e-a355b5208add.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:58:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/3d353afe-e78e-4582-bf5a-d6fe449970ae_47d830c2-0a06-428b-945f-5f67790bd7cb.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:58:49 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 7469ee25-88d3-50e5-9728-2fe5297e8cbe with identifier 8402196c-a90f-4f3e-bedc-3995f9674d6c
2025-12-05 11:58:49 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 11:58:49 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 11:58:49 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 7469ee25-88d3-50e5-9728-2fe5297e8cbe
2025-12-05 11:58:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autoscout24.it/api/dealer-detail/fetch-listings>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'emission_standard': None,
 'engine': None,
 'engine_horse_power': 150,
 'expiration_date': None,
 'fuel_type': 'Gasoline',
 'id': '7469ee25-88d3-50e5-9728-2fe5297e8cbe',
 'is_damaged': False,
 'is_operable': True,
 'license_plate': None,
 'link_to_web_offer': 'https://www.autoscout24.it/offers/audi-q3-spb-tfsi-s-tronic-business-nuovo-uff-italia-promo-gasoline-white-8402196c-a90f-4f3e-bedc-3995f9674d6c',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 1,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 5,
 'photo_urls': ['https://prod.pictures.autoscout24.net/listing-images/8402196c-a90f-4f3e-bedc-3995f9674d6c_1a435f9a-e730-4098-a58f-82570e66ec3f.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/8402196c-a90f-4f3e-bedc-3995f9674d6c_db2949e4-77b4-467c-91a2-56334b83035e.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/8402196c-a90f-4f3e-bedc-3995f9674d6c_bb6fae74-3c8a-44e6-8cad-fc0e038544d6.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/8402196c-a90f-4f3e-bedc-3995f9674d6c_678e890e-aaf2-4cea-b242-e87e42134c45.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/8402196c-a90f-4f3e-bedc-3995f9674d6c_eba31268-f5a9-4941-8337-3ea6d305e0bd.jpg/250x188.webp'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6e61df1-8712-5216-ab08-603a0d04d2b1/b6e61df1-8712-5216-ab08-603a0d04d2b1_image_0.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3430,
             'Height': 154,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/8402196c-a90f-4f3e-bedc-3995f9674d6c_1a435f9a-e730-4098-a58f-82570e66ec3f.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6e61df1-8712-5216-ab08-603a0d04d2b1/b6e61df1-8712-5216-ab08-603a0d04d2b1_image_1.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 2596,
             'Height': 112,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/8402196c-a90f-4f3e-bedc-3995f9674d6c_db2949e4-77b4-467c-91a2-56334b83035e.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6e61df1-8712-5216-ab08-603a0d04d2b1/b6e61df1-8712-5216-ab08-603a0d04d2b1_image_2.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3364,
             'Height': 145,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/8402196c-a90f-4f3e-bedc-3995f9674d6c_bb6fae74-3c8a-44e6-8cad-fc0e038544d6.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6e61df1-8712-5216-ab08-603a0d04d2b1/b6e61df1-8712-5216-ab08-603a0d04d2b1_image_3.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 2488,
             'Height': 110,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/8402196c-a90f-4f3e-bedc-3995f9674d6c_678e890e-aaf2-4cea-b242-e87e42134c45.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6e61df1-8712-5216-ab08-603a0d04d2b1/b6e61df1-8712-5216-ab08-603a0d04d2b1_image_4.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 2484,
             'Height': 111,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/8402196c-a90f-4f3e-bedc-3995f9674d6c_eba31268-f5a9-4941-8337-3ea6d305e0bd.jpg/250x188.webp',
             'Width': 250}],
 'price': 42800,
 'price_includes_vat': False,
 'registration_date': '2025-10-01',
 'seller_name': None,
 'title': 'Audi Q3 SPB TFSI S-TRONIC BUSINESS NUOVO UFF.ITALIA PROMO',
 'transmission': 'automatic',
 'trim': 'SPB TFSI S-TRONIC BUSINESS NUOVO UFF.ITALIA PROMO',
 'vin': None,
 'year': 2025}
2025-12-05 11:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%278402196c-a90f-4f3e-bedc-3995f9674d6c%27 HTTP/1.1" 200 None
2025-12-05 11:58:49 [auto_selling_autoscout24.it] INFO: Saving data for 8402196c-a90f-4f3e-bedc-3995f9674d6c: {'created_time': 1764935929.909696, 'last_price_update_time': 1764935929.909707}
2025-12-05 11:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autoscout24.it',RowKey='8402196c-a90f-4f3e-bedc-3995f9674d6c') HTTP/1.1" 204 0
2025-12-05 11:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27b0362319-1791-4bbf-85eb-f1bcc56b7554%27 HTTP/1.1" 200 None
2025-12-05 11:58:50 [auto_selling_autoscout24.it] INFO: Scrape type for b0362319-1791-4bbf-85eb-f1bcc56b7554: 1
2025-12-05 11:58:50 [auto_selling_autoscout24.it] INFO: Scraping new listing b0362319-1791-4bbf-85eb-f1bcc56b7554
2025-12-05 11:58:50 [auto_selling_autoscout24.it] INFO: Extracting item from listing ID: b0362319-1791-4bbf-85eb-f1bcc56b7554
2025-12-05 11:58:50 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 122397c7-1084-5af3-86d3-cf458c050375 with identifier: b0362319-1791-4bbf-85eb-f1bcc56b7554
2025-12-05 11:58:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 122397c7-1084-5af3-86d3-cf458c050375
2025-12-05 11:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fb0362319-1791-4bbf-85eb-f1bcc56b7554_1c3a65a5-3c30-442c-831e-a938f4cc7051.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/b0362319-1791-4bbf-85eb-f1bcc56b7554_1c3a65a5-3c30-442c-831e-a938f4cc7051.jpg/250x188.webp not downloaded yet
2025-12-05 11:58:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/2537cbc4-dba6-4e1d-b485-df61d4b534a6_b6e535de-767f-4c23-9afb-4578cdd24827.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fb0362319-1791-4bbf-85eb-f1bcc56b7554_b912612f-c64f-4307-bf48-dea496f184c5.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/b0362319-1791-4bbf-85eb-f1bcc56b7554_b912612f-c64f-4307-bf48-dea496f184c5.jpg/250x188.webp not downloaded yet
2025-12-05 11:58:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:58:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:58:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:58:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5b68810>
2025-12-05 11:58:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:58:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:58:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 11:58:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:58:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:58:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:58:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97538c30-565f-5e3a-b523-ff0863c3c1f3/97538c30-565f-5e3a-b523-ff0863c3c1f3_image_1.webp HTTP/1.1" 201 0
2025-12-05 11:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F2537cbc4-dba6-4e1d-b485-df61d4b534a6_c54ee054-35d9-451f-94b7-5ce45e79e820.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:58:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/2537cbc4-dba6-4e1d-b485-df61d4b534a6_c54ee054-35d9-451f-94b7-5ce45e79e820.jpg/250x188.webp saved to cache
2025-12-05 11:58:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 97538c30-565f-5e3a-b523-ff0863c3c1f3
2025-12-05 11:58:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:58:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:58:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:58:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5b72ad0>
2025-12-05 11:58:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:58:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:58:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 11:58:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:58:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:58:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:58:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97538c30-565f-5e3a-b523-ff0863c3c1f3/97538c30-565f-5e3a-b523-ff0863c3c1f3_image_2.webp HTTP/1.1" 201 0
2025-12-05 11:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F2537cbc4-dba6-4e1d-b485-df61d4b534a6_106097c5-8d12-462c-aadc-b69b9d7e0ccb.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:58:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/2537cbc4-dba6-4e1d-b485-df61d4b534a6_106097c5-8d12-462c-aadc-b69b9d7e0ccb.jpg/250x188.webp saved to cache
2025-12-05 11:58:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 97538c30-565f-5e3a-b523-ff0863c3c1f3
2025-12-05 11:58:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:58:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:58:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:58:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5b75610>
2025-12-05 11:58:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:58:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:58:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 11:58:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:58:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:58:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:58:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ad7a47a-8da0-5f8d-93df-51ddb8c4064b/4ad7a47a-8da0-5f8d-93df-51ddb8c4064b_image_2.webp HTTP/1.1" 201 0
2025-12-05 11:58:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F3d168cd6-139c-4ebc-98a9-7c7678a651d5_4a74dbc1-aad4-4d86-b663-fc85ce65c6a2.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/3d168cd6-139c-4ebc-98a9-7c7678a651d5_4a74dbc1-aad4-4d86-b663-fc85ce65c6a2.jpg/250x188.webp saved to cache
2025-12-05 11:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4ad7a47a-8da0-5f8d-93df-51ddb8c4064b
2025-12-05 11:58:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:58:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:58:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:58:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5b795d0>
2025-12-05 11:58:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:58:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:58:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 11:58:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:58:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:58:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:58:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ad7a47a-8da0-5f8d-93df-51ddb8c4064b/4ad7a47a-8da0-5f8d-93df-51ddb8c4064b_image_1.webp HTTP/1.1" 201 0
2025-12-05 11:58:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F3d168cd6-139c-4ebc-98a9-7c7678a651d5_825e5779-9cc2-4273-8974-2497a8db89e8.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/3d168cd6-139c-4ebc-98a9-7c7678a651d5_825e5779-9cc2-4273-8974-2497a8db89e8.jpg/250x188.webp saved to cache
2025-12-05 11:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4ad7a47a-8da0-5f8d-93df-51ddb8c4064b
2025-12-05 11:58:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:58:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:58:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:58:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5b72c50>
2025-12-05 11:58:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:58:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:58:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 11:58:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:58:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:58:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:58:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ad7a47a-8da0-5f8d-93df-51ddb8c4064b/4ad7a47a-8da0-5f8d-93df-51ddb8c4064b_image_3.webp HTTP/1.1" 201 0
2025-12-05 11:58:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F3d168cd6-139c-4ebc-98a9-7c7678a651d5_6ba3a39a-b774-4c2f-bcb5-036ebc6749f8.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/3d168cd6-139c-4ebc-98a9-7c7678a651d5_6ba3a39a-b774-4c2f-bcb5-036ebc6749f8.jpg/250x188.webp saved to cache
2025-12-05 11:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4ad7a47a-8da0-5f8d-93df-51ddb8c4064b
2025-12-05 11:58:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:58:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:58:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:58:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5b83650>
2025-12-05 11:58:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:58:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:58:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 11:58:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:58:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:58:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:58:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97538c30-565f-5e3a-b523-ff0863c3c1f3/97538c30-565f-5e3a-b523-ff0863c3c1f3_image_3.webp HTTP/1.1" 201 0
2025-12-05 11:58:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F2537cbc4-dba6-4e1d-b485-df61d4b534a6_a496a2fa-3635-43fb-b2b5-531f28953d93.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/2537cbc4-dba6-4e1d-b485-df61d4b534a6_a496a2fa-3635-43fb-b2b5-531f28953d93.jpg/250x188.webp saved to cache
2025-12-05 11:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 97538c30-565f-5e3a-b523-ff0863c3c1f3
2025-12-05 11:58:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:58:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:58:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:58:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e7b190>
2025-12-05 11:58:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:58:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:58:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 11:58:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:58:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:58:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:58:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97538c30-565f-5e3a-b523-ff0863c3c1f3/97538c30-565f-5e3a-b523-ff0863c3c1f3_image_4.webp HTTP/1.1" 201 0
2025-12-05 11:58:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F2537cbc4-dba6-4e1d-b485-df61d4b534a6_ceaa1e6d-2c7c-438c-8651-2a3c9b33f0c6.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/2537cbc4-dba6-4e1d-b485-df61d4b534a6_ceaa1e6d-2c7c-438c-8651-2a3c9b33f0c6.jpg/250x188.webp saved to cache
2025-12-05 11:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 97538c30-565f-5e3a-b523-ff0863c3c1f3
2025-12-05 11:58:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:58:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:58:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:58:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5b82090>
2025-12-05 11:58:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:58:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:58:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 11:58:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:58:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:58:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:58:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ad7a47a-8da0-5f8d-93df-51ddb8c4064b/4ad7a47a-8da0-5f8d-93df-51ddb8c4064b_image_0.webp HTTP/1.1" 201 0
2025-12-05 11:58:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F3d168cd6-139c-4ebc-98a9-7c7678a651d5_4c604d5a-f71f-40de-877e-a355b5208add.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/3d168cd6-139c-4ebc-98a9-7c7678a651d5_4c604d5a-f71f-40de-877e-a355b5208add.jpg/250x188.webp saved to cache
2025-12-05 11:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4ad7a47a-8da0-5f8d-93df-51ddb8c4064b
2025-12-05 11:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 4ad7a47a-8da0-5f8d-93df-51ddb8c4064b from tracking dictionaries
2025-12-05 11:58:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4ad7a47a-8da0-5f8d-93df-51ddb8c4064b sending to next pipeline
2025-12-05 11:58:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:58:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:58:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:58:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5b8f050>
2025-12-05 11:58:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:58:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:58:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 11:58:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:58:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:58:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:58:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e30d62fe-2ead-5f1a-b839-064aa61eba0c/e30d62fe-2ead-5f1a-b839-064aa61eba0c_image_5.webp HTTP/1.1" 201 0
2025-12-05 11:58:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F3d353afe-e78e-4582-bf5a-d6fe449970ae_47d830c2-0a06-428b-945f-5f67790bd7cb.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/3d353afe-e78e-4582-bf5a-d6fe449970ae_47d830c2-0a06-428b-945f-5f67790bd7cb.jpg/250x188.webp saved to cache
2025-12-05 11:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e30d62fe-2ead-5f1a-b839-064aa61eba0c
2025-12-05 11:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Removing item e30d62fe-2ead-5f1a-b839-064aa61eba0c from tracking dictionaries
2025-12-05 11:58:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e30d62fe-2ead-5f1a-b839-064aa61eba0c sending to next pipeline
2025-12-05 11:58:52 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 4ad7a47a-8da0-5f8d-93df-51ddb8c4064b with identifier 3d168cd6-139c-4ebc-98a9-7c7678a651d5
2025-12-05 11:58:52 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 11:58:52 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 11:58:52 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 4ad7a47a-8da0-5f8d-93df-51ddb8c4064b
2025-12-05 11:58:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://prod.pictures.autoscout24.net/listing-images/3d168cd6-139c-4ebc-98a9-7c7678a651d5_4c604d5a-f71f-40de-877e-a355b5208add.jpg/250x188.webp>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'emission_standard': None,
 'engine': None,
 'engine_horse_power': 333,
 'expiration_date': None,
 'fuel_type': 'Gasoline',
 'id': '4ad7a47a-8da0-5f8d-93df-51ddb8c4064b',
 'is_damaged': False,
 'is_operable': True,
 'license_plate': None,
 'link_to_web_offer': 'https://www.autoscout24.it/offers/audi-s3-spb-tfsi-quattro-s-tr-333cv-matrix-tetto-promo-gasoline-grey-3d168cd6-139c-4ebc-98a9-7c7678a651d5',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'S3',
 'odometer': 5400,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ad7a47a-8da0-5f8d-93df-51ddb8c4064b/4ad7a47a-8da0-5f8d-93df-51ddb8c4064b_image_0.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4750,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/3d168cd6-139c-4ebc-98a9-7c7678a651d5_4c604d5a-f71f-40de-877e-a355b5208add.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ad7a47a-8da0-5f8d-93df-51ddb8c4064b/4ad7a47a-8da0-5f8d-93df-51ddb8c4064b_image_1.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4808,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/3d168cd6-139c-4ebc-98a9-7c7678a651d5_825e5779-9cc2-4273-8974-2497a8db89e8.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ad7a47a-8da0-5f8d-93df-51ddb8c4064b/4ad7a47a-8da0-5f8d-93df-51ddb8c4064b_image_2.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4820,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/3d168cd6-139c-4ebc-98a9-7c7678a651d5_4a74dbc1-aad4-4d86-b663-fc85ce65c6a2.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ad7a47a-8da0-5f8d-93df-51ddb8c4064b/4ad7a47a-8da0-5f8d-93df-51ddb8c4064b_image_3.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4826,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/3d168cd6-139c-4ebc-98a9-7c7678a651d5_6ba3a39a-b774-4c2f-bcb5-036ebc6749f8.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ad7a47a-8da0-5f8d-93df-51ddb8c4064b/4ad7a47a-8da0-5f8d-93df-51ddb8c4064b_image_4.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4538,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/3d168cd6-139c-4ebc-98a9-7c7678a651d5_931958ba-a5f9-43ac-8efb-19ac22ba72cb.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ad7a47a-8da0-5f8d-93df-51ddb8c4064b/4ad7a47a-8da0-5f8d-93df-51ddb8c4064b_image_5.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5008,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/3d168cd6-139c-4ebc-98a9-7c7678a651d5_014acf10-89f5-4243-9a02-ff24f0fd8fa9.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ad7a47a-8da0-5f8d-93df-51ddb8c4064b/4ad7a47a-8da0-5f8d-93df-51ddb8c4064b_image_6.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 6928,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/3d168cd6-139c-4ebc-98a9-7c7678a651d5_0a563b85-145a-48af-b616-203956710a5d.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ad7a47a-8da0-5f8d-93df-51ddb8c4064b/4ad7a47a-8da0-5f8d-93df-51ddb8c4064b_image_7.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5688,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/3d168cd6-139c-4ebc-98a9-7c7678a651d5_12b0c2ea-685c-4452-bb69-8bef02f6ff04.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ad7a47a-8da0-5f8d-93df-51ddb8c4064b/4ad7a47a-8da0-5f8d-93df-51ddb8c4064b_image_8.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 7122,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/3d168cd6-139c-4ebc-98a9-7c7678a651d5_b741e95e-a7e1-4a80-b310-c35f793a656f.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ad7a47a-8da0-5f8d-93df-51ddb8c4064b/4ad7a47a-8da0-5f8d-93df-51ddb8c4064b_image_9.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5936,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/3d168cd6-139c-4ebc-98a9-7c7678a651d5_597200cb-b00f-4eef-9515-8d4b3f9beb7d.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ad7a47a-8da0-5f8d-93df-51ddb8c4064b/4ad7a47a-8da0-5f8d-93df-51ddb8c4064b_image_10.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4934,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/3d168cd6-139c-4ebc-98a9-7c7678a651d5_44aa481f-392f-4e45-a11e-7c629f0bf772.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ad7a47a-8da0-5f8d-93df-51ddb8c4064b/4ad7a47a-8da0-5f8d-93df-51ddb8c4064b_image_11.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4350,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/3d168cd6-139c-4ebc-98a9-7c7678a651d5_367b216e-6120-43c3-9c75-c45fdf45b57d.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ad7a47a-8da0-5f8d-93df-51ddb8c4064b/4ad7a47a-8da0-5f8d-93df-51ddb8c4064b_image_12.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3372,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/3d168cd6-139c-4ebc-98a9-7c7678a651d5_6fbecf16-11e4-4cf3-b8da-e33741674b1c.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ad7a47a-8da0-5f8d-93df-51ddb8c4064b/4ad7a47a-8da0-5f8d-93df-51ddb8c4064b_image_13.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5860,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/3d168cd6-139c-4ebc-98a9-7c7678a651d5_4ef003d7-547d-40cb-8cf5-94c9f4523a95.jpg/250x188.webp',
             'Width': 250}],
 'price': 52900,
 'price_includes_vat': False,
 'registration_date': '2025-10-01',
 'seller_name': None,
 'title': 'Audi S3 SPB TFSI QUATTRO S-TR. 333CV *MATRIX+TETTO* PROMO',
 'transmission': 'automatic',
 'trim': 'SPB TFSI QUATTRO S-TR. 333CV *MATRIX+TETTO* PROMO',
 'vin': None,
 'year': 2025}
2025-12-05 11:58:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%273d168cd6-139c-4ebc-98a9-7c7678a651d5%27 HTTP/1.1" 200 None
2025-12-05 11:58:52 [auto_selling_autoscout24.it] INFO: Saving data for 3d168cd6-139c-4ebc-98a9-7c7678a651d5: {'created_time': 1764935932.743186, 'last_price_update_time': 1764935932.743197}
2025-12-05 11:58:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autoscout24.it',RowKey='3d168cd6-139c-4ebc-98a9-7c7678a651d5') HTTP/1.1" 204 0
2025-12-05 11:58:52 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: e30d62fe-2ead-5f1a-b839-064aa61eba0c with identifier 3d353afe-e78e-4582-bf5a-d6fe449970ae
2025-12-05 11:58:52 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 11:58:52 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 11:58:52 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item e30d62fe-2ead-5f1a-b839-064aa61eba0c
2025-12-05 11:58:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://prod.pictures.autoscout24.net/listing-images/3d353afe-e78e-4582-bf5a-d6fe449970ae_47d830c2-0a06-428b-945f-5f67790bd7cb.jpg/250x188.webp>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'emission_standard': None,
 'engine': None,
 'engine_horse_power': 95,
 'expiration_date': None,
 'fuel_type': 'Gasoline',
 'id': 'e30d62fe-2ead-5f1a-b839-064aa61eba0c',
 'is_damaged': False,
 'is_operable': True,
 'license_plate': None,
 'link_to_web_offer': 'https://www.autoscout24.it/offers/volkswagen-t-cross-1-0-tsi-edition-plus-95cv-nuovo-uff-italia-promo-gasoline-grey-3d353afe-e78e-4582-bf5a-d6fe449970ae',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Cross',
 'odometer': 1,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e30d62fe-2ead-5f1a-b839-064aa61eba0c/e30d62fe-2ead-5f1a-b839-064aa61eba0c_image_0.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3896,
             'Height': 173,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/3d353afe-e78e-4582-bf5a-d6fe449970ae_2e72c2b4-875e-4bcd-afc9-bcb5eb9c206a.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e30d62fe-2ead-5f1a-b839-064aa61eba0c/e30d62fe-2ead-5f1a-b839-064aa61eba0c_image_1.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 2752,
             'Height': 139,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/3d353afe-e78e-4582-bf5a-d6fe449970ae_76279068-4ace-4a5f-9939-b09b0a9765cf.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e30d62fe-2ead-5f1a-b839-064aa61eba0c/e30d62fe-2ead-5f1a-b839-064aa61eba0c_image_2.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3344,
             'Height': 162,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/3d353afe-e78e-4582-bf5a-d6fe449970ae_2b4ce521-1919-4484-9e48-a4ee9d27e887.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e30d62fe-2ead-5f1a-b839-064aa61eba0c/e30d62fe-2ead-5f1a-b839-064aa61eba0c_image_3.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3060,
             'Height': 140,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/3d353afe-e78e-4582-bf5a-d6fe449970ae_2e05b594-9be9-47c6-9dea-8cbcf5014ea1.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e30d62fe-2ead-5f1a-b839-064aa61eba0c/e30d62fe-2ead-5f1a-b839-064aa61eba0c_image_4.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 2926,
             'Height': 139,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/3d353afe-e78e-4582-bf5a-d6fe449970ae_ab732d26-e6ba-48f5-9599-88c87717df19.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e30d62fe-2ead-5f1a-b839-064aa61eba0c/e30d62fe-2ead-5f1a-b839-064aa61eba0c_image_5.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 2084,
             'Height': 136,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/3d353afe-e78e-4582-bf5a-d6fe449970ae_47d830c2-0a06-428b-945f-5f67790bd7cb.jpg/250x188.webp',
             'Width': 250}],
 'price': 21900,
 'price_includes_vat': False,
 'registration_date': '2025-12-01',
 'seller_name': None,
 'title': 'Volkswagen T-Cross 1.0 TSI EDITION PLUS 95CV NUOVO UFF. ITALIA '
          'PROMO',
 'transmission': 'automatic',
 'trim': '1.0 TSI EDITION PLUS 95CV NUOVO UFF. ITALIA PROMO',
 'vin': None,
 'year': 2025}
2025-12-05 11:58:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%273d353afe-e78e-4582-bf5a-d6fe449970ae%27 HTTP/1.1" 200 None
2025-12-05 11:58:52 [auto_selling_autoscout24.it] INFO: Saving data for 3d353afe-e78e-4582-bf5a-d6fe449970ae: {'created_time': 1764935932.788432, 'last_price_update_time': 1764935932.788441}
2025-12-05 11:58:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autoscout24.it',RowKey='3d353afe-e78e-4582-bf5a-d6fe449970ae') HTTP/1.1" 204 0
2025-12-05 11:58:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/2537cbc4-dba6-4e1d-b485-df61d4b534a6_d253cd3a-4371-49cb-884d-f607fea929a9.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:58:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fb0362319-1791-4bbf-85eb-f1bcc56b7554_ff41c3d6-8ca1-4849-900b-049ba89babf3.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/b0362319-1791-4bbf-85eb-f1bcc56b7554_ff41c3d6-8ca1-4849-900b-049ba89babf3.jpg/250x188.webp not downloaded yet
2025-12-05 11:58:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:58:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:58:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:58:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9dc1ba110>
2025-12-05 11:58:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:58:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:58:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 11:58:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:58:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:58:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:58:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97538c30-565f-5e3a-b523-ff0863c3c1f3/97538c30-565f-5e3a-b523-ff0863c3c1f3_image_5.webp HTTP/1.1" 201 0
2025-12-05 11:58:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F2537cbc4-dba6-4e1d-b485-df61d4b534a6_b6e535de-767f-4c23-9afb-4578cdd24827.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:58:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/2537cbc4-dba6-4e1d-b485-df61d4b534a6_b6e535de-767f-4c23-9afb-4578cdd24827.jpg/250x188.webp saved to cache
2025-12-05 11:58:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 97538c30-565f-5e3a-b523-ff0863c3c1f3
2025-12-05 11:58:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/b0362319-1791-4bbf-85eb-f1bcc56b7554_1c3a65a5-3c30-442c-831e-a938f4cc7051.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:58:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fb0362319-1791-4bbf-85eb-f1bcc56b7554_334e8d85-07a1-4246-a1e5-304e0c6c6e70.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/b0362319-1791-4bbf-85eb-f1bcc56b7554_334e8d85-07a1-4246-a1e5-304e0c6c6e70.jpg/250x188.webp not downloaded yet
2025-12-05 11:58:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fb0362319-1791-4bbf-85eb-f1bcc56b7554_0ebe8a06-f456-4520-ad5a-6ab4afe53b6a.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/b0362319-1791-4bbf-85eb-f1bcc56b7554_0ebe8a06-f456-4520-ad5a-6ab4afe53b6a.jpg/250x188.webp not downloaded yet
2025-12-05 11:58:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:58:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:58:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:58:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5c9e7d0>
2025-12-05 11:58:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:58:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:58:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 11:58:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:58:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:58:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:58:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97538c30-565f-5e3a-b523-ff0863c3c1f3/97538c30-565f-5e3a-b523-ff0863c3c1f3_image_6.webp HTTP/1.1" 201 0
2025-12-05 11:58:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F2537cbc4-dba6-4e1d-b485-df61d4b534a6_d253cd3a-4371-49cb-884d-f607fea929a9.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:58:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/2537cbc4-dba6-4e1d-b485-df61d4b534a6_d253cd3a-4371-49cb-884d-f607fea929a9.jpg/250x188.webp saved to cache
2025-12-05 11:58:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 97538c30-565f-5e3a-b523-ff0863c3c1f3
2025-12-05 11:58:53 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 97538c30-565f-5e3a-b523-ff0863c3c1f3 from tracking dictionaries
2025-12-05 11:58:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 97538c30-565f-5e3a-b523-ff0863c3c1f3 sending to next pipeline
2025-12-05 11:58:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fb0362319-1791-4bbf-85eb-f1bcc56b7554_6d548462-b655-4d58-9858-7dfc72e2e826.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/b0362319-1791-4bbf-85eb-f1bcc56b7554_6d548462-b655-4d58-9858-7dfc72e2e826.jpg/250x188.webp not downloaded yet
2025-12-05 11:58:53 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 97538c30-565f-5e3a-b523-ff0863c3c1f3 with identifier 2537cbc4-dba6-4e1d-b485-df61d4b534a6
2025-12-05 11:58:53 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 11:58:53 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 11:58:53 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 97538c30-565f-5e3a-b523-ff0863c3c1f3
2025-12-05 11:58:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://prod.pictures.autoscout24.net/listing-images/2537cbc4-dba6-4e1d-b485-df61d4b534a6_d253cd3a-4371-49cb-884d-f607fea929a9.jpg/250x188.webp>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'emission_standard': None,
 'engine': None,
 'engine_horse_power': 300,
 'expiration_date': None,
 'fuel_type': 'Gasoline',
 'id': '97538c30-565f-5e3a-b523-ff0863c3c1f3',
 'is_damaged': False,
 'is_operable': True,
 'license_plate': None,
 'link_to_web_offer': 'https://www.autoscout24.it/offers/volkswagen-golf-gti-8-5-clubsport-300cv-black-style-nuovo-modello-gasoline-grey-2537cbc4-dba6-4e1d-b485-df61d4b534a6',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf GTI',
 'odometer': 15200,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 7,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97538c30-565f-5e3a-b523-ff0863c3c1f3/97538c30-565f-5e3a-b523-ff0863c3c1f3_image_0.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3848,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/2537cbc4-dba6-4e1d-b485-df61d4b534a6_d697195b-6aa7-47e0-85f8-f1f856d146a4.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97538c30-565f-5e3a-b523-ff0863c3c1f3/97538c30-565f-5e3a-b523-ff0863c3c1f3_image_1.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5704,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/2537cbc4-dba6-4e1d-b485-df61d4b534a6_c54ee054-35d9-451f-94b7-5ce45e79e820.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97538c30-565f-5e3a-b523-ff0863c3c1f3/97538c30-565f-5e3a-b523-ff0863c3c1f3_image_2.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5920,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/2537cbc4-dba6-4e1d-b485-df61d4b534a6_106097c5-8d12-462c-aadc-b69b9d7e0ccb.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97538c30-565f-5e3a-b523-ff0863c3c1f3/97538c30-565f-5e3a-b523-ff0863c3c1f3_image_3.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 7520,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/2537cbc4-dba6-4e1d-b485-df61d4b534a6_a496a2fa-3635-43fb-b2b5-531f28953d93.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97538c30-565f-5e3a-b523-ff0863c3c1f3/97538c30-565f-5e3a-b523-ff0863c3c1f3_image_4.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 8346,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/2537cbc4-dba6-4e1d-b485-df61d4b534a6_ceaa1e6d-2c7c-438c-8651-2a3c9b33f0c6.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97538c30-565f-5e3a-b523-ff0863c3c1f3/97538c30-565f-5e3a-b523-ff0863c3c1f3_image_5.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 7700,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/2537cbc4-dba6-4e1d-b485-df61d4b534a6_b6e535de-767f-4c23-9afb-4578cdd24827.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_97538c30-565f-5e3a-b523-ff0863c3c1f3/97538c30-565f-5e3a-b523-ff0863c3c1f3_image_6.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4832,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/2537cbc4-dba6-4e1d-b485-df61d4b534a6_d253cd3a-4371-49cb-884d-f607fea929a9.jpg/250x188.webp',
             'Width': 250}],
 'price': 45800,
 'price_includes_vat': False,
 'registration_date': '2024-12-01',
 'seller_name': None,
 'title': 'Volkswagen Golf GTI 8.5 CLUBSPORT 300CV *Black Style* (NUOVO '
          'MODELLO)',
 'transmission': 'automatic',
 'trim': '8.5 CLUBSPORT 300CV *Black Style* (NUOVO MODELLO)',
 'vin': None,
 'year': 2024}
2025-12-05 11:58:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%272537cbc4-dba6-4e1d-b485-df61d4b534a6%27 HTTP/1.1" 200 None
2025-12-05 11:58:53 [auto_selling_autoscout24.it] INFO: Saving data for 2537cbc4-dba6-4e1d-b485-df61d4b534a6: {'created_time': 1764935933.483598, 'last_price_update_time': 1764935933.483605}
2025-12-05 11:58:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autoscout24.it',RowKey='2537cbc4-dba6-4e1d-b485-df61d4b534a6') HTTP/1.1" 204 0
2025-12-05 11:58:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/b0362319-1791-4bbf-85eb-f1bcc56b7554_b912612f-c64f-4307-bf48-dea496f184c5.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:58:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/b0362319-1791-4bbf-85eb-f1bcc56b7554_ff41c3d6-8ca1-4849-900b-049ba89babf3.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:58:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fb0362319-1791-4bbf-85eb-f1bcc56b7554_456f2aae-8a0d-4e6c-a658-fe94c497fcfb.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/b0362319-1791-4bbf-85eb-f1bcc56b7554_456f2aae-8a0d-4e6c-a658-fe94c497fcfb.jpg/250x188.webp not downloaded yet
2025-12-05 11:58:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:58:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:58:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:58:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9dc13fed0>
2025-12-05 11:58:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:58:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:58:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 11:58:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:58:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:58:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:58:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_122397c7-1084-5af3-86d3-cf458c050375/122397c7-1084-5af3-86d3-cf458c050375_image_0.webp HTTP/1.1" 201 0
2025-12-05 11:58:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fb0362319-1791-4bbf-85eb-f1bcc56b7554_1c3a65a5-3c30-442c-831e-a938f4cc7051.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:58:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/b0362319-1791-4bbf-85eb-f1bcc56b7554_1c3a65a5-3c30-442c-831e-a938f4cc7051.jpg/250x188.webp saved to cache
2025-12-05 11:58:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 122397c7-1084-5af3-86d3-cf458c050375
2025-12-05 11:58:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fb0362319-1791-4bbf-85eb-f1bcc56b7554_f9636915-8c5e-4214-b33c-249541329131.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/b0362319-1791-4bbf-85eb-f1bcc56b7554_f9636915-8c5e-4214-b33c-249541329131.jpg/250x188.webp not downloaded yet
2025-12-05 11:58:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/b0362319-1791-4bbf-85eb-f1bcc56b7554_334e8d85-07a1-4246-a1e5-304e0c6c6e70.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:58:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/b0362319-1791-4bbf-85eb-f1bcc56b7554_0ebe8a06-f456-4520-ad5a-6ab4afe53b6a.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:58:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%270e2c4c68-8157-4aad-8384-8a781c1fc3d8%27 HTTP/1.1" 200 None
2025-12-05 11:58:53 [auto_selling_autoscout24.it] INFO: Scrape type for 0e2c4c68-8157-4aad-8384-8a781c1fc3d8: 1
2025-12-05 11:58:53 [auto_selling_autoscout24.it] INFO: Scraping new listing 0e2c4c68-8157-4aad-8384-8a781c1fc3d8
2025-12-05 11:58:53 [auto_selling_autoscout24.it] INFO: Extracting item from listing ID: 0e2c4c68-8157-4aad-8384-8a781c1fc3d8
2025-12-05 11:58:53 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 4222b1b3-8caf-572c-9281-46014c40f3ba with identifier: 0e2c4c68-8157-4aad-8384-8a781c1fc3d8
2025-12-05 11:58:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 4222b1b3-8caf-572c-9281-46014c40f3ba
2025-12-05 11:58:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F0e2c4c68-8157-4aad-8384-8a781c1fc3d8_d2ce3086-b41a-492f-a1f7-6aa28b3dc4d6.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/0e2c4c68-8157-4aad-8384-8a781c1fc3d8_d2ce3086-b41a-492f-a1f7-6aa28b3dc4d6.jpg/250x188.webp not downloaded yet
2025-12-05 11:58:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:58:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:58:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:58:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e7d410>
2025-12-05 11:58:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:58:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:58:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 11:58:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:58:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:58:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:58:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_122397c7-1084-5af3-86d3-cf458c050375/122397c7-1084-5af3-86d3-cf458c050375_image_1.webp HTTP/1.1" 201 0
2025-12-05 11:58:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fb0362319-1791-4bbf-85eb-f1bcc56b7554_b912612f-c64f-4307-bf48-dea496f184c5.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:58:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/b0362319-1791-4bbf-85eb-f1bcc56b7554_b912612f-c64f-4307-bf48-dea496f184c5.jpg/250x188.webp saved to cache
2025-12-05 11:58:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 122397c7-1084-5af3-86d3-cf458c050375
2025-12-05 11:58:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:58:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:58:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:58:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5c16690>
2025-12-05 11:58:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:58:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:58:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 11:58:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:58:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:58:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:58:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_122397c7-1084-5af3-86d3-cf458c050375/122397c7-1084-5af3-86d3-cf458c050375_image_2.webp HTTP/1.1" 201 0
2025-12-05 11:58:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fb0362319-1791-4bbf-85eb-f1bcc56b7554_ff41c3d6-8ca1-4849-900b-049ba89babf3.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:58:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/b0362319-1791-4bbf-85eb-f1bcc56b7554_ff41c3d6-8ca1-4849-900b-049ba89babf3.jpg/250x188.webp saved to cache
2025-12-05 11:58:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 122397c7-1084-5af3-86d3-cf458c050375
2025-12-05 11:58:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F0e2c4c68-8157-4aad-8384-8a781c1fc3d8_5fc5c0d7-2a46-486f-a45a-cef3242df03a.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/0e2c4c68-8157-4aad-8384-8a781c1fc3d8_5fc5c0d7-2a46-486f-a45a-cef3242df03a.jpg/250x188.webp not downloaded yet
2025-12-05 11:58:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/b0362319-1791-4bbf-85eb-f1bcc56b7554_6d548462-b655-4d58-9858-7dfc72e2e826.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:58:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/b0362319-1791-4bbf-85eb-f1bcc56b7554_456f2aae-8a0d-4e6c-a658-fe94c497fcfb.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:58:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F0e2c4c68-8157-4aad-8384-8a781c1fc3d8_f3eba786-2db4-418c-869f-d6ddd54cf4e3.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/0e2c4c68-8157-4aad-8384-8a781c1fc3d8_f3eba786-2db4-418c-869f-d6ddd54cf4e3.jpg/250x188.webp not downloaded yet
2025-12-05 11:58:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:58:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:58:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:58:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e7c710>
2025-12-05 11:58:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:58:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:58:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 11:58:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:58:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:58:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:58:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_122397c7-1084-5af3-86d3-cf458c050375/122397c7-1084-5af3-86d3-cf458c050375_image_3.webp HTTP/1.1" 201 0
2025-12-05 11:58:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fb0362319-1791-4bbf-85eb-f1bcc56b7554_334e8d85-07a1-4246-a1e5-304e0c6c6e70.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:58:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/b0362319-1791-4bbf-85eb-f1bcc56b7554_334e8d85-07a1-4246-a1e5-304e0c6c6e70.jpg/250x188.webp saved to cache
2025-12-05 11:58:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 122397c7-1084-5af3-86d3-cf458c050375
2025-12-05 11:58:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:58:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:58:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:58:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5cd5150>
2025-12-05 11:58:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:58:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:58:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 11:58:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:58:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:58:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:58:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_122397c7-1084-5af3-86d3-cf458c050375/122397c7-1084-5af3-86d3-cf458c050375_image_4.webp HTTP/1.1" 201 0
2025-12-05 11:58:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fb0362319-1791-4bbf-85eb-f1bcc56b7554_0ebe8a06-f456-4520-ad5a-6ab4afe53b6a.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:58:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/b0362319-1791-4bbf-85eb-f1bcc56b7554_0ebe8a06-f456-4520-ad5a-6ab4afe53b6a.jpg/250x188.webp saved to cache
2025-12-05 11:58:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 122397c7-1084-5af3-86d3-cf458c050375
2025-12-05 11:58:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F0e2c4c68-8157-4aad-8384-8a781c1fc3d8_55f7140a-5928-4ac5-b255-444b47b4794a.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/0e2c4c68-8157-4aad-8384-8a781c1fc3d8_55f7140a-5928-4ac5-b255-444b47b4794a.jpg/250x188.webp not downloaded yet
2025-12-05 11:58:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/0e2c4c68-8157-4aad-8384-8a781c1fc3d8_d2ce3086-b41a-492f-a1f7-6aa28b3dc4d6.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:58:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/b0362319-1791-4bbf-85eb-f1bcc56b7554_f9636915-8c5e-4214-b33c-249541329131.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:58:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F0e2c4c68-8157-4aad-8384-8a781c1fc3d8_5c965d54-942a-4011-8c62-00efa951e856.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/0e2c4c68-8157-4aad-8384-8a781c1fc3d8_5c965d54-942a-4011-8c62-00efa951e856.jpg/250x188.webp not downloaded yet
2025-12-05 11:58:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:58:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:58:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:58:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5c3b650>
2025-12-05 11:58:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:58:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:58:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 11:58:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:58:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:58:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:58:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_122397c7-1084-5af3-86d3-cf458c050375/122397c7-1084-5af3-86d3-cf458c050375_image_5.webp HTTP/1.1" 201 0
2025-12-05 11:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fb0362319-1791-4bbf-85eb-f1bcc56b7554_6d548462-b655-4d58-9858-7dfc72e2e826.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:58:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/b0362319-1791-4bbf-85eb-f1bcc56b7554_6d548462-b655-4d58-9858-7dfc72e2e826.jpg/250x188.webp saved to cache
2025-12-05 11:58:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 122397c7-1084-5af3-86d3-cf458c050375
2025-12-05 11:58:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:58:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:58:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:58:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e38810>
2025-12-05 11:58:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:58:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:58:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 11:58:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:58:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:58:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:58:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_122397c7-1084-5af3-86d3-cf458c050375/122397c7-1084-5af3-86d3-cf458c050375_image_6.webp HTTP/1.1" 201 0
2025-12-05 11:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fb0362319-1791-4bbf-85eb-f1bcc56b7554_456f2aae-8a0d-4e6c-a658-fe94c497fcfb.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:58:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/b0362319-1791-4bbf-85eb-f1bcc56b7554_456f2aae-8a0d-4e6c-a658-fe94c497fcfb.jpg/250x188.webp saved to cache
2025-12-05 11:58:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 122397c7-1084-5af3-86d3-cf458c050375
2025-12-05 11:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27e96617d0-5e20-4e39-bd61-469a97e27e6e%27 HTTP/1.1" 200 None
2025-12-05 11:58:55 [auto_selling_autoscout24.it] INFO: Scrape type for e96617d0-5e20-4e39-bd61-469a97e27e6e: 1
2025-12-05 11:58:55 [auto_selling_autoscout24.it] INFO: Scraping new listing e96617d0-5e20-4e39-bd61-469a97e27e6e
2025-12-05 11:58:55 [auto_selling_autoscout24.it] INFO: Extracting item from listing ID: e96617d0-5e20-4e39-bd61-469a97e27e6e
2025-12-05 11:58:55 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: c001f9a4-fb19-5856-aa26-d7031d5f3504 with identifier: e96617d0-5e20-4e39-bd61-469a97e27e6e
2025-12-05 11:58:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item c001f9a4-fb19-5856-aa26-d7031d5f3504
2025-12-05 11:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fe96617d0-5e20-4e39-bd61-469a97e27e6e_85c8dd6c-8cb0-4027-89c1-fedc0fd34acb.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/e96617d0-5e20-4e39-bd61-469a97e27e6e_85c8dd6c-8cb0-4027-89c1-fedc0fd34acb.jpg/250x188.webp already downloaded
2025-12-05 11:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fe96617d0-5e20-4e39-bd61-469a97e27e6e_df7e5071-5385-4671-9f70-99fa1ad6407a.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/e96617d0-5e20-4e39-bd61-469a97e27e6e_df7e5071-5385-4671-9f70-99fa1ad6407a.jpg/250x188.webp already downloaded
2025-12-05 11:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fe96617d0-5e20-4e39-bd61-469a97e27e6e_647ef6b2-cb9d-4ef2-8a5d-4099c82cae42.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/e96617d0-5e20-4e39-bd61-469a97e27e6e_647ef6b2-cb9d-4ef2-8a5d-4099c82cae42.jpg/250x188.webp already downloaded
2025-12-05 11:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fe96617d0-5e20-4e39-bd61-469a97e27e6e_e0342c58-664a-4aaf-8685-930b2c65fede.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/e96617d0-5e20-4e39-bd61-469a97e27e6e_e0342c58-664a-4aaf-8685-930b2c65fede.jpg/250x188.webp already downloaded
2025-12-05 11:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fe96617d0-5e20-4e39-bd61-469a97e27e6e_a601a1e6-1721-4e89-865f-001eeaaea6e0.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/e96617d0-5e20-4e39-bd61-469a97e27e6e_a601a1e6-1721-4e89-865f-001eeaaea6e0.jpg/250x188.webp already downloaded
2025-12-05 11:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fe96617d0-5e20-4e39-bd61-469a97e27e6e_e5bce817-ae0e-4d60-9b0d-af8a31bff57a.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/e96617d0-5e20-4e39-bd61-469a97e27e6e_e5bce817-ae0e-4d60-9b0d-af8a31bff57a.jpg/250x188.webp already downloaded
2025-12-05 11:58:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/0e2c4c68-8157-4aad-8384-8a781c1fc3d8_5fc5c0d7-2a46-486f-a45a-cef3242df03a.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:58:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/0e2c4c68-8157-4aad-8384-8a781c1fc3d8_f3eba786-2db4-418c-869f-d6ddd54cf4e3.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:58:55 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: c001f9a4-fb19-5856-aa26-d7031d5f3504 with identifier e96617d0-5e20-4e39-bd61-469a97e27e6e
2025-12-05 11:58:55 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 11:58:55 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 11:58:55 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item c001f9a4-fb19-5856-aa26-d7031d5f3504
2025-12-05 11:58:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autoscout24.it/api/dealer-detail/fetch-listings>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'emission_standard': None,
 'engine': None,
 'engine_horse_power': 95,
 'expiration_date': None,
 'fuel_type': 'Gasoline',
 'id': 'c001f9a4-fb19-5856-aa26-d7031d5f3504',
 'is_damaged': False,
 'is_operable': True,
 'license_plate': None,
 'link_to_web_offer': 'https://www.autoscout24.it/offers/volkswagen-t-cross-1-0-tsi-edition-plus-95cv-nuovo-uff-italia-promo-gasoline-white-e96617d0-5e20-4e39-bd61-469a97e27e6e',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Cross',
 'odometer': 1,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 6,
 'photo_urls': ['https://prod.pictures.autoscout24.net/listing-images/e96617d0-5e20-4e39-bd61-469a97e27e6e_85c8dd6c-8cb0-4027-89c1-fedc0fd34acb.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/e96617d0-5e20-4e39-bd61-469a97e27e6e_df7e5071-5385-4671-9f70-99fa1ad6407a.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/e96617d0-5e20-4e39-bd61-469a97e27e6e_647ef6b2-cb9d-4ef2-8a5d-4099c82cae42.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/e96617d0-5e20-4e39-bd61-469a97e27e6e_e0342c58-664a-4aaf-8685-930b2c65fede.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/e96617d0-5e20-4e39-bd61-469a97e27e6e_a601a1e6-1721-4e89-865f-001eeaaea6e0.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/e96617d0-5e20-4e39-bd61-469a97e27e6e_e5bce817-ae0e-4d60-9b0d-af8a31bff57a.jpg/250x188.webp'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f365ded6-92c7-57e6-acff-17ab6aac7847/f365ded6-92c7-57e6-acff-17ab6aac7847_image_0.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3842,
             'Height': 173,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/e96617d0-5e20-4e39-bd61-469a97e27e6e_85c8dd6c-8cb0-4027-89c1-fedc0fd34acb.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f365ded6-92c7-57e6-acff-17ab6aac7847/f365ded6-92c7-57e6-acff-17ab6aac7847_image_1.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 2870,
             'Height': 143,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/e96617d0-5e20-4e39-bd61-469a97e27e6e_df7e5071-5385-4671-9f70-99fa1ad6407a.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f365ded6-92c7-57e6-acff-17ab6aac7847/f365ded6-92c7-57e6-acff-17ab6aac7847_image_2.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3312,
             'Height': 154,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/e96617d0-5e20-4e39-bd61-469a97e27e6e_647ef6b2-cb9d-4ef2-8a5d-4099c82cae42.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f365ded6-92c7-57e6-acff-17ab6aac7847/f365ded6-92c7-57e6-acff-17ab6aac7847_image_3.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3092,
             'Height': 142,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/e96617d0-5e20-4e39-bd61-469a97e27e6e_e0342c58-664a-4aaf-8685-930b2c65fede.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f365ded6-92c7-57e6-acff-17ab6aac7847/f365ded6-92c7-57e6-acff-17ab6aac7847_image_4.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 2984,
             'Height': 142,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/e96617d0-5e20-4e39-bd61-469a97e27e6e_a601a1e6-1721-4e89-865f-001eeaaea6e0.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f365ded6-92c7-57e6-acff-17ab6aac7847/f365ded6-92c7-57e6-acff-17ab6aac7847_image_5.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 2108,
             'Height': 138,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/e96617d0-5e20-4e39-bd61-469a97e27e6e_e5bce817-ae0e-4d60-9b0d-af8a31bff57a.jpg/250x188.webp',
             'Width': 250}],
 'price': 21900,
 'price_includes_vat': False,
 'registration_date': '2025-12-01',
 'seller_name': None,
 'title': 'Volkswagen T-Cross 1.0 TSI EDITION PLUS 95CV NUOVO UFF. ITALIA '
          'PROMO',
 'transmission': 'automatic',
 'trim': '1.0 TSI EDITION PLUS 95CV NUOVO UFF. ITALIA PROMO',
 'vin': None,
 'year': 2025}
2025-12-05 11:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27e96617d0-5e20-4e39-bd61-469a97e27e6e%27 HTTP/1.1" 200 None
2025-12-05 11:58:55 [auto_selling_autoscout24.it] INFO: Saving data for e96617d0-5e20-4e39-bd61-469a97e27e6e: {'created_time': 1764935935.656355, 'last_price_update_time': 1764935935.656366}
2025-12-05 11:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autoscout24.it',RowKey='e96617d0-5e20-4e39-bd61-469a97e27e6e') HTTP/1.1" 204 0
2025-12-05 11:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%279cbcad9a-47b8-4f8b-a293-c5e8f3c3b166%27 HTTP/1.1" 200 None
2025-12-05 11:58:55 [auto_selling_autoscout24.it] INFO: Scrape type for 9cbcad9a-47b8-4f8b-a293-c5e8f3c3b166: 1
2025-12-05 11:58:55 [auto_selling_autoscout24.it] INFO: Scraping new listing 9cbcad9a-47b8-4f8b-a293-c5e8f3c3b166
2025-12-05 11:58:55 [auto_selling_autoscout24.it] INFO: Extracting item from listing ID: 9cbcad9a-47b8-4f8b-a293-c5e8f3c3b166
2025-12-05 11:58:55 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: fd0bef90-62da-50a0-94c6-a2e16b21a7ed with identifier: 9cbcad9a-47b8-4f8b-a293-c5e8f3c3b166
2025-12-05 11:58:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 14 photos for item fd0bef90-62da-50a0-94c6-a2e16b21a7ed
2025-12-05 11:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F9cbcad9a-47b8-4f8b-a293-c5e8f3c3b166_b9e76f5d-f6d8-4917-bcf0-97258539142d.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/9cbcad9a-47b8-4f8b-a293-c5e8f3c3b166_b9e76f5d-f6d8-4917-bcf0-97258539142d.jpg/250x188.webp not downloaded yet
2025-12-05 11:58:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:58:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:58:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:58:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e382d0>
2025-12-05 11:58:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:58:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:58:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 11:58:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:58:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:58:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:58:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4222b1b3-8caf-572c-9281-46014c40f3ba/4222b1b3-8caf-572c-9281-46014c40f3ba_image_0.webp HTTP/1.1" 201 0
2025-12-05 11:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F0e2c4c68-8157-4aad-8384-8a781c1fc3d8_d2ce3086-b41a-492f-a1f7-6aa28b3dc4d6.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:58:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/0e2c4c68-8157-4aad-8384-8a781c1fc3d8_d2ce3086-b41a-492f-a1f7-6aa28b3dc4d6.jpg/250x188.webp saved to cache
2025-12-05 11:58:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4222b1b3-8caf-572c-9281-46014c40f3ba
2025-12-05 11:58:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:58:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:58:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:58:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5c5dd90>
2025-12-05 11:58:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:58:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:58:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 11:58:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:58:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:58:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:58:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_122397c7-1084-5af3-86d3-cf458c050375/122397c7-1084-5af3-86d3-cf458c050375_image_7.webp HTTP/1.1" 201 0
2025-12-05 11:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fb0362319-1791-4bbf-85eb-f1bcc56b7554_f9636915-8c5e-4214-b33c-249541329131.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/b0362319-1791-4bbf-85eb-f1bcc56b7554_f9636915-8c5e-4214-b33c-249541329131.jpg/250x188.webp saved to cache
2025-12-05 11:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 122397c7-1084-5af3-86d3-cf458c050375
2025-12-05 11:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 122397c7-1084-5af3-86d3-cf458c050375 from tracking dictionaries
2025-12-05 11:58:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 122397c7-1084-5af3-86d3-cf458c050375 sending to next pipeline
2025-12-05 11:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F9cbcad9a-47b8-4f8b-a293-c5e8f3c3b166_8a2b86f0-5f86-4b14-9ea7-557bce29ef41.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/9cbcad9a-47b8-4f8b-a293-c5e8f3c3b166_8a2b86f0-5f86-4b14-9ea7-557bce29ef41.jpg/250x188.webp not downloaded yet
2025-12-05 11:58:56 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 122397c7-1084-5af3-86d3-cf458c050375 with identifier b0362319-1791-4bbf-85eb-f1bcc56b7554
2025-12-05 11:58:56 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 11:58:56 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 11:58:56 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 122397c7-1084-5af3-86d3-cf458c050375
2025-12-05 11:58:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://prod.pictures.autoscout24.net/listing-images/b0362319-1791-4bbf-85eb-f1bcc56b7554_f9636915-8c5e-4214-b33c-249541329131.jpg/250x188.webp>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'emission_standard': None,
 'engine': None,
 'engine_horse_power': 305,
 'expiration_date': None,
 'fuel_type': 'Gasoline',
 'id': '122397c7-1084-5af3-86d3-cf458c050375',
 'is_damaged': False,
 'is_operable': True,
 'license_plate': None,
 'link_to_web_offer': 'https://www.autoscout24.it/offers/genesis-gv70-2-5t-sport-4wd-305cv-nuovo-modello-in-esclusiva-gasoline-grey-b0362319-1791-4bbf-85eb-f1bcc56b7554',
 'listing': 'auction',
 'make': 'Genesis',
 'model': 'GV70',
 'odometer': 1,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 8,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_122397c7-1084-5af3-86d3-cf458c050375/122397c7-1084-5af3-86d3-cf458c050375_image_0.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3548,
             'Height': 148,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/b0362319-1791-4bbf-85eb-f1bcc56b7554_1c3a65a5-3c30-442c-831e-a938f4cc7051.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_122397c7-1084-5af3-86d3-cf458c050375/122397c7-1084-5af3-86d3-cf458c050375_image_1.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3486,
             'Height': 145,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/b0362319-1791-4bbf-85eb-f1bcc56b7554_b912612f-c64f-4307-bf48-dea496f184c5.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_122397c7-1084-5af3-86d3-cf458c050375/122397c7-1084-5af3-86d3-cf458c050375_image_2.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3284,
             'Height': 136,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/b0362319-1791-4bbf-85eb-f1bcc56b7554_ff41c3d6-8ca1-4849-900b-049ba89babf3.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_122397c7-1084-5af3-86d3-cf458c050375/122397c7-1084-5af3-86d3-cf458c050375_image_3.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3462,
             'Height': 150,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/b0362319-1791-4bbf-85eb-f1bcc56b7554_334e8d85-07a1-4246-a1e5-304e0c6c6e70.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_122397c7-1084-5af3-86d3-cf458c050375/122397c7-1084-5af3-86d3-cf458c050375_image_4.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5052,
             'Height': 164,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/b0362319-1791-4bbf-85eb-f1bcc56b7554_0ebe8a06-f456-4520-ad5a-6ab4afe53b6a.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_122397c7-1084-5af3-86d3-cf458c050375/122397c7-1084-5af3-86d3-cf458c050375_image_5.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3550,
             'Height': 166,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/b0362319-1791-4bbf-85eb-f1bcc56b7554_6d548462-b655-4d58-9858-7dfc72e2e826.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_122397c7-1084-5af3-86d3-cf458c050375/122397c7-1084-5af3-86d3-cf458c050375_image_6.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3840,
             'Height': 164,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/b0362319-1791-4bbf-85eb-f1bcc56b7554_456f2aae-8a0d-4e6c-a658-fe94c497fcfb.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_122397c7-1084-5af3-86d3-cf458c050375/122397c7-1084-5af3-86d3-cf458c050375_image_7.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4136,
             'Height': 166,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/b0362319-1791-4bbf-85eb-f1bcc56b7554_f9636915-8c5e-4214-b33c-249541329131.jpg/250x188.webp',
             'Width': 250}],
 'price': 54800,
 'price_includes_vat': False,
 'registration_date': '2025-03-01',
 'seller_name': None,
 'title': 'Genesis GV70 2.5T SPORT 4WD 305CV NUOVO MODELLO IN ESCLUSIVA!',
 'transmission': 'automatic',
 'trim': '2.5T SPORT 4WD 305CV NUOVO MODELLO IN ESCLUSIVA!',
 'vin': None,
 'year': 2025}
2025-12-05 11:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27b0362319-1791-4bbf-85eb-f1bcc56b7554%27 HTTP/1.1" 200 None
2025-12-05 11:58:56 [auto_selling_autoscout24.it] INFO: Saving data for b0362319-1791-4bbf-85eb-f1bcc56b7554: {'created_time': 1764935936.274442, 'last_price_update_time': 1764935936.274451}
2025-12-05 11:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autoscout24.it',RowKey='b0362319-1791-4bbf-85eb-f1bcc56b7554') HTTP/1.1" 204 0
2025-12-05 11:58:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/0e2c4c68-8157-4aad-8384-8a781c1fc3d8_55f7140a-5928-4ac5-b255-444b47b4794a.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:58:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/0e2c4c68-8157-4aad-8384-8a781c1fc3d8_5c965d54-942a-4011-8c62-00efa951e856.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F9cbcad9a-47b8-4f8b-a293-c5e8f3c3b166_41d42838-b125-46ea-9fab-2f030ecf313f.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/9cbcad9a-47b8-4f8b-a293-c5e8f3c3b166_41d42838-b125-46ea-9fab-2f030ecf313f.jpg/250x188.webp not downloaded yet
2025-12-05 11:58:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:58:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:58:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:58:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5cb3a10>
2025-12-05 11:58:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:58:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:58:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 11:58:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:58:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:58:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:58:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4222b1b3-8caf-572c-9281-46014c40f3ba/4222b1b3-8caf-572c-9281-46014c40f3ba_image_1.webp HTTP/1.1" 201 0
2025-12-05 11:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F0e2c4c68-8157-4aad-8384-8a781c1fc3d8_5fc5c0d7-2a46-486f-a45a-cef3242df03a.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/0e2c4c68-8157-4aad-8384-8a781c1fc3d8_5fc5c0d7-2a46-486f-a45a-cef3242df03a.jpg/250x188.webp saved to cache
2025-12-05 11:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4222b1b3-8caf-572c-9281-46014c40f3ba
2025-12-05 11:58:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:58:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:58:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:58:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9dc11c290>
2025-12-05 11:58:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:58:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:58:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 11:58:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:58:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:58:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:58:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4222b1b3-8caf-572c-9281-46014c40f3ba/4222b1b3-8caf-572c-9281-46014c40f3ba_image_2.webp HTTP/1.1" 201 0
2025-12-05 11:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F0e2c4c68-8157-4aad-8384-8a781c1fc3d8_f3eba786-2db4-418c-869f-d6ddd54cf4e3.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/0e2c4c68-8157-4aad-8384-8a781c1fc3d8_f3eba786-2db4-418c-869f-d6ddd54cf4e3.jpg/250x188.webp saved to cache
2025-12-05 11:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4222b1b3-8caf-572c-9281-46014c40f3ba
2025-12-05 11:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F9cbcad9a-47b8-4f8b-a293-c5e8f3c3b166_b04c2d6f-7041-49b4-9f8c-6c0515a5c747.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/9cbcad9a-47b8-4f8b-a293-c5e8f3c3b166_b04c2d6f-7041-49b4-9f8c-6c0515a5c747.jpg/250x188.webp not downloaded yet
2025-12-05 11:58:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/9cbcad9a-47b8-4f8b-a293-c5e8f3c3b166_b9e76f5d-f6d8-4917-bcf0-97258539142d.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F9cbcad9a-47b8-4f8b-a293-c5e8f3c3b166_7a5bbdcf-e8ef-4d4b-9c12-287730418a09.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/9cbcad9a-47b8-4f8b-a293-c5e8f3c3b166_7a5bbdcf-e8ef-4d4b-9c12-287730418a09.jpg/250x188.webp not downloaded yet
2025-12-05 11:58:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:58:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:58:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:58:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5c55350>
2025-12-05 11:58:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:58:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:58:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 11:58:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:58:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:58:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:58:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4222b1b3-8caf-572c-9281-46014c40f3ba/4222b1b3-8caf-572c-9281-46014c40f3ba_image_3.webp HTTP/1.1" 201 0
2025-12-05 11:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F0e2c4c68-8157-4aad-8384-8a781c1fc3d8_55f7140a-5928-4ac5-b255-444b47b4794a.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:58:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/0e2c4c68-8157-4aad-8384-8a781c1fc3d8_55f7140a-5928-4ac5-b255-444b47b4794a.jpg/250x188.webp saved to cache
2025-12-05 11:58:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4222b1b3-8caf-572c-9281-46014c40f3ba
2025-12-05 11:58:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:58:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:58:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:58:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9dc1b98d0>
2025-12-05 11:58:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:58:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:58:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 11:58:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:58:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:58:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:58:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4222b1b3-8caf-572c-9281-46014c40f3ba/4222b1b3-8caf-572c-9281-46014c40f3ba_image_4.webp HTTP/1.1" 201 0
2025-12-05 11:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F0e2c4c68-8157-4aad-8384-8a781c1fc3d8_5c965d54-942a-4011-8c62-00efa951e856.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:58:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/0e2c4c68-8157-4aad-8384-8a781c1fc3d8_5c965d54-942a-4011-8c62-00efa951e856.jpg/250x188.webp saved to cache
2025-12-05 11:58:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4222b1b3-8caf-572c-9281-46014c40f3ba
2025-12-05 11:58:57 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 4222b1b3-8caf-572c-9281-46014c40f3ba from tracking dictionaries
2025-12-05 11:58:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4222b1b3-8caf-572c-9281-46014c40f3ba sending to next pipeline
2025-12-05 11:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F9cbcad9a-47b8-4f8b-a293-c5e8f3c3b166_734a541a-c486-4303-826e-6edd46f36057.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/9cbcad9a-47b8-4f8b-a293-c5e8f3c3b166_734a541a-c486-4303-826e-6edd46f36057.jpg/250x188.webp not downloaded yet
2025-12-05 11:58:57 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 4222b1b3-8caf-572c-9281-46014c40f3ba with identifier 0e2c4c68-8157-4aad-8384-8a781c1fc3d8
2025-12-05 11:58:57 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 11:58:57 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 11:58:57 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 4222b1b3-8caf-572c-9281-46014c40f3ba
2025-12-05 11:58:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://prod.pictures.autoscout24.net/listing-images/0e2c4c68-8157-4aad-8384-8a781c1fc3d8_5c965d54-942a-4011-8c62-00efa951e856.jpg/250x188.webp>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'emission_standard': None,
 'engine': None,
 'engine_horse_power': 207,
 'expiration_date': None,
 'fuel_type': 'Gasoline',
 'id': '4222b1b3-8caf-572c-9281-46014c40f3ba',
 'is_damaged': False,
 'is_operable': True,
 'license_plate': None,
 'link_to_web_offer': 'https://www.autoscout24.it/offers/audi-a1-spb-40-tfsi-s-tr-s-line-207cv-uff-italia-promo-gasoline-black-0e2c4c68-8157-4aad-8384-8a781c1fc3d8',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1',
 'odometer': 1,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4222b1b3-8caf-572c-9281-46014c40f3ba/4222b1b3-8caf-572c-9281-46014c40f3ba_image_0.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3464,
             'Height': 142,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/0e2c4c68-8157-4aad-8384-8a781c1fc3d8_d2ce3086-b41a-492f-a1f7-6aa28b3dc4d6.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4222b1b3-8caf-572c-9281-46014c40f3ba/4222b1b3-8caf-572c-9281-46014c40f3ba_image_1.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 2200,
             'Height': 122,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/0e2c4c68-8157-4aad-8384-8a781c1fc3d8_5fc5c0d7-2a46-486f-a45a-cef3242df03a.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4222b1b3-8caf-572c-9281-46014c40f3ba/4222b1b3-8caf-572c-9281-46014c40f3ba_image_2.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 2974,
             'Height': 149,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/0e2c4c68-8157-4aad-8384-8a781c1fc3d8_f3eba786-2db4-418c-869f-d6ddd54cf4e3.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4222b1b3-8caf-572c-9281-46014c40f3ba/4222b1b3-8caf-572c-9281-46014c40f3ba_image_3.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 2538,
             'Height': 109,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/0e2c4c68-8157-4aad-8384-8a781c1fc3d8_55f7140a-5928-4ac5-b255-444b47b4794a.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4222b1b3-8caf-572c-9281-46014c40f3ba/4222b1b3-8caf-572c-9281-46014c40f3ba_image_4.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 2798,
             'Height': 110,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/0e2c4c68-8157-4aad-8384-8a781c1fc3d8_5c965d54-942a-4011-8c62-00efa951e856.jpg/250x188.webp',
             'Width': 250}],
 'price': 34800,
 'price_includes_vat': False,
 'registration_date': '2025-08-01',
 'seller_name': None,
 'title': 'Audi A1 SPB 40 TFSI S-TR S-LINE 207CV UFF. ITALIA PROMO',
 'transmission': 'automatic',
 'trim': 'SPB 40 TFSI S-TR S-LINE 207CV UFF. ITALIA PROMO',
 'vin': None,
 'year': 2025}
2025-12-05 11:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%270e2c4c68-8157-4aad-8384-8a781c1fc3d8%27 HTTP/1.1" 200 None
2025-12-05 11:58:57 [auto_selling_autoscout24.it] INFO: Saving data for 0e2c4c68-8157-4aad-8384-8a781c1fc3d8: {'created_time': 1764935937.557105, 'last_price_update_time': 1764935937.557114}
2025-12-05 11:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autoscout24.it',RowKey='0e2c4c68-8157-4aad-8384-8a781c1fc3d8') HTTP/1.1" 204 0
2025-12-05 11:58:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/9cbcad9a-47b8-4f8b-a293-c5e8f3c3b166_8a2b86f0-5f86-4b14-9ea7-557bce29ef41.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:58:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/9cbcad9a-47b8-4f8b-a293-c5e8f3c3b166_41d42838-b125-46ea-9fab-2f030ecf313f.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F9cbcad9a-47b8-4f8b-a293-c5e8f3c3b166_31a55759-9094-4b91-a220-c3d77b5e3c67.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/9cbcad9a-47b8-4f8b-a293-c5e8f3c3b166_31a55759-9094-4b91-a220-c3d77b5e3c67.jpg/250x188.webp not downloaded yet
2025-12-05 11:58:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:58:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:58:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:58:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d6f0abd0>
2025-12-05 11:58:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:58:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:58:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 11:58:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:58:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:58:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:58:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd0bef90-62da-50a0-94c6-a2e16b21a7ed/fd0bef90-62da-50a0-94c6-a2e16b21a7ed_image_0.webp HTTP/1.1" 201 0
2025-12-05 11:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F9cbcad9a-47b8-4f8b-a293-c5e8f3c3b166_b9e76f5d-f6d8-4917-bcf0-97258539142d.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:58:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/9cbcad9a-47b8-4f8b-a293-c5e8f3c3b166_b9e76f5d-f6d8-4917-bcf0-97258539142d.jpg/250x188.webp saved to cache
2025-12-05 11:58:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fd0bef90-62da-50a0-94c6-a2e16b21a7ed
2025-12-05 11:58:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/9cbcad9a-47b8-4f8b-a293-c5e8f3c3b166_b04c2d6f-7041-49b4-9f8c-6c0515a5c747.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:58:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/9cbcad9a-47b8-4f8b-a293-c5e8f3c3b166_7a5bbdcf-e8ef-4d4b-9c12-287730418a09.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F9cbcad9a-47b8-4f8b-a293-c5e8f3c3b166_4af33f6a-8ba1-4509-ac8d-5e1022110457.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/9cbcad9a-47b8-4f8b-a293-c5e8f3c3b166_4af33f6a-8ba1-4509-ac8d-5e1022110457.jpg/250x188.webp not downloaded yet
2025-12-05 11:58:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:58:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:58:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:58:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d6ffa810>
2025-12-05 11:58:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:58:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:58:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 11:58:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:58:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:58:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:58:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd0bef90-62da-50a0-94c6-a2e16b21a7ed/fd0bef90-62da-50a0-94c6-a2e16b21a7ed_image_1.webp HTTP/1.1" 201 0
2025-12-05 11:58:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F9cbcad9a-47b8-4f8b-a293-c5e8f3c3b166_8a2b86f0-5f86-4b14-9ea7-557bce29ef41.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/9cbcad9a-47b8-4f8b-a293-c5e8f3c3b166_8a2b86f0-5f86-4b14-9ea7-557bce29ef41.jpg/250x188.webp saved to cache
2025-12-05 11:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fd0bef90-62da-50a0-94c6-a2e16b21a7ed
2025-12-05 11:58:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:58:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:58:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:58:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9dc1e7690>
2025-12-05 11:58:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:58:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:58:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 11:58:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:58:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:58:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:58:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd0bef90-62da-50a0-94c6-a2e16b21a7ed/fd0bef90-62da-50a0-94c6-a2e16b21a7ed_image_2.webp HTTP/1.1" 201 0
2025-12-05 11:58:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F9cbcad9a-47b8-4f8b-a293-c5e8f3c3b166_41d42838-b125-46ea-9fab-2f030ecf313f.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/9cbcad9a-47b8-4f8b-a293-c5e8f3c3b166_41d42838-b125-46ea-9fab-2f030ecf313f.jpg/250x188.webp saved to cache
2025-12-05 11:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fd0bef90-62da-50a0-94c6-a2e16b21a7ed
2025-12-05 11:58:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/9cbcad9a-47b8-4f8b-a293-c5e8f3c3b166_734a541a-c486-4303-826e-6edd46f36057.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:58:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F9cbcad9a-47b8-4f8b-a293-c5e8f3c3b166_3aa493bd-ffd8-44b1-9097-d2f40d025af4.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/9cbcad9a-47b8-4f8b-a293-c5e8f3c3b166_3aa493bd-ffd8-44b1-9097-d2f40d025af4.jpg/250x188.webp not downloaded yet
2025-12-05 11:58:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F9cbcad9a-47b8-4f8b-a293-c5e8f3c3b166_06384aec-c206-47e6-964c-51768ecebfd8.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/9cbcad9a-47b8-4f8b-a293-c5e8f3c3b166_06384aec-c206-47e6-964c-51768ecebfd8.jpg/250x188.webp not downloaded yet
2025-12-05 11:58:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:58:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:58:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:58:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d6f09790>
2025-12-05 11:58:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:58:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:58:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 11:58:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:58:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:58:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:58:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd0bef90-62da-50a0-94c6-a2e16b21a7ed/fd0bef90-62da-50a0-94c6-a2e16b21a7ed_image_3.webp HTTP/1.1" 201 0
2025-12-05 11:58:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F9cbcad9a-47b8-4f8b-a293-c5e8f3c3b166_b04c2d6f-7041-49b4-9f8c-6c0515a5c747.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/9cbcad9a-47b8-4f8b-a293-c5e8f3c3b166_b04c2d6f-7041-49b4-9f8c-6c0515a5c747.jpg/250x188.webp saved to cache
2025-12-05 11:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fd0bef90-62da-50a0-94c6-a2e16b21a7ed
2025-12-05 11:58:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:58:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:58:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:58:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5c9c590>
2025-12-05 11:58:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:58:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:58:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 11:58:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:58:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:58:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:58:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd0bef90-62da-50a0-94c6-a2e16b21a7ed/fd0bef90-62da-50a0-94c6-a2e16b21a7ed_image_4.webp HTTP/1.1" 201 0
2025-12-05 11:58:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F9cbcad9a-47b8-4f8b-a293-c5e8f3c3b166_7a5bbdcf-e8ef-4d4b-9c12-287730418a09.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/9cbcad9a-47b8-4f8b-a293-c5e8f3c3b166_7a5bbdcf-e8ef-4d4b-9c12-287730418a09.jpg/250x188.webp saved to cache
2025-12-05 11:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fd0bef90-62da-50a0-94c6-a2e16b21a7ed
2025-12-05 11:58:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/9cbcad9a-47b8-4f8b-a293-c5e8f3c3b166_31a55759-9094-4b91-a220-c3d77b5e3c67.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:58:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/9cbcad9a-47b8-4f8b-a293-c5e8f3c3b166_4af33f6a-8ba1-4509-ac8d-5e1022110457.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:58:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F9cbcad9a-47b8-4f8b-a293-c5e8f3c3b166_476bf1c0-fa74-453d-97a7-4d025561cada.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/9cbcad9a-47b8-4f8b-a293-c5e8f3c3b166_476bf1c0-fa74-453d-97a7-4d025561cada.jpg/250x188.webp not downloaded yet
2025-12-05 11:58:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:58:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:58:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:58:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9dc172710>
2025-12-05 11:58:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:58:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:58:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 11:58:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:58:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:58:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:58:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd0bef90-62da-50a0-94c6-a2e16b21a7ed/fd0bef90-62da-50a0-94c6-a2e16b21a7ed_image_5.webp HTTP/1.1" 201 0
2025-12-05 11:58:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F9cbcad9a-47b8-4f8b-a293-c5e8f3c3b166_734a541a-c486-4303-826e-6edd46f36057.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/9cbcad9a-47b8-4f8b-a293-c5e8f3c3b166_734a541a-c486-4303-826e-6edd46f36057.jpg/250x188.webp saved to cache
2025-12-05 11:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fd0bef90-62da-50a0-94c6-a2e16b21a7ed
2025-12-05 11:58:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F9cbcad9a-47b8-4f8b-a293-c5e8f3c3b166_e27f08eb-1557-442e-8410-774fec2ee20f.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/9cbcad9a-47b8-4f8b-a293-c5e8f3c3b166_e27f08eb-1557-442e-8410-774fec2ee20f.jpg/250x188.webp not downloaded yet
2025-12-05 11:58:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/9cbcad9a-47b8-4f8b-a293-c5e8f3c3b166_3aa493bd-ffd8-44b1-9097-d2f40d025af4.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:58:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F9cbcad9a-47b8-4f8b-a293-c5e8f3c3b166_279281a9-d0e5-48a4-a490-e13fc7097e86.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/9cbcad9a-47b8-4f8b-a293-c5e8f3c3b166_279281a9-d0e5-48a4-a490-e13fc7097e86.jpg/250x188.webp not downloaded yet
2025-12-05 11:58:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:58:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:58:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:58:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e07f50>
2025-12-05 11:58:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:58:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:58:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 11:58:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:58:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:58:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:58:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd0bef90-62da-50a0-94c6-a2e16b21a7ed/fd0bef90-62da-50a0-94c6-a2e16b21a7ed_image_6.webp HTTP/1.1" 201 0
2025-12-05 11:58:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:58:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F9cbcad9a-47b8-4f8b-a293-c5e8f3c3b166_31a55759-9094-4b91-a220-c3d77b5e3c67.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/9cbcad9a-47b8-4f8b-a293-c5e8f3c3b166_31a55759-9094-4b91-a220-c3d77b5e3c67.jpg/250x188.webp saved to cache
2025-12-05 11:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fd0bef90-62da-50a0-94c6-a2e16b21a7ed
2025-12-05 11:58:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:58:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:58:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:58:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9dc1e9c90>
2025-12-05 11:58:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:58:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:58:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 11:58:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:58:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:58:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:58:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd0bef90-62da-50a0-94c6-a2e16b21a7ed/fd0bef90-62da-50a0-94c6-a2e16b21a7ed_image_7.webp HTTP/1.1" 201 0
2025-12-05 11:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F9cbcad9a-47b8-4f8b-a293-c5e8f3c3b166_4af33f6a-8ba1-4509-ac8d-5e1022110457.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/9cbcad9a-47b8-4f8b-a293-c5e8f3c3b166_4af33f6a-8ba1-4509-ac8d-5e1022110457.jpg/250x188.webp saved to cache
2025-12-05 11:59:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fd0bef90-62da-50a0-94c6-a2e16b21a7ed
2025-12-05 11:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F9cbcad9a-47b8-4f8b-a293-c5e8f3c3b166_b863e84a-8f0f-4e00-83e0-47a6d0d7814e.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/9cbcad9a-47b8-4f8b-a293-c5e8f3c3b166_b863e84a-8f0f-4e00-83e0-47a6d0d7814e.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/9cbcad9a-47b8-4f8b-a293-c5e8f3c3b166_476bf1c0-fa74-453d-97a7-4d025561cada.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/9cbcad9a-47b8-4f8b-a293-c5e8f3c3b166_06384aec-c206-47e6-964c-51768ecebfd8.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27b1872391-5fb3-4fda-842f-80e63a1acd78%27 HTTP/1.1" 200 None
2025-12-05 11:59:00 [auto_selling_autoscout24.it] INFO: Scrape type for b1872391-5fb3-4fda-842f-80e63a1acd78: 1
2025-12-05 11:59:00 [auto_selling_autoscout24.it] INFO: Scraping new listing b1872391-5fb3-4fda-842f-80e63a1acd78
2025-12-05 11:59:00 [auto_selling_autoscout24.it] INFO: Extracting item from listing ID: b1872391-5fb3-4fda-842f-80e63a1acd78
2025-12-05 11:59:00 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 92ce90a0-0dc8-5ab3-a1f6-fcffe371209b with identifier: b1872391-5fb3-4fda-842f-80e63a1acd78
2025-12-05 11:59:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 13 photos for item 92ce90a0-0dc8-5ab3-a1f6-fcffe371209b
2025-12-05 11:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fb1872391-5fb3-4fda-842f-80e63a1acd78_18da27ec-ec9e-472a-a91a-ad320bc15dbf.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/b1872391-5fb3-4fda-842f-80e63a1acd78_18da27ec-ec9e-472a-a91a-ad320bc15dbf.jpg/250x188.webp already downloaded
2025-12-05 11:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fb1872391-5fb3-4fda-842f-80e63a1acd78_5d7802f8-b164-4a4f-a644-8d55eaa1294a.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/b1872391-5fb3-4fda-842f-80e63a1acd78_5d7802f8-b164-4a4f-a644-8d55eaa1294a.jpg/250x188.webp already downloaded
2025-12-05 11:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fb1872391-5fb3-4fda-842f-80e63a1acd78_35ed9fb6-36c6-4214-9cc7-225c41c044af.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/b1872391-5fb3-4fda-842f-80e63a1acd78_35ed9fb6-36c6-4214-9cc7-225c41c044af.jpg/250x188.webp already downloaded
2025-12-05 11:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fb1872391-5fb3-4fda-842f-80e63a1acd78_a56f15f3-5359-48a5-bd48-d755e237f69e.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/b1872391-5fb3-4fda-842f-80e63a1acd78_a56f15f3-5359-48a5-bd48-d755e237f69e.jpg/250x188.webp already downloaded
2025-12-05 11:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fb1872391-5fb3-4fda-842f-80e63a1acd78_3cdcc60a-9b63-43ad-abb3-f53cb8136eae.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/b1872391-5fb3-4fda-842f-80e63a1acd78_3cdcc60a-9b63-43ad-abb3-f53cb8136eae.jpg/250x188.webp already downloaded
2025-12-05 11:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fb1872391-5fb3-4fda-842f-80e63a1acd78_c642111a-23a3-43dc-8dfc-b65fdcbc9ba1.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/b1872391-5fb3-4fda-842f-80e63a1acd78_c642111a-23a3-43dc-8dfc-b65fdcbc9ba1.jpg/250x188.webp already downloaded
2025-12-05 11:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fb1872391-5fb3-4fda-842f-80e63a1acd78_80a8bdb8-d48d-4288-a7ee-e703398579bf.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/b1872391-5fb3-4fda-842f-80e63a1acd78_80a8bdb8-d48d-4288-a7ee-e703398579bf.jpg/250x188.webp already downloaded
2025-12-05 11:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fb1872391-5fb3-4fda-842f-80e63a1acd78_5eea2c4e-d9de-4c48-87db-873af020fee5.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/b1872391-5fb3-4fda-842f-80e63a1acd78_5eea2c4e-d9de-4c48-87db-873af020fee5.jpg/250x188.webp already downloaded
2025-12-05 11:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fb1872391-5fb3-4fda-842f-80e63a1acd78_975f93ad-6e6b-4884-964f-b9f53ffd5ded.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/b1872391-5fb3-4fda-842f-80e63a1acd78_975f93ad-6e6b-4884-964f-b9f53ffd5ded.jpg/250x188.webp already downloaded
2025-12-05 11:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fb1872391-5fb3-4fda-842f-80e63a1acd78_b8e1043f-6192-45c3-9173-bea044f805b6.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/b1872391-5fb3-4fda-842f-80e63a1acd78_b8e1043f-6192-45c3-9173-bea044f805b6.jpg/250x188.webp already downloaded
2025-12-05 11:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fb1872391-5fb3-4fda-842f-80e63a1acd78_83c210aa-85d7-4c81-ad1e-d68943703fad.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/b1872391-5fb3-4fda-842f-80e63a1acd78_83c210aa-85d7-4c81-ad1e-d68943703fad.jpg/250x188.webp already downloaded
2025-12-05 11:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fb1872391-5fb3-4fda-842f-80e63a1acd78_80de3d30-a99b-497c-90ec-ec821a2a6f51.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/b1872391-5fb3-4fda-842f-80e63a1acd78_80de3d30-a99b-497c-90ec-ec821a2a6f51.jpg/250x188.webp already downloaded
2025-12-05 11:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fb1872391-5fb3-4fda-842f-80e63a1acd78_cbc847bf-15d0-44fe-9eb8-74b9379a1e96.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/b1872391-5fb3-4fda-842f-80e63a1acd78_cbc847bf-15d0-44fe-9eb8-74b9379a1e96.jpg/250x188.webp already downloaded
2025-12-05 11:59:00 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 92ce90a0-0dc8-5ab3-a1f6-fcffe371209b with identifier b1872391-5fb3-4fda-842f-80e63a1acd78
2025-12-05 11:59:00 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 11:59:00 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 11:59:00 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 92ce90a0-0dc8-5ab3-a1f6-fcffe371209b
2025-12-05 11:59:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autoscout24.it/api/dealer-detail/fetch-listings>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'emission_standard': None,
 'engine': None,
 'engine_horse_power': 286,
 'expiration_date': None,
 'fuel_type': 'Gasoline',
 'id': '92ce90a0-0dc8-5ab3-a1f6-fcffe371209b',
 'is_damaged': False,
 'is_operable': True,
 'license_plate': None,
 'link_to_web_offer': 'https://www.autoscout24.it/offers/audi-q8-s-line-3-0-tdi-tiptronic-286cv-iva-esposta-promo-gasoline-black-b1872391-5fb3-4fda-842f-80e63a1acd78',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q8',
 'odometer': 4200,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 13,
 'photo_urls': ['https://prod.pictures.autoscout24.net/listing-images/b1872391-5fb3-4fda-842f-80e63a1acd78_18da27ec-ec9e-472a-a91a-ad320bc15dbf.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/b1872391-5fb3-4fda-842f-80e63a1acd78_5d7802f8-b164-4a4f-a644-8d55eaa1294a.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/b1872391-5fb3-4fda-842f-80e63a1acd78_35ed9fb6-36c6-4214-9cc7-225c41c044af.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/b1872391-5fb3-4fda-842f-80e63a1acd78_a56f15f3-5359-48a5-bd48-d755e237f69e.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/b1872391-5fb3-4fda-842f-80e63a1acd78_3cdcc60a-9b63-43ad-abb3-f53cb8136eae.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/b1872391-5fb3-4fda-842f-80e63a1acd78_c642111a-23a3-43dc-8dfc-b65fdcbc9ba1.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/b1872391-5fb3-4fda-842f-80e63a1acd78_80a8bdb8-d48d-4288-a7ee-e703398579bf.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/b1872391-5fb3-4fda-842f-80e63a1acd78_5eea2c4e-d9de-4c48-87db-873af020fee5.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/b1872391-5fb3-4fda-842f-80e63a1acd78_975f93ad-6e6b-4884-964f-b9f53ffd5ded.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/b1872391-5fb3-4fda-842f-80e63a1acd78_b8e1043f-6192-45c3-9173-bea044f805b6.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/b1872391-5fb3-4fda-842f-80e63a1acd78_83c210aa-85d7-4c81-ad1e-d68943703fad.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/b1872391-5fb3-4fda-842f-80e63a1acd78_80de3d30-a99b-497c-90ec-ec821a2a6f51.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/b1872391-5fb3-4fda-842f-80e63a1acd78_cbc847bf-15d0-44fe-9eb8-74b9379a1e96.jpg/250x188.webp'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22372def-3616-5645-8afd-1d511d905289/22372def-3616-5645-8afd-1d511d905289_image_0.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3906,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/b1872391-5fb3-4fda-842f-80e63a1acd78_18da27ec-ec9e-472a-a91a-ad320bc15dbf.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22372def-3616-5645-8afd-1d511d905289/22372def-3616-5645-8afd-1d511d905289_image_1.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3680,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/b1872391-5fb3-4fda-842f-80e63a1acd78_5d7802f8-b164-4a4f-a644-8d55eaa1294a.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22372def-3616-5645-8afd-1d511d905289/22372def-3616-5645-8afd-1d511d905289_image_2.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4058,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/b1872391-5fb3-4fda-842f-80e63a1acd78_35ed9fb6-36c6-4214-9cc7-225c41c044af.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22372def-3616-5645-8afd-1d511d905289/22372def-3616-5645-8afd-1d511d905289_image_3.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4420,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/b1872391-5fb3-4fda-842f-80e63a1acd78_a56f15f3-5359-48a5-bd48-d755e237f69e.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22372def-3616-5645-8afd-1d511d905289/22372def-3616-5645-8afd-1d511d905289_image_4.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3676,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/b1872391-5fb3-4fda-842f-80e63a1acd78_3cdcc60a-9b63-43ad-abb3-f53cb8136eae.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22372def-3616-5645-8afd-1d511d905289/22372def-3616-5645-8afd-1d511d905289_image_5.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3942,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/b1872391-5fb3-4fda-842f-80e63a1acd78_c642111a-23a3-43dc-8dfc-b65fdcbc9ba1.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22372def-3616-5645-8afd-1d511d905289/22372def-3616-5645-8afd-1d511d905289_image_6.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 6668,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/b1872391-5fb3-4fda-842f-80e63a1acd78_80a8bdb8-d48d-4288-a7ee-e703398579bf.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22372def-3616-5645-8afd-1d511d905289/22372def-3616-5645-8afd-1d511d905289_image_7.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4886,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/b1872391-5fb3-4fda-842f-80e63a1acd78_5eea2c4e-d9de-4c48-87db-873af020fee5.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22372def-3616-5645-8afd-1d511d905289/22372def-3616-5645-8afd-1d511d905289_image_8.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 7380,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/b1872391-5fb3-4fda-842f-80e63a1acd78_975f93ad-6e6b-4884-964f-b9f53ffd5ded.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22372def-3616-5645-8afd-1d511d905289/22372def-3616-5645-8afd-1d511d905289_image_9.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5566,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/b1872391-5fb3-4fda-842f-80e63a1acd78_b8e1043f-6192-45c3-9173-bea044f805b6.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22372def-3616-5645-8afd-1d511d905289/22372def-3616-5645-8afd-1d511d905289_image_10.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4340,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/b1872391-5fb3-4fda-842f-80e63a1acd78_83c210aa-85d7-4c81-ad1e-d68943703fad.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22372def-3616-5645-8afd-1d511d905289/22372def-3616-5645-8afd-1d511d905289_image_11.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 7138,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/b1872391-5fb3-4fda-842f-80e63a1acd78_80de3d30-a99b-497c-90ec-ec821a2a6f51.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22372def-3616-5645-8afd-1d511d905289/22372def-3616-5645-8afd-1d511d905289_image_12.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 7210,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/b1872391-5fb3-4fda-842f-80e63a1acd78_cbc847bf-15d0-44fe-9eb8-74b9379a1e96.jpg/250x188.webp',
             'Width': 250}],
 'price': 89900,
 'price_includes_vat': False,
 'registration_date': '2025-02-01',
 'seller_name': None,
 'title': 'Audi Q8 S-LINE 3.0 TDI TIPTRONIC 286CV *IVA ESPOSTA* PROMO',
 'transmission': 'automatic',
 'trim': 'S-LINE 3.0 TDI TIPTRONIC 286CV *IVA ESPOSTA* PROMO',
 'vin': None,
 'year': 2025}
2025-12-05 11:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27b1872391-5fb3-4fda-842f-80e63a1acd78%27 HTTP/1.1" 200 None
2025-12-05 11:59:00 [auto_selling_autoscout24.it] INFO: Saving data for b1872391-5fb3-4fda-842f-80e63a1acd78: {'created_time': 1764935940.448833, 'last_price_update_time': 1764935940.448843}
2025-12-05 11:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autoscout24.it',RowKey='b1872391-5fb3-4fda-842f-80e63a1acd78') HTTP/1.1" 204 0
2025-12-05 11:59:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5c9d390>
2025-12-05 11:59:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 11:59:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd0bef90-62da-50a0-94c6-a2e16b21a7ed/fd0bef90-62da-50a0-94c6-a2e16b21a7ed_image_8.webp HTTP/1.1" 201 0
2025-12-05 11:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F9cbcad9a-47b8-4f8b-a293-c5e8f3c3b166_3aa493bd-ffd8-44b1-9097-d2f40d025af4.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/9cbcad9a-47b8-4f8b-a293-c5e8f3c3b166_3aa493bd-ffd8-44b1-9097-d2f40d025af4.jpg/250x188.webp saved to cache
2025-12-05 11:59:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fd0bef90-62da-50a0-94c6-a2e16b21a7ed
2025-12-05 11:59:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/9cbcad9a-47b8-4f8b-a293-c5e8f3c3b166_279281a9-d0e5-48a4-a490-e13fc7097e86.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/9cbcad9a-47b8-4f8b-a293-c5e8f3c3b166_e27f08eb-1557-442e-8410-774fec2ee20f.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%276170967f-607e-4a35-b1ca-8ff2a69511f0%27 HTTP/1.1" 200 None
2025-12-05 11:59:00 [auto_selling_autoscout24.it] INFO: Scrape type for 6170967f-607e-4a35-b1ca-8ff2a69511f0: 1
2025-12-05 11:59:00 [auto_selling_autoscout24.it] INFO: Scraping new listing 6170967f-607e-4a35-b1ca-8ff2a69511f0
2025-12-05 11:59:00 [auto_selling_autoscout24.it] INFO: Extracting item from listing ID: 6170967f-607e-4a35-b1ca-8ff2a69511f0
2025-12-05 11:59:00 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 452763de-38c1-5cef-8363-1e86e8c8dc12 with identifier: 6170967f-607e-4a35-b1ca-8ff2a69511f0
2025-12-05 11:59:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 14 photos for item 452763de-38c1-5cef-8363-1e86e8c8dc12
2025-12-05 11:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F6170967f-607e-4a35-b1ca-8ff2a69511f0_4ec9d7c7-e02e-41ea-945e-08ce8b273f04.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/6170967f-607e-4a35-b1ca-8ff2a69511f0_4ec9d7c7-e02e-41ea-945e-08ce8b273f04.jpg/250x188.webp already downloaded
2025-12-05 11:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F6170967f-607e-4a35-b1ca-8ff2a69511f0_927ce680-df83-43a5-bdbd-8ee2085d29fb.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/6170967f-607e-4a35-b1ca-8ff2a69511f0_927ce680-df83-43a5-bdbd-8ee2085d29fb.jpg/250x188.webp already downloaded
2025-12-05 11:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F6170967f-607e-4a35-b1ca-8ff2a69511f0_41b381ed-34cf-4678-a5d8-7d719b7a48b3.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/6170967f-607e-4a35-b1ca-8ff2a69511f0_41b381ed-34cf-4678-a5d8-7d719b7a48b3.jpg/250x188.webp already downloaded
2025-12-05 11:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F6170967f-607e-4a35-b1ca-8ff2a69511f0_15cb33d6-cdab-4229-b777-60f5edf349f0.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/6170967f-607e-4a35-b1ca-8ff2a69511f0_15cb33d6-cdab-4229-b777-60f5edf349f0.jpg/250x188.webp already downloaded
2025-12-05 11:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F6170967f-607e-4a35-b1ca-8ff2a69511f0_bd73a1cf-3deb-42ae-8e42-365f29478b56.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/6170967f-607e-4a35-b1ca-8ff2a69511f0_bd73a1cf-3deb-42ae-8e42-365f29478b56.jpg/250x188.webp already downloaded
2025-12-05 11:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F6170967f-607e-4a35-b1ca-8ff2a69511f0_22430a9b-a608-446e-86d9-abcf8d7ccdb2.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/6170967f-607e-4a35-b1ca-8ff2a69511f0_22430a9b-a608-446e-86d9-abcf8d7ccdb2.jpg/250x188.webp already downloaded
2025-12-05 11:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F6170967f-607e-4a35-b1ca-8ff2a69511f0_f0530042-dc92-400f-a8b1-54b0fa3dfef4.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/6170967f-607e-4a35-b1ca-8ff2a69511f0_f0530042-dc92-400f-a8b1-54b0fa3dfef4.jpg/250x188.webp already downloaded
2025-12-05 11:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F6170967f-607e-4a35-b1ca-8ff2a69511f0_41d4864d-7300-49ed-befa-6eb2fe055195.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/6170967f-607e-4a35-b1ca-8ff2a69511f0_41d4864d-7300-49ed-befa-6eb2fe055195.jpg/250x188.webp already downloaded
2025-12-05 11:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F6170967f-607e-4a35-b1ca-8ff2a69511f0_63b92470-dbcc-4c82-95bd-ee20f2ef72e5.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/6170967f-607e-4a35-b1ca-8ff2a69511f0_63b92470-dbcc-4c82-95bd-ee20f2ef72e5.jpg/250x188.webp already downloaded
2025-12-05 11:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F6170967f-607e-4a35-b1ca-8ff2a69511f0_065d40db-964a-4d46-b0a2-29174b92f6e9.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/6170967f-607e-4a35-b1ca-8ff2a69511f0_065d40db-964a-4d46-b0a2-29174b92f6e9.jpg/250x188.webp already downloaded
2025-12-05 11:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F6170967f-607e-4a35-b1ca-8ff2a69511f0_c56384a7-358f-4ce2-bbdf-71c9835cd450.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/6170967f-607e-4a35-b1ca-8ff2a69511f0_c56384a7-358f-4ce2-bbdf-71c9835cd450.jpg/250x188.webp already downloaded
2025-12-05 11:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F6170967f-607e-4a35-b1ca-8ff2a69511f0_9322f0f4-0116-4eae-bba7-aab17febd968.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/6170967f-607e-4a35-b1ca-8ff2a69511f0_9322f0f4-0116-4eae-bba7-aab17febd968.jpg/250x188.webp already downloaded
2025-12-05 11:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F6170967f-607e-4a35-b1ca-8ff2a69511f0_68dfa3cd-0025-4ea4-8d6b-16b255d90483.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/6170967f-607e-4a35-b1ca-8ff2a69511f0_68dfa3cd-0025-4ea4-8d6b-16b255d90483.jpg/250x188.webp already downloaded
2025-12-05 11:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F6170967f-607e-4a35-b1ca-8ff2a69511f0_d67a8c1b-6def-40fa-bd05-98a40cd99c6a.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/6170967f-607e-4a35-b1ca-8ff2a69511f0_d67a8c1b-6def-40fa-bd05-98a40cd99c6a.jpg/250x188.webp already downloaded
2025-12-05 11:59:00 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 452763de-38c1-5cef-8363-1e86e8c8dc12 with identifier 6170967f-607e-4a35-b1ca-8ff2a69511f0
2025-12-05 11:59:00 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 11:59:00 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 11:59:01 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 452763de-38c1-5cef-8363-1e86e8c8dc12
2025-12-05 11:59:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autoscout24.it/api/dealer-detail/fetch-listings>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'emission_standard': None,
 'engine': None,
 'engine_horse_power': 150,
 'expiration_date': None,
 'fuel_type': 'Electric/Gasoline',
 'id': '452763de-38c1-5cef-8363-1e86e8c8dc12',
 'is_damaged': False,
 'is_operable': True,
 'license_plate': None,
 'link_to_web_offer': 'https://www.autoscout24.it/offers/cupra-terramar-1-5-etsi-dsg-150cv-pack-performance-only-promo-electric-gasoline-grey-6170967f-607e-4a35-b1ca-8ff2a69511f0',
 'listing': 'auction',
 'make': 'CUPRA',
 'model': 'Terramar',
 'odometer': 22900,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 14,
 'photo_urls': ['https://prod.pictures.autoscout24.net/listing-images/6170967f-607e-4a35-b1ca-8ff2a69511f0_4ec9d7c7-e02e-41ea-945e-08ce8b273f04.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/6170967f-607e-4a35-b1ca-8ff2a69511f0_927ce680-df83-43a5-bdbd-8ee2085d29fb.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/6170967f-607e-4a35-b1ca-8ff2a69511f0_41b381ed-34cf-4678-a5d8-7d719b7a48b3.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/6170967f-607e-4a35-b1ca-8ff2a69511f0_15cb33d6-cdab-4229-b777-60f5edf349f0.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/6170967f-607e-4a35-b1ca-8ff2a69511f0_bd73a1cf-3deb-42ae-8e42-365f29478b56.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/6170967f-607e-4a35-b1ca-8ff2a69511f0_22430a9b-a608-446e-86d9-abcf8d7ccdb2.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/6170967f-607e-4a35-b1ca-8ff2a69511f0_f0530042-dc92-400f-a8b1-54b0fa3dfef4.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/6170967f-607e-4a35-b1ca-8ff2a69511f0_41d4864d-7300-49ed-befa-6eb2fe055195.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/6170967f-607e-4a35-b1ca-8ff2a69511f0_63b92470-dbcc-4c82-95bd-ee20f2ef72e5.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/6170967f-607e-4a35-b1ca-8ff2a69511f0_065d40db-964a-4d46-b0a2-29174b92f6e9.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/6170967f-607e-4a35-b1ca-8ff2a69511f0_c56384a7-358f-4ce2-bbdf-71c9835cd450.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/6170967f-607e-4a35-b1ca-8ff2a69511f0_9322f0f4-0116-4eae-bba7-aab17febd968.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/6170967f-607e-4a35-b1ca-8ff2a69511f0_68dfa3cd-0025-4ea4-8d6b-16b255d90483.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/6170967f-607e-4a35-b1ca-8ff2a69511f0_d67a8c1b-6def-40fa-bd05-98a40cd99c6a.jpg/250x188.webp'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15dbb687-a96c-5a00-b6ff-53b22235117d/15dbb687-a96c-5a00-b6ff-53b22235117d_image_0.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4322,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/6170967f-607e-4a35-b1ca-8ff2a69511f0_4ec9d7c7-e02e-41ea-945e-08ce8b273f04.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15dbb687-a96c-5a00-b6ff-53b22235117d/15dbb687-a96c-5a00-b6ff-53b22235117d_image_1.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4916,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/6170967f-607e-4a35-b1ca-8ff2a69511f0_927ce680-df83-43a5-bdbd-8ee2085d29fb.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15dbb687-a96c-5a00-b6ff-53b22235117d/15dbb687-a96c-5a00-b6ff-53b22235117d_image_2.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4946,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/6170967f-607e-4a35-b1ca-8ff2a69511f0_41b381ed-34cf-4678-a5d8-7d719b7a48b3.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15dbb687-a96c-5a00-b6ff-53b22235117d/15dbb687-a96c-5a00-b6ff-53b22235117d_image_3.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4794,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/6170967f-607e-4a35-b1ca-8ff2a69511f0_15cb33d6-cdab-4229-b777-60f5edf349f0.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15dbb687-a96c-5a00-b6ff-53b22235117d/15dbb687-a96c-5a00-b6ff-53b22235117d_image_4.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 6408,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/6170967f-607e-4a35-b1ca-8ff2a69511f0_bd73a1cf-3deb-42ae-8e42-365f29478b56.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15dbb687-a96c-5a00-b6ff-53b22235117d/15dbb687-a96c-5a00-b6ff-53b22235117d_image_5.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5342,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/6170967f-607e-4a35-b1ca-8ff2a69511f0_22430a9b-a608-446e-86d9-abcf8d7ccdb2.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15dbb687-a96c-5a00-b6ff-53b22235117d/15dbb687-a96c-5a00-b6ff-53b22235117d_image_6.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 7110,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/6170967f-607e-4a35-b1ca-8ff2a69511f0_f0530042-dc92-400f-a8b1-54b0fa3dfef4.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15dbb687-a96c-5a00-b6ff-53b22235117d/15dbb687-a96c-5a00-b6ff-53b22235117d_image_7.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 6132,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/6170967f-607e-4a35-b1ca-8ff2a69511f0_41d4864d-7300-49ed-befa-6eb2fe055195.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15dbb687-a96c-5a00-b6ff-53b22235117d/15dbb687-a96c-5a00-b6ff-53b22235117d_image_8.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5060,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/6170967f-607e-4a35-b1ca-8ff2a69511f0_63b92470-dbcc-4c82-95bd-ee20f2ef72e5.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15dbb687-a96c-5a00-b6ff-53b22235117d/15dbb687-a96c-5a00-b6ff-53b22235117d_image_9.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5672,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/6170967f-607e-4a35-b1ca-8ff2a69511f0_065d40db-964a-4d46-b0a2-29174b92f6e9.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15dbb687-a96c-5a00-b6ff-53b22235117d/15dbb687-a96c-5a00-b6ff-53b22235117d_image_10.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5280,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/6170967f-607e-4a35-b1ca-8ff2a69511f0_c56384a7-358f-4ce2-bbdf-71c9835cd450.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15dbb687-a96c-5a00-b6ff-53b22235117d/15dbb687-a96c-5a00-b6ff-53b22235117d_image_11.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4222,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/6170967f-607e-4a35-b1ca-8ff2a69511f0_9322f0f4-0116-4eae-bba7-aab17febd968.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15dbb687-a96c-5a00-b6ff-53b22235117d/15dbb687-a96c-5a00-b6ff-53b22235117d_image_12.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4578,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/6170967f-607e-4a35-b1ca-8ff2a69511f0_68dfa3cd-0025-4ea4-8d6b-16b255d90483.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15dbb687-a96c-5a00-b6ff-53b22235117d/15dbb687-a96c-5a00-b6ff-53b22235117d_image_13.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 6138,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/6170967f-607e-4a35-b1ca-8ff2a69511f0_d67a8c1b-6def-40fa-bd05-98a40cd99c6a.jpg/250x188.webp',
             'Width': 250}],
 'price': 36800,
 'price_includes_vat': False,
 'registration_date': '2025-02-01',
 'seller_name': None,
 'title': 'CUPRA Terramar 1.5 eTSI DSG 150CV *Pack Performance* Only Promo!',
 'transmission': 'automatic',
 'trim': '1.5 eTSI DSG 150CV *Pack Performance* Only Promo!',
 'vin': None,
 'year': 2025}
2025-12-05 11:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%276170967f-607e-4a35-b1ca-8ff2a69511f0%27 HTTP/1.1" 200 None
2025-12-05 11:59:01 [auto_selling_autoscout24.it] INFO: Saving data for 6170967f-607e-4a35-b1ca-8ff2a69511f0: {'created_time': 1764935941.025343, 'last_price_update_time': 1764935941.025352}
2025-12-05 11:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autoscout24.it',RowKey='6170967f-607e-4a35-b1ca-8ff2a69511f0') HTTP/1.1" 204 0
2025-12-05 11:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27e1bf5b95-00c9-478c-9e47-a71499f380d9%27 HTTP/1.1" 200 None
2025-12-05 11:59:01 [auto_selling_autoscout24.it] INFO: Scrape type for e1bf5b95-00c9-478c-9e47-a71499f380d9: 1
2025-12-05 11:59:01 [auto_selling_autoscout24.it] INFO: Scraping new listing e1bf5b95-00c9-478c-9e47-a71499f380d9
2025-12-05 11:59:01 [auto_selling_autoscout24.it] INFO: Extracting item from listing ID: e1bf5b95-00c9-478c-9e47-a71499f380d9
2025-12-05 11:59:01 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 449585c8-25dc-50d2-8510-992a68da0954 with identifier: e1bf5b95-00c9-478c-9e47-a71499f380d9
2025-12-05 11:59:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 4 photos for item 449585c8-25dc-50d2-8510-992a68da0954
2025-12-05 11:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fe1bf5b95-00c9-478c-9e47-a71499f380d9_88ea632d-119d-41eb-81ab-c17f4afea8d6.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/e1bf5b95-00c9-478c-9e47-a71499f380d9_88ea632d-119d-41eb-81ab-c17f4afea8d6.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5c81e50>
2025-12-05 11:59:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 11:59:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd0bef90-62da-50a0-94c6-a2e16b21a7ed/fd0bef90-62da-50a0-94c6-a2e16b21a7ed_image_10.webp HTTP/1.1" 201 0
2025-12-05 11:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F9cbcad9a-47b8-4f8b-a293-c5e8f3c3b166_476bf1c0-fa74-453d-97a7-4d025561cada.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/9cbcad9a-47b8-4f8b-a293-c5e8f3c3b166_476bf1c0-fa74-453d-97a7-4d025561cada.jpg/250x188.webp saved to cache
2025-12-05 11:59:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item fd0bef90-62da-50a0-94c6-a2e16b21a7ed
2025-12-05 11:59:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5b27950>
2025-12-05 11:59:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 11:59:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd0bef90-62da-50a0-94c6-a2e16b21a7ed/fd0bef90-62da-50a0-94c6-a2e16b21a7ed_image_9.webp HTTP/1.1" 201 0
2025-12-05 11:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F9cbcad9a-47b8-4f8b-a293-c5e8f3c3b166_06384aec-c206-47e6-964c-51768ecebfd8.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/9cbcad9a-47b8-4f8b-a293-c5e8f3c3b166_06384aec-c206-47e6-964c-51768ecebfd8.jpg/250x188.webp saved to cache
2025-12-05 11:59:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fd0bef90-62da-50a0-94c6-a2e16b21a7ed
2025-12-05 11:59:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/9cbcad9a-47b8-4f8b-a293-c5e8f3c3b166_b863e84a-8f0f-4e00-83e0-47a6d0d7814e.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fe1bf5b95-00c9-478c-9e47-a71499f380d9_e432a5ae-7d49-430e-b20d-bdbfc66f9eed.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/e1bf5b95-00c9-478c-9e47-a71499f380d9_e432a5ae-7d49-430e-b20d-bdbfc66f9eed.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e64550>
2025-12-05 11:59:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 11:59:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd0bef90-62da-50a0-94c6-a2e16b21a7ed/fd0bef90-62da-50a0-94c6-a2e16b21a7ed_image_12.webp HTTP/1.1" 201 0
2025-12-05 11:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F9cbcad9a-47b8-4f8b-a293-c5e8f3c3b166_279281a9-d0e5-48a4-a490-e13fc7097e86.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/9cbcad9a-47b8-4f8b-a293-c5e8f3c3b166_279281a9-d0e5-48a4-a490-e13fc7097e86.jpg/250x188.webp saved to cache
2025-12-05 11:59:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item fd0bef90-62da-50a0-94c6-a2e16b21a7ed
2025-12-05 11:59:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e51950>
2025-12-05 11:59:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 11:59:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd0bef90-62da-50a0-94c6-a2e16b21a7ed/fd0bef90-62da-50a0-94c6-a2e16b21a7ed_image_11.webp HTTP/1.1" 201 0
2025-12-05 11:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F9cbcad9a-47b8-4f8b-a293-c5e8f3c3b166_e27f08eb-1557-442e-8410-774fec2ee20f.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/9cbcad9a-47b8-4f8b-a293-c5e8f3c3b166_e27f08eb-1557-442e-8410-774fec2ee20f.jpg/250x188.webp saved to cache
2025-12-05 11:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item fd0bef90-62da-50a0-94c6-a2e16b21a7ed
2025-12-05 11:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fe1bf5b95-00c9-478c-9e47-a71499f380d9_42dd7c64-9d7b-46f1-8786-3ca1e2f10579.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/e1bf5b95-00c9-478c-9e47-a71499f380d9_42dd7c64-9d7b-46f1-8786-3ca1e2f10579.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fe1bf5b95-00c9-478c-9e47-a71499f380d9_993a3086-5ba1-4520-8f53-34376415a800.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/e1bf5b95-00c9-478c-9e47-a71499f380d9_993a3086-5ba1-4520-8f53-34376415a800.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5ce3d10>
2025-12-05 11:59:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 11:59:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd0bef90-62da-50a0-94c6-a2e16b21a7ed/fd0bef90-62da-50a0-94c6-a2e16b21a7ed_image_13.webp HTTP/1.1" 201 0
2025-12-05 11:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F9cbcad9a-47b8-4f8b-a293-c5e8f3c3b166_b863e84a-8f0f-4e00-83e0-47a6d0d7814e.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/9cbcad9a-47b8-4f8b-a293-c5e8f3c3b166_b863e84a-8f0f-4e00-83e0-47a6d0d7814e.jpg/250x188.webp saved to cache
2025-12-05 11:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item fd0bef90-62da-50a0-94c6-a2e16b21a7ed
2025-12-05 11:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Removing item fd0bef90-62da-50a0-94c6-a2e16b21a7ed from tracking dictionaries
2025-12-05 11:59:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fd0bef90-62da-50a0-94c6-a2e16b21a7ed sending to next pipeline
2025-12-05 11:59:02 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: fd0bef90-62da-50a0-94c6-a2e16b21a7ed with identifier 9cbcad9a-47b8-4f8b-a293-c5e8f3c3b166
2025-12-05 11:59:02 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 11:59:02 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 11:59:02 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item fd0bef90-62da-50a0-94c6-a2e16b21a7ed
2025-12-05 11:59:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://prod.pictures.autoscout24.net/listing-images/9cbcad9a-47b8-4f8b-a293-c5e8f3c3b166_b863e84a-8f0f-4e00-83e0-47a6d0d7814e.jpg/250x188.webp>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'emission_standard': None,
 'engine': None,
 'engine_horse_power': 75,
 'expiration_date': None,
 'fuel_type': 'Gasoline',
 'id': 'fd0bef90-62da-50a0-94c6-a2e16b21a7ed',
 'is_damaged': False,
 'is_operable': True,
 'license_plate': None,
 'link_to_web_offer': 'https://www.autoscout24.it/offers/volkswagen-up-cross-1-0-benzina-75cv-neopatentati-only-promo-gasoline-silver-9cbcad9a-47b8-4f8b-a293-c5e8f3c3b166',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'up!',
 'odometer': 73500,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd0bef90-62da-50a0-94c6-a2e16b21a7ed/fd0bef90-62da-50a0-94c6-a2e16b21a7ed_image_0.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3948,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/9cbcad9a-47b8-4f8b-a293-c5e8f3c3b166_b9e76f5d-f6d8-4917-bcf0-97258539142d.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd0bef90-62da-50a0-94c6-a2e16b21a7ed/fd0bef90-62da-50a0-94c6-a2e16b21a7ed_image_1.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4046,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/9cbcad9a-47b8-4f8b-a293-c5e8f3c3b166_8a2b86f0-5f86-4b14-9ea7-557bce29ef41.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd0bef90-62da-50a0-94c6-a2e16b21a7ed/fd0bef90-62da-50a0-94c6-a2e16b21a7ed_image_2.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4354,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/9cbcad9a-47b8-4f8b-a293-c5e8f3c3b166_41d42838-b125-46ea-9fab-2f030ecf313f.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd0bef90-62da-50a0-94c6-a2e16b21a7ed/fd0bef90-62da-50a0-94c6-a2e16b21a7ed_image_3.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4122,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/9cbcad9a-47b8-4f8b-a293-c5e8f3c3b166_b04c2d6f-7041-49b4-9f8c-6c0515a5c747.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd0bef90-62da-50a0-94c6-a2e16b21a7ed/fd0bef90-62da-50a0-94c6-a2e16b21a7ed_image_4.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5196,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/9cbcad9a-47b8-4f8b-a293-c5e8f3c3b166_7a5bbdcf-e8ef-4d4b-9c12-287730418a09.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd0bef90-62da-50a0-94c6-a2e16b21a7ed/fd0bef90-62da-50a0-94c6-a2e16b21a7ed_image_5.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 6656,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/9cbcad9a-47b8-4f8b-a293-c5e8f3c3b166_734a541a-c486-4303-826e-6edd46f36057.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd0bef90-62da-50a0-94c6-a2e16b21a7ed/fd0bef90-62da-50a0-94c6-a2e16b21a7ed_image_6.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 7536,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/9cbcad9a-47b8-4f8b-a293-c5e8f3c3b166_31a55759-9094-4b91-a220-c3d77b5e3c67.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd0bef90-62da-50a0-94c6-a2e16b21a7ed/fd0bef90-62da-50a0-94c6-a2e16b21a7ed_image_7.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5056,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/9cbcad9a-47b8-4f8b-a293-c5e8f3c3b166_4af33f6a-8ba1-4509-ac8d-5e1022110457.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd0bef90-62da-50a0-94c6-a2e16b21a7ed/fd0bef90-62da-50a0-94c6-a2e16b21a7ed_image_8.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 6394,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/9cbcad9a-47b8-4f8b-a293-c5e8f3c3b166_3aa493bd-ffd8-44b1-9097-d2f40d025af4.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd0bef90-62da-50a0-94c6-a2e16b21a7ed/fd0bef90-62da-50a0-94c6-a2e16b21a7ed_image_9.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 6312,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/9cbcad9a-47b8-4f8b-a293-c5e8f3c3b166_06384aec-c206-47e6-964c-51768ecebfd8.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd0bef90-62da-50a0-94c6-a2e16b21a7ed/fd0bef90-62da-50a0-94c6-a2e16b21a7ed_image_10.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5194,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/9cbcad9a-47b8-4f8b-a293-c5e8f3c3b166_476bf1c0-fa74-453d-97a7-4d025561cada.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd0bef90-62da-50a0-94c6-a2e16b21a7ed/fd0bef90-62da-50a0-94c6-a2e16b21a7ed_image_11.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 7072,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/9cbcad9a-47b8-4f8b-a293-c5e8f3c3b166_e27f08eb-1557-442e-8410-774fec2ee20f.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd0bef90-62da-50a0-94c6-a2e16b21a7ed/fd0bef90-62da-50a0-94c6-a2e16b21a7ed_image_12.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 7510,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/9cbcad9a-47b8-4f8b-a293-c5e8f3c3b166_279281a9-d0e5-48a4-a490-e13fc7097e86.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd0bef90-62da-50a0-94c6-a2e16b21a7ed/fd0bef90-62da-50a0-94c6-a2e16b21a7ed_image_13.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4162,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/9cbcad9a-47b8-4f8b-a293-c5e8f3c3b166_b863e84a-8f0f-4e00-83e0-47a6d0d7814e.jpg/250x188.webp',
             'Width': 250}],
 'price': 13800,
 'price_includes_vat': False,
 'registration_date': '2017-11-01',
 'seller_name': None,
 'title': 'Volkswagen up! CROSS 1.0 Benzina 75CV Neopatentati Only Promo',
 'transmission': 'automatic',
 'trim': 'CROSS 1.0 Benzina 75CV Neopatentati Only Promo',
 'vin': None,
 'year': 2017}
2025-12-05 11:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%279cbcad9a-47b8-4f8b-a293-c5e8f3c3b166%27 HTTP/1.1" 200 None
2025-12-05 11:59:02 [auto_selling_autoscout24.it] INFO: Saving data for 9cbcad9a-47b8-4f8b-a293-c5e8f3c3b166: {'created_time': 1764935942.455136, 'last_price_update_time': 1764935942.455148}
2025-12-05 11:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autoscout24.it',RowKey='9cbcad9a-47b8-4f8b-a293-c5e8f3c3b166') HTTP/1.1" 204 0
2025-12-05 11:59:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/e1bf5b95-00c9-478c-9e47-a71499f380d9_e432a5ae-7d49-430e-b20d-bdbfc66f9eed.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/e1bf5b95-00c9-478c-9e47-a71499f380d9_88ea632d-119d-41eb-81ab-c17f4afea8d6.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27d26f0280-ffe7-454c-9c15-9fdac318beff%27 HTTP/1.1" 200 None
2025-12-05 11:59:02 [auto_selling_autoscout24.it] INFO: Scrape type for d26f0280-ffe7-454c-9c15-9fdac318beff: 1
2025-12-05 11:59:02 [auto_selling_autoscout24.it] INFO: Scraping new listing d26f0280-ffe7-454c-9c15-9fdac318beff
2025-12-05 11:59:02 [auto_selling_autoscout24.it] INFO: Extracting item from listing ID: d26f0280-ffe7-454c-9c15-9fdac318beff
2025-12-05 11:59:02 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: e22920c7-d80f-5a56-8255-dab1ca4b05e6 with identifier: d26f0280-ffe7-454c-9c15-9fdac318beff
2025-12-05 11:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 4 photos for item e22920c7-d80f-5a56-8255-dab1ca4b05e6
2025-12-05 11:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fd26f0280-ffe7-454c-9c15-9fdac318beff_65e86c0e-c004-4418-aacd-988d11224dcf.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/d26f0280-ffe7-454c-9c15-9fdac318beff_65e86c0e-c004-4418-aacd-988d11224dcf.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/e1bf5b95-00c9-478c-9e47-a71499f380d9_42dd7c64-9d7b-46f1-8786-3ca1e2f10579.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fd26f0280-ffe7-454c-9c15-9fdac318beff_8d226cc4-19da-40c9-9f62-c9675ab68487.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/d26f0280-ffe7-454c-9c15-9fdac318beff_8d226cc4-19da-40c9-9f62-c9675ab68487.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fd26f0280-ffe7-454c-9c15-9fdac318beff_09e03084-2fa6-4d53-a3c6-5992bc70a0d6.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/d26f0280-ffe7-454c-9c15-9fdac318beff_09e03084-2fa6-4d53-a3c6-5992bc70a0d6.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/e1bf5b95-00c9-478c-9e47-a71499f380d9_993a3086-5ba1-4520-8f53-34376415a800.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fd26f0280-ffe7-454c-9c15-9fdac318beff_e8ff1dd0-c8ef-4597-a96a-927d46542699.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/d26f0280-ffe7-454c-9c15-9fdac318beff_e8ff1dd0-c8ef-4597-a96a-927d46542699.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:02 [auto_selling_autoscout24.it] INFO: Fetching listings for customerId: 31910200, page: 2
2025-12-05 11:59:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5b26a10>
2025-12-05 11:59:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 11:59:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_449585c8-25dc-50d2-8510-992a68da0954/449585c8-25dc-50d2-8510-992a68da0954_image_1.webp HTTP/1.1" 201 0
2025-12-05 11:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fe1bf5b95-00c9-478c-9e47-a71499f380d9_e432a5ae-7d49-430e-b20d-bdbfc66f9eed.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/e1bf5b95-00c9-478c-9e47-a71499f380d9_e432a5ae-7d49-430e-b20d-bdbfc66f9eed.jpg/250x188.webp saved to cache
2025-12-05 11:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 449585c8-25dc-50d2-8510-992a68da0954
2025-12-05 11:59:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5b27690>
2025-12-05 11:59:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 11:59:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_449585c8-25dc-50d2-8510-992a68da0954/449585c8-25dc-50d2-8510-992a68da0954_image_0.webp HTTP/1.1" 201 0
2025-12-05 11:59:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fe1bf5b95-00c9-478c-9e47-a71499f380d9_88ea632d-119d-41eb-81ab-c17f4afea8d6.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/e1bf5b95-00c9-478c-9e47-a71499f380d9_88ea632d-119d-41eb-81ab-c17f4afea8d6.jpg/250x188.webp saved to cache
2025-12-05 11:59:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 449585c8-25dc-50d2-8510-992a68da0954
2025-12-05 11:59:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/d26f0280-ffe7-454c-9c15-9fdac318beff_09e03084-2fa6-4d53-a3c6-5992bc70a0d6.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/d26f0280-ffe7-454c-9c15-9fdac318beff_65e86c0e-c004-4418-aacd-988d11224dcf.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/d26f0280-ffe7-454c-9c15-9fdac318beff_8d226cc4-19da-40c9-9f62-c9675ab68487.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 11:59:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9dd5db750>
2025-12-05 11:59:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 11:59:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_449585c8-25dc-50d2-8510-992a68da0954/449585c8-25dc-50d2-8510-992a68da0954_image_2.webp HTTP/1.1" 201 0
2025-12-05 11:59:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fe1bf5b95-00c9-478c-9e47-a71499f380d9_42dd7c64-9d7b-46f1-8786-3ca1e2f10579.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/e1bf5b95-00c9-478c-9e47-a71499f380d9_42dd7c64-9d7b-46f1-8786-3ca1e2f10579.jpg/250x188.webp saved to cache
2025-12-05 11:59:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 449585c8-25dc-50d2-8510-992a68da0954
2025-12-05 11:59:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9dd5eaf90>
2025-12-05 11:59:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 11:59:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_449585c8-25dc-50d2-8510-992a68da0954/449585c8-25dc-50d2-8510-992a68da0954_image_3.webp HTTP/1.1" 201 0
2025-12-05 11:59:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fe1bf5b95-00c9-478c-9e47-a71499f380d9_993a3086-5ba1-4520-8f53-34376415a800.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/e1bf5b95-00c9-478c-9e47-a71499f380d9_993a3086-5ba1-4520-8f53-34376415a800.jpg/250x188.webp saved to cache
2025-12-05 11:59:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 449585c8-25dc-50d2-8510-992a68da0954
2025-12-05 11:59:03 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 449585c8-25dc-50d2-8510-992a68da0954 from tracking dictionaries
2025-12-05 11:59:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 449585c8-25dc-50d2-8510-992a68da0954 sending to next pipeline
2025-12-05 11:59:03 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 449585c8-25dc-50d2-8510-992a68da0954 with identifier e1bf5b95-00c9-478c-9e47-a71499f380d9
2025-12-05 11:59:03 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 11:59:03 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 11:59:03 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 449585c8-25dc-50d2-8510-992a68da0954
2025-12-05 11:59:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://prod.pictures.autoscout24.net/listing-images/e1bf5b95-00c9-478c-9e47-a71499f380d9_993a3086-5ba1-4520-8f53-34376415a800.jpg/250x188.webp>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'emission_standard': None,
 'engine': None,
 'engine_horse_power': 204,
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': '449585c8-25dc-50d2-8510-992a68da0954',
 'is_damaged': False,
 'is_operable': True,
 'license_plate': None,
 'link_to_web_offer': 'https://www.autoscout24.it/offers/audi-q5-spb-2-0-tdi-quattro-s-tronic-204cv-facelift-promo-diesel-white-e1bf5b95-00c9-478c-9e47-a71499f380d9',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 1,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 4,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_449585c8-25dc-50d2-8510-992a68da0954/449585c8-25dc-50d2-8510-992a68da0954_image_0.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 2742,
             'Height': 140,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/e1bf5b95-00c9-478c-9e47-a71499f380d9_88ea632d-119d-41eb-81ab-c17f4afea8d6.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_449585c8-25dc-50d2-8510-992a68da0954/449585c8-25dc-50d2-8510-992a68da0954_image_1.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3298,
             'Height': 140,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/e1bf5b95-00c9-478c-9e47-a71499f380d9_e432a5ae-7d49-430e-b20d-bdbfc66f9eed.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_449585c8-25dc-50d2-8510-992a68da0954/449585c8-25dc-50d2-8510-992a68da0954_image_2.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 2656,
             'Height': 140,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/e1bf5b95-00c9-478c-9e47-a71499f380d9_42dd7c64-9d7b-46f1-8786-3ca1e2f10579.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_449585c8-25dc-50d2-8510-992a68da0954/449585c8-25dc-50d2-8510-992a68da0954_image_3.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5046,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/e1bf5b95-00c9-478c-9e47-a71499f380d9_993a3086-5ba1-4520-8f53-34376415a800.jpg/250x188.webp',
             'Width': 250}],
 'price': 59900,
 'price_includes_vat': False,
 'registration_date': '2025-10-01',
 'seller_name': None,
 'title': 'Audi Q5 SPB 2.0 TDI QUATTRO S-TRONIC 204CV FACELIFT PROMO',
 'transmission': 'automatic',
 'trim': 'SPB 2.0 TDI QUATTRO S-TRONIC 204CV FACELIFT PROMO',
 'vin': None,
 'year': 2025}
2025-12-05 11:59:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27e1bf5b95-00c9-478c-9e47-a71499f380d9%27 HTTP/1.1" 200 None
2025-12-05 11:59:03 [auto_selling_autoscout24.it] INFO: Saving data for e1bf5b95-00c9-478c-9e47-a71499f380d9: {'created_time': 1764935943.698107, 'last_price_update_time': 1764935943.698118}
2025-12-05 11:59:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autoscout24.it',RowKey='e1bf5b95-00c9-478c-9e47-a71499f380d9') HTTP/1.1" 204 0
2025-12-05 11:59:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/d26f0280-ffe7-454c-9c15-9fdac318beff_e8ff1dd0-c8ef-4597-a96a-927d46542699.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d6f0b190>
2025-12-05 11:59:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 11:59:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e22920c7-d80f-5a56-8255-dab1ca4b05e6/e22920c7-d80f-5a56-8255-dab1ca4b05e6_image_2.webp HTTP/1.1" 201 0
2025-12-05 11:59:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fd26f0280-ffe7-454c-9c15-9fdac318beff_09e03084-2fa6-4d53-a3c6-5992bc70a0d6.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/d26f0280-ffe7-454c-9c15-9fdac318beff_09e03084-2fa6-4d53-a3c6-5992bc70a0d6.jpg/250x188.webp saved to cache
2025-12-05 11:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e22920c7-d80f-5a56-8255-dab1ca4b05e6
2025-12-05 11:59:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9dc11dd10>
2025-12-05 11:59:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 11:59:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e22920c7-d80f-5a56-8255-dab1ca4b05e6/e22920c7-d80f-5a56-8255-dab1ca4b05e6_image_0.webp HTTP/1.1" 201 0
2025-12-05 11:59:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fd26f0280-ffe7-454c-9c15-9fdac318beff_65e86c0e-c004-4418-aacd-988d11224dcf.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/d26f0280-ffe7-454c-9c15-9fdac318beff_65e86c0e-c004-4418-aacd-988d11224dcf.jpg/250x188.webp saved to cache
2025-12-05 11:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e22920c7-d80f-5a56-8255-dab1ca4b05e6
2025-12-05 11:59:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9dd5d7210>
2025-12-05 11:59:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 11:59:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e22920c7-d80f-5a56-8255-dab1ca4b05e6/e22920c7-d80f-5a56-8255-dab1ca4b05e6_image_1.webp HTTP/1.1" 201 0
2025-12-05 11:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fd26f0280-ffe7-454c-9c15-9fdac318beff_8d226cc4-19da-40c9-9f62-c9675ab68487.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/d26f0280-ffe7-454c-9c15-9fdac318beff_8d226cc4-19da-40c9-9f62-c9675ab68487.jpg/250x188.webp saved to cache
2025-12-05 11:59:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e22920c7-d80f-5a56-8255-dab1ca4b05e6
2025-12-05 11:59:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5cedfd0>
2025-12-05 11:59:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 11:59:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e22920c7-d80f-5a56-8255-dab1ca4b05e6/e22920c7-d80f-5a56-8255-dab1ca4b05e6_image_3.webp HTTP/1.1" 201 0
2025-12-05 11:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fd26f0280-ffe7-454c-9c15-9fdac318beff_e8ff1dd0-c8ef-4597-a96a-927d46542699.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/d26f0280-ffe7-454c-9c15-9fdac318beff_e8ff1dd0-c8ef-4597-a96a-927d46542699.jpg/250x188.webp saved to cache
2025-12-05 11:59:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e22920c7-d80f-5a56-8255-dab1ca4b05e6
2025-12-05 11:59:05 [crawlers.middlewares.photo_download_middleware] INFO: Removing item e22920c7-d80f-5a56-8255-dab1ca4b05e6 from tracking dictionaries
2025-12-05 11:59:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e22920c7-d80f-5a56-8255-dab1ca4b05e6 sending to next pipeline
2025-12-05 11:59:05 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: e22920c7-d80f-5a56-8255-dab1ca4b05e6 with identifier d26f0280-ffe7-454c-9c15-9fdac318beff
2025-12-05 11:59:05 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 11:59:05 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 11:59:05 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item e22920c7-d80f-5a56-8255-dab1ca4b05e6
2025-12-05 11:59:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://prod.pictures.autoscout24.net/listing-images/d26f0280-ffe7-454c-9c15-9fdac318beff_e8ff1dd0-c8ef-4597-a96a-927d46542699.jpg/250x188.webp>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'emission_standard': None,
 'engine': None,
 'engine_horse_power': 158,
 'expiration_date': None,
 'fuel_type': 'Electric/Gasoline',
 'id': 'e22920c7-d80f-5a56-8255-dab1ca4b05e6',
 'is_damaged': False,
 'is_operable': True,
 'license_plate': None,
 'link_to_web_offer': 'https://www.autoscout24.it/offers/nissan-qashqai-newmodel-x-tronic-n-connecta-158cv-only-promo-electric-gasoline-black-d26f0280-ffe7-454c-9c15-9fdac318beff',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 18700,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 4,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e22920c7-d80f-5a56-8255-dab1ca4b05e6/e22920c7-d80f-5a56-8255-dab1ca4b05e6_image_0.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3100,
             'Height': 147,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/d26f0280-ffe7-454c-9c15-9fdac318beff_65e86c0e-c004-4418-aacd-988d11224dcf.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e22920c7-d80f-5a56-8255-dab1ca4b05e6/e22920c7-d80f-5a56-8255-dab1ca4b05e6_image_1.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 2322,
             'Height': 128,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/d26f0280-ffe7-454c-9c15-9fdac318beff_8d226cc4-19da-40c9-9f62-c9675ab68487.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e22920c7-d80f-5a56-8255-dab1ca4b05e6/e22920c7-d80f-5a56-8255-dab1ca4b05e6_image_2.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 2728,
             'Height': 142,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/d26f0280-ffe7-454c-9c15-9fdac318beff_09e03084-2fa6-4d53-a3c6-5992bc70a0d6.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e22920c7-d80f-5a56-8255-dab1ca4b05e6/e22920c7-d80f-5a56-8255-dab1ca4b05e6_image_3.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3490,
             'Height': 121,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/d26f0280-ffe7-454c-9c15-9fdac318beff_e8ff1dd0-c8ef-4597-a96a-927d46542699.jpg/250x188.webp',
             'Width': 250}],
 'price': 27900,
 'price_includes_vat': False,
 'registration_date': '2025-01-01',
 'seller_name': None,
 'title': 'Nissan Qashqai NEWMODEL  X-TRONIC N-CONNECTA 158CV ONLY PROMO!',
 'transmission': 'automatic',
 'trim': 'NEWMODEL  X-TRONIC N-CONNECTA 158CV ONLY PROMO!',
 'vin': None,
 'year': 2025}
2025-12-05 11:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27d26f0280-ffe7-454c-9c15-9fdac318beff%27 HTTP/1.1" 200 None
2025-12-05 11:59:05 [auto_selling_autoscout24.it] INFO: Saving data for d26f0280-ffe7-454c-9c15-9fdac318beff: {'created_time': 1764935945.495635, 'last_price_update_time': 1764935945.495643}
2025-12-05 11:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autoscout24.it',RowKey='d26f0280-ffe7-454c-9c15-9fdac318beff') HTTP/1.1" 204 0
2025-12-05 11:59:17 [scrapy.extensions.logstats] INFO: Crawled 2 pages (at 2 pages/min), scraped 20 items (at 20 items/min)
2025-12-05 11:59:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autoscout24.it/api/dealer-detail/fetch-listings> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings) ['zyte-api']
2025-12-05 11:59:24 [auto_selling_autoscout24.it] INFO: Parsing listings response for page: 2
2025-12-05 11:59:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%276b9b8015-f7b4-4c09-a127-1b886aab350a%27 HTTP/1.1" 200 None
2025-12-05 11:59:24 [auto_selling_autoscout24.it] INFO: Scrape type for 6b9b8015-f7b4-4c09-a127-1b886aab350a: 1
2025-12-05 11:59:24 [auto_selling_autoscout24.it] INFO: Scraping new listing 6b9b8015-f7b4-4c09-a127-1b886aab350a
2025-12-05 11:59:24 [auto_selling_autoscout24.it] INFO: Extracting item from listing ID: 6b9b8015-f7b4-4c09-a127-1b886aab350a
2025-12-05 11:59:24 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: feb5bac9-354f-50ec-b328-c39481c432f2 with identifier: 6b9b8015-f7b4-4c09-a127-1b886aab350a
2025-12-05 11:59:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 4 photos for item feb5bac9-354f-50ec-b328-c39481c432f2
2025-12-05 11:59:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F6b9b8015-f7b4-4c09-a127-1b886aab350a_327e6e5f-e8e2-421f-80f0-f48604c7c63a.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/6b9b8015-f7b4-4c09-a127-1b886aab350a_327e6e5f-e8e2-421f-80f0-f48604c7c63a.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F6b9b8015-f7b4-4c09-a127-1b886aab350a_afafeacb-52de-42d1-9e2a-422239dc1869.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/6b9b8015-f7b4-4c09-a127-1b886aab350a_afafeacb-52de-42d1-9e2a-422239dc1869.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F6b9b8015-f7b4-4c09-a127-1b886aab350a_c42aa6e7-509e-4b4d-83c4-0eacdf1bab50.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/6b9b8015-f7b4-4c09-a127-1b886aab350a_c42aa6e7-509e-4b4d-83c4-0eacdf1bab50.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F6b9b8015-f7b4-4c09-a127-1b886aab350a_7e2e445f-70d7-4696-a7df-e08054728db2.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/6b9b8015-f7b4-4c09-a127-1b886aab350a_7e2e445f-70d7-4696-a7df-e08054728db2.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/6b9b8015-f7b4-4c09-a127-1b886aab350a_327e6e5f-e8e2-421f-80f0-f48604c7c63a.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27e197314a-a4d0-47b3-9c4a-2da4c952fbb3%27 HTTP/1.1" 200 None
2025-12-05 11:59:24 [auto_selling_autoscout24.it] INFO: Scrape type for e197314a-a4d0-47b3-9c4a-2da4c952fbb3: 1
2025-12-05 11:59:24 [auto_selling_autoscout24.it] INFO: Scraping new listing e197314a-a4d0-47b3-9c4a-2da4c952fbb3
2025-12-05 11:59:24 [auto_selling_autoscout24.it] INFO: Extracting item from listing ID: e197314a-a4d0-47b3-9c4a-2da4c952fbb3
2025-12-05 11:59:24 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 11c9f5ac-4921-59ad-aba1-90f0802f662d with identifier: e197314a-a4d0-47b3-9c4a-2da4c952fbb3
2025-12-05 11:59:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 14 photos for item 11c9f5ac-4921-59ad-aba1-90f0802f662d
2025-12-05 11:59:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fe197314a-a4d0-47b3-9c4a-2da4c952fbb3_580b3dba-b496-424f-a5ea-af2237c8b7cd.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/e197314a-a4d0-47b3-9c4a-2da4c952fbb3_580b3dba-b496-424f-a5ea-af2237c8b7cd.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fe197314a-a4d0-47b3-9c4a-2da4c952fbb3_9f05e754-64ea-43b8-9724-f641bc8582a7.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/e197314a-a4d0-47b3-9c4a-2da4c952fbb3_9f05e754-64ea-43b8-9724-f641bc8582a7.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fe197314a-a4d0-47b3-9c4a-2da4c952fbb3_3dc84609-e9d8-48a1-81e7-3f880aad8c9b.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/e197314a-a4d0-47b3-9c4a-2da4c952fbb3_3dc84609-e9d8-48a1-81e7-3f880aad8c9b.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fe197314a-a4d0-47b3-9c4a-2da4c952fbb3_900eb047-8fd6-4457-ae21-2a784a5865a9.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/e197314a-a4d0-47b3-9c4a-2da4c952fbb3_900eb047-8fd6-4457-ae21-2a784a5865a9.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/6b9b8015-f7b4-4c09-a127-1b886aab350a_afafeacb-52de-42d1-9e2a-422239dc1869.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fe197314a-a4d0-47b3-9c4a-2da4c952fbb3_e65ff2b6-b7f9-4c69-a031-60701dce1a81.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/e197314a-a4d0-47b3-9c4a-2da4c952fbb3_e65ff2b6-b7f9-4c69-a031-60701dce1a81.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/e197314a-a4d0-47b3-9c4a-2da4c952fbb3_580b3dba-b496-424f-a5ea-af2237c8b7cd.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fe197314a-a4d0-47b3-9c4a-2da4c952fbb3_0604e128-0681-4cd8-b264-aa5187cf7dd0.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/e197314a-a4d0-47b3-9c4a-2da4c952fbb3_0604e128-0681-4cd8-b264-aa5187cf7dd0.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fe197314a-a4d0-47b3-9c4a-2da4c952fbb3_7f9d7ac0-012d-47fe-97ca-c90e27f90cb4.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/e197314a-a4d0-47b3-9c4a-2da4c952fbb3_7f9d7ac0-012d-47fe-97ca-c90e27f90cb4.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5cce010>
2025-12-05 11:59:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 11:59:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_feb5bac9-354f-50ec-b328-c39481c432f2/feb5bac9-354f-50ec-b328-c39481c432f2_image_0.webp HTTP/1.1" 201 0
2025-12-05 11:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F6b9b8015-f7b4-4c09-a127-1b886aab350a_327e6e5f-e8e2-421f-80f0-f48604c7c63a.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/6b9b8015-f7b4-4c09-a127-1b886aab350a_327e6e5f-e8e2-421f-80f0-f48604c7c63a.jpg/250x188.webp saved to cache
2025-12-05 11:59:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item feb5bac9-354f-50ec-b328-c39481c432f2
2025-12-05 11:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fe197314a-a4d0-47b3-9c4a-2da4c952fbb3_b07ffb3c-64db-4d41-8cfe-070048bfbbee.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/e197314a-a4d0-47b3-9c4a-2da4c952fbb3_b07ffb3c-64db-4d41-8cfe-070048bfbbee.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/6b9b8015-f7b4-4c09-a127-1b886aab350a_c42aa6e7-509e-4b4d-83c4-0eacdf1bab50.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/6b9b8015-f7b4-4c09-a127-1b886aab350a_7e2e445f-70d7-4696-a7df-e08054728db2.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/e197314a-a4d0-47b3-9c4a-2da4c952fbb3_9f05e754-64ea-43b8-9724-f641bc8582a7.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/e197314a-a4d0-47b3-9c4a-2da4c952fbb3_900eb047-8fd6-4457-ae21-2a784a5865a9.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/e197314a-a4d0-47b3-9c4a-2da4c952fbb3_e65ff2b6-b7f9-4c69-a031-60701dce1a81.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fe197314a-a4d0-47b3-9c4a-2da4c952fbb3_6808887c-e4f7-4739-b86b-81ed51fac114.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/e197314a-a4d0-47b3-9c4a-2da4c952fbb3_6808887c-e4f7-4739-b86b-81ed51fac114.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e518d0>
2025-12-05 11:59:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 11:59:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_feb5bac9-354f-50ec-b328-c39481c432f2/feb5bac9-354f-50ec-b328-c39481c432f2_image_1.webp HTTP/1.1" 201 0
2025-12-05 11:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F6b9b8015-f7b4-4c09-a127-1b886aab350a_afafeacb-52de-42d1-9e2a-422239dc1869.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/6b9b8015-f7b4-4c09-a127-1b886aab350a_afafeacb-52de-42d1-9e2a-422239dc1869.jpg/250x188.webp saved to cache
2025-12-05 11:59:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item feb5bac9-354f-50ec-b328-c39481c432f2
2025-12-05 11:59:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e67110>
2025-12-05 11:59:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 11:59:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11c9f5ac-4921-59ad-aba1-90f0802f662d/11c9f5ac-4921-59ad-aba1-90f0802f662d_image_0.webp HTTP/1.1" 201 0
2025-12-05 11:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fe197314a-a4d0-47b3-9c4a-2da4c952fbb3_580b3dba-b496-424f-a5ea-af2237c8b7cd.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/e197314a-a4d0-47b3-9c4a-2da4c952fbb3_580b3dba-b496-424f-a5ea-af2237c8b7cd.jpg/250x188.webp saved to cache
2025-12-05 11:59:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 11c9f5ac-4921-59ad-aba1-90f0802f662d
2025-12-05 11:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fe197314a-a4d0-47b3-9c4a-2da4c952fbb3_a2a3de46-2bd5-4fed-b882-9f0f642dc271.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/e197314a-a4d0-47b3-9c4a-2da4c952fbb3_a2a3de46-2bd5-4fed-b882-9f0f642dc271.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/e197314a-a4d0-47b3-9c4a-2da4c952fbb3_0604e128-0681-4cd8-b264-aa5187cf7dd0.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/e197314a-a4d0-47b3-9c4a-2da4c952fbb3_7f9d7ac0-012d-47fe-97ca-c90e27f90cb4.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/e197314a-a4d0-47b3-9c4a-2da4c952fbb3_3dc84609-e9d8-48a1-81e7-3f880aad8c9b.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fe197314a-a4d0-47b3-9c4a-2da4c952fbb3_fe6de3c8-72dc-4b26-b91e-2e8b4d270c7e.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/e197314a-a4d0-47b3-9c4a-2da4c952fbb3_fe6de3c8-72dc-4b26-b91e-2e8b4d270c7e.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9e076c4d0>
2025-12-05 11:59:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 11:59:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_feb5bac9-354f-50ec-b328-c39481c432f2/feb5bac9-354f-50ec-b328-c39481c432f2_image_2.webp HTTP/1.1" 201 0
2025-12-05 11:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F6b9b8015-f7b4-4c09-a127-1b886aab350a_c42aa6e7-509e-4b4d-83c4-0eacdf1bab50.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/6b9b8015-f7b4-4c09-a127-1b886aab350a_c42aa6e7-509e-4b4d-83c4-0eacdf1bab50.jpg/250x188.webp saved to cache
2025-12-05 11:59:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item feb5bac9-354f-50ec-b328-c39481c432f2
2025-12-05 11:59:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e25f50>
2025-12-05 11:59:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 11:59:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_feb5bac9-354f-50ec-b328-c39481c432f2/feb5bac9-354f-50ec-b328-c39481c432f2_image_3.webp HTTP/1.1" 201 0
2025-12-05 11:59:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F6b9b8015-f7b4-4c09-a127-1b886aab350a_7e2e445f-70d7-4696-a7df-e08054728db2.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/6b9b8015-f7b4-4c09-a127-1b886aab350a_7e2e445f-70d7-4696-a7df-e08054728db2.jpg/250x188.webp saved to cache
2025-12-05 11:59:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item feb5bac9-354f-50ec-b328-c39481c432f2
2025-12-05 11:59:26 [crawlers.middlewares.photo_download_middleware] INFO: Removing item feb5bac9-354f-50ec-b328-c39481c432f2 from tracking dictionaries
2025-12-05 11:59:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item feb5bac9-354f-50ec-b328-c39481c432f2 sending to next pipeline
2025-12-05 11:59:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d6ff0790>
2025-12-05 11:59:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 11:59:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11c9f5ac-4921-59ad-aba1-90f0802f662d/11c9f5ac-4921-59ad-aba1-90f0802f662d_image_1.webp HTTP/1.1" 201 0
2025-12-05 11:59:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fe197314a-a4d0-47b3-9c4a-2da4c952fbb3_9f05e754-64ea-43b8-9724-f641bc8582a7.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/e197314a-a4d0-47b3-9c4a-2da4c952fbb3_9f05e754-64ea-43b8-9724-f641bc8582a7.jpg/250x188.webp saved to cache
2025-12-05 11:59:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 11c9f5ac-4921-59ad-aba1-90f0802f662d
2025-12-05 11:59:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e888d0>
2025-12-05 11:59:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 11:59:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11c9f5ac-4921-59ad-aba1-90f0802f662d/11c9f5ac-4921-59ad-aba1-90f0802f662d_image_3.webp HTTP/1.1" 201 0
2025-12-05 11:59:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fe197314a-a4d0-47b3-9c4a-2da4c952fbb3_900eb047-8fd6-4457-ae21-2a784a5865a9.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/e197314a-a4d0-47b3-9c4a-2da4c952fbb3_900eb047-8fd6-4457-ae21-2a784a5865a9.jpg/250x188.webp saved to cache
2025-12-05 11:59:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 11c9f5ac-4921-59ad-aba1-90f0802f662d
2025-12-05 11:59:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5c7a910>
2025-12-05 11:59:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 11:59:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11c9f5ac-4921-59ad-aba1-90f0802f662d/11c9f5ac-4921-59ad-aba1-90f0802f662d_image_4.webp HTTP/1.1" 201 0
2025-12-05 11:59:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fe197314a-a4d0-47b3-9c4a-2da4c952fbb3_e65ff2b6-b7f9-4c69-a031-60701dce1a81.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/e197314a-a4d0-47b3-9c4a-2da4c952fbb3_e65ff2b6-b7f9-4c69-a031-60701dce1a81.jpg/250x188.webp saved to cache
2025-12-05 11:59:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 11c9f5ac-4921-59ad-aba1-90f0802f662d
2025-12-05 11:59:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fe197314a-a4d0-47b3-9c4a-2da4c952fbb3_7f2fdb21-5c7a-4917-9a82-25a0241f524c.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/e197314a-a4d0-47b3-9c4a-2da4c952fbb3_7f2fdb21-5c7a-4917-9a82-25a0241f524c.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:27 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: feb5bac9-354f-50ec-b328-c39481c432f2 with identifier 6b9b8015-f7b4-4c09-a127-1b886aab350a
2025-12-05 11:59:27 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 11:59:27 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 11:59:27 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item feb5bac9-354f-50ec-b328-c39481c432f2
2025-12-05 11:59:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://prod.pictures.autoscout24.net/listing-images/6b9b8015-f7b4-4c09-a127-1b886aab350a_7e2e445f-70d7-4696-a7df-e08054728db2.jpg/250x188.webp>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'emission_standard': None,
 'engine': None,
 'engine_horse_power': 116,
 'expiration_date': None,
 'fuel_type': 'Gasoline',
 'id': 'feb5bac9-354f-50ec-b328-c39481c432f2',
 'is_damaged': False,
 'is_operable': True,
 'license_plate': None,
 'link_to_web_offer': 'https://www.autoscout24.it/offers/audi-a1-sportback-s-line-edition-30tfsi-s-tronic-116cv-uff-gasoline-grey-6b9b8015-f7b4-4c09-a127-1b886aab350a',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1',
 'odometer': 1,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 4,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_feb5bac9-354f-50ec-b328-c39481c432f2/feb5bac9-354f-50ec-b328-c39481c432f2_image_0.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3090,
             'Height': 148,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/6b9b8015-f7b4-4c09-a127-1b886aab350a_327e6e5f-e8e2-421f-80f0-f48604c7c63a.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_feb5bac9-354f-50ec-b328-c39481c432f2/feb5bac9-354f-50ec-b328-c39481c432f2_image_1.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 2828,
             'Height': 141,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/6b9b8015-f7b4-4c09-a127-1b886aab350a_afafeacb-52de-42d1-9e2a-422239dc1869.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_feb5bac9-354f-50ec-b328-c39481c432f2/feb5bac9-354f-50ec-b328-c39481c432f2_image_2.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 2716,
             'Height': 123,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/6b9b8015-f7b4-4c09-a127-1b886aab350a_c42aa6e7-509e-4b4d-83c4-0eacdf1bab50.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_feb5bac9-354f-50ec-b328-c39481c432f2/feb5bac9-354f-50ec-b328-c39481c432f2_image_3.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3210,
             'Height': 124,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/6b9b8015-f7b4-4c09-a127-1b886aab350a_7e2e445f-70d7-4696-a7df-e08054728db2.jpg/250x188.webp',
             'Width': 250}],
 'price': 29900,
 'price_includes_vat': False,
 'registration_date': '2025-06-01',
 'seller_name': None,
 'title': 'Audi A1 SPORTBACK S-LINE EDITION 30TFSI S-TRONIC 116CV UFF',
 'transmission': 'automatic',
 'trim': 'SPORTBACK S-LINE EDITION 30TFSI S-TRONIC 116CV UFF',
 'vin': None,
 'year': 2025}
2025-12-05 11:59:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%276b9b8015-f7b4-4c09-a127-1b886aab350a%27 HTTP/1.1" 200 None
2025-12-05 11:59:27 [auto_selling_autoscout24.it] INFO: Saving data for 6b9b8015-f7b4-4c09-a127-1b886aab350a: {'created_time': 1764935967.08581, 'last_price_update_time': 1764935967.085818}
2025-12-05 11:59:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autoscout24.it',RowKey='6b9b8015-f7b4-4c09-a127-1b886aab350a') HTTP/1.1" 204 0
2025-12-05 11:59:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/e197314a-a4d0-47b3-9c4a-2da4c952fbb3_6808887c-e4f7-4739-b86b-81ed51fac114.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/e197314a-a4d0-47b3-9c4a-2da4c952fbb3_b07ffb3c-64db-4d41-8cfe-070048bfbbee.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fe197314a-a4d0-47b3-9c4a-2da4c952fbb3_e495e822-11cb-4140-8c21-9006a796f651.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/e197314a-a4d0-47b3-9c4a-2da4c952fbb3_e495e822-11cb-4140-8c21-9006a796f651.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d6f2abd0>
2025-12-05 11:59:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 11:59:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11c9f5ac-4921-59ad-aba1-90f0802f662d/11c9f5ac-4921-59ad-aba1-90f0802f662d_image_5.webp HTTP/1.1" 201 0
2025-12-05 11:59:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fe197314a-a4d0-47b3-9c4a-2da4c952fbb3_0604e128-0681-4cd8-b264-aa5187cf7dd0.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/e197314a-a4d0-47b3-9c4a-2da4c952fbb3_0604e128-0681-4cd8-b264-aa5187cf7dd0.jpg/250x188.webp saved to cache
2025-12-05 11:59:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 11c9f5ac-4921-59ad-aba1-90f0802f662d
2025-12-05 11:59:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e88e10>
2025-12-05 11:59:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 11:59:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11c9f5ac-4921-59ad-aba1-90f0802f662d/11c9f5ac-4921-59ad-aba1-90f0802f662d_image_6.webp HTTP/1.1" 201 0
2025-12-05 11:59:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fe197314a-a4d0-47b3-9c4a-2da4c952fbb3_7f9d7ac0-012d-47fe-97ca-c90e27f90cb4.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/e197314a-a4d0-47b3-9c4a-2da4c952fbb3_7f9d7ac0-012d-47fe-97ca-c90e27f90cb4.jpg/250x188.webp saved to cache
2025-12-05 11:59:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 11c9f5ac-4921-59ad-aba1-90f0802f662d
2025-12-05 11:59:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5c701d0>
2025-12-05 11:59:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 11:59:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11c9f5ac-4921-59ad-aba1-90f0802f662d/11c9f5ac-4921-59ad-aba1-90f0802f662d_image_2.webp HTTP/1.1" 201 0
2025-12-05 11:59:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fe197314a-a4d0-47b3-9c4a-2da4c952fbb3_3dc84609-e9d8-48a1-81e7-3f880aad8c9b.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/e197314a-a4d0-47b3-9c4a-2da4c952fbb3_3dc84609-e9d8-48a1-81e7-3f880aad8c9b.jpg/250x188.webp saved to cache
2025-12-05 11:59:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 11c9f5ac-4921-59ad-aba1-90f0802f662d
2025-12-05 11:59:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fe197314a-a4d0-47b3-9c4a-2da4c952fbb3_4968d776-e456-485e-994f-d189e6bd354d.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/e197314a-a4d0-47b3-9c4a-2da4c952fbb3_4968d776-e456-485e-994f-d189e6bd354d.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/e197314a-a4d0-47b3-9c4a-2da4c952fbb3_a2a3de46-2bd5-4fed-b882-9f0f642dc271.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/e197314a-a4d0-47b3-9c4a-2da4c952fbb3_fe6de3c8-72dc-4b26-b91e-2e8b4d270c7e.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%279d2f6003-395d-4ed1-98f5-77024e98c9f2%27 HTTP/1.1" 200 None
2025-12-05 11:59:27 [auto_selling_autoscout24.it] INFO: Scrape type for 9d2f6003-395d-4ed1-98f5-77024e98c9f2: 1
2025-12-05 11:59:27 [auto_selling_autoscout24.it] INFO: Scraping new listing 9d2f6003-395d-4ed1-98f5-77024e98c9f2
2025-12-05 11:59:27 [auto_selling_autoscout24.it] INFO: Extracting item from listing ID: 9d2f6003-395d-4ed1-98f5-77024e98c9f2
2025-12-05 11:59:27 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 74bd17b2-f017-501d-8205-3ba68fb5a1cc with identifier: 9d2f6003-395d-4ed1-98f5-77024e98c9f2
2025-12-05 11:59:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 74bd17b2-f017-501d-8205-3ba68fb5a1cc
2025-12-05 11:59:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F9d2f6003-395d-4ed1-98f5-77024e98c9f2_19490962-c591-48c5-8114-41538e259b98.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/9d2f6003-395d-4ed1-98f5-77024e98c9f2_19490962-c591-48c5-8114-41538e259b98.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e39150>
2025-12-05 11:59:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 11:59:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11c9f5ac-4921-59ad-aba1-90f0802f662d/11c9f5ac-4921-59ad-aba1-90f0802f662d_image_8.webp HTTP/1.1" 201 0
2025-12-05 11:59:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fe197314a-a4d0-47b3-9c4a-2da4c952fbb3_6808887c-e4f7-4739-b86b-81ed51fac114.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/e197314a-a4d0-47b3-9c4a-2da4c952fbb3_6808887c-e4f7-4739-b86b-81ed51fac114.jpg/250x188.webp saved to cache
2025-12-05 11:59:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 11c9f5ac-4921-59ad-aba1-90f0802f662d
2025-12-05 11:59:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d6ff2ed0>
2025-12-05 11:59:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 11:59:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11c9f5ac-4921-59ad-aba1-90f0802f662d/11c9f5ac-4921-59ad-aba1-90f0802f662d_image_7.webp HTTP/1.1" 201 0
2025-12-05 11:59:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fe197314a-a4d0-47b3-9c4a-2da4c952fbb3_b07ffb3c-64db-4d41-8cfe-070048bfbbee.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/e197314a-a4d0-47b3-9c4a-2da4c952fbb3_b07ffb3c-64db-4d41-8cfe-070048bfbbee.jpg/250x188.webp saved to cache
2025-12-05 11:59:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 11c9f5ac-4921-59ad-aba1-90f0802f662d
2025-12-05 11:59:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/e197314a-a4d0-47b3-9c4a-2da4c952fbb3_7f2fdb21-5c7a-4917-9a82-25a0241f524c.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/e197314a-a4d0-47b3-9c4a-2da4c952fbb3_e495e822-11cb-4140-8c21-9006a796f651.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F9d2f6003-395d-4ed1-98f5-77024e98c9f2_85b5dbf1-664e-4090-8b00-62ccf7677578.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/9d2f6003-395d-4ed1-98f5-77024e98c9f2_85b5dbf1-664e-4090-8b00-62ccf7677578.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e4d290>
2025-12-05 11:59:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 11:59:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11c9f5ac-4921-59ad-aba1-90f0802f662d/11c9f5ac-4921-59ad-aba1-90f0802f662d_image_9.webp HTTP/1.1" 201 0
2025-12-05 11:59:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fe197314a-a4d0-47b3-9c4a-2da4c952fbb3_a2a3de46-2bd5-4fed-b882-9f0f642dc271.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/e197314a-a4d0-47b3-9c4a-2da4c952fbb3_a2a3de46-2bd5-4fed-b882-9f0f642dc271.jpg/250x188.webp saved to cache
2025-12-05 11:59:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 11c9f5ac-4921-59ad-aba1-90f0802f662d
2025-12-05 11:59:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d6fccb50>
2025-12-05 11:59:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 11:59:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11c9f5ac-4921-59ad-aba1-90f0802f662d/11c9f5ac-4921-59ad-aba1-90f0802f662d_image_10.webp HTTP/1.1" 201 0
2025-12-05 11:59:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fe197314a-a4d0-47b3-9c4a-2da4c952fbb3_fe6de3c8-72dc-4b26-b91e-2e8b4d270c7e.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/e197314a-a4d0-47b3-9c4a-2da4c952fbb3_fe6de3c8-72dc-4b26-b91e-2e8b4d270c7e.jpg/250x188.webp saved to cache
2025-12-05 11:59:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 11c9f5ac-4921-59ad-aba1-90f0802f662d
2025-12-05 11:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F9d2f6003-395d-4ed1-98f5-77024e98c9f2_7ab79c72-4273-4d4f-acb1-4909bd7aadc0.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/9d2f6003-395d-4ed1-98f5-77024e98c9f2_7ab79c72-4273-4d4f-acb1-4909bd7aadc0.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/e197314a-a4d0-47b3-9c4a-2da4c952fbb3_4968d776-e456-485e-994f-d189e6bd354d.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F9d2f6003-395d-4ed1-98f5-77024e98c9f2_ca513de6-4ad6-4862-9966-db79a0caf147.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/9d2f6003-395d-4ed1-98f5-77024e98c9f2_ca513de6-4ad6-4862-9966-db79a0caf147.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e4d110>
2025-12-05 11:59:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 11:59:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11c9f5ac-4921-59ad-aba1-90f0802f662d/11c9f5ac-4921-59ad-aba1-90f0802f662d_image_11.webp HTTP/1.1" 201 0
2025-12-05 11:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fe197314a-a4d0-47b3-9c4a-2da4c952fbb3_7f2fdb21-5c7a-4917-9a82-25a0241f524c.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/e197314a-a4d0-47b3-9c4a-2da4c952fbb3_7f2fdb21-5c7a-4917-9a82-25a0241f524c.jpg/250x188.webp saved to cache
2025-12-05 11:59:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 11c9f5ac-4921-59ad-aba1-90f0802f662d
2025-12-05 11:59:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e734d0>
2025-12-05 11:59:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 11:59:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11c9f5ac-4921-59ad-aba1-90f0802f662d/11c9f5ac-4921-59ad-aba1-90f0802f662d_image_12.webp HTTP/1.1" 201 0
2025-12-05 11:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fe197314a-a4d0-47b3-9c4a-2da4c952fbb3_e495e822-11cb-4140-8c21-9006a796f651.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/e197314a-a4d0-47b3-9c4a-2da4c952fbb3_e495e822-11cb-4140-8c21-9006a796f651.jpg/250x188.webp saved to cache
2025-12-05 11:59:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 11c9f5ac-4921-59ad-aba1-90f0802f662d
2025-12-05 11:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F9d2f6003-395d-4ed1-98f5-77024e98c9f2_e09ccc9c-4478-4541-87d8-1e18151a458c.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/9d2f6003-395d-4ed1-98f5-77024e98c9f2_e09ccc9c-4478-4541-87d8-1e18151a458c.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/9d2f6003-395d-4ed1-98f5-77024e98c9f2_85b5dbf1-664e-4090-8b00-62ccf7677578.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/9d2f6003-395d-4ed1-98f5-77024e98c9f2_19490962-c591-48c5-8114-41538e259b98.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F9d2f6003-395d-4ed1-98f5-77024e98c9f2_cc972a74-fb15-4838-85cb-41d3b05027d9.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/9d2f6003-395d-4ed1-98f5-77024e98c9f2_cc972a74-fb15-4838-85cb-41d3b05027d9.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5c77550>
2025-12-05 11:59:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 11:59:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11c9f5ac-4921-59ad-aba1-90f0802f662d/11c9f5ac-4921-59ad-aba1-90f0802f662d_image_13.webp HTTP/1.1" 201 0
2025-12-05 11:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fe197314a-a4d0-47b3-9c4a-2da4c952fbb3_4968d776-e456-485e-994f-d189e6bd354d.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/e197314a-a4d0-47b3-9c4a-2da4c952fbb3_4968d776-e456-485e-994f-d189e6bd354d.jpg/250x188.webp saved to cache
2025-12-05 11:59:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 11c9f5ac-4921-59ad-aba1-90f0802f662d
2025-12-05 11:59:30 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 11c9f5ac-4921-59ad-aba1-90f0802f662d from tracking dictionaries
2025-12-05 11:59:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 11c9f5ac-4921-59ad-aba1-90f0802f662d sending to next pipeline
2025-12-05 11:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F9d2f6003-395d-4ed1-98f5-77024e98c9f2_9693ae35-55f0-4017-8d2a-af50012cef87.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/9d2f6003-395d-4ed1-98f5-77024e98c9f2_9693ae35-55f0-4017-8d2a-af50012cef87.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:30 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 11c9f5ac-4921-59ad-aba1-90f0802f662d with identifier e197314a-a4d0-47b3-9c4a-2da4c952fbb3
2025-12-05 11:59:30 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 11:59:30 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 11:59:30 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 11c9f5ac-4921-59ad-aba1-90f0802f662d
2025-12-05 11:59:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://prod.pictures.autoscout24.net/listing-images/e197314a-a4d0-47b3-9c4a-2da4c952fbb3_4968d776-e456-485e-994f-d189e6bd354d.jpg/250x188.webp>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'emission_standard': None,
 'engine': None,
 'engine_horse_power': 213,
 'expiration_date': None,
 'fuel_type': 'Electric/Gasoline',
 'id': '11c9f5ac-4921-59ad-aba1-90f0802f662d',
 'is_damaged': False,
 'is_operable': True,
 'license_plate': None,
 'link_to_web_offer': 'https://www.autoscout24.it/offers/nissan-x-trail-1-5-e-power-e-4orce-4wd-7posti-n-connecta-promo-electric-gasoline-grey-e197314a-a4d0-47b3-9c4a-2da4c952fbb3',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'X-Trail',
 'odometer': 6400,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11c9f5ac-4921-59ad-aba1-90f0802f662d/11c9f5ac-4921-59ad-aba1-90f0802f662d_image_0.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4284,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/e197314a-a4d0-47b3-9c4a-2da4c952fbb3_580b3dba-b496-424f-a5ea-af2237c8b7cd.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11c9f5ac-4921-59ad-aba1-90f0802f662d/11c9f5ac-4921-59ad-aba1-90f0802f662d_image_1.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5012,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/e197314a-a4d0-47b3-9c4a-2da4c952fbb3_9f05e754-64ea-43b8-9724-f641bc8582a7.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11c9f5ac-4921-59ad-aba1-90f0802f662d/11c9f5ac-4921-59ad-aba1-90f0802f662d_image_2.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4588,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/e197314a-a4d0-47b3-9c4a-2da4c952fbb3_3dc84609-e9d8-48a1-81e7-3f880aad8c9b.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11c9f5ac-4921-59ad-aba1-90f0802f662d/11c9f5ac-4921-59ad-aba1-90f0802f662d_image_3.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4326,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/e197314a-a4d0-47b3-9c4a-2da4c952fbb3_900eb047-8fd6-4457-ae21-2a784a5865a9.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11c9f5ac-4921-59ad-aba1-90f0802f662d/11c9f5ac-4921-59ad-aba1-90f0802f662d_image_4.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3770,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/e197314a-a4d0-47b3-9c4a-2da4c952fbb3_e65ff2b6-b7f9-4c69-a031-60701dce1a81.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11c9f5ac-4921-59ad-aba1-90f0802f662d/11c9f5ac-4921-59ad-aba1-90f0802f662d_image_5.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4382,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/e197314a-a4d0-47b3-9c4a-2da4c952fbb3_0604e128-0681-4cd8-b264-aa5187cf7dd0.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11c9f5ac-4921-59ad-aba1-90f0802f662d/11c9f5ac-4921-59ad-aba1-90f0802f662d_image_6.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5394,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/e197314a-a4d0-47b3-9c4a-2da4c952fbb3_7f9d7ac0-012d-47fe-97ca-c90e27f90cb4.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11c9f5ac-4921-59ad-aba1-90f0802f662d/11c9f5ac-4921-59ad-aba1-90f0802f662d_image_7.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 6696,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/e197314a-a4d0-47b3-9c4a-2da4c952fbb3_b07ffb3c-64db-4d41-8cfe-070048bfbbee.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11c9f5ac-4921-59ad-aba1-90f0802f662d/11c9f5ac-4921-59ad-aba1-90f0802f662d_image_8.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4606,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/e197314a-a4d0-47b3-9c4a-2da4c952fbb3_6808887c-e4f7-4739-b86b-81ed51fac114.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11c9f5ac-4921-59ad-aba1-90f0802f662d/11c9f5ac-4921-59ad-aba1-90f0802f662d_image_9.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5274,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/e197314a-a4d0-47b3-9c4a-2da4c952fbb3_a2a3de46-2bd5-4fed-b882-9f0f642dc271.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11c9f5ac-4921-59ad-aba1-90f0802f662d/11c9f5ac-4921-59ad-aba1-90f0802f662d_image_10.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5462,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/e197314a-a4d0-47b3-9c4a-2da4c952fbb3_fe6de3c8-72dc-4b26-b91e-2e8b4d270c7e.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11c9f5ac-4921-59ad-aba1-90f0802f662d/11c9f5ac-4921-59ad-aba1-90f0802f662d_image_11.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4108,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/e197314a-a4d0-47b3-9c4a-2da4c952fbb3_7f2fdb21-5c7a-4917-9a82-25a0241f524c.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11c9f5ac-4921-59ad-aba1-90f0802f662d/11c9f5ac-4921-59ad-aba1-90f0802f662d_image_12.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 6012,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/e197314a-a4d0-47b3-9c4a-2da4c952fbb3_e495e822-11cb-4140-8c21-9006a796f651.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11c9f5ac-4921-59ad-aba1-90f0802f662d/11c9f5ac-4921-59ad-aba1-90f0802f662d_image_13.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5506,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/e197314a-a4d0-47b3-9c4a-2da4c952fbb3_4968d776-e456-485e-994f-d189e6bd354d.jpg/250x188.webp',
             'Width': 250}],
 'price': 36500,
 'price_includes_vat': False,
 'registration_date': '2024-02-01',
 'seller_name': None,
 'title': 'Nissan X-Trail 1.5 e-Power e-4orce 4WD 7POSTI N-CONNECTA PROMO',
 'transmission': 'automatic',
 'trim': '1.5 e-Power e-4orce 4WD 7POSTI N-CONNECTA PROMO',
 'vin': None,
 'year': 2024}
2025-12-05 11:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27e197314a-a4d0-47b3-9c4a-2da4c952fbb3%27 HTTP/1.1" 200 None
2025-12-05 11:59:30 [auto_selling_autoscout24.it] INFO: Saving data for e197314a-a4d0-47b3-9c4a-2da4c952fbb3: {'created_time': 1764935970.452367, 'last_price_update_time': 1764935970.452375}
2025-12-05 11:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autoscout24.it',RowKey='e197314a-a4d0-47b3-9c4a-2da4c952fbb3') HTTP/1.1" 204 0
2025-12-05 11:59:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/9d2f6003-395d-4ed1-98f5-77024e98c9f2_7ab79c72-4273-4d4f-acb1-4909bd7aadc0.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/9d2f6003-395d-4ed1-98f5-77024e98c9f2_ca513de6-4ad6-4862-9966-db79a0caf147.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F9d2f6003-395d-4ed1-98f5-77024e98c9f2_2ffbc18c-b950-47b7-bcdf-27eafcb5d08c.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/9d2f6003-395d-4ed1-98f5-77024e98c9f2_2ffbc18c-b950-47b7-bcdf-27eafcb5d08c.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9dd5e8f50>
2025-12-05 11:59:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 11:59:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74bd17b2-f017-501d-8205-3ba68fb5a1cc/74bd17b2-f017-501d-8205-3ba68fb5a1cc_image_1.webp HTTP/1.1" 201 0
2025-12-05 11:59:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F9d2f6003-395d-4ed1-98f5-77024e98c9f2_85b5dbf1-664e-4090-8b00-62ccf7677578.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/9d2f6003-395d-4ed1-98f5-77024e98c9f2_85b5dbf1-664e-4090-8b00-62ccf7677578.jpg/250x188.webp saved to cache
2025-12-05 11:59:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 74bd17b2-f017-501d-8205-3ba68fb5a1cc
2025-12-05 11:59:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e3da10>
2025-12-05 11:59:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 11:59:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74bd17b2-f017-501d-8205-3ba68fb5a1cc/74bd17b2-f017-501d-8205-3ba68fb5a1cc_image_0.webp HTTP/1.1" 201 0
2025-12-05 11:59:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F9d2f6003-395d-4ed1-98f5-77024e98c9f2_19490962-c591-48c5-8114-41538e259b98.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/9d2f6003-395d-4ed1-98f5-77024e98c9f2_19490962-c591-48c5-8114-41538e259b98.jpg/250x188.webp saved to cache
2025-12-05 11:59:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 74bd17b2-f017-501d-8205-3ba68fb5a1cc
2025-12-05 11:59:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F9d2f6003-395d-4ed1-98f5-77024e98c9f2_bdf673e0-c03d-4dba-814e-2551980d1e4c.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/9d2f6003-395d-4ed1-98f5-77024e98c9f2_bdf673e0-c03d-4dba-814e-2551980d1e4c.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/9d2f6003-395d-4ed1-98f5-77024e98c9f2_cc972a74-fb15-4838-85cb-41d3b05027d9.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/9d2f6003-395d-4ed1-98f5-77024e98c9f2_e09ccc9c-4478-4541-87d8-1e18151a458c.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F9d2f6003-395d-4ed1-98f5-77024e98c9f2_dabc5964-b057-449f-99c5-3d8e06f87f32.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/9d2f6003-395d-4ed1-98f5-77024e98c9f2_dabc5964-b057-449f-99c5-3d8e06f87f32.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d6f6f010>
2025-12-05 11:59:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 11:59:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74bd17b2-f017-501d-8205-3ba68fb5a1cc/74bd17b2-f017-501d-8205-3ba68fb5a1cc_image_2.webp HTTP/1.1" 201 0
2025-12-05 11:59:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F9d2f6003-395d-4ed1-98f5-77024e98c9f2_7ab79c72-4273-4d4f-acb1-4909bd7aadc0.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/9d2f6003-395d-4ed1-98f5-77024e98c9f2_7ab79c72-4273-4d4f-acb1-4909bd7aadc0.jpg/250x188.webp saved to cache
2025-12-05 11:59:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 74bd17b2-f017-501d-8205-3ba68fb5a1cc
2025-12-05 11:59:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9dd5d4a90>
2025-12-05 11:59:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 11:59:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74bd17b2-f017-501d-8205-3ba68fb5a1cc/74bd17b2-f017-501d-8205-3ba68fb5a1cc_image_3.webp HTTP/1.1" 201 0
2025-12-05 11:59:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F9d2f6003-395d-4ed1-98f5-77024e98c9f2_ca513de6-4ad6-4862-9966-db79a0caf147.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/9d2f6003-395d-4ed1-98f5-77024e98c9f2_ca513de6-4ad6-4862-9966-db79a0caf147.jpg/250x188.webp saved to cache
2025-12-05 11:59:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 74bd17b2-f017-501d-8205-3ba68fb5a1cc
2025-12-05 11:59:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F9d2f6003-395d-4ed1-98f5-77024e98c9f2_e70a2222-1ac0-4ef5-903f-22816e1e45dd.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/9d2f6003-395d-4ed1-98f5-77024e98c9f2_e70a2222-1ac0-4ef5-903f-22816e1e45dd.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/9d2f6003-395d-4ed1-98f5-77024e98c9f2_2ffbc18c-b950-47b7-bcdf-27eafcb5d08c.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/9d2f6003-395d-4ed1-98f5-77024e98c9f2_9693ae35-55f0-4017-8d2a-af50012cef87.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F9d2f6003-395d-4ed1-98f5-77024e98c9f2_379c1f7e-b39c-4401-a8ff-3e386d9dc63f.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/9d2f6003-395d-4ed1-98f5-77024e98c9f2_379c1f7e-b39c-4401-a8ff-3e386d9dc63f.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5cef710>
2025-12-05 11:59:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 11:59:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74bd17b2-f017-501d-8205-3ba68fb5a1cc/74bd17b2-f017-501d-8205-3ba68fb5a1cc_image_5.webp HTTP/1.1" 201 0
2025-12-05 11:59:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F9d2f6003-395d-4ed1-98f5-77024e98c9f2_cc972a74-fb15-4838-85cb-41d3b05027d9.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/9d2f6003-395d-4ed1-98f5-77024e98c9f2_cc972a74-fb15-4838-85cb-41d3b05027d9.jpg/250x188.webp saved to cache
2025-12-05 11:59:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 74bd17b2-f017-501d-8205-3ba68fb5a1cc
2025-12-05 11:59:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5c39090>
2025-12-05 11:59:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 11:59:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74bd17b2-f017-501d-8205-3ba68fb5a1cc/74bd17b2-f017-501d-8205-3ba68fb5a1cc_image_4.webp HTTP/1.1" 201 0
2025-12-05 11:59:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F9d2f6003-395d-4ed1-98f5-77024e98c9f2_e09ccc9c-4478-4541-87d8-1e18151a458c.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/9d2f6003-395d-4ed1-98f5-77024e98c9f2_e09ccc9c-4478-4541-87d8-1e18151a458c.jpg/250x188.webp saved to cache
2025-12-05 11:59:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 74bd17b2-f017-501d-8205-3ba68fb5a1cc
2025-12-05 11:59:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F9d2f6003-395d-4ed1-98f5-77024e98c9f2_866e8f03-852d-4434-992c-f9ebcccd371d.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/9d2f6003-395d-4ed1-98f5-77024e98c9f2_866e8f03-852d-4434-992c-f9ebcccd371d.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/9d2f6003-395d-4ed1-98f5-77024e98c9f2_dabc5964-b057-449f-99c5-3d8e06f87f32.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/9d2f6003-395d-4ed1-98f5-77024e98c9f2_bdf673e0-c03d-4dba-814e-2551980d1e4c.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F9d2f6003-395d-4ed1-98f5-77024e98c9f2_01ad4665-b0f4-4ab4-8596-0b5419a34ffd.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/9d2f6003-395d-4ed1-98f5-77024e98c9f2_01ad4665-b0f4-4ab4-8596-0b5419a34ffd.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e52050>
2025-12-05 11:59:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 11:59:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74bd17b2-f017-501d-8205-3ba68fb5a1cc/74bd17b2-f017-501d-8205-3ba68fb5a1cc_image_7.webp HTTP/1.1" 201 0
2025-12-05 11:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F9d2f6003-395d-4ed1-98f5-77024e98c9f2_2ffbc18c-b950-47b7-bcdf-27eafcb5d08c.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/9d2f6003-395d-4ed1-98f5-77024e98c9f2_2ffbc18c-b950-47b7-bcdf-27eafcb5d08c.jpg/250x188.webp saved to cache
2025-12-05 11:59:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 74bd17b2-f017-501d-8205-3ba68fb5a1cc
2025-12-05 11:59:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d6f6da50>
2025-12-05 11:59:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 11:59:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74bd17b2-f017-501d-8205-3ba68fb5a1cc/74bd17b2-f017-501d-8205-3ba68fb5a1cc_image_6.webp HTTP/1.1" 201 0
2025-12-05 11:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F9d2f6003-395d-4ed1-98f5-77024e98c9f2_9693ae35-55f0-4017-8d2a-af50012cef87.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/9d2f6003-395d-4ed1-98f5-77024e98c9f2_9693ae35-55f0-4017-8d2a-af50012cef87.jpg/250x188.webp saved to cache
2025-12-05 11:59:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 74bd17b2-f017-501d-8205-3ba68fb5a1cc
2025-12-05 11:59:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/9d2f6003-395d-4ed1-98f5-77024e98c9f2_379c1f7e-b39c-4401-a8ff-3e386d9dc63f.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/9d2f6003-395d-4ed1-98f5-77024e98c9f2_e70a2222-1ac0-4ef5-903f-22816e1e45dd.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F9d2f6003-395d-4ed1-98f5-77024e98c9f2_bdfb4b43-8add-4761-95a2-0bf32e1c3024.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/9d2f6003-395d-4ed1-98f5-77024e98c9f2_bdfb4b43-8add-4761-95a2-0bf32e1c3024.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5c75b50>
2025-12-05 11:59:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 11:59:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74bd17b2-f017-501d-8205-3ba68fb5a1cc/74bd17b2-f017-501d-8205-3ba68fb5a1cc_image_9.webp HTTP/1.1" 201 0
2025-12-05 11:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F9d2f6003-395d-4ed1-98f5-77024e98c9f2_dabc5964-b057-449f-99c5-3d8e06f87f32.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/9d2f6003-395d-4ed1-98f5-77024e98c9f2_dabc5964-b057-449f-99c5-3d8e06f87f32.jpg/250x188.webp saved to cache
2025-12-05 11:59:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 74bd17b2-f017-501d-8205-3ba68fb5a1cc
2025-12-05 11:59:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5eb6210>
2025-12-05 11:59:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 11:59:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74bd17b2-f017-501d-8205-3ba68fb5a1cc/74bd17b2-f017-501d-8205-3ba68fb5a1cc_image_8.webp HTTP/1.1" 201 0
2025-12-05 11:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F9d2f6003-395d-4ed1-98f5-77024e98c9f2_bdf673e0-c03d-4dba-814e-2551980d1e4c.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/9d2f6003-395d-4ed1-98f5-77024e98c9f2_bdf673e0-c03d-4dba-814e-2551980d1e4c.jpg/250x188.webp saved to cache
2025-12-05 11:59:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 74bd17b2-f017-501d-8205-3ba68fb5a1cc
2025-12-05 11:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27ac5d8737-5787-4b22-9f03-0a5c9d0dd588%27 HTTP/1.1" 200 None
2025-12-05 11:59:33 [auto_selling_autoscout24.it] INFO: Scrape type for ac5d8737-5787-4b22-9f03-0a5c9d0dd588: 1
2025-12-05 11:59:33 [auto_selling_autoscout24.it] INFO: Scraping new listing ac5d8737-5787-4b22-9f03-0a5c9d0dd588
2025-12-05 11:59:33 [auto_selling_autoscout24.it] INFO: Extracting item from listing ID: ac5d8737-5787-4b22-9f03-0a5c9d0dd588
2025-12-05 11:59:33 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 9817e074-0601-5a0d-bc19-cdcd75845073 with identifier: ac5d8737-5787-4b22-9f03-0a5c9d0dd588
2025-12-05 11:59:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 11 photos for item 9817e074-0601-5a0d-bc19-cdcd75845073
2025-12-05 11:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fac5d8737-5787-4b22-9f03-0a5c9d0dd588_eb17b860-bacc-4982-b886-d6f51bcc46e7.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/ac5d8737-5787-4b22-9f03-0a5c9d0dd588_eb17b860-bacc-4982-b886-d6f51bcc46e7.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/9d2f6003-395d-4ed1-98f5-77024e98c9f2_866e8f03-852d-4434-992c-f9ebcccd371d.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fac5d8737-5787-4b22-9f03-0a5c9d0dd588_3c8c9864-0c29-4457-ae8c-46137a4adeb2.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/ac5d8737-5787-4b22-9f03-0a5c9d0dd588_3c8c9864-0c29-4457-ae8c-46137a4adeb2.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5eaf0d0>
2025-12-05 11:59:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 11:59:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74bd17b2-f017-501d-8205-3ba68fb5a1cc/74bd17b2-f017-501d-8205-3ba68fb5a1cc_image_11.webp HTTP/1.1" 201 0
2025-12-05 11:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F9d2f6003-395d-4ed1-98f5-77024e98c9f2_379c1f7e-b39c-4401-a8ff-3e386d9dc63f.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/9d2f6003-395d-4ed1-98f5-77024e98c9f2_379c1f7e-b39c-4401-a8ff-3e386d9dc63f.jpg/250x188.webp saved to cache
2025-12-05 11:59:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 74bd17b2-f017-501d-8205-3ba68fb5a1cc
2025-12-05 11:59:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5c7a450>
2025-12-05 11:59:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 11:59:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74bd17b2-f017-501d-8205-3ba68fb5a1cc/74bd17b2-f017-501d-8205-3ba68fb5a1cc_image_10.webp HTTP/1.1" 201 0
2025-12-05 11:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F9d2f6003-395d-4ed1-98f5-77024e98c9f2_e70a2222-1ac0-4ef5-903f-22816e1e45dd.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/9d2f6003-395d-4ed1-98f5-77024e98c9f2_e70a2222-1ac0-4ef5-903f-22816e1e45dd.jpg/250x188.webp saved to cache
2025-12-05 11:59:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 74bd17b2-f017-501d-8205-3ba68fb5a1cc
2025-12-05 11:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fac5d8737-5787-4b22-9f03-0a5c9d0dd588_98aa2934-5607-45af-ab30-035c852f6ee6.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/ac5d8737-5787-4b22-9f03-0a5c9d0dd588_98aa2934-5607-45af-ab30-035c852f6ee6.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/9d2f6003-395d-4ed1-98f5-77024e98c9f2_01ad4665-b0f4-4ab4-8596-0b5419a34ffd.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/9d2f6003-395d-4ed1-98f5-77024e98c9f2_bdfb4b43-8add-4761-95a2-0bf32e1c3024.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fac5d8737-5787-4b22-9f03-0a5c9d0dd588_9265dd66-9675-40f6-9458-76a9303c61ce.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/ac5d8737-5787-4b22-9f03-0a5c9d0dd588_9265dd66-9675-40f6-9458-76a9303c61ce.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5c56910>
2025-12-05 11:59:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 11:59:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74bd17b2-f017-501d-8205-3ba68fb5a1cc/74bd17b2-f017-501d-8205-3ba68fb5a1cc_image_12.webp HTTP/1.1" 201 0
2025-12-05 11:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F9d2f6003-395d-4ed1-98f5-77024e98c9f2_866e8f03-852d-4434-992c-f9ebcccd371d.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/9d2f6003-395d-4ed1-98f5-77024e98c9f2_866e8f03-852d-4434-992c-f9ebcccd371d.jpg/250x188.webp saved to cache
2025-12-05 11:59:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 74bd17b2-f017-501d-8205-3ba68fb5a1cc
2025-12-05 11:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fac5d8737-5787-4b22-9f03-0a5c9d0dd588_2dc81351-2896-4352-af92-ba5fe59e4026.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/ac5d8737-5787-4b22-9f03-0a5c9d0dd588_2dc81351-2896-4352-af92-ba5fe59e4026.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/ac5d8737-5787-4b22-9f03-0a5c9d0dd588_eb17b860-bacc-4982-b886-d6f51bcc46e7.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/ac5d8737-5787-4b22-9f03-0a5c9d0dd588_3c8c9864-0c29-4457-ae8c-46137a4adeb2.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fac5d8737-5787-4b22-9f03-0a5c9d0dd588_9c68b707-be07-4217-8d99-69911f8ced8c.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/ac5d8737-5787-4b22-9f03-0a5c9d0dd588_9c68b707-be07-4217-8d99-69911f8ced8c.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5c391d0>
2025-12-05 11:59:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 11:59:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74bd17b2-f017-501d-8205-3ba68fb5a1cc/74bd17b2-f017-501d-8205-3ba68fb5a1cc_image_13.webp HTTP/1.1" 201 0
2025-12-05 11:59:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F9d2f6003-395d-4ed1-98f5-77024e98c9f2_01ad4665-b0f4-4ab4-8596-0b5419a34ffd.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/9d2f6003-395d-4ed1-98f5-77024e98c9f2_01ad4665-b0f4-4ab4-8596-0b5419a34ffd.jpg/250x188.webp saved to cache
2025-12-05 11:59:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 74bd17b2-f017-501d-8205-3ba68fb5a1cc
2025-12-05 11:59:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5c065d0>
2025-12-05 11:59:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 11:59:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74bd17b2-f017-501d-8205-3ba68fb5a1cc/74bd17b2-f017-501d-8205-3ba68fb5a1cc_image_14.webp HTTP/1.1" 201 0
2025-12-05 11:59:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F9d2f6003-395d-4ed1-98f5-77024e98c9f2_bdfb4b43-8add-4761-95a2-0bf32e1c3024.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/9d2f6003-395d-4ed1-98f5-77024e98c9f2_bdfb4b43-8add-4761-95a2-0bf32e1c3024.jpg/250x188.webp saved to cache
2025-12-05 11:59:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 74bd17b2-f017-501d-8205-3ba68fb5a1cc
2025-12-05 11:59:35 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 74bd17b2-f017-501d-8205-3ba68fb5a1cc from tracking dictionaries
2025-12-05 11:59:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 74bd17b2-f017-501d-8205-3ba68fb5a1cc sending to next pipeline
2025-12-05 11:59:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fac5d8737-5787-4b22-9f03-0a5c9d0dd588_e3615347-628d-48c9-9dbe-e1ff4c0584f2.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/ac5d8737-5787-4b22-9f03-0a5c9d0dd588_e3615347-628d-48c9-9dbe-e1ff4c0584f2.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:35 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 74bd17b2-f017-501d-8205-3ba68fb5a1cc with identifier 9d2f6003-395d-4ed1-98f5-77024e98c9f2
2025-12-05 11:59:35 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 11:59:35 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 11:59:35 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 74bd17b2-f017-501d-8205-3ba68fb5a1cc
2025-12-05 11:59:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://prod.pictures.autoscout24.net/listing-images/9d2f6003-395d-4ed1-98f5-77024e98c9f2_bdfb4b43-8add-4761-95a2-0bf32e1c3024.jpg/250x188.webp>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'emission_standard': None,
 'engine': None,
 'engine_horse_power': 137,
 'expiration_date': None,
 'fuel_type': 'LPG',
 'id': '74bd17b2-f017-501d-8205-3ba68fb5a1cc',
 'is_damaged': False,
 'is_operable': True,
 'license_plate': None,
 'link_to_web_offer': 'https://www.autoscout24.it/offers/cirelli-others-sportcoupe-bifuel-137cv-e-cvt-super-promo-lpg-white-9d2f6003-395d-4ed1-98f5-77024e98c9f2',
 'listing': 'auction',
 'make': 'Cirelli',
 'model': "SPORTCOUPE' BiFuel 137CV e-CVT SUPER PROMO!!!",
 'odometer': 1,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74bd17b2-f017-501d-8205-3ba68fb5a1cc/74bd17b2-f017-501d-8205-3ba68fb5a1cc_image_0.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3262,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/9d2f6003-395d-4ed1-98f5-77024e98c9f2_19490962-c591-48c5-8114-41538e259b98.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74bd17b2-f017-501d-8205-3ba68fb5a1cc/74bd17b2-f017-501d-8205-3ba68fb5a1cc_image_1.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3652,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/9d2f6003-395d-4ed1-98f5-77024e98c9f2_85b5dbf1-664e-4090-8b00-62ccf7677578.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74bd17b2-f017-501d-8205-3ba68fb5a1cc/74bd17b2-f017-501d-8205-3ba68fb5a1cc_image_2.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4272,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/9d2f6003-395d-4ed1-98f5-77024e98c9f2_7ab79c72-4273-4d4f-acb1-4909bd7aadc0.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74bd17b2-f017-501d-8205-3ba68fb5a1cc/74bd17b2-f017-501d-8205-3ba68fb5a1cc_image_3.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3958,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/9d2f6003-395d-4ed1-98f5-77024e98c9f2_ca513de6-4ad6-4862-9966-db79a0caf147.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74bd17b2-f017-501d-8205-3ba68fb5a1cc/74bd17b2-f017-501d-8205-3ba68fb5a1cc_image_4.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3662,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/9d2f6003-395d-4ed1-98f5-77024e98c9f2_e09ccc9c-4478-4541-87d8-1e18151a458c.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74bd17b2-f017-501d-8205-3ba68fb5a1cc/74bd17b2-f017-501d-8205-3ba68fb5a1cc_image_5.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3814,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/9d2f6003-395d-4ed1-98f5-77024e98c9f2_cc972a74-fb15-4838-85cb-41d3b05027d9.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74bd17b2-f017-501d-8205-3ba68fb5a1cc/74bd17b2-f017-501d-8205-3ba68fb5a1cc_image_6.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 6392,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/9d2f6003-395d-4ed1-98f5-77024e98c9f2_9693ae35-55f0-4017-8d2a-af50012cef87.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74bd17b2-f017-501d-8205-3ba68fb5a1cc/74bd17b2-f017-501d-8205-3ba68fb5a1cc_image_7.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5982,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/9d2f6003-395d-4ed1-98f5-77024e98c9f2_2ffbc18c-b950-47b7-bcdf-27eafcb5d08c.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74bd17b2-f017-501d-8205-3ba68fb5a1cc/74bd17b2-f017-501d-8205-3ba68fb5a1cc_image_8.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5374,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/9d2f6003-395d-4ed1-98f5-77024e98c9f2_bdf673e0-c03d-4dba-814e-2551980d1e4c.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74bd17b2-f017-501d-8205-3ba68fb5a1cc/74bd17b2-f017-501d-8205-3ba68fb5a1cc_image_9.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4330,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/9d2f6003-395d-4ed1-98f5-77024e98c9f2_dabc5964-b057-449f-99c5-3d8e06f87f32.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74bd17b2-f017-501d-8205-3ba68fb5a1cc/74bd17b2-f017-501d-8205-3ba68fb5a1cc_image_10.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4262,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/9d2f6003-395d-4ed1-98f5-77024e98c9f2_e70a2222-1ac0-4ef5-903f-22816e1e45dd.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74bd17b2-f017-501d-8205-3ba68fb5a1cc/74bd17b2-f017-501d-8205-3ba68fb5a1cc_image_11.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4850,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/9d2f6003-395d-4ed1-98f5-77024e98c9f2_379c1f7e-b39c-4401-a8ff-3e386d9dc63f.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74bd17b2-f017-501d-8205-3ba68fb5a1cc/74bd17b2-f017-501d-8205-3ba68fb5a1cc_image_12.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4438,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/9d2f6003-395d-4ed1-98f5-77024e98c9f2_866e8f03-852d-4434-992c-f9ebcccd371d.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74bd17b2-f017-501d-8205-3ba68fb5a1cc/74bd17b2-f017-501d-8205-3ba68fb5a1cc_image_13.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5474,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/9d2f6003-395d-4ed1-98f5-77024e98c9f2_01ad4665-b0f4-4ab4-8596-0b5419a34ffd.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74bd17b2-f017-501d-8205-3ba68fb5a1cc/74bd17b2-f017-501d-8205-3ba68fb5a1cc_image_14.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4902,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/9d2f6003-395d-4ed1-98f5-77024e98c9f2_bdfb4b43-8add-4761-95a2-0bf32e1c3024.jpg/250x188.webp',
             'Width': 250}],
 'price': 28900,
 'price_includes_vat': False,
 'registration_date': '2025-11-01',
 'seller_name': None,
 'title': "Cirelli SPORTCOUPE' BiFuel 137CV e-CVT SUPER PROMO!!! SPORTCOUPE' "
          'BiFuel 137CV e-CVT SUPER PROMO!!!',
 'transmission': 'automatic',
 'trim': "SPORTCOUPE' BiFuel 137CV e-CVT SUPER PROMO!!!",
 'vin': None,
 'year': 2025}
2025-12-05 11:59:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%279d2f6003-395d-4ed1-98f5-77024e98c9f2%27 HTTP/1.1" 200 None
2025-12-05 11:59:35 [auto_selling_autoscout24.it] INFO: Saving data for 9d2f6003-395d-4ed1-98f5-77024e98c9f2: {'created_time': 1764935975.428785, 'last_price_update_time': 1764935975.428795}
2025-12-05 11:59:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autoscout24.it',RowKey='9d2f6003-395d-4ed1-98f5-77024e98c9f2') HTTP/1.1" 204 0
2025-12-05 11:59:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/ac5d8737-5787-4b22-9f03-0a5c9d0dd588_9265dd66-9675-40f6-9458-76a9303c61ce.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/ac5d8737-5787-4b22-9f03-0a5c9d0dd588_98aa2934-5607-45af-ab30-035c852f6ee6.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fac5d8737-5787-4b22-9f03-0a5c9d0dd588_5d5f5510-5564-4d09-95c0-9f58c9c78f86.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/ac5d8737-5787-4b22-9f03-0a5c9d0dd588_5d5f5510-5564-4d09-95c0-9f58c9c78f86.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9de9dd450>
2025-12-05 11:59:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 11:59:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9817e074-0601-5a0d-bc19-cdcd75845073/9817e074-0601-5a0d-bc19-cdcd75845073_image_0.webp HTTP/1.1" 201 0
2025-12-05 11:59:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fac5d8737-5787-4b22-9f03-0a5c9d0dd588_eb17b860-bacc-4982-b886-d6f51bcc46e7.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/ac5d8737-5787-4b22-9f03-0a5c9d0dd588_eb17b860-bacc-4982-b886-d6f51bcc46e7.jpg/250x188.webp saved to cache
2025-12-05 11:59:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9817e074-0601-5a0d-bc19-cdcd75845073
2025-12-05 11:59:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5c78110>
2025-12-05 11:59:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 11:59:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9817e074-0601-5a0d-bc19-cdcd75845073/9817e074-0601-5a0d-bc19-cdcd75845073_image_1.webp HTTP/1.1" 201 0
2025-12-05 11:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fac5d8737-5787-4b22-9f03-0a5c9d0dd588_3c8c9864-0c29-4457-ae8c-46137a4adeb2.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/ac5d8737-5787-4b22-9f03-0a5c9d0dd588_3c8c9864-0c29-4457-ae8c-46137a4adeb2.jpg/250x188.webp saved to cache
2025-12-05 11:59:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9817e074-0601-5a0d-bc19-cdcd75845073
2025-12-05 11:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fac5d8737-5787-4b22-9f03-0a5c9d0dd588_269e52a5-d7d6-4937-9b8c-183a0df529d4.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/ac5d8737-5787-4b22-9f03-0a5c9d0dd588_269e52a5-d7d6-4937-9b8c-183a0df529d4.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/ac5d8737-5787-4b22-9f03-0a5c9d0dd588_9c68b707-be07-4217-8d99-69911f8ced8c.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/ac5d8737-5787-4b22-9f03-0a5c9d0dd588_2dc81351-2896-4352-af92-ba5fe59e4026.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fac5d8737-5787-4b22-9f03-0a5c9d0dd588_13e8e69f-ef11-458a-91db-75ae3d4db5a8.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/ac5d8737-5787-4b22-9f03-0a5c9d0dd588_13e8e69f-ef11-458a-91db-75ae3d4db5a8.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5b11510>
2025-12-05 11:59:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 11:59:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9817e074-0601-5a0d-bc19-cdcd75845073/9817e074-0601-5a0d-bc19-cdcd75845073_image_3.webp HTTP/1.1" 201 0
2025-12-05 11:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fac5d8737-5787-4b22-9f03-0a5c9d0dd588_9265dd66-9675-40f6-9458-76a9303c61ce.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/ac5d8737-5787-4b22-9f03-0a5c9d0dd588_9265dd66-9675-40f6-9458-76a9303c61ce.jpg/250x188.webp saved to cache
2025-12-05 11:59:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9817e074-0601-5a0d-bc19-cdcd75845073
2025-12-05 11:59:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d6f6d650>
2025-12-05 11:59:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 11:59:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9817e074-0601-5a0d-bc19-cdcd75845073/9817e074-0601-5a0d-bc19-cdcd75845073_image_2.webp HTTP/1.1" 201 0
2025-12-05 11:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fac5d8737-5787-4b22-9f03-0a5c9d0dd588_98aa2934-5607-45af-ab30-035c852f6ee6.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/ac5d8737-5787-4b22-9f03-0a5c9d0dd588_98aa2934-5607-45af-ab30-035c852f6ee6.jpg/250x188.webp saved to cache
2025-12-05 11:59:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9817e074-0601-5a0d-bc19-cdcd75845073
2025-12-05 11:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fac5d8737-5787-4b22-9f03-0a5c9d0dd588_b67a2722-b0ee-4063-9e87-7a4cf5f7ee41.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/ac5d8737-5787-4b22-9f03-0a5c9d0dd588_b67a2722-b0ee-4063-9e87-7a4cf5f7ee41.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/ac5d8737-5787-4b22-9f03-0a5c9d0dd588_e3615347-628d-48c9-9dbe-e1ff4c0584f2.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/ac5d8737-5787-4b22-9f03-0a5c9d0dd588_5d5f5510-5564-4d09-95c0-9f58c9c78f86.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27b0b9d3e3-1b6a-4527-8f02-2e7b52c0152e%27 HTTP/1.1" 200 None
2025-12-05 11:59:36 [auto_selling_autoscout24.it] INFO: Scrape type for b0b9d3e3-1b6a-4527-8f02-2e7b52c0152e: 1
2025-12-05 11:59:36 [auto_selling_autoscout24.it] INFO: Scraping new listing b0b9d3e3-1b6a-4527-8f02-2e7b52c0152e
2025-12-05 11:59:36 [auto_selling_autoscout24.it] INFO: Extracting item from listing ID: b0b9d3e3-1b6a-4527-8f02-2e7b52c0152e
2025-12-05 11:59:36 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: f09a67d3-b615-5fd9-9cda-dccd9811be19 with identifier: b0b9d3e3-1b6a-4527-8f02-2e7b52c0152e
2025-12-05 11:59:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 14 photos for item f09a67d3-b615-5fd9-9cda-dccd9811be19
2025-12-05 11:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fb0b9d3e3-1b6a-4527-8f02-2e7b52c0152e_e4b0f40a-7875-4ca8-a28f-07c29b04414d.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/b0b9d3e3-1b6a-4527-8f02-2e7b52c0152e_e4b0f40a-7875-4ca8-a28f-07c29b04414d.jpg/250x188.webp already downloaded
2025-12-05 11:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fb0b9d3e3-1b6a-4527-8f02-2e7b52c0152e_d62f8d16-b399-46f2-8cae-00b12b51095d.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/b0b9d3e3-1b6a-4527-8f02-2e7b52c0152e_d62f8d16-b399-46f2-8cae-00b12b51095d.jpg/250x188.webp already downloaded
2025-12-05 11:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fb0b9d3e3-1b6a-4527-8f02-2e7b52c0152e_493ae080-0dd8-4e76-9bcf-3224d03c36f5.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/b0b9d3e3-1b6a-4527-8f02-2e7b52c0152e_493ae080-0dd8-4e76-9bcf-3224d03c36f5.jpg/250x188.webp already downloaded
2025-12-05 11:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fb0b9d3e3-1b6a-4527-8f02-2e7b52c0152e_6844ed93-aab8-42bf-824c-12318dc613a2.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/b0b9d3e3-1b6a-4527-8f02-2e7b52c0152e_6844ed93-aab8-42bf-824c-12318dc613a2.jpg/250x188.webp already downloaded
2025-12-05 11:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fb0b9d3e3-1b6a-4527-8f02-2e7b52c0152e_07be8c3c-0b18-42ca-86b9-bae97ff22afc.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/b0b9d3e3-1b6a-4527-8f02-2e7b52c0152e_07be8c3c-0b18-42ca-86b9-bae97ff22afc.jpg/250x188.webp already downloaded
2025-12-05 11:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fb0b9d3e3-1b6a-4527-8f02-2e7b52c0152e_553f41a5-10e9-495e-bd87-a97c8d1a3a8d.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/b0b9d3e3-1b6a-4527-8f02-2e7b52c0152e_553f41a5-10e9-495e-bd87-a97c8d1a3a8d.jpg/250x188.webp already downloaded
2025-12-05 11:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fb0b9d3e3-1b6a-4527-8f02-2e7b52c0152e_e4fab532-c1ce-4fe6-a89e-44e009335410.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/b0b9d3e3-1b6a-4527-8f02-2e7b52c0152e_e4fab532-c1ce-4fe6-a89e-44e009335410.jpg/250x188.webp already downloaded
2025-12-05 11:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fb0b9d3e3-1b6a-4527-8f02-2e7b52c0152e_4c2db234-5d8a-419f-8ac6-4332353039e1.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/b0b9d3e3-1b6a-4527-8f02-2e7b52c0152e_4c2db234-5d8a-419f-8ac6-4332353039e1.jpg/250x188.webp already downloaded
2025-12-05 11:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fb0b9d3e3-1b6a-4527-8f02-2e7b52c0152e_a0527e61-82ff-403d-8645-14d1b8d526d6.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/b0b9d3e3-1b6a-4527-8f02-2e7b52c0152e_a0527e61-82ff-403d-8645-14d1b8d526d6.jpg/250x188.webp already downloaded
2025-12-05 11:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fb0b9d3e3-1b6a-4527-8f02-2e7b52c0152e_c01b0969-21de-4d6c-aa85-2ac618c07f10.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/b0b9d3e3-1b6a-4527-8f02-2e7b52c0152e_c01b0969-21de-4d6c-aa85-2ac618c07f10.jpg/250x188.webp already downloaded
2025-12-05 11:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fb0b9d3e3-1b6a-4527-8f02-2e7b52c0152e_15a7264a-5f89-4f54-a76e-9ae2c0c256fe.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/b0b9d3e3-1b6a-4527-8f02-2e7b52c0152e_15a7264a-5f89-4f54-a76e-9ae2c0c256fe.jpg/250x188.webp already downloaded
2025-12-05 11:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fb0b9d3e3-1b6a-4527-8f02-2e7b52c0152e_9d6f347d-f953-4dfe-a97c-0a8e9a679c04.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/b0b9d3e3-1b6a-4527-8f02-2e7b52c0152e_9d6f347d-f953-4dfe-a97c-0a8e9a679c04.jpg/250x188.webp already downloaded
2025-12-05 11:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fb0b9d3e3-1b6a-4527-8f02-2e7b52c0152e_0fb1fe29-ad92-4354-86e4-07f81ee86280.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/b0b9d3e3-1b6a-4527-8f02-2e7b52c0152e_0fb1fe29-ad92-4354-86e4-07f81ee86280.jpg/250x188.webp already downloaded
2025-12-05 11:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fb0b9d3e3-1b6a-4527-8f02-2e7b52c0152e_804cbe15-c9cf-4e23-a3cb-eb0aaae81729.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/b0b9d3e3-1b6a-4527-8f02-2e7b52c0152e_804cbe15-c9cf-4e23-a3cb-eb0aaae81729.jpg/250x188.webp already downloaded
2025-12-05 11:59:36 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: f09a67d3-b615-5fd9-9cda-dccd9811be19 with identifier b0b9d3e3-1b6a-4527-8f02-2e7b52c0152e
2025-12-05 11:59:36 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 11:59:36 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 11:59:36 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item f09a67d3-b615-5fd9-9cda-dccd9811be19
2025-12-05 11:59:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autoscout24.it/api/dealer-detail/fetch-listings>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'emission_standard': None,
 'engine': None,
 'engine_horse_power': 204,
 'expiration_date': None,
 'fuel_type': 'Electric/Diesel',
 'id': 'f09a67d3-b615-5fd9-9cda-dccd9811be19',
 'is_damaged': False,
 'is_operable': True,
 'license_plate': None,
 'link_to_web_offer': 'https://www.autoscout24.it/offers/audi-q5-facelift-tdi-quattro-s-tronic-204cv-my2025-promo-electric-diesel-black-b0b9d3e3-1b6a-4527-8f02-2e7b52c0152e',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 1,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 14,
 'photo_urls': ['https://prod.pictures.autoscout24.net/listing-images/b0b9d3e3-1b6a-4527-8f02-2e7b52c0152e_e4b0f40a-7875-4ca8-a28f-07c29b04414d.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/b0b9d3e3-1b6a-4527-8f02-2e7b52c0152e_d62f8d16-b399-46f2-8cae-00b12b51095d.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/b0b9d3e3-1b6a-4527-8f02-2e7b52c0152e_493ae080-0dd8-4e76-9bcf-3224d03c36f5.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/b0b9d3e3-1b6a-4527-8f02-2e7b52c0152e_6844ed93-aab8-42bf-824c-12318dc613a2.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/b0b9d3e3-1b6a-4527-8f02-2e7b52c0152e_07be8c3c-0b18-42ca-86b9-bae97ff22afc.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/b0b9d3e3-1b6a-4527-8f02-2e7b52c0152e_553f41a5-10e9-495e-bd87-a97c8d1a3a8d.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/b0b9d3e3-1b6a-4527-8f02-2e7b52c0152e_e4fab532-c1ce-4fe6-a89e-44e009335410.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/b0b9d3e3-1b6a-4527-8f02-2e7b52c0152e_4c2db234-5d8a-419f-8ac6-4332353039e1.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/b0b9d3e3-1b6a-4527-8f02-2e7b52c0152e_a0527e61-82ff-403d-8645-14d1b8d526d6.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/b0b9d3e3-1b6a-4527-8f02-2e7b52c0152e_c01b0969-21de-4d6c-aa85-2ac618c07f10.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/b0b9d3e3-1b6a-4527-8f02-2e7b52c0152e_15a7264a-5f89-4f54-a76e-9ae2c0c256fe.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/b0b9d3e3-1b6a-4527-8f02-2e7b52c0152e_9d6f347d-f953-4dfe-a97c-0a8e9a679c04.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/b0b9d3e3-1b6a-4527-8f02-2e7b52c0152e_0fb1fe29-ad92-4354-86e4-07f81ee86280.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/b0b9d3e3-1b6a-4527-8f02-2e7b52c0152e_804cbe15-c9cf-4e23-a3cb-eb0aaae81729.jpg/250x188.webp'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d44999dc-bcae-5b9d-9c8f-c50a0fd3168f/d44999dc-bcae-5b9d-9c8f-c50a0fd3168f_image_0.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4658,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/b0b9d3e3-1b6a-4527-8f02-2e7b52c0152e_e4b0f40a-7875-4ca8-a28f-07c29b04414d.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d44999dc-bcae-5b9d-9c8f-c50a0fd3168f/d44999dc-bcae-5b9d-9c8f-c50a0fd3168f_image_1.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5730,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/b0b9d3e3-1b6a-4527-8f02-2e7b52c0152e_d62f8d16-b399-46f2-8cae-00b12b51095d.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d44999dc-bcae-5b9d-9c8f-c50a0fd3168f/d44999dc-bcae-5b9d-9c8f-c50a0fd3168f_image_2.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4918,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/b0b9d3e3-1b6a-4527-8f02-2e7b52c0152e_493ae080-0dd8-4e76-9bcf-3224d03c36f5.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d44999dc-bcae-5b9d-9c8f-c50a0fd3168f/d44999dc-bcae-5b9d-9c8f-c50a0fd3168f_image_3.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4770,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/b0b9d3e3-1b6a-4527-8f02-2e7b52c0152e_6844ed93-aab8-42bf-824c-12318dc613a2.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d44999dc-bcae-5b9d-9c8f-c50a0fd3168f/d44999dc-bcae-5b9d-9c8f-c50a0fd3168f_image_4.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5030,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/b0b9d3e3-1b6a-4527-8f02-2e7b52c0152e_07be8c3c-0b18-42ca-86b9-bae97ff22afc.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d44999dc-bcae-5b9d-9c8f-c50a0fd3168f/d44999dc-bcae-5b9d-9c8f-c50a0fd3168f_image_5.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4900,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/b0b9d3e3-1b6a-4527-8f02-2e7b52c0152e_553f41a5-10e9-495e-bd87-a97c8d1a3a8d.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d44999dc-bcae-5b9d-9c8f-c50a0fd3168f/d44999dc-bcae-5b9d-9c8f-c50a0fd3168f_image_6.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5778,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/b0b9d3e3-1b6a-4527-8f02-2e7b52c0152e_e4fab532-c1ce-4fe6-a89e-44e009335410.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d44999dc-bcae-5b9d-9c8f-c50a0fd3168f/d44999dc-bcae-5b9d-9c8f-c50a0fd3168f_image_7.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 8736,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/b0b9d3e3-1b6a-4527-8f02-2e7b52c0152e_4c2db234-5d8a-419f-8ac6-4332353039e1.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d44999dc-bcae-5b9d-9c8f-c50a0fd3168f/d44999dc-bcae-5b9d-9c8f-c50a0fd3168f_image_8.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5722,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/b0b9d3e3-1b6a-4527-8f02-2e7b52c0152e_a0527e61-82ff-403d-8645-14d1b8d526d6.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d44999dc-bcae-5b9d-9c8f-c50a0fd3168f/d44999dc-bcae-5b9d-9c8f-c50a0fd3168f_image_9.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 6900,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/b0b9d3e3-1b6a-4527-8f02-2e7b52c0152e_c01b0969-21de-4d6c-aa85-2ac618c07f10.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d44999dc-bcae-5b9d-9c8f-c50a0fd3168f/d44999dc-bcae-5b9d-9c8f-c50a0fd3168f_image_10.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 6618,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/b0b9d3e3-1b6a-4527-8f02-2e7b52c0152e_15a7264a-5f89-4f54-a76e-9ae2c0c256fe.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d44999dc-bcae-5b9d-9c8f-c50a0fd3168f/d44999dc-bcae-5b9d-9c8f-c50a0fd3168f_image_11.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5616,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/b0b9d3e3-1b6a-4527-8f02-2e7b52c0152e_9d6f347d-f953-4dfe-a97c-0a8e9a679c04.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d44999dc-bcae-5b9d-9c8f-c50a0fd3168f/d44999dc-bcae-5b9d-9c8f-c50a0fd3168f_image_12.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5756,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/b0b9d3e3-1b6a-4527-8f02-2e7b52c0152e_0fb1fe29-ad92-4354-86e4-07f81ee86280.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d44999dc-bcae-5b9d-9c8f-c50a0fd3168f/d44999dc-bcae-5b9d-9c8f-c50a0fd3168f_image_13.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4276,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/b0b9d3e3-1b6a-4527-8f02-2e7b52c0152e_804cbe15-c9cf-4e23-a3cb-eb0aaae81729.jpg/250x188.webp',
             'Width': 250}],
 'price': 69900,
 'price_includes_vat': False,
 'registration_date': '2025-10-01',
 'seller_name': None,
 'title': 'Audi Q5 FACELIFT TDI QUATTRO S-TRONIC 204CV MY2025 PROMO!',
 'transmission': 'automatic',
 'trim': 'FACELIFT TDI QUATTRO S-TRONIC 204CV MY2025 PROMO!',
 'vin': None,
 'year': 2025}
2025-12-05 11:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27b0b9d3e3-1b6a-4527-8f02-2e7b52c0152e%27 HTTP/1.1" 200 None
2025-12-05 11:59:36 [auto_selling_autoscout24.it] INFO: Saving data for b0b9d3e3-1b6a-4527-8f02-2e7b52c0152e: {'created_time': 1764935976.964349, 'last_price_update_time': 1764935976.96436}
2025-12-05 11:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autoscout24.it',RowKey='b0b9d3e3-1b6a-4527-8f02-2e7b52c0152e') HTTP/1.1" 204 0
2025-12-05 11:59:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d6f68ad0>
2025-12-05 11:59:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 11:59:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9817e074-0601-5a0d-bc19-cdcd75845073/9817e074-0601-5a0d-bc19-cdcd75845073_image_5.webp HTTP/1.1" 201 0
2025-12-05 11:59:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fac5d8737-5787-4b22-9f03-0a5c9d0dd588_9c68b707-be07-4217-8d99-69911f8ced8c.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/ac5d8737-5787-4b22-9f03-0a5c9d0dd588_9c68b707-be07-4217-8d99-69911f8ced8c.jpg/250x188.webp saved to cache
2025-12-05 11:59:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9817e074-0601-5a0d-bc19-cdcd75845073
2025-12-05 11:59:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9dc100810>
2025-12-05 11:59:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 11:59:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9817e074-0601-5a0d-bc19-cdcd75845073/9817e074-0601-5a0d-bc19-cdcd75845073_image_4.webp HTTP/1.1" 201 0
2025-12-05 11:59:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fac5d8737-5787-4b22-9f03-0a5c9d0dd588_2dc81351-2896-4352-af92-ba5fe59e4026.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/ac5d8737-5787-4b22-9f03-0a5c9d0dd588_2dc81351-2896-4352-af92-ba5fe59e4026.jpg/250x188.webp saved to cache
2025-12-05 11:59:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9817e074-0601-5a0d-bc19-cdcd75845073
2025-12-05 11:59:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/ac5d8737-5787-4b22-9f03-0a5c9d0dd588_269e52a5-d7d6-4937-9b8c-183a0df529d4.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/ac5d8737-5787-4b22-9f03-0a5c9d0dd588_13e8e69f-ef11-458a-91db-75ae3d4db5a8.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%275f42cd06-f3c0-48f7-a659-632cf08861e2%27 HTTP/1.1" 200 None
2025-12-05 11:59:37 [auto_selling_autoscout24.it] INFO: Scrape type for 5f42cd06-f3c0-48f7-a659-632cf08861e2: 1
2025-12-05 11:59:37 [auto_selling_autoscout24.it] INFO: Scraping new listing 5f42cd06-f3c0-48f7-a659-632cf08861e2
2025-12-05 11:59:37 [auto_selling_autoscout24.it] INFO: Extracting item from listing ID: 5f42cd06-f3c0-48f7-a659-632cf08861e2
2025-12-05 11:59:37 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 0cf9a6db-a910-5ad2-823f-0302e5ec6343 with identifier: 5f42cd06-f3c0-48f7-a659-632cf08861e2
2025-12-05 11:59:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 0cf9a6db-a910-5ad2-823f-0302e5ec6343
2025-12-05 11:59:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F5f42cd06-f3c0-48f7-a659-632cf08861e2_690a2944-9e6f-4301-856b-5f9d08600656.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/5f42cd06-f3c0-48f7-a659-632cf08861e2_690a2944-9e6f-4301-856b-5f9d08600656.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F5f42cd06-f3c0-48f7-a659-632cf08861e2_0996937e-b9f0-479c-a73f-d07c8d4df19f.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/5f42cd06-f3c0-48f7-a659-632cf08861e2_0996937e-b9f0-479c-a73f-d07c8d4df19f.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e6f390>
2025-12-05 11:59:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 11:59:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9817e074-0601-5a0d-bc19-cdcd75845073/9817e074-0601-5a0d-bc19-cdcd75845073_image_6.webp HTTP/1.1" 201 0
2025-12-05 11:59:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fac5d8737-5787-4b22-9f03-0a5c9d0dd588_e3615347-628d-48c9-9dbe-e1ff4c0584f2.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/ac5d8737-5787-4b22-9f03-0a5c9d0dd588_e3615347-628d-48c9-9dbe-e1ff4c0584f2.jpg/250x188.webp saved to cache
2025-12-05 11:59:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9817e074-0601-5a0d-bc19-cdcd75845073
2025-12-05 11:59:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e7e6d0>
2025-12-05 11:59:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 11:59:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9817e074-0601-5a0d-bc19-cdcd75845073/9817e074-0601-5a0d-bc19-cdcd75845073_image_7.webp HTTP/1.1" 201 0
2025-12-05 11:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fac5d8737-5787-4b22-9f03-0a5c9d0dd588_5d5f5510-5564-4d09-95c0-9f58c9c78f86.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/ac5d8737-5787-4b22-9f03-0a5c9d0dd588_5d5f5510-5564-4d09-95c0-9f58c9c78f86.jpg/250x188.webp saved to cache
2025-12-05 11:59:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9817e074-0601-5a0d-bc19-cdcd75845073
2025-12-05 11:59:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/ac5d8737-5787-4b22-9f03-0a5c9d0dd588_b67a2722-b0ee-4063-9e87-7a4cf5f7ee41.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F5f42cd06-f3c0-48f7-a659-632cf08861e2_59319f25-357c-4d8d-ad2e-f6d27ede8965.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/5f42cd06-f3c0-48f7-a659-632cf08861e2_59319f25-357c-4d8d-ad2e-f6d27ede8965.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5ce1a50>
2025-12-05 11:59:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 11:59:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9817e074-0601-5a0d-bc19-cdcd75845073/9817e074-0601-5a0d-bc19-cdcd75845073_image_8.webp HTTP/1.1" 201 0
2025-12-05 11:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fac5d8737-5787-4b22-9f03-0a5c9d0dd588_269e52a5-d7d6-4937-9b8c-183a0df529d4.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/ac5d8737-5787-4b22-9f03-0a5c9d0dd588_269e52a5-d7d6-4937-9b8c-183a0df529d4.jpg/250x188.webp saved to cache
2025-12-05 11:59:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9817e074-0601-5a0d-bc19-cdcd75845073
2025-12-05 11:59:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5cb3550>
2025-12-05 11:59:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 11:59:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9817e074-0601-5a0d-bc19-cdcd75845073/9817e074-0601-5a0d-bc19-cdcd75845073_image_9.webp HTTP/1.1" 201 0
2025-12-05 11:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fac5d8737-5787-4b22-9f03-0a5c9d0dd588_13e8e69f-ef11-458a-91db-75ae3d4db5a8.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/ac5d8737-5787-4b22-9f03-0a5c9d0dd588_13e8e69f-ef11-458a-91db-75ae3d4db5a8.jpg/250x188.webp saved to cache
2025-12-05 11:59:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9817e074-0601-5a0d-bc19-cdcd75845073
2025-12-05 11:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F5f42cd06-f3c0-48f7-a659-632cf08861e2_210c7fd4-24c1-478b-9e05-f0e38e195d4d.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/5f42cd06-f3c0-48f7-a659-632cf08861e2_210c7fd4-24c1-478b-9e05-f0e38e195d4d.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/5f42cd06-f3c0-48f7-a659-632cf08861e2_690a2944-9e6f-4301-856b-5f9d08600656.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F5f42cd06-f3c0-48f7-a659-632cf08861e2_b03aafdc-31b1-473b-8019-d2ef244f42f2.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/5f42cd06-f3c0-48f7-a659-632cf08861e2_b03aafdc-31b1-473b-8019-d2ef244f42f2.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9dd5d59d0>
2025-12-05 11:59:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 11:59:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9817e074-0601-5a0d-bc19-cdcd75845073/9817e074-0601-5a0d-bc19-cdcd75845073_image_10.webp HTTP/1.1" 201 0
2025-12-05 11:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fac5d8737-5787-4b22-9f03-0a5c9d0dd588_b67a2722-b0ee-4063-9e87-7a4cf5f7ee41.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/ac5d8737-5787-4b22-9f03-0a5c9d0dd588_b67a2722-b0ee-4063-9e87-7a4cf5f7ee41.jpg/250x188.webp saved to cache
2025-12-05 11:59:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 9817e074-0601-5a0d-bc19-cdcd75845073
2025-12-05 11:59:38 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 9817e074-0601-5a0d-bc19-cdcd75845073 from tracking dictionaries
2025-12-05 11:59:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9817e074-0601-5a0d-bc19-cdcd75845073 sending to next pipeline
2025-12-05 11:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F5f42cd06-f3c0-48f7-a659-632cf08861e2_ade6551b-a9ca-44cc-ad46-0f25f7e312ca.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/5f42cd06-f3c0-48f7-a659-632cf08861e2_ade6551b-a9ca-44cc-ad46-0f25f7e312ca.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:38 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 9817e074-0601-5a0d-bc19-cdcd75845073 with identifier ac5d8737-5787-4b22-9f03-0a5c9d0dd588
2025-12-05 11:59:38 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 11:59:38 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 11:59:38 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 9817e074-0601-5a0d-bc19-cdcd75845073
2025-12-05 11:59:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://prod.pictures.autoscout24.net/listing-images/ac5d8737-5787-4b22-9f03-0a5c9d0dd588_b67a2722-b0ee-4063-9e87-7a4cf5f7ee41.jpg/250x188.webp>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'emission_standard': None,
 'engine': None,
 'engine_horse_power': 177,
 'expiration_date': None,
 'fuel_type': 'LPG',
 'id': '9817e074-0601-5a0d-bc19-cdcd75845073',
 'is_damaged': False,
 'is_operable': True,
 'license_plate': None,
 'link_to_web_offer': 'https://www.autoscout24.it/offers/cirelli-cirelli-5-premium-1-5l-benzina-gpl-177cv-only-promo-lpg-black-ac5d8737-5787-4b22-9f03-0a5c9d0dd588',
 'listing': 'auction',
 'make': 'Cirelli',
 'model': 'Cirelli 5',
 'odometer': 1,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 11,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9817e074-0601-5a0d-bc19-cdcd75845073/9817e074-0601-5a0d-bc19-cdcd75845073_image_0.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4788,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/ac5d8737-5787-4b22-9f03-0a5c9d0dd588_eb17b860-bacc-4982-b886-d6f51bcc46e7.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9817e074-0601-5a0d-bc19-cdcd75845073/9817e074-0601-5a0d-bc19-cdcd75845073_image_1.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5304,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/ac5d8737-5787-4b22-9f03-0a5c9d0dd588_3c8c9864-0c29-4457-ae8c-46137a4adeb2.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9817e074-0601-5a0d-bc19-cdcd75845073/9817e074-0601-5a0d-bc19-cdcd75845073_image_2.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5290,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/ac5d8737-5787-4b22-9f03-0a5c9d0dd588_98aa2934-5607-45af-ab30-035c852f6ee6.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9817e074-0601-5a0d-bc19-cdcd75845073/9817e074-0601-5a0d-bc19-cdcd75845073_image_3.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4996,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/ac5d8737-5787-4b22-9f03-0a5c9d0dd588_9265dd66-9675-40f6-9458-76a9303c61ce.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9817e074-0601-5a0d-bc19-cdcd75845073/9817e074-0601-5a0d-bc19-cdcd75845073_image_4.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 6292,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/ac5d8737-5787-4b22-9f03-0a5c9d0dd588_2dc81351-2896-4352-af92-ba5fe59e4026.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9817e074-0601-5a0d-bc19-cdcd75845073/9817e074-0601-5a0d-bc19-cdcd75845073_image_5.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 6722,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/ac5d8737-5787-4b22-9f03-0a5c9d0dd588_9c68b707-be07-4217-8d99-69911f8ced8c.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9817e074-0601-5a0d-bc19-cdcd75845073/9817e074-0601-5a0d-bc19-cdcd75845073_image_6.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 8726,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/ac5d8737-5787-4b22-9f03-0a5c9d0dd588_e3615347-628d-48c9-9dbe-e1ff4c0584f2.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9817e074-0601-5a0d-bc19-cdcd75845073/9817e074-0601-5a0d-bc19-cdcd75845073_image_7.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 7496,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/ac5d8737-5787-4b22-9f03-0a5c9d0dd588_5d5f5510-5564-4d09-95c0-9f58c9c78f86.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9817e074-0601-5a0d-bc19-cdcd75845073/9817e074-0601-5a0d-bc19-cdcd75845073_image_8.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4124,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/ac5d8737-5787-4b22-9f03-0a5c9d0dd588_269e52a5-d7d6-4937-9b8c-183a0df529d4.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9817e074-0601-5a0d-bc19-cdcd75845073/9817e074-0601-5a0d-bc19-cdcd75845073_image_9.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4348,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/ac5d8737-5787-4b22-9f03-0a5c9d0dd588_13e8e69f-ef11-458a-91db-75ae3d4db5a8.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9817e074-0601-5a0d-bc19-cdcd75845073/9817e074-0601-5a0d-bc19-cdcd75845073_image_10.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4718,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/ac5d8737-5787-4b22-9f03-0a5c9d0dd588_b67a2722-b0ee-4063-9e87-7a4cf5f7ee41.jpg/250x188.webp',
             'Width': 250}],
 'price': 31900,
 'price_includes_vat': False,
 'registration_date': '2025-11-01',
 'seller_name': None,
 'title': 'Cirelli Cirelli 5 PREMIUM 1.5L Benzina - GPL  177CV  ONLY PROMO!',
 'transmission': 'automatic',
 'trim': 'PREMIUM 1.5L Benzina - GPL  177CV  ONLY PROMO!',
 'vin': None,
 'year': 2025}
2025-12-05 11:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27ac5d8737-5787-4b22-9f03-0a5c9d0dd588%27 HTTP/1.1" 200 None
2025-12-05 11:59:38 [auto_selling_autoscout24.it] INFO: Saving data for ac5d8737-5787-4b22-9f03-0a5c9d0dd588: {'created_time': 1764935978.993333, 'last_price_update_time': 1764935978.993341}
2025-12-05 11:59:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autoscout24.it',RowKey='ac5d8737-5787-4b22-9f03-0a5c9d0dd588') HTTP/1.1" 204 0
2025-12-05 11:59:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/5f42cd06-f3c0-48f7-a659-632cf08861e2_0996937e-b9f0-479c-a73f-d07c8d4df19f.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/5f42cd06-f3c0-48f7-a659-632cf08861e2_59319f25-357c-4d8d-ad2e-f6d27ede8965.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27fa53e4d1-5d45-41fe-91be-1ef535dc6d02%27 HTTP/1.1" 200 None
2025-12-05 11:59:39 [auto_selling_autoscout24.it] INFO: Scrape type for fa53e4d1-5d45-41fe-91be-1ef535dc6d02: 1
2025-12-05 11:59:39 [auto_selling_autoscout24.it] INFO: Scraping new listing fa53e4d1-5d45-41fe-91be-1ef535dc6d02
2025-12-05 11:59:39 [auto_selling_autoscout24.it] INFO: Extracting item from listing ID: fa53e4d1-5d45-41fe-91be-1ef535dc6d02
2025-12-05 11:59:39 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b9f2420-9a07-5fb4-9b4b-ea2f64c929f9 with identifier: fa53e4d1-5d45-41fe-91be-1ef535dc6d02
2025-12-05 11:59:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 6b9f2420-9a07-5fb4-9b4b-ea2f64c929f9
2025-12-05 11:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Ffa53e4d1-5d45-41fe-91be-1ef535dc6d02_dfce937b-92e7-4b93-b777-532635748de2.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/fa53e4d1-5d45-41fe-91be-1ef535dc6d02_dfce937b-92e7-4b93-b777-532635748de2.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e73750>
2025-12-05 11:59:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 11:59:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cf9a6db-a910-5ad2-823f-0302e5ec6343/0cf9a6db-a910-5ad2-823f-0302e5ec6343_image_0.webp HTTP/1.1" 201 0
2025-12-05 11:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F5f42cd06-f3c0-48f7-a659-632cf08861e2_690a2944-9e6f-4301-856b-5f9d08600656.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/5f42cd06-f3c0-48f7-a659-632cf08861e2_690a2944-9e6f-4301-856b-5f9d08600656.jpg/250x188.webp saved to cache
2025-12-05 11:59:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0cf9a6db-a910-5ad2-823f-0302e5ec6343
2025-12-05 11:59:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/5f42cd06-f3c0-48f7-a659-632cf08861e2_210c7fd4-24c1-478b-9e05-f0e38e195d4d.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/5f42cd06-f3c0-48f7-a659-632cf08861e2_b03aafdc-31b1-473b-8019-d2ef244f42f2.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Ffa53e4d1-5d45-41fe-91be-1ef535dc6d02_e5e857cb-5868-4a0f-870d-07f9bc5ef45a.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/fa53e4d1-5d45-41fe-91be-1ef535dc6d02_e5e857cb-5868-4a0f-870d-07f9bc5ef45a.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Ffa53e4d1-5d45-41fe-91be-1ef535dc6d02_54f3548a-e26d-45c0-a56d-e37c24d01330.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/fa53e4d1-5d45-41fe-91be-1ef535dc6d02_54f3548a-e26d-45c0-a56d-e37c24d01330.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5c91fd0>
2025-12-05 11:59:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 11:59:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cf9a6db-a910-5ad2-823f-0302e5ec6343/0cf9a6db-a910-5ad2-823f-0302e5ec6343_image_1.webp HTTP/1.1" 201 0
2025-12-05 11:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F5f42cd06-f3c0-48f7-a659-632cf08861e2_0996937e-b9f0-479c-a73f-d07c8d4df19f.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/5f42cd06-f3c0-48f7-a659-632cf08861e2_0996937e-b9f0-479c-a73f-d07c8d4df19f.jpg/250x188.webp saved to cache
2025-12-05 11:59:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0cf9a6db-a910-5ad2-823f-0302e5ec6343
2025-12-05 11:59:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e41ed0>
2025-12-05 11:59:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 11:59:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cf9a6db-a910-5ad2-823f-0302e5ec6343/0cf9a6db-a910-5ad2-823f-0302e5ec6343_image_2.webp HTTP/1.1" 201 0
2025-12-05 11:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F5f42cd06-f3c0-48f7-a659-632cf08861e2_59319f25-357c-4d8d-ad2e-f6d27ede8965.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/5f42cd06-f3c0-48f7-a659-632cf08861e2_59319f25-357c-4d8d-ad2e-f6d27ede8965.jpg/250x188.webp saved to cache
2025-12-05 11:59:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0cf9a6db-a910-5ad2-823f-0302e5ec6343
2025-12-05 11:59:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/5f42cd06-f3c0-48f7-a659-632cf08861e2_ade6551b-a9ca-44cc-ad46-0f25f7e312ca.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/fa53e4d1-5d45-41fe-91be-1ef535dc6d02_dfce937b-92e7-4b93-b777-532635748de2.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Ffa53e4d1-5d45-41fe-91be-1ef535dc6d02_acad164c-d0a5-47da-8d26-c341b0a522da.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/fa53e4d1-5d45-41fe-91be-1ef535dc6d02_acad164c-d0a5-47da-8d26-c341b0a522da.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e049d0>
2025-12-05 11:59:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 11:59:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cf9a6db-a910-5ad2-823f-0302e5ec6343/0cf9a6db-a910-5ad2-823f-0302e5ec6343_image_3.webp HTTP/1.1" 201 0
2025-12-05 11:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F5f42cd06-f3c0-48f7-a659-632cf08861e2_210c7fd4-24c1-478b-9e05-f0e38e195d4d.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/5f42cd06-f3c0-48f7-a659-632cf08861e2_210c7fd4-24c1-478b-9e05-f0e38e195d4d.jpg/250x188.webp saved to cache
2025-12-05 11:59:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0cf9a6db-a910-5ad2-823f-0302e5ec6343
2025-12-05 11:59:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5c463d0>
2025-12-05 11:59:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 11:59:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cf9a6db-a910-5ad2-823f-0302e5ec6343/0cf9a6db-a910-5ad2-823f-0302e5ec6343_image_4.webp HTTP/1.1" 201 0
2025-12-05 11:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F5f42cd06-f3c0-48f7-a659-632cf08861e2_b03aafdc-31b1-473b-8019-d2ef244f42f2.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/5f42cd06-f3c0-48f7-a659-632cf08861e2_b03aafdc-31b1-473b-8019-d2ef244f42f2.jpg/250x188.webp saved to cache
2025-12-05 11:59:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0cf9a6db-a910-5ad2-823f-0302e5ec6343
2025-12-05 11:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Ffa53e4d1-5d45-41fe-91be-1ef535dc6d02_abdabead-1f41-42ee-b5f6-9ca635be8059.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/fa53e4d1-5d45-41fe-91be-1ef535dc6d02_abdabead-1f41-42ee-b5f6-9ca635be8059.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/fa53e4d1-5d45-41fe-91be-1ef535dc6d02_e5e857cb-5868-4a0f-870d-07f9bc5ef45a.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Ffa53e4d1-5d45-41fe-91be-1ef535dc6d02_5c244a26-1bb9-4e2c-8d3d-a5a768f55116.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/fa53e4d1-5d45-41fe-91be-1ef535dc6d02_5c244a26-1bb9-4e2c-8d3d-a5a768f55116.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5c76250>
2025-12-05 11:59:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 11:59:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cf9a6db-a910-5ad2-823f-0302e5ec6343/0cf9a6db-a910-5ad2-823f-0302e5ec6343_image_5.webp HTTP/1.1" 201 0
2025-12-05 11:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F5f42cd06-f3c0-48f7-a659-632cf08861e2_ade6551b-a9ca-44cc-ad46-0f25f7e312ca.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/5f42cd06-f3c0-48f7-a659-632cf08861e2_ade6551b-a9ca-44cc-ad46-0f25f7e312ca.jpg/250x188.webp saved to cache
2025-12-05 11:59:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0cf9a6db-a910-5ad2-823f-0302e5ec6343
2025-12-05 11:59:40 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 0cf9a6db-a910-5ad2-823f-0302e5ec6343 from tracking dictionaries
2025-12-05 11:59:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0cf9a6db-a910-5ad2-823f-0302e5ec6343 sending to next pipeline
2025-12-05 11:59:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e3b250>
2025-12-05 11:59:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 11:59:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b9f2420-9a07-5fb4-9b4b-ea2f64c929f9/6b9f2420-9a07-5fb4-9b4b-ea2f64c929f9_image_0.webp HTTP/1.1" 201 0
2025-12-05 11:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Ffa53e4d1-5d45-41fe-91be-1ef535dc6d02_dfce937b-92e7-4b93-b777-532635748de2.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/fa53e4d1-5d45-41fe-91be-1ef535dc6d02_dfce937b-92e7-4b93-b777-532635748de2.jpg/250x188.webp saved to cache
2025-12-05 11:59:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6b9f2420-9a07-5fb4-9b4b-ea2f64c929f9
2025-12-05 11:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Ffa53e4d1-5d45-41fe-91be-1ef535dc6d02_a21c088d-81b6-4188-a53b-50ba56d05607.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/fa53e4d1-5d45-41fe-91be-1ef535dc6d02_a21c088d-81b6-4188-a53b-50ba56d05607.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:40 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 0cf9a6db-a910-5ad2-823f-0302e5ec6343 with identifier 5f42cd06-f3c0-48f7-a659-632cf08861e2
2025-12-05 11:59:40 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 11:59:40 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 11:59:40 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 0cf9a6db-a910-5ad2-823f-0302e5ec6343
2025-12-05 11:59:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://prod.pictures.autoscout24.net/listing-images/5f42cd06-f3c0-48f7-a659-632cf08861e2_ade6551b-a9ca-44cc-ad46-0f25f7e312ca.jpg/250x188.webp>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'emission_standard': None,
 'engine': None,
 'engine_horse_power': 150,
 'expiration_date': None,
 'fuel_type': 'Gasoline',
 'id': '0cf9a6db-a910-5ad2-823f-0302e5ec6343',
 'is_damaged': False,
 'is_operable': True,
 'license_plate': None,
 'link_to_web_offer': 'https://www.autoscout24.it/offers/audi-a1-sportback-35-tfsi-150-cv-s-tronic-s-line-promo-gasoline-black-5f42cd06-f3c0-48f7-a659-632cf08861e2',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1',
 'odometer': 1,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cf9a6db-a910-5ad2-823f-0302e5ec6343/0cf9a6db-a910-5ad2-823f-0302e5ec6343_image_0.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3380,
             'Height': 146,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/5f42cd06-f3c0-48f7-a659-632cf08861e2_690a2944-9e6f-4301-856b-5f9d08600656.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cf9a6db-a910-5ad2-823f-0302e5ec6343/0cf9a6db-a910-5ad2-823f-0302e5ec6343_image_1.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 2154,
             'Height': 113,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/5f42cd06-f3c0-48f7-a659-632cf08861e2_0996937e-b9f0-479c-a73f-d07c8d4df19f.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cf9a6db-a910-5ad2-823f-0302e5ec6343/0cf9a6db-a910-5ad2-823f-0302e5ec6343_image_2.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 2924,
             'Height': 143,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/5f42cd06-f3c0-48f7-a659-632cf08861e2_59319f25-357c-4d8d-ad2e-f6d27ede8965.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cf9a6db-a910-5ad2-823f-0302e5ec6343/0cf9a6db-a910-5ad2-823f-0302e5ec6343_image_3.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3316,
             'Height': 164,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/5f42cd06-f3c0-48f7-a659-632cf08861e2_210c7fd4-24c1-478b-9e05-f0e38e195d4d.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cf9a6db-a910-5ad2-823f-0302e5ec6343/0cf9a6db-a910-5ad2-823f-0302e5ec6343_image_4.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3350,
             'Height': 167,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/5f42cd06-f3c0-48f7-a659-632cf08861e2_b03aafdc-31b1-473b-8019-d2ef244f42f2.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cf9a6db-a910-5ad2-823f-0302e5ec6343/0cf9a6db-a910-5ad2-823f-0302e5ec6343_image_5.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 2390,
             'Height': 161,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/5f42cd06-f3c0-48f7-a659-632cf08861e2_ade6551b-a9ca-44cc-ad46-0f25f7e312ca.jpg/250x188.webp',
             'Width': 250}],
 'price': 31900,
 'price_includes_vat': False,
 'registration_date': '2025-07-01',
 'seller_name': None,
 'title': 'Audi A1 SPORTBACK 35 TFSI 150 CV *S-TRONIC+S-LINE* PROMO!',
 'transmission': 'automatic',
 'trim': 'SPORTBACK 35 TFSI 150 CV *S-TRONIC+S-LINE* PROMO!',
 'vin': None,
 'year': 2025}
2025-12-05 11:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%275f42cd06-f3c0-48f7-a659-632cf08861e2%27 HTTP/1.1" 200 None
2025-12-05 11:59:40 [auto_selling_autoscout24.it] INFO: Saving data for 5f42cd06-f3c0-48f7-a659-632cf08861e2: {'created_time': 1764935980.977694, 'last_price_update_time': 1764935980.977705}
2025-12-05 11:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autoscout24.it',RowKey='5f42cd06-f3c0-48f7-a659-632cf08861e2') HTTP/1.1" 204 0
2025-12-05 11:59:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/fa53e4d1-5d45-41fe-91be-1ef535dc6d02_54f3548a-e26d-45c0-a56d-e37c24d01330.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/fa53e4d1-5d45-41fe-91be-1ef535dc6d02_acad164c-d0a5-47da-8d26-c341b0a522da.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Ffa53e4d1-5d45-41fe-91be-1ef535dc6d02_3c548530-e4f1-4730-bd6d-85f60d3fcc1a.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/fa53e4d1-5d45-41fe-91be-1ef535dc6d02_3c548530-e4f1-4730-bd6d-85f60d3fcc1a.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5c444d0>
2025-12-05 11:59:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 11:59:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b9f2420-9a07-5fb4-9b4b-ea2f64c929f9/6b9f2420-9a07-5fb4-9b4b-ea2f64c929f9_image_1.webp HTTP/1.1" 201 0
2025-12-05 11:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Ffa53e4d1-5d45-41fe-91be-1ef535dc6d02_e5e857cb-5868-4a0f-870d-07f9bc5ef45a.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/fa53e4d1-5d45-41fe-91be-1ef535dc6d02_e5e857cb-5868-4a0f-870d-07f9bc5ef45a.jpg/250x188.webp saved to cache
2025-12-05 11:59:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6b9f2420-9a07-5fb4-9b4b-ea2f64c929f9
2025-12-05 11:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Ffa53e4d1-5d45-41fe-91be-1ef535dc6d02_647f0735-b58b-429c-8eca-cf53c92ddd06.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/fa53e4d1-5d45-41fe-91be-1ef535dc6d02_647f0735-b58b-429c-8eca-cf53c92ddd06.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/fa53e4d1-5d45-41fe-91be-1ef535dc6d02_5c244a26-1bb9-4e2c-8d3d-a5a768f55116.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/fa53e4d1-5d45-41fe-91be-1ef535dc6d02_abdabead-1f41-42ee-b5f6-9ca635be8059.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Ffa53e4d1-5d45-41fe-91be-1ef535dc6d02_e6038935-5e18-43cc-9927-b1aae99ccf09.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/fa53e4d1-5d45-41fe-91be-1ef535dc6d02_e6038935-5e18-43cc-9927-b1aae99ccf09.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e3bd50>
2025-12-05 11:59:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 11:59:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b9f2420-9a07-5fb4-9b4b-ea2f64c929f9/6b9f2420-9a07-5fb4-9b4b-ea2f64c929f9_image_2.webp HTTP/1.1" 201 0
2025-12-05 11:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Ffa53e4d1-5d45-41fe-91be-1ef535dc6d02_54f3548a-e26d-45c0-a56d-e37c24d01330.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/fa53e4d1-5d45-41fe-91be-1ef535dc6d02_54f3548a-e26d-45c0-a56d-e37c24d01330.jpg/250x188.webp saved to cache
2025-12-05 11:59:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6b9f2420-9a07-5fb4-9b4b-ea2f64c929f9
2025-12-05 11:59:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9dc1ca290>
2025-12-05 11:59:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 11:59:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b9f2420-9a07-5fb4-9b4b-ea2f64c929f9/6b9f2420-9a07-5fb4-9b4b-ea2f64c929f9_image_3.webp HTTP/1.1" 201 0
2025-12-05 11:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Ffa53e4d1-5d45-41fe-91be-1ef535dc6d02_acad164c-d0a5-47da-8d26-c341b0a522da.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/fa53e4d1-5d45-41fe-91be-1ef535dc6d02_acad164c-d0a5-47da-8d26-c341b0a522da.jpg/250x188.webp saved to cache
2025-12-05 11:59:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6b9f2420-9a07-5fb4-9b4b-ea2f64c929f9
2025-12-05 11:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Ffa53e4d1-5d45-41fe-91be-1ef535dc6d02_6b1ecab7-c722-46ba-85f7-1d55948ab3b9.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/fa53e4d1-5d45-41fe-91be-1ef535dc6d02_6b1ecab7-c722-46ba-85f7-1d55948ab3b9.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/fa53e4d1-5d45-41fe-91be-1ef535dc6d02_3c548530-e4f1-4730-bd6d-85f60d3fcc1a.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/fa53e4d1-5d45-41fe-91be-1ef535dc6d02_a21c088d-81b6-4188-a53b-50ba56d05607.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Ffa53e4d1-5d45-41fe-91be-1ef535dc6d02_706fc049-74bb-46c8-9e66-e3ddead41484.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/fa53e4d1-5d45-41fe-91be-1ef535dc6d02_706fc049-74bb-46c8-9e66-e3ddead41484.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e94690>
2025-12-05 11:59:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 11:59:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b9f2420-9a07-5fb4-9b4b-ea2f64c929f9/6b9f2420-9a07-5fb4-9b4b-ea2f64c929f9_image_5.webp HTTP/1.1" 201 0
2025-12-05 11:59:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Ffa53e4d1-5d45-41fe-91be-1ef535dc6d02_5c244a26-1bb9-4e2c-8d3d-a5a768f55116.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/fa53e4d1-5d45-41fe-91be-1ef535dc6d02_5c244a26-1bb9-4e2c-8d3d-a5a768f55116.jpg/250x188.webp saved to cache
2025-12-05 11:59:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6b9f2420-9a07-5fb4-9b4b-ea2f64c929f9
2025-12-05 11:59:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5b36ed0>
2025-12-05 11:59:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 11:59:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b9f2420-9a07-5fb4-9b4b-ea2f64c929f9/6b9f2420-9a07-5fb4-9b4b-ea2f64c929f9_image_4.webp HTTP/1.1" 201 0
2025-12-05 11:59:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Ffa53e4d1-5d45-41fe-91be-1ef535dc6d02_abdabead-1f41-42ee-b5f6-9ca635be8059.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/fa53e4d1-5d45-41fe-91be-1ef535dc6d02_abdabead-1f41-42ee-b5f6-9ca635be8059.jpg/250x188.webp saved to cache
2025-12-05 11:59:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6b9f2420-9a07-5fb4-9b4b-ea2f64c929f9
2025-12-05 11:59:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Ffa53e4d1-5d45-41fe-91be-1ef535dc6d02_bc23241c-1440-4dfa-a20c-737b3f91a2b3.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/fa53e4d1-5d45-41fe-91be-1ef535dc6d02_bc23241c-1440-4dfa-a20c-737b3f91a2b3.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/fa53e4d1-5d45-41fe-91be-1ef535dc6d02_e6038935-5e18-43cc-9927-b1aae99ccf09.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/fa53e4d1-5d45-41fe-91be-1ef535dc6d02_647f0735-b58b-429c-8eca-cf53c92ddd06.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Ffa53e4d1-5d45-41fe-91be-1ef535dc6d02_da614f62-457b-4deb-8a9b-7af04f7f1292.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/fa53e4d1-5d45-41fe-91be-1ef535dc6d02_da614f62-457b-4deb-8a9b-7af04f7f1292.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5c93cd0>
2025-12-05 11:59:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 11:59:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b9f2420-9a07-5fb4-9b4b-ea2f64c929f9/6b9f2420-9a07-5fb4-9b4b-ea2f64c929f9_image_7.webp HTTP/1.1" 201 0
2025-12-05 11:59:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Ffa53e4d1-5d45-41fe-91be-1ef535dc6d02_3c548530-e4f1-4730-bd6d-85f60d3fcc1a.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/fa53e4d1-5d45-41fe-91be-1ef535dc6d02_3c548530-e4f1-4730-bd6d-85f60d3fcc1a.jpg/250x188.webp saved to cache
2025-12-05 11:59:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6b9f2420-9a07-5fb4-9b4b-ea2f64c929f9
2025-12-05 11:59:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e4c390>
2025-12-05 11:59:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 11:59:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b9f2420-9a07-5fb4-9b4b-ea2f64c929f9/6b9f2420-9a07-5fb4-9b4b-ea2f64c929f9_image_6.webp HTTP/1.1" 201 0
2025-12-05 11:59:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Ffa53e4d1-5d45-41fe-91be-1ef535dc6d02_a21c088d-81b6-4188-a53b-50ba56d05607.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/fa53e4d1-5d45-41fe-91be-1ef535dc6d02_a21c088d-81b6-4188-a53b-50ba56d05607.jpg/250x188.webp saved to cache
2025-12-05 11:59:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6b9f2420-9a07-5fb4-9b4b-ea2f64c929f9
2025-12-05 11:59:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/fa53e4d1-5d45-41fe-91be-1ef535dc6d02_6b1ecab7-c722-46ba-85f7-1d55948ab3b9.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/fa53e4d1-5d45-41fe-91be-1ef535dc6d02_706fc049-74bb-46c8-9e66-e3ddead41484.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Ffa53e4d1-5d45-41fe-91be-1ef535dc6d02_b06c4fe5-a8fd-4915-97d8-30b5a5b3e824.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/fa53e4d1-5d45-41fe-91be-1ef535dc6d02_b06c4fe5-a8fd-4915-97d8-30b5a5b3e824.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9dc1953d0>
2025-12-05 11:59:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 11:59:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b9f2420-9a07-5fb4-9b4b-ea2f64c929f9/6b9f2420-9a07-5fb4-9b4b-ea2f64c929f9_image_9.webp HTTP/1.1" 201 0
2025-12-05 11:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Ffa53e4d1-5d45-41fe-91be-1ef535dc6d02_e6038935-5e18-43cc-9927-b1aae99ccf09.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/fa53e4d1-5d45-41fe-91be-1ef535dc6d02_e6038935-5e18-43cc-9927-b1aae99ccf09.jpg/250x188.webp saved to cache
2025-12-05 11:59:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6b9f2420-9a07-5fb4-9b4b-ea2f64c929f9
2025-12-05 11:59:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e7c550>
2025-12-05 11:59:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 11:59:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b9f2420-9a07-5fb4-9b4b-ea2f64c929f9/6b9f2420-9a07-5fb4-9b4b-ea2f64c929f9_image_8.webp HTTP/1.1" 201 0
2025-12-05 11:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Ffa53e4d1-5d45-41fe-91be-1ef535dc6d02_647f0735-b58b-429c-8eca-cf53c92ddd06.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/fa53e4d1-5d45-41fe-91be-1ef535dc6d02_647f0735-b58b-429c-8eca-cf53c92ddd06.jpg/250x188.webp saved to cache
2025-12-05 11:59:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6b9f2420-9a07-5fb4-9b4b-ea2f64c929f9
2025-12-05 11:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27b06416dd-93c4-4ada-80e0-eb78f469210e%27 HTTP/1.1" 200 None
2025-12-05 11:59:43 [auto_selling_autoscout24.it] INFO: Scrape type for b06416dd-93c4-4ada-80e0-eb78f469210e: 1
2025-12-05 11:59:43 [auto_selling_autoscout24.it] INFO: Scraping new listing b06416dd-93c4-4ada-80e0-eb78f469210e
2025-12-05 11:59:43 [auto_selling_autoscout24.it] INFO: Extracting item from listing ID: b06416dd-93c4-4ada-80e0-eb78f469210e
2025-12-05 11:59:43 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: e0213dca-13b8-569f-aea0-a41701116f2d with identifier: b06416dd-93c4-4ada-80e0-eb78f469210e
2025-12-05 11:59:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item e0213dca-13b8-569f-aea0-a41701116f2d
2025-12-05 11:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fb06416dd-93c4-4ada-80e0-eb78f469210e_ad7ae0f2-723e-4ff0-8588-5880edb16fad.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/b06416dd-93c4-4ada-80e0-eb78f469210e_ad7ae0f2-723e-4ff0-8588-5880edb16fad.jpg/250x188.webp already downloaded
2025-12-05 11:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fb06416dd-93c4-4ada-80e0-eb78f469210e_1e5916b2-d35a-42aa-872b-56c0d15427d7.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/b06416dd-93c4-4ada-80e0-eb78f469210e_1e5916b2-d35a-42aa-872b-56c0d15427d7.jpg/250x188.webp already downloaded
2025-12-05 11:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fb06416dd-93c4-4ada-80e0-eb78f469210e_23dd6877-8570-4226-b804-982ff9400613.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/b06416dd-93c4-4ada-80e0-eb78f469210e_23dd6877-8570-4226-b804-982ff9400613.jpg/250x188.webp already downloaded
2025-12-05 11:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fb06416dd-93c4-4ada-80e0-eb78f469210e_feadd56d-d963-4e59-8089-f561eb26fcec.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/b06416dd-93c4-4ada-80e0-eb78f469210e_feadd56d-d963-4e59-8089-f561eb26fcec.jpg/250x188.webp already downloaded
2025-12-05 11:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fb06416dd-93c4-4ada-80e0-eb78f469210e_84184702-80cd-47eb-ad42-41a8f923f6db.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/b06416dd-93c4-4ada-80e0-eb78f469210e_84184702-80cd-47eb-ad42-41a8f923f6db.jpg/250x188.webp already downloaded
2025-12-05 11:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fb06416dd-93c4-4ada-80e0-eb78f469210e_1a3def7e-15db-498c-a243-d75f86d7ff6a.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/b06416dd-93c4-4ada-80e0-eb78f469210e_1a3def7e-15db-498c-a243-d75f86d7ff6a.jpg/250x188.webp already downloaded
2025-12-05 11:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fb06416dd-93c4-4ada-80e0-eb78f469210e_bf86ebdf-d814-4975-941a-75be1314c134.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/b06416dd-93c4-4ada-80e0-eb78f469210e_bf86ebdf-d814-4975-941a-75be1314c134.jpg/250x188.webp already downloaded
2025-12-05 11:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fb06416dd-93c4-4ada-80e0-eb78f469210e_fa108277-b85d-4fa7-a1d8-45851f758b5c.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/b06416dd-93c4-4ada-80e0-eb78f469210e_fa108277-b85d-4fa7-a1d8-45851f758b5c.jpg/250x188.webp already downloaded
2025-12-05 11:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fb06416dd-93c4-4ada-80e0-eb78f469210e_a5d15209-d336-4ceb-9675-a4e44955740c.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/b06416dd-93c4-4ada-80e0-eb78f469210e_a5d15209-d336-4ceb-9675-a4e44955740c.jpg/250x188.webp already downloaded
2025-12-05 11:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fb06416dd-93c4-4ada-80e0-eb78f469210e_b4c6fae9-d0f5-4c8e-bc40-5961ca778f1c.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/b06416dd-93c4-4ada-80e0-eb78f469210e_b4c6fae9-d0f5-4c8e-bc40-5961ca778f1c.jpg/250x188.webp already downloaded
2025-12-05 11:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fb06416dd-93c4-4ada-80e0-eb78f469210e_6c661ee9-a92e-45c2-bb89-d1eaee45533b.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/b06416dd-93c4-4ada-80e0-eb78f469210e_6c661ee9-a92e-45c2-bb89-d1eaee45533b.jpg/250x188.webp already downloaded
2025-12-05 11:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fb06416dd-93c4-4ada-80e0-eb78f469210e_ef413740-e975-431e-bc0e-c1589dfae003.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/b06416dd-93c4-4ada-80e0-eb78f469210e_ef413740-e975-431e-bc0e-c1589dfae003.jpg/250x188.webp already downloaded
2025-12-05 11:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fb06416dd-93c4-4ada-80e0-eb78f469210e_c3da76ec-eb04-43fb-bdac-a9427d2e438f.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/b06416dd-93c4-4ada-80e0-eb78f469210e_c3da76ec-eb04-43fb-bdac-a9427d2e438f.jpg/250x188.webp already downloaded
2025-12-05 11:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fb06416dd-93c4-4ada-80e0-eb78f469210e_b18329ad-10ea-41a6-8f40-239b7f527c68.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/b06416dd-93c4-4ada-80e0-eb78f469210e_b18329ad-10ea-41a6-8f40-239b7f527c68.jpg/250x188.webp already downloaded
2025-12-05 11:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fb06416dd-93c4-4ada-80e0-eb78f469210e_e1667239-4ccc-45f5-a889-975536a76197.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/b06416dd-93c4-4ada-80e0-eb78f469210e_e1667239-4ccc-45f5-a889-975536a76197.jpg/250x188.webp already downloaded
2025-12-05 11:59:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/fa53e4d1-5d45-41fe-91be-1ef535dc6d02_bc23241c-1440-4dfa-a20c-737b3f91a2b3.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:43 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: e0213dca-13b8-569f-aea0-a41701116f2d with identifier b06416dd-93c4-4ada-80e0-eb78f469210e
2025-12-05 11:59:43 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 11:59:43 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 11:59:43 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item e0213dca-13b8-569f-aea0-a41701116f2d
2025-12-05 11:59:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autoscout24.it/api/dealer-detail/fetch-listings>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'emission_standard': None,
 'engine': None,
 'engine_horse_power': 158,
 'expiration_date': None,
 'fuel_type': 'Electric/Gasoline',
 'id': 'e0213dca-13b8-569f-aea0-a41701116f2d',
 'is_damaged': False,
 'is_operable': True,
 'license_plate': None,
 'link_to_web_offer': 'https://www.autoscout24.it/offers/nissan-qashqai-1-3-m-hev-x-tronic-n-connecta-158cv-only-promo-electric-gasoline-grey-b06416dd-93c4-4ada-80e0-eb78f469210e',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 24500,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://prod.pictures.autoscout24.net/listing-images/b06416dd-93c4-4ada-80e0-eb78f469210e_ad7ae0f2-723e-4ff0-8588-5880edb16fad.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/b06416dd-93c4-4ada-80e0-eb78f469210e_1e5916b2-d35a-42aa-872b-56c0d15427d7.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/b06416dd-93c4-4ada-80e0-eb78f469210e_23dd6877-8570-4226-b804-982ff9400613.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/b06416dd-93c4-4ada-80e0-eb78f469210e_feadd56d-d963-4e59-8089-f561eb26fcec.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/b06416dd-93c4-4ada-80e0-eb78f469210e_84184702-80cd-47eb-ad42-41a8f923f6db.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/b06416dd-93c4-4ada-80e0-eb78f469210e_1a3def7e-15db-498c-a243-d75f86d7ff6a.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/b06416dd-93c4-4ada-80e0-eb78f469210e_bf86ebdf-d814-4975-941a-75be1314c134.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/b06416dd-93c4-4ada-80e0-eb78f469210e_fa108277-b85d-4fa7-a1d8-45851f758b5c.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/b06416dd-93c4-4ada-80e0-eb78f469210e_a5d15209-d336-4ceb-9675-a4e44955740c.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/b06416dd-93c4-4ada-80e0-eb78f469210e_b4c6fae9-d0f5-4c8e-bc40-5961ca778f1c.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/b06416dd-93c4-4ada-80e0-eb78f469210e_6c661ee9-a92e-45c2-bb89-d1eaee45533b.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/b06416dd-93c4-4ada-80e0-eb78f469210e_ef413740-e975-431e-bc0e-c1589dfae003.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/b06416dd-93c4-4ada-80e0-eb78f469210e_c3da76ec-eb04-43fb-bdac-a9427d2e438f.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/b06416dd-93c4-4ada-80e0-eb78f469210e_b18329ad-10ea-41a6-8f40-239b7f527c68.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/b06416dd-93c4-4ada-80e0-eb78f469210e_e1667239-4ccc-45f5-a889-975536a76197.jpg/250x188.webp'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01fe8dcd-c7e8-54d7-8b15-d716bd7d2e2b/01fe8dcd-c7e8-54d7-8b15-d716bd7d2e2b_image_0.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4560,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/b06416dd-93c4-4ada-80e0-eb78f469210e_ad7ae0f2-723e-4ff0-8588-5880edb16fad.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01fe8dcd-c7e8-54d7-8b15-d716bd7d2e2b/01fe8dcd-c7e8-54d7-8b15-d716bd7d2e2b_image_1.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4810,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/b06416dd-93c4-4ada-80e0-eb78f469210e_1e5916b2-d35a-42aa-872b-56c0d15427d7.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01fe8dcd-c7e8-54d7-8b15-d716bd7d2e2b/01fe8dcd-c7e8-54d7-8b15-d716bd7d2e2b_image_2.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4634,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/b06416dd-93c4-4ada-80e0-eb78f469210e_23dd6877-8570-4226-b804-982ff9400613.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01fe8dcd-c7e8-54d7-8b15-d716bd7d2e2b/01fe8dcd-c7e8-54d7-8b15-d716bd7d2e2b_image_3.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4664,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/b06416dd-93c4-4ada-80e0-eb78f469210e_feadd56d-d963-4e59-8089-f561eb26fcec.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01fe8dcd-c7e8-54d7-8b15-d716bd7d2e2b/01fe8dcd-c7e8-54d7-8b15-d716bd7d2e2b_image_4.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5446,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/b06416dd-93c4-4ada-80e0-eb78f469210e_84184702-80cd-47eb-ad42-41a8f923f6db.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01fe8dcd-c7e8-54d7-8b15-d716bd7d2e2b/01fe8dcd-c7e8-54d7-8b15-d716bd7d2e2b_image_5.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5410,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/b06416dd-93c4-4ada-80e0-eb78f469210e_1a3def7e-15db-498c-a243-d75f86d7ff6a.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01fe8dcd-c7e8-54d7-8b15-d716bd7d2e2b/01fe8dcd-c7e8-54d7-8b15-d716bd7d2e2b_image_6.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 7528,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/b06416dd-93c4-4ada-80e0-eb78f469210e_bf86ebdf-d814-4975-941a-75be1314c134.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01fe8dcd-c7e8-54d7-8b15-d716bd7d2e2b/01fe8dcd-c7e8-54d7-8b15-d716bd7d2e2b_image_7.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5014,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/b06416dd-93c4-4ada-80e0-eb78f469210e_fa108277-b85d-4fa7-a1d8-45851f758b5c.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01fe8dcd-c7e8-54d7-8b15-d716bd7d2e2b/01fe8dcd-c7e8-54d7-8b15-d716bd7d2e2b_image_8.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4554,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/b06416dd-93c4-4ada-80e0-eb78f469210e_a5d15209-d336-4ceb-9675-a4e44955740c.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01fe8dcd-c7e8-54d7-8b15-d716bd7d2e2b/01fe8dcd-c7e8-54d7-8b15-d716bd7d2e2b_image_9.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3578,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/b06416dd-93c4-4ada-80e0-eb78f469210e_b4c6fae9-d0f5-4c8e-bc40-5961ca778f1c.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01fe8dcd-c7e8-54d7-8b15-d716bd7d2e2b/01fe8dcd-c7e8-54d7-8b15-d716bd7d2e2b_image_10.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4838,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/b06416dd-93c4-4ada-80e0-eb78f469210e_6c661ee9-a92e-45c2-bb89-d1eaee45533b.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01fe8dcd-c7e8-54d7-8b15-d716bd7d2e2b/01fe8dcd-c7e8-54d7-8b15-d716bd7d2e2b_image_11.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4296,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/b06416dd-93c4-4ada-80e0-eb78f469210e_ef413740-e975-431e-bc0e-c1589dfae003.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01fe8dcd-c7e8-54d7-8b15-d716bd7d2e2b/01fe8dcd-c7e8-54d7-8b15-d716bd7d2e2b_image_12.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5746,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/b06416dd-93c4-4ada-80e0-eb78f469210e_c3da76ec-eb04-43fb-bdac-a9427d2e438f.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01fe8dcd-c7e8-54d7-8b15-d716bd7d2e2b/01fe8dcd-c7e8-54d7-8b15-d716bd7d2e2b_image_13.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5958,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/b06416dd-93c4-4ada-80e0-eb78f469210e_b18329ad-10ea-41a6-8f40-239b7f527c68.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01fe8dcd-c7e8-54d7-8b15-d716bd7d2e2b/01fe8dcd-c7e8-54d7-8b15-d716bd7d2e2b_image_14.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4176,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/b06416dd-93c4-4ada-80e0-eb78f469210e_e1667239-4ccc-45f5-a889-975536a76197.jpg/250x188.webp',
             'Width': 250}],
 'price': 25800,
 'price_includes_vat': False,
 'registration_date': '2024-03-01',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.3 M-HEV X-TRONIC N-CONNECTA 158CV ONLY PROMO!',
 'transmission': 'automatic',
 'trim': '1.3 M-HEV X-TRONIC N-CONNECTA 158CV ONLY PROMO!',
 'vin': None,
 'year': 2024}
2025-12-05 11:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27b06416dd-93c4-4ada-80e0-eb78f469210e%27 HTTP/1.1" 200 None
2025-12-05 11:59:43 [auto_selling_autoscout24.it] INFO: Saving data for b06416dd-93c4-4ada-80e0-eb78f469210e: {'created_time': 1764935983.851374, 'last_price_update_time': 1764935983.851385}
2025-12-05 11:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autoscout24.it',RowKey='b06416dd-93c4-4ada-80e0-eb78f469210e') HTTP/1.1" 204 0
2025-12-05 11:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27f50df5f6-6b46-46d1-86ff-4629a0a148c2%27 HTTP/1.1" 200 None
2025-12-05 11:59:43 [auto_selling_autoscout24.it] INFO: Scrape type for f50df5f6-6b46-46d1-86ff-4629a0a148c2: 1
2025-12-05 11:59:43 [auto_selling_autoscout24.it] INFO: Scraping new listing f50df5f6-6b46-46d1-86ff-4629a0a148c2
2025-12-05 11:59:43 [auto_selling_autoscout24.it] INFO: Extracting item from listing ID: f50df5f6-6b46-46d1-86ff-4629a0a148c2
2025-12-05 11:59:43 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: dfc53ae2-3d8c-5ca1-8a79-808643e82cf8 with identifier: f50df5f6-6b46-46d1-86ff-4629a0a148c2
2025-12-05 11:59:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 4 photos for item dfc53ae2-3d8c-5ca1-8a79-808643e82cf8
2025-12-05 11:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Ff50df5f6-6b46-46d1-86ff-4629a0a148c2_0e83e95c-e067-46ec-aec1-15fe100f72d4.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/f50df5f6-6b46-46d1-86ff-4629a0a148c2_0e83e95c-e067-46ec-aec1-15fe100f72d4.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5c7af90>
2025-12-05 11:59:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 11:59:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b9f2420-9a07-5fb4-9b4b-ea2f64c929f9/6b9f2420-9a07-5fb4-9b4b-ea2f64c929f9_image_10.webp HTTP/1.1" 201 0
2025-12-05 11:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Ffa53e4d1-5d45-41fe-91be-1ef535dc6d02_6b1ecab7-c722-46ba-85f7-1d55948ab3b9.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/fa53e4d1-5d45-41fe-91be-1ef535dc6d02_6b1ecab7-c722-46ba-85f7-1d55948ab3b9.jpg/250x188.webp saved to cache
2025-12-05 11:59:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 6b9f2420-9a07-5fb4-9b4b-ea2f64c929f9
2025-12-05 11:59:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e7e190>
2025-12-05 11:59:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 11:59:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b9f2420-9a07-5fb4-9b4b-ea2f64c929f9/6b9f2420-9a07-5fb4-9b4b-ea2f64c929f9_image_11.webp HTTP/1.1" 201 0
2025-12-05 11:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Ffa53e4d1-5d45-41fe-91be-1ef535dc6d02_706fc049-74bb-46c8-9e66-e3ddead41484.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/fa53e4d1-5d45-41fe-91be-1ef535dc6d02_706fc049-74bb-46c8-9e66-e3ddead41484.jpg/250x188.webp saved to cache
2025-12-05 11:59:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 6b9f2420-9a07-5fb4-9b4b-ea2f64c929f9
2025-12-05 11:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Ff50df5f6-6b46-46d1-86ff-4629a0a148c2_25151391-378e-4852-ad13-678c096c84d4.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/f50df5f6-6b46-46d1-86ff-4629a0a148c2_25151391-378e-4852-ad13-678c096c84d4.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/fa53e4d1-5d45-41fe-91be-1ef535dc6d02_da614f62-457b-4deb-8a9b-7af04f7f1292.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/fa53e4d1-5d45-41fe-91be-1ef535dc6d02_b06c4fe5-a8fd-4915-97d8-30b5a5b3e824.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Ff50df5f6-6b46-46d1-86ff-4629a0a148c2_88f1de4c-7e25-4ae9-8e77-3425e429d709.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/f50df5f6-6b46-46d1-86ff-4629a0a148c2_88f1de4c-7e25-4ae9-8e77-3425e429d709.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e6edd0>
2025-12-05 11:59:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 11:59:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b9f2420-9a07-5fb4-9b4b-ea2f64c929f9/6b9f2420-9a07-5fb4-9b4b-ea2f64c929f9_image_12.webp HTTP/1.1" 201 0
2025-12-05 11:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Ffa53e4d1-5d45-41fe-91be-1ef535dc6d02_bc23241c-1440-4dfa-a20c-737b3f91a2b3.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/fa53e4d1-5d45-41fe-91be-1ef535dc6d02_bc23241c-1440-4dfa-a20c-737b3f91a2b3.jpg/250x188.webp saved to cache
2025-12-05 11:59:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 6b9f2420-9a07-5fb4-9b4b-ea2f64c929f9
2025-12-05 11:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Ff50df5f6-6b46-46d1-86ff-4629a0a148c2_d15bf7d2-2d92-4c67-bf7e-d29406829e77.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/f50df5f6-6b46-46d1-86ff-4629a0a148c2_d15bf7d2-2d92-4c67-bf7e-d29406829e77.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/f50df5f6-6b46-46d1-86ff-4629a0a148c2_0e83e95c-e067-46ec-aec1-15fe100f72d4.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27ca8d1a6f-6de9-41d7-bd9a-194c2e0ceb79%27 HTTP/1.1" 200 None
2025-12-05 11:59:44 [auto_selling_autoscout24.it] INFO: Scrape type for ca8d1a6f-6de9-41d7-bd9a-194c2e0ceb79: 1
2025-12-05 11:59:44 [auto_selling_autoscout24.it] INFO: Scraping new listing ca8d1a6f-6de9-41d7-bd9a-194c2e0ceb79
2025-12-05 11:59:44 [auto_selling_autoscout24.it] INFO: Extracting item from listing ID: ca8d1a6f-6de9-41d7-bd9a-194c2e0ceb79
2025-12-05 11:59:44 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f2f859c-ef70-5d9e-ab7d-be685bc06cc3 with identifier: ca8d1a6f-6de9-41d7-bd9a-194c2e0ceb79
2025-12-05 11:59:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 13 photos for item 6f2f859c-ef70-5d9e-ab7d-be685bc06cc3
2025-12-05 11:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fca8d1a6f-6de9-41d7-bd9a-194c2e0ceb79_f10f68ca-b853-4bbb-ad9a-b1962b4ea395.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/ca8d1a6f-6de9-41d7-bd9a-194c2e0ceb79_f10f68ca-b853-4bbb-ad9a-b1962b4ea395.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5cafdd0>
2025-12-05 11:59:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 11:59:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b9f2420-9a07-5fb4-9b4b-ea2f64c929f9/6b9f2420-9a07-5fb4-9b4b-ea2f64c929f9_image_13.webp HTTP/1.1" 201 0
2025-12-05 11:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Ffa53e4d1-5d45-41fe-91be-1ef535dc6d02_da614f62-457b-4deb-8a9b-7af04f7f1292.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/fa53e4d1-5d45-41fe-91be-1ef535dc6d02_da614f62-457b-4deb-8a9b-7af04f7f1292.jpg/250x188.webp saved to cache
2025-12-05 11:59:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 6b9f2420-9a07-5fb4-9b4b-ea2f64c929f9
2025-12-05 11:59:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e40c10>
2025-12-05 11:59:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 11:59:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b9f2420-9a07-5fb4-9b4b-ea2f64c929f9/6b9f2420-9a07-5fb4-9b4b-ea2f64c929f9_image_14.webp HTTP/1.1" 201 0
2025-12-05 11:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Ffa53e4d1-5d45-41fe-91be-1ef535dc6d02_b06c4fe5-a8fd-4915-97d8-30b5a5b3e824.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/fa53e4d1-5d45-41fe-91be-1ef535dc6d02_b06c4fe5-a8fd-4915-97d8-30b5a5b3e824.jpg/250x188.webp saved to cache
2025-12-05 11:59:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 6b9f2420-9a07-5fb4-9b4b-ea2f64c929f9
2025-12-05 11:59:45 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 6b9f2420-9a07-5fb4-9b4b-ea2f64c929f9 from tracking dictionaries
2025-12-05 11:59:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6b9f2420-9a07-5fb4-9b4b-ea2f64c929f9 sending to next pipeline
2025-12-05 11:59:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/f50df5f6-6b46-46d1-86ff-4629a0a148c2_25151391-378e-4852-ad13-678c096c84d4.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fca8d1a6f-6de9-41d7-bd9a-194c2e0ceb79_00267de3-ad57-40b8-8bf4-808597261ac4.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/ca8d1a6f-6de9-41d7-bd9a-194c2e0ceb79_00267de3-ad57-40b8-8bf4-808597261ac4.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:45 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 6b9f2420-9a07-5fb4-9b4b-ea2f64c929f9 with identifier fa53e4d1-5d45-41fe-91be-1ef535dc6d02
2025-12-05 11:59:45 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 11:59:45 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 11:59:45 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 6b9f2420-9a07-5fb4-9b4b-ea2f64c929f9
2025-12-05 11:59:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://prod.pictures.autoscout24.net/listing-images/fa53e4d1-5d45-41fe-91be-1ef535dc6d02_b06c4fe5-a8fd-4915-97d8-30b5a5b3e824.jpg/250x188.webp>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'emission_standard': None,
 'engine': None,
 'engine_horse_power': 204,
 'expiration_date': None,
 'fuel_type': 'Electric/Diesel',
 'id': '6b9f2420-9a07-5fb4-9b4b-ea2f64c929f9',
 'is_damaged': False,
 'is_operable': True,
 'license_plate': None,
 'link_to_web_offer': 'https://www.autoscout24.it/offers/audi-a5-avant-s-line-tdi-s-tronic-my25-204cv-only-promo-electric-diesel-white-fa53e4d1-5d45-41fe-91be-1ef535dc6d02',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5',
 'odometer': 1,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b9f2420-9a07-5fb4-9b4b-ea2f64c929f9/6b9f2420-9a07-5fb4-9b4b-ea2f64c929f9_image_0.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3634,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/fa53e4d1-5d45-41fe-91be-1ef535dc6d02_dfce937b-92e7-4b93-b777-532635748de2.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b9f2420-9a07-5fb4-9b4b-ea2f64c929f9/6b9f2420-9a07-5fb4-9b4b-ea2f64c929f9_image_1.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3328,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/fa53e4d1-5d45-41fe-91be-1ef535dc6d02_e5e857cb-5868-4a0f-870d-07f9bc5ef45a.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b9f2420-9a07-5fb4-9b4b-ea2f64c929f9/6b9f2420-9a07-5fb4-9b4b-ea2f64c929f9_image_2.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3624,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/fa53e4d1-5d45-41fe-91be-1ef535dc6d02_54f3548a-e26d-45c0-a56d-e37c24d01330.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b9f2420-9a07-5fb4-9b4b-ea2f64c929f9/6b9f2420-9a07-5fb4-9b4b-ea2f64c929f9_image_3.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3556,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/fa53e4d1-5d45-41fe-91be-1ef535dc6d02_acad164c-d0a5-47da-8d26-c341b0a522da.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b9f2420-9a07-5fb4-9b4b-ea2f64c929f9/6b9f2420-9a07-5fb4-9b4b-ea2f64c929f9_image_4.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3494,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/fa53e4d1-5d45-41fe-91be-1ef535dc6d02_abdabead-1f41-42ee-b5f6-9ca635be8059.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b9f2420-9a07-5fb4-9b4b-ea2f64c929f9/6b9f2420-9a07-5fb4-9b4b-ea2f64c929f9_image_5.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3912,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/fa53e4d1-5d45-41fe-91be-1ef535dc6d02_5c244a26-1bb9-4e2c-8d3d-a5a768f55116.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b9f2420-9a07-5fb4-9b4b-ea2f64c929f9/6b9f2420-9a07-5fb4-9b4b-ea2f64c929f9_image_6.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 6314,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/fa53e4d1-5d45-41fe-91be-1ef535dc6d02_a21c088d-81b6-4188-a53b-50ba56d05607.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b9f2420-9a07-5fb4-9b4b-ea2f64c929f9/6b9f2420-9a07-5fb4-9b4b-ea2f64c929f9_image_7.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5992,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/fa53e4d1-5d45-41fe-91be-1ef535dc6d02_3c548530-e4f1-4730-bd6d-85f60d3fcc1a.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b9f2420-9a07-5fb4-9b4b-ea2f64c929f9/6b9f2420-9a07-5fb4-9b4b-ea2f64c929f9_image_8.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5866,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/fa53e4d1-5d45-41fe-91be-1ef535dc6d02_647f0735-b58b-429c-8eca-cf53c92ddd06.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b9f2420-9a07-5fb4-9b4b-ea2f64c929f9/6b9f2420-9a07-5fb4-9b4b-ea2f64c929f9_image_9.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 6068,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/fa53e4d1-5d45-41fe-91be-1ef535dc6d02_e6038935-5e18-43cc-9927-b1aae99ccf09.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b9f2420-9a07-5fb4-9b4b-ea2f64c929f9/6b9f2420-9a07-5fb4-9b4b-ea2f64c929f9_image_10.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 6136,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/fa53e4d1-5d45-41fe-91be-1ef535dc6d02_6b1ecab7-c722-46ba-85f7-1d55948ab3b9.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b9f2420-9a07-5fb4-9b4b-ea2f64c929f9/6b9f2420-9a07-5fb4-9b4b-ea2f64c929f9_image_11.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4640,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/fa53e4d1-5d45-41fe-91be-1ef535dc6d02_706fc049-74bb-46c8-9e66-e3ddead41484.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b9f2420-9a07-5fb4-9b4b-ea2f64c929f9/6b9f2420-9a07-5fb4-9b4b-ea2f64c929f9_image_12.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4624,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/fa53e4d1-5d45-41fe-91be-1ef535dc6d02_bc23241c-1440-4dfa-a20c-737b3f91a2b3.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b9f2420-9a07-5fb4-9b4b-ea2f64c929f9/6b9f2420-9a07-5fb4-9b4b-ea2f64c929f9_image_13.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3720,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/fa53e4d1-5d45-41fe-91be-1ef535dc6d02_da614f62-457b-4deb-8a9b-7af04f7f1292.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b9f2420-9a07-5fb4-9b4b-ea2f64c929f9/6b9f2420-9a07-5fb4-9b4b-ea2f64c929f9_image_14.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 6850,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/fa53e4d1-5d45-41fe-91be-1ef535dc6d02_b06c4fe5-a8fd-4915-97d8-30b5a5b3e824.jpg/250x188.webp',
             'Width': 250}],
 'price': 55900,
 'price_includes_vat': False,
 'registration_date': '2025-09-01',
 'seller_name': None,
 'title': 'Audi A5 AVANT S-LINE TDI S-TRONIC MY25 204CV ONLY PROMO!',
 'transmission': 'automatic',
 'trim': 'AVANT S-LINE TDI S-TRONIC MY25 204CV ONLY PROMO!',
 'vin': None,
 'year': 2025}
2025-12-05 11:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27fa53e4d1-5d45-41fe-91be-1ef535dc6d02%27 HTTP/1.1" 200 None
2025-12-05 11:59:45 [auto_selling_autoscout24.it] INFO: Saving data for fa53e4d1-5d45-41fe-91be-1ef535dc6d02: {'created_time': 1764935985.893703, 'last_price_update_time': 1764935985.893713}
2025-12-05 11:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autoscout24.it',RowKey='fa53e4d1-5d45-41fe-91be-1ef535dc6d02') HTTP/1.1" 204 0
2025-12-05 11:59:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/f50df5f6-6b46-46d1-86ff-4629a0a148c2_88f1de4c-7e25-4ae9-8e77-3425e429d709.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fca8d1a6f-6de9-41d7-bd9a-194c2e0ceb79_f0eb177e-620f-421c-9b07-34580b97e424.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/ca8d1a6f-6de9-41d7-bd9a-194c2e0ceb79_f0eb177e-620f-421c-9b07-34580b97e424.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e4cf50>
2025-12-05 11:59:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 11:59:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfc53ae2-3d8c-5ca1-8a79-808643e82cf8/dfc53ae2-3d8c-5ca1-8a79-808643e82cf8_image_0.webp HTTP/1.1" 201 0
2025-12-05 11:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Ff50df5f6-6b46-46d1-86ff-4629a0a148c2_0e83e95c-e067-46ec-aec1-15fe100f72d4.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/f50df5f6-6b46-46d1-86ff-4629a0a148c2_0e83e95c-e067-46ec-aec1-15fe100f72d4.jpg/250x188.webp saved to cache
2025-12-05 11:59:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dfc53ae2-3d8c-5ca1-8a79-808643e82cf8
2025-12-05 11:59:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5c381d0>
2025-12-05 11:59:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 11:59:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfc53ae2-3d8c-5ca1-8a79-808643e82cf8/dfc53ae2-3d8c-5ca1-8a79-808643e82cf8_image_1.webp HTTP/1.1" 201 0
2025-12-05 11:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Ff50df5f6-6b46-46d1-86ff-4629a0a148c2_25151391-378e-4852-ad13-678c096c84d4.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/f50df5f6-6b46-46d1-86ff-4629a0a148c2_25151391-378e-4852-ad13-678c096c84d4.jpg/250x188.webp saved to cache
2025-12-05 11:59:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dfc53ae2-3d8c-5ca1-8a79-808643e82cf8
2025-12-05 11:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fca8d1a6f-6de9-41d7-bd9a-194c2e0ceb79_14ffc10b-974f-454f-9608-d8207fe2bbf3.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/ca8d1a6f-6de9-41d7-bd9a-194c2e0ceb79_14ffc10b-974f-454f-9608-d8207fe2bbf3.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/f50df5f6-6b46-46d1-86ff-4629a0a148c2_d15bf7d2-2d92-4c67-bf7e-d29406829e77.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/ca8d1a6f-6de9-41d7-bd9a-194c2e0ceb79_f10f68ca-b853-4bbb-ad9a-b1962b4ea395.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fca8d1a6f-6de9-41d7-bd9a-194c2e0ceb79_dfcb259f-c3b0-4654-8228-0dc89995579c.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/ca8d1a6f-6de9-41d7-bd9a-194c2e0ceb79_dfcb259f-c3b0-4654-8228-0dc89995579c.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9dc103c90>
2025-12-05 11:59:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 11:59:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfc53ae2-3d8c-5ca1-8a79-808643e82cf8/dfc53ae2-3d8c-5ca1-8a79-808643e82cf8_image_2.webp HTTP/1.1" 201 0
2025-12-05 11:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Ff50df5f6-6b46-46d1-86ff-4629a0a148c2_88f1de4c-7e25-4ae9-8e77-3425e429d709.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/f50df5f6-6b46-46d1-86ff-4629a0a148c2_88f1de4c-7e25-4ae9-8e77-3425e429d709.jpg/250x188.webp saved to cache
2025-12-05 11:59:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dfc53ae2-3d8c-5ca1-8a79-808643e82cf8
2025-12-05 11:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fca8d1a6f-6de9-41d7-bd9a-194c2e0ceb79_a9a3dfe0-f824-480c-9ffc-3d2df2d7fc30.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/ca8d1a6f-6de9-41d7-bd9a-194c2e0ceb79_a9a3dfe0-f824-480c-9ffc-3d2df2d7fc30.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/ca8d1a6f-6de9-41d7-bd9a-194c2e0ceb79_f0eb177e-620f-421c-9b07-34580b97e424.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/ca8d1a6f-6de9-41d7-bd9a-194c2e0ceb79_00267de3-ad57-40b8-8bf4-808597261ac4.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fca8d1a6f-6de9-41d7-bd9a-194c2e0ceb79_53f223a4-19a0-459f-b515-84d2676610b0.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/ca8d1a6f-6de9-41d7-bd9a-194c2e0ceb79_53f223a4-19a0-459f-b515-84d2676610b0.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5eafed0>
2025-12-05 11:59:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 11:59:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfc53ae2-3d8c-5ca1-8a79-808643e82cf8/dfc53ae2-3d8c-5ca1-8a79-808643e82cf8_image_3.webp HTTP/1.1" 201 0
2025-12-05 11:59:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Ff50df5f6-6b46-46d1-86ff-4629a0a148c2_d15bf7d2-2d92-4c67-bf7e-d29406829e77.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/f50df5f6-6b46-46d1-86ff-4629a0a148c2_d15bf7d2-2d92-4c67-bf7e-d29406829e77.jpg/250x188.webp saved to cache
2025-12-05 11:59:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dfc53ae2-3d8c-5ca1-8a79-808643e82cf8
2025-12-05 11:59:47 [crawlers.middlewares.photo_download_middleware] INFO: Removing item dfc53ae2-3d8c-5ca1-8a79-808643e82cf8 from tracking dictionaries
2025-12-05 11:59:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dfc53ae2-3d8c-5ca1-8a79-808643e82cf8 sending to next pipeline
2025-12-05 11:59:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5c7a250>
2025-12-05 11:59:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 11:59:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f2f859c-ef70-5d9e-ab7d-be685bc06cc3/6f2f859c-ef70-5d9e-ab7d-be685bc06cc3_image_0.webp HTTP/1.1" 201 0
2025-12-05 11:59:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fca8d1a6f-6de9-41d7-bd9a-194c2e0ceb79_f10f68ca-b853-4bbb-ad9a-b1962b4ea395.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/ca8d1a6f-6de9-41d7-bd9a-194c2e0ceb79_f10f68ca-b853-4bbb-ad9a-b1962b4ea395.jpg/250x188.webp saved to cache
2025-12-05 11:59:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6f2f859c-ef70-5d9e-ab7d-be685bc06cc3
2025-12-05 11:59:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fca8d1a6f-6de9-41d7-bd9a-194c2e0ceb79_49f34dba-5b63-4757-8183-e88dbe03aab1.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/ca8d1a6f-6de9-41d7-bd9a-194c2e0ceb79_49f34dba-5b63-4757-8183-e88dbe03aab1.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:47 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: dfc53ae2-3d8c-5ca1-8a79-808643e82cf8 with identifier f50df5f6-6b46-46d1-86ff-4629a0a148c2
2025-12-05 11:59:47 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 11:59:47 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 11:59:47 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item dfc53ae2-3d8c-5ca1-8a79-808643e82cf8
2025-12-05 11:59:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://prod.pictures.autoscout24.net/listing-images/f50df5f6-6b46-46d1-86ff-4629a0a148c2_d15bf7d2-2d92-4c67-bf7e-d29406829e77.jpg/250x188.webp>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'emission_standard': None,
 'engine': None,
 'engine_horse_power': 204,
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': 'dfc53ae2-3d8c-5ca1-8a79-808643e82cf8',
 'is_damaged': False,
 'is_operable': True,
 'license_plate': None,
 'link_to_web_offer': 'https://www.autoscout24.it/offers/audi-q5-spb-2-0-tdi-quattro-s-tronic-204cv-facelift-promo-diesel-grey-f50df5f6-6b46-46d1-86ff-4629a0a148c2',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 1,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 4,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfc53ae2-3d8c-5ca1-8a79-808643e82cf8/dfc53ae2-3d8c-5ca1-8a79-808643e82cf8_image_0.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 2676,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/f50df5f6-6b46-46d1-86ff-4629a0a148c2_0e83e95c-e067-46ec-aec1-15fe100f72d4.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfc53ae2-3d8c-5ca1-8a79-808643e82cf8/dfc53ae2-3d8c-5ca1-8a79-808643e82cf8_image_1.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 2482,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/f50df5f6-6b46-46d1-86ff-4629a0a148c2_25151391-378e-4852-ad13-678c096c84d4.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfc53ae2-3d8c-5ca1-8a79-808643e82cf8/dfc53ae2-3d8c-5ca1-8a79-808643e82cf8_image_2.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3942,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/f50df5f6-6b46-46d1-86ff-4629a0a148c2_88f1de4c-7e25-4ae9-8e77-3425e429d709.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfc53ae2-3d8c-5ca1-8a79-808643e82cf8/dfc53ae2-3d8c-5ca1-8a79-808643e82cf8_image_3.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4300,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/f50df5f6-6b46-46d1-86ff-4629a0a148c2_d15bf7d2-2d92-4c67-bf7e-d29406829e77.jpg/250x188.webp',
             'Width': 250}],
 'price': 59900,
 'price_includes_vat': False,
 'registration_date': '2025-10-01',
 'seller_name': None,
 'title': 'Audi Q5 SPB 2.0 TDI QUATTRO S-TRONIC 204CV FACELIFT PROMO',
 'transmission': 'automatic',
 'trim': 'SPB 2.0 TDI QUATTRO S-TRONIC 204CV FACELIFT PROMO',
 'vin': None,
 'year': 2025}
2025-12-05 11:59:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27f50df5f6-6b46-46d1-86ff-4629a0a148c2%27 HTTP/1.1" 200 None
2025-12-05 11:59:47 [auto_selling_autoscout24.it] INFO: Saving data for f50df5f6-6b46-46d1-86ff-4629a0a148c2: {'created_time': 1764935987.410364, 'last_price_update_time': 1764935987.410373}
2025-12-05 11:59:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autoscout24.it',RowKey='f50df5f6-6b46-46d1-86ff-4629a0a148c2') HTTP/1.1" 204 0
2025-12-05 11:59:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/ca8d1a6f-6de9-41d7-bd9a-194c2e0ceb79_14ffc10b-974f-454f-9608-d8207fe2bbf3.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/ca8d1a6f-6de9-41d7-bd9a-194c2e0ceb79_dfcb259f-c3b0-4654-8228-0dc89995579c.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fca8d1a6f-6de9-41d7-bd9a-194c2e0ceb79_41c3040f-5a1e-4a3c-849f-59a52ac65d08.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/ca8d1a6f-6de9-41d7-bd9a-194c2e0ceb79_41c3040f-5a1e-4a3c-849f-59a52ac65d08.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5cd7d50>
2025-12-05 11:59:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 11:59:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f2f859c-ef70-5d9e-ab7d-be685bc06cc3/6f2f859c-ef70-5d9e-ab7d-be685bc06cc3_image_2.webp HTTP/1.1" 201 0
2025-12-05 11:59:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fca8d1a6f-6de9-41d7-bd9a-194c2e0ceb79_f0eb177e-620f-421c-9b07-34580b97e424.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/ca8d1a6f-6de9-41d7-bd9a-194c2e0ceb79_f0eb177e-620f-421c-9b07-34580b97e424.jpg/250x188.webp saved to cache
2025-12-05 11:59:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6f2f859c-ef70-5d9e-ab7d-be685bc06cc3
2025-12-05 11:59:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5cb1090>
2025-12-05 11:59:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 11:59:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f2f859c-ef70-5d9e-ab7d-be685bc06cc3/6f2f859c-ef70-5d9e-ab7d-be685bc06cc3_image_1.webp HTTP/1.1" 201 0
2025-12-05 11:59:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fca8d1a6f-6de9-41d7-bd9a-194c2e0ceb79_00267de3-ad57-40b8-8bf4-808597261ac4.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/ca8d1a6f-6de9-41d7-bd9a-194c2e0ceb79_00267de3-ad57-40b8-8bf4-808597261ac4.jpg/250x188.webp saved to cache
2025-12-05 11:59:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6f2f859c-ef70-5d9e-ab7d-be685bc06cc3
2025-12-05 11:59:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/ca8d1a6f-6de9-41d7-bd9a-194c2e0ceb79_53f223a4-19a0-459f-b515-84d2676610b0.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/ca8d1a6f-6de9-41d7-bd9a-194c2e0ceb79_a9a3dfe0-f824-480c-9ffc-3d2df2d7fc30.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fca8d1a6f-6de9-41d7-bd9a-194c2e0ceb79_43c5970f-7e03-4715-9184-226b38fe2e3b.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/ca8d1a6f-6de9-41d7-bd9a-194c2e0ceb79_43c5970f-7e03-4715-9184-226b38fe2e3b.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d6f7d8d0>
2025-12-05 11:59:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 11:59:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f2f859c-ef70-5d9e-ab7d-be685bc06cc3/6f2f859c-ef70-5d9e-ab7d-be685bc06cc3_image_3.webp HTTP/1.1" 201 0
2025-12-05 11:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fca8d1a6f-6de9-41d7-bd9a-194c2e0ceb79_14ffc10b-974f-454f-9608-d8207fe2bbf3.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/ca8d1a6f-6de9-41d7-bd9a-194c2e0ceb79_14ffc10b-974f-454f-9608-d8207fe2bbf3.jpg/250x188.webp saved to cache
2025-12-05 11:59:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6f2f859c-ef70-5d9e-ab7d-be685bc06cc3
2025-12-05 11:59:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5cb1b10>
2025-12-05 11:59:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 11:59:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f2f859c-ef70-5d9e-ab7d-be685bc06cc3/6f2f859c-ef70-5d9e-ab7d-be685bc06cc3_image_4.webp HTTP/1.1" 201 0
2025-12-05 11:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fca8d1a6f-6de9-41d7-bd9a-194c2e0ceb79_dfcb259f-c3b0-4654-8228-0dc89995579c.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/ca8d1a6f-6de9-41d7-bd9a-194c2e0ceb79_dfcb259f-c3b0-4654-8228-0dc89995579c.jpg/250x188.webp saved to cache
2025-12-05 11:59:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6f2f859c-ef70-5d9e-ab7d-be685bc06cc3
2025-12-05 11:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fca8d1a6f-6de9-41d7-bd9a-194c2e0ceb79_33b5ed28-f16e-4818-b3d7-c41c11f61a82.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/ca8d1a6f-6de9-41d7-bd9a-194c2e0ceb79_33b5ed28-f16e-4818-b3d7-c41c11f61a82.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/ca8d1a6f-6de9-41d7-bd9a-194c2e0ceb79_49f34dba-5b63-4757-8183-e88dbe03aab1.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fca8d1a6f-6de9-41d7-bd9a-194c2e0ceb79_654c2d85-85fb-4fd9-a472-3304cc42590b.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/ca8d1a6f-6de9-41d7-bd9a-194c2e0ceb79_654c2d85-85fb-4fd9-a472-3304cc42590b.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e94a50>
2025-12-05 11:59:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 11:59:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f2f859c-ef70-5d9e-ab7d-be685bc06cc3/6f2f859c-ef70-5d9e-ab7d-be685bc06cc3_image_6.webp HTTP/1.1" 201 0
2025-12-05 11:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fca8d1a6f-6de9-41d7-bd9a-194c2e0ceb79_53f223a4-19a0-459f-b515-84d2676610b0.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/ca8d1a6f-6de9-41d7-bd9a-194c2e0ceb79_53f223a4-19a0-459f-b515-84d2676610b0.jpg/250x188.webp saved to cache
2025-12-05 11:59:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6f2f859c-ef70-5d9e-ab7d-be685bc06cc3
2025-12-05 11:59:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5b04210>
2025-12-05 11:59:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 11:59:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f2f859c-ef70-5d9e-ab7d-be685bc06cc3/6f2f859c-ef70-5d9e-ab7d-be685bc06cc3_image_5.webp HTTP/1.1" 201 0
2025-12-05 11:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fca8d1a6f-6de9-41d7-bd9a-194c2e0ceb79_a9a3dfe0-f824-480c-9ffc-3d2df2d7fc30.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/ca8d1a6f-6de9-41d7-bd9a-194c2e0ceb79_a9a3dfe0-f824-480c-9ffc-3d2df2d7fc30.jpg/250x188.webp saved to cache
2025-12-05 11:59:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6f2f859c-ef70-5d9e-ab7d-be685bc06cc3
2025-12-05 11:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fca8d1a6f-6de9-41d7-bd9a-194c2e0ceb79_6f5b0f15-16d7-45dc-a394-1e7e444b2e98.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/ca8d1a6f-6de9-41d7-bd9a-194c2e0ceb79_6f5b0f15-16d7-45dc-a394-1e7e444b2e98.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/ca8d1a6f-6de9-41d7-bd9a-194c2e0ceb79_41c3040f-5a1e-4a3c-849f-59a52ac65d08.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/ca8d1a6f-6de9-41d7-bd9a-194c2e0ceb79_43c5970f-7e03-4715-9184-226b38fe2e3b.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%2790344699-8a81-471b-9dff-68eb762f3065%27 HTTP/1.1" 200 None
2025-12-05 11:59:49 [auto_selling_autoscout24.it] INFO: Scrape type for 90344699-8a81-471b-9dff-68eb762f3065: 1
2025-12-05 11:59:49 [auto_selling_autoscout24.it] INFO: Scraping new listing 90344699-8a81-471b-9dff-68eb762f3065
2025-12-05 11:59:49 [auto_selling_autoscout24.it] INFO: Extracting item from listing ID: 90344699-8a81-471b-9dff-68eb762f3065
2025-12-05 11:59:49 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f2ce25c-cfc7-5302-bfad-8f8e6d4bf12b with identifier: 90344699-8a81-471b-9dff-68eb762f3065
2025-12-05 11:59:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 0f2ce25c-cfc7-5302-bfad-8f8e6d4bf12b
2025-12-05 11:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F90344699-8a81-471b-9dff-68eb762f3065_1ce56104-3c6d-4523-bd4b-fcac7b216aac.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/90344699-8a81-471b-9dff-68eb762f3065_1ce56104-3c6d-4523-bd4b-fcac7b216aac.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5c683d0>
2025-12-05 11:59:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 11:59:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f2f859c-ef70-5d9e-ab7d-be685bc06cc3/6f2f859c-ef70-5d9e-ab7d-be685bc06cc3_image_7.webp HTTP/1.1" 201 0
2025-12-05 11:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fca8d1a6f-6de9-41d7-bd9a-194c2e0ceb79_49f34dba-5b63-4757-8183-e88dbe03aab1.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/ca8d1a6f-6de9-41d7-bd9a-194c2e0ceb79_49f34dba-5b63-4757-8183-e88dbe03aab1.jpg/250x188.webp saved to cache
2025-12-05 11:59:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6f2f859c-ef70-5d9e-ab7d-be685bc06cc3
2025-12-05 11:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F90344699-8a81-471b-9dff-68eb762f3065_0b78de0f-6f87-42cd-8806-7049a9ca4c27.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/90344699-8a81-471b-9dff-68eb762f3065_0b78de0f-6f87-42cd-8806-7049a9ca4c27.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/ca8d1a6f-6de9-41d7-bd9a-194c2e0ceb79_33b5ed28-f16e-4818-b3d7-c41c11f61a82.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/ca8d1a6f-6de9-41d7-bd9a-194c2e0ceb79_654c2d85-85fb-4fd9-a472-3304cc42590b.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F90344699-8a81-471b-9dff-68eb762f3065_add94c46-79e3-4b66-a808-ef086a1bbe9b.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/90344699-8a81-471b-9dff-68eb762f3065_add94c46-79e3-4b66-a808-ef086a1bbe9b.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5c69150>
2025-12-05 11:59:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 11:59:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f2f859c-ef70-5d9e-ab7d-be685bc06cc3/6f2f859c-ef70-5d9e-ab7d-be685bc06cc3_image_8.webp HTTP/1.1" 201 0
2025-12-05 11:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fca8d1a6f-6de9-41d7-bd9a-194c2e0ceb79_41c3040f-5a1e-4a3c-849f-59a52ac65d08.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/ca8d1a6f-6de9-41d7-bd9a-194c2e0ceb79_41c3040f-5a1e-4a3c-849f-59a52ac65d08.jpg/250x188.webp saved to cache
2025-12-05 11:59:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6f2f859c-ef70-5d9e-ab7d-be685bc06cc3
2025-12-05 11:59:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5c3a990>
2025-12-05 11:59:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 11:59:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f2f859c-ef70-5d9e-ab7d-be685bc06cc3/6f2f859c-ef70-5d9e-ab7d-be685bc06cc3_image_9.webp HTTP/1.1" 201 0
2025-12-05 11:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fca8d1a6f-6de9-41d7-bd9a-194c2e0ceb79_43c5970f-7e03-4715-9184-226b38fe2e3b.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/ca8d1a6f-6de9-41d7-bd9a-194c2e0ceb79_43c5970f-7e03-4715-9184-226b38fe2e3b.jpg/250x188.webp saved to cache
2025-12-05 11:59:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6f2f859c-ef70-5d9e-ab7d-be685bc06cc3
2025-12-05 11:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F90344699-8a81-471b-9dff-68eb762f3065_be9ed740-b745-4cd5-92f3-fefeab73e930.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/90344699-8a81-471b-9dff-68eb762f3065_be9ed740-b745-4cd5-92f3-fefeab73e930.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/90344699-8a81-471b-9dff-68eb762f3065_1ce56104-3c6d-4523-bd4b-fcac7b216aac.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/ca8d1a6f-6de9-41d7-bd9a-194c2e0ceb79_6f5b0f15-16d7-45dc-a394-1e7e444b2e98.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F90344699-8a81-471b-9dff-68eb762f3065_715bcf54-00c4-4a1e-a0e6-ab730dbc884b.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/90344699-8a81-471b-9dff-68eb762f3065_715bcf54-00c4-4a1e-a0e6-ab730dbc884b.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9dd5d3c50>
2025-12-05 11:59:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 11:59:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f2f859c-ef70-5d9e-ab7d-be685bc06cc3/6f2f859c-ef70-5d9e-ab7d-be685bc06cc3_image_10.webp HTTP/1.1" 201 0
2025-12-05 11:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fca8d1a6f-6de9-41d7-bd9a-194c2e0ceb79_33b5ed28-f16e-4818-b3d7-c41c11f61a82.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/ca8d1a6f-6de9-41d7-bd9a-194c2e0ceb79_33b5ed28-f16e-4818-b3d7-c41c11f61a82.jpg/250x188.webp saved to cache
2025-12-05 11:59:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 6f2f859c-ef70-5d9e-ab7d-be685bc06cc3
2025-12-05 11:59:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d6ffb210>
2025-12-05 11:59:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 11:59:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f2f859c-ef70-5d9e-ab7d-be685bc06cc3/6f2f859c-ef70-5d9e-ab7d-be685bc06cc3_image_11.webp HTTP/1.1" 201 0
2025-12-05 11:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fca8d1a6f-6de9-41d7-bd9a-194c2e0ceb79_654c2d85-85fb-4fd9-a472-3304cc42590b.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/ca8d1a6f-6de9-41d7-bd9a-194c2e0ceb79_654c2d85-85fb-4fd9-a472-3304cc42590b.jpg/250x188.webp saved to cache
2025-12-05 11:59:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 6f2f859c-ef70-5d9e-ab7d-be685bc06cc3
2025-12-05 11:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%2768beb3a0-21dd-4413-ba50-dc3eca171456%27 HTTP/1.1" 200 None
2025-12-05 11:59:50 [auto_selling_autoscout24.it] INFO: Scrape type for 68beb3a0-21dd-4413-ba50-dc3eca171456: 1
2025-12-05 11:59:50 [auto_selling_autoscout24.it] INFO: Scraping new listing 68beb3a0-21dd-4413-ba50-dc3eca171456
2025-12-05 11:59:50 [auto_selling_autoscout24.it] INFO: Extracting item from listing ID: 68beb3a0-21dd-4413-ba50-dc3eca171456
2025-12-05 11:59:50 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: a486abc3-2cf6-59e1-827a-2f75e700ad51 with identifier: 68beb3a0-21dd-4413-ba50-dc3eca171456
2025-12-05 11:59:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item a486abc3-2cf6-59e1-827a-2f75e700ad51
2025-12-05 11:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F68beb3a0-21dd-4413-ba50-dc3eca171456_596f0ce2-a6da-4923-904e-0806efebd387.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/68beb3a0-21dd-4413-ba50-dc3eca171456_596f0ce2-a6da-4923-904e-0806efebd387.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/90344699-8a81-471b-9dff-68eb762f3065_0b78de0f-6f87-42cd-8806-7049a9ca4c27.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/90344699-8a81-471b-9dff-68eb762f3065_add94c46-79e3-4b66-a808-ef086a1bbe9b.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%2710d9e083-1baa-4938-8c38-98fdc3c20343%27 HTTP/1.1" 200 None
2025-12-05 11:59:50 [auto_selling_autoscout24.it] INFO: Scrape type for 10d9e083-1baa-4938-8c38-98fdc3c20343: 1
2025-12-05 11:59:50 [auto_selling_autoscout24.it] INFO: Scraping new listing 10d9e083-1baa-4938-8c38-98fdc3c20343
2025-12-05 11:59:50 [auto_selling_autoscout24.it] INFO: Extracting item from listing ID: 10d9e083-1baa-4938-8c38-98fdc3c20343
2025-12-05 11:59:50 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 0440b762-4e8d-5702-b909-ea4a80d58dae with identifier: 10d9e083-1baa-4938-8c38-98fdc3c20343
2025-12-05 11:59:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 7 photos for item 0440b762-4e8d-5702-b909-ea4a80d58dae
2025-12-05 11:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F10d9e083-1baa-4938-8c38-98fdc3c20343_b8087903-2488-4acb-95b5-ae2489b67cbb.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/10d9e083-1baa-4938-8c38-98fdc3c20343_b8087903-2488-4acb-95b5-ae2489b67cbb.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e39910>
2025-12-05 11:59:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 11:59:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f2ce25c-cfc7-5302-bfad-8f8e6d4bf12b/0f2ce25c-cfc7-5302-bfad-8f8e6d4bf12b_image_0.webp HTTP/1.1" 201 0
2025-12-05 11:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F90344699-8a81-471b-9dff-68eb762f3065_1ce56104-3c6d-4523-bd4b-fcac7b216aac.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/90344699-8a81-471b-9dff-68eb762f3065_1ce56104-3c6d-4523-bd4b-fcac7b216aac.jpg/250x188.webp saved to cache
2025-12-05 11:59:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0f2ce25c-cfc7-5302-bfad-8f8e6d4bf12b
2025-12-05 11:59:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d6ff2790>
2025-12-05 11:59:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 11:59:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f2f859c-ef70-5d9e-ab7d-be685bc06cc3/6f2f859c-ef70-5d9e-ab7d-be685bc06cc3_image_12.webp HTTP/1.1" 201 0
2025-12-05 11:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fca8d1a6f-6de9-41d7-bd9a-194c2e0ceb79_6f5b0f15-16d7-45dc-a394-1e7e444b2e98.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/ca8d1a6f-6de9-41d7-bd9a-194c2e0ceb79_6f5b0f15-16d7-45dc-a394-1e7e444b2e98.jpg/250x188.webp saved to cache
2025-12-05 11:59:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 6f2f859c-ef70-5d9e-ab7d-be685bc06cc3
2025-12-05 11:59:51 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 6f2f859c-ef70-5d9e-ab7d-be685bc06cc3 from tracking dictionaries
2025-12-05 11:59:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6f2f859c-ef70-5d9e-ab7d-be685bc06cc3 sending to next pipeline
2025-12-05 11:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F10d9e083-1baa-4938-8c38-98fdc3c20343_65a6439e-d083-4bb4-b820-1b7108dc7367.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/10d9e083-1baa-4938-8c38-98fdc3c20343_65a6439e-d083-4bb4-b820-1b7108dc7367.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:51 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 6f2f859c-ef70-5d9e-ab7d-be685bc06cc3 with identifier ca8d1a6f-6de9-41d7-bd9a-194c2e0ceb79
2025-12-05 11:59:51 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 11:59:51 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 11:59:51 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 6f2f859c-ef70-5d9e-ab7d-be685bc06cc3
2025-12-05 11:59:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://prod.pictures.autoscout24.net/listing-images/ca8d1a6f-6de9-41d7-bd9a-194c2e0ceb79_6f5b0f15-16d7-45dc-a394-1e7e444b2e98.jpg/250x188.webp>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'emission_standard': None,
 'engine': None,
 'engine_horse_power': 286,
 'expiration_date': None,
 'fuel_type': 'Electric/Diesel',
 'id': '6f2f859c-ef70-5d9e-ab7d-be685bc06cc3',
 'is_damaged': False,
 'is_operable': True,
 'license_plate': None,
 'link_to_web_offer': 'https://www.autoscout24.it/offers/audi-q7-s-line-facelift-50tdi-quattro-286cv-s-tronic-promo-electric-diesel-black-ca8d1a6f-6de9-41d7-bd9a-194c2e0ceb79',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q7',
 'odometer': 1,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f2f859c-ef70-5d9e-ab7d-be685bc06cc3/6f2f859c-ef70-5d9e-ab7d-be685bc06cc3_image_0.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5270,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/ca8d1a6f-6de9-41d7-bd9a-194c2e0ceb79_f10f68ca-b853-4bbb-ad9a-b1962b4ea395.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f2f859c-ef70-5d9e-ab7d-be685bc06cc3/6f2f859c-ef70-5d9e-ab7d-be685bc06cc3_image_1.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5154,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/ca8d1a6f-6de9-41d7-bd9a-194c2e0ceb79_00267de3-ad57-40b8-8bf4-808597261ac4.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f2f859c-ef70-5d9e-ab7d-be685bc06cc3/6f2f859c-ef70-5d9e-ab7d-be685bc06cc3_image_2.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5010,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/ca8d1a6f-6de9-41d7-bd9a-194c2e0ceb79_f0eb177e-620f-421c-9b07-34580b97e424.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f2f859c-ef70-5d9e-ab7d-be685bc06cc3/6f2f859c-ef70-5d9e-ab7d-be685bc06cc3_image_3.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5248,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/ca8d1a6f-6de9-41d7-bd9a-194c2e0ceb79_14ffc10b-974f-454f-9608-d8207fe2bbf3.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f2f859c-ef70-5d9e-ab7d-be685bc06cc3/6f2f859c-ef70-5d9e-ab7d-be685bc06cc3_image_4.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3398,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/ca8d1a6f-6de9-41d7-bd9a-194c2e0ceb79_dfcb259f-c3b0-4654-8228-0dc89995579c.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f2f859c-ef70-5d9e-ab7d-be685bc06cc3/6f2f859c-ef70-5d9e-ab7d-be685bc06cc3_image_5.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5828,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/ca8d1a6f-6de9-41d7-bd9a-194c2e0ceb79_a9a3dfe0-f824-480c-9ffc-3d2df2d7fc30.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f2f859c-ef70-5d9e-ab7d-be685bc06cc3/6f2f859c-ef70-5d9e-ab7d-be685bc06cc3_image_6.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5060,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/ca8d1a6f-6de9-41d7-bd9a-194c2e0ceb79_53f223a4-19a0-459f-b515-84d2676610b0.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f2f859c-ef70-5d9e-ab7d-be685bc06cc3/6f2f859c-ef70-5d9e-ab7d-be685bc06cc3_image_7.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 8100,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/ca8d1a6f-6de9-41d7-bd9a-194c2e0ceb79_49f34dba-5b63-4757-8183-e88dbe03aab1.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f2f859c-ef70-5d9e-ab7d-be685bc06cc3/6f2f859c-ef70-5d9e-ab7d-be685bc06cc3_image_8.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5856,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/ca8d1a6f-6de9-41d7-bd9a-194c2e0ceb79_41c3040f-5a1e-4a3c-849f-59a52ac65d08.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f2f859c-ef70-5d9e-ab7d-be685bc06cc3/6f2f859c-ef70-5d9e-ab7d-be685bc06cc3_image_9.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 6920,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/ca8d1a6f-6de9-41d7-bd9a-194c2e0ceb79_43c5970f-7e03-4715-9184-226b38fe2e3b.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f2f859c-ef70-5d9e-ab7d-be685bc06cc3/6f2f859c-ef70-5d9e-ab7d-be685bc06cc3_image_10.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 7126,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/ca8d1a6f-6de9-41d7-bd9a-194c2e0ceb79_33b5ed28-f16e-4818-b3d7-c41c11f61a82.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f2f859c-ef70-5d9e-ab7d-be685bc06cc3/6f2f859c-ef70-5d9e-ab7d-be685bc06cc3_image_11.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4810,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/ca8d1a6f-6de9-41d7-bd9a-194c2e0ceb79_654c2d85-85fb-4fd9-a472-3304cc42590b.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f2f859c-ef70-5d9e-ab7d-be685bc06cc3/6f2f859c-ef70-5d9e-ab7d-be685bc06cc3_image_12.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5844,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/ca8d1a6f-6de9-41d7-bd9a-194c2e0ceb79_6f5b0f15-16d7-45dc-a394-1e7e444b2e98.jpg/250x188.webp',
             'Width': 250}],
 'price': 89800,
 'price_includes_vat': False,
 'registration_date': '2025-01-01',
 'seller_name': None,
 'title': 'Audi Q7 S-LINE FACELIFT 50TDI QUATTRO 286CV S-TRONIC PROMO',
 'transmission': 'automatic',
 'trim': 'S-LINE FACELIFT 50TDI QUATTRO 286CV S-TRONIC PROMO',
 'vin': None,
 'year': 2025}
2025-12-05 11:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27ca8d1a6f-6de9-41d7-bd9a-194c2e0ceb79%27 HTTP/1.1" 200 None
2025-12-05 11:59:51 [auto_selling_autoscout24.it] INFO: Saving data for ca8d1a6f-6de9-41d7-bd9a-194c2e0ceb79: {'created_time': 1764935991.307176, 'last_price_update_time': 1764935991.307185}
2025-12-05 11:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autoscout24.it',RowKey='ca8d1a6f-6de9-41d7-bd9a-194c2e0ceb79') HTTP/1.1" 204 0
2025-12-05 11:59:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/90344699-8a81-471b-9dff-68eb762f3065_be9ed740-b745-4cd5-92f3-fefeab73e930.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/90344699-8a81-471b-9dff-68eb762f3065_715bcf54-00c4-4a1e-a0e6-ab730dbc884b.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F10d9e083-1baa-4938-8c38-98fdc3c20343_1a81a953-47ac-495a-8ed1-ae8a6bfbc473.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/10d9e083-1baa-4938-8c38-98fdc3c20343_1a81a953-47ac-495a-8ed1-ae8a6bfbc473.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5c3be50>
2025-12-05 11:59:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 11:59:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f2ce25c-cfc7-5302-bfad-8f8e6d4bf12b/0f2ce25c-cfc7-5302-bfad-8f8e6d4bf12b_image_1.webp HTTP/1.1" 201 0
2025-12-05 11:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F90344699-8a81-471b-9dff-68eb762f3065_0b78de0f-6f87-42cd-8806-7049a9ca4c27.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/90344699-8a81-471b-9dff-68eb762f3065_0b78de0f-6f87-42cd-8806-7049a9ca4c27.jpg/250x188.webp saved to cache
2025-12-05 11:59:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0f2ce25c-cfc7-5302-bfad-8f8e6d4bf12b
2025-12-05 11:59:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d6f117d0>
2025-12-05 11:59:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 11:59:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f2ce25c-cfc7-5302-bfad-8f8e6d4bf12b/0f2ce25c-cfc7-5302-bfad-8f8e6d4bf12b_image_2.webp HTTP/1.1" 201 0
2025-12-05 11:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F90344699-8a81-471b-9dff-68eb762f3065_add94c46-79e3-4b66-a808-ef086a1bbe9b.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/90344699-8a81-471b-9dff-68eb762f3065_add94c46-79e3-4b66-a808-ef086a1bbe9b.jpg/250x188.webp saved to cache
2025-12-05 11:59:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0f2ce25c-cfc7-5302-bfad-8f8e6d4bf12b
2025-12-05 11:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F10d9e083-1baa-4938-8c38-98fdc3c20343_74c0a5d0-8ecc-4599-aa3e-a255b7b9b5cf.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/10d9e083-1baa-4938-8c38-98fdc3c20343_74c0a5d0-8ecc-4599-aa3e-a255b7b9b5cf.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/10d9e083-1baa-4938-8c38-98fdc3c20343_b8087903-2488-4acb-95b5-ae2489b67cbb.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/68beb3a0-21dd-4413-ba50-dc3eca171456_596f0ce2-a6da-4923-904e-0806efebd387.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F10d9e083-1baa-4938-8c38-98fdc3c20343_2b0c0608-3e63-4a92-a0fb-f9519553d91d.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/10d9e083-1baa-4938-8c38-98fdc3c20343_2b0c0608-3e63-4a92-a0fb-f9519553d91d.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9de911390>
2025-12-05 11:59:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 11:59:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f2ce25c-cfc7-5302-bfad-8f8e6d4bf12b/0f2ce25c-cfc7-5302-bfad-8f8e6d4bf12b_image_3.webp HTTP/1.1" 201 0
2025-12-05 11:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F90344699-8a81-471b-9dff-68eb762f3065_be9ed740-b745-4cd5-92f3-fefeab73e930.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/90344699-8a81-471b-9dff-68eb762f3065_be9ed740-b745-4cd5-92f3-fefeab73e930.jpg/250x188.webp saved to cache
2025-12-05 11:59:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0f2ce25c-cfc7-5302-bfad-8f8e6d4bf12b
2025-12-05 11:59:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5c54ad0>
2025-12-05 11:59:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 11:59:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f2ce25c-cfc7-5302-bfad-8f8e6d4bf12b/0f2ce25c-cfc7-5302-bfad-8f8e6d4bf12b_image_4.webp HTTP/1.1" 201 0
2025-12-05 11:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F90344699-8a81-471b-9dff-68eb762f3065_715bcf54-00c4-4a1e-a0e6-ab730dbc884b.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/90344699-8a81-471b-9dff-68eb762f3065_715bcf54-00c4-4a1e-a0e6-ab730dbc884b.jpg/250x188.webp saved to cache
2025-12-05 11:59:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0f2ce25c-cfc7-5302-bfad-8f8e6d4bf12b
2025-12-05 11:59:52 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 0f2ce25c-cfc7-5302-bfad-8f8e6d4bf12b from tracking dictionaries
2025-12-05 11:59:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0f2ce25c-cfc7-5302-bfad-8f8e6d4bf12b sending to next pipeline
2025-12-05 11:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F10d9e083-1baa-4938-8c38-98fdc3c20343_8cbec173-8a3a-4065-9a75-39a70bffb329.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/10d9e083-1baa-4938-8c38-98fdc3c20343_8cbec173-8a3a-4065-9a75-39a70bffb329.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:52 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 0f2ce25c-cfc7-5302-bfad-8f8e6d4bf12b with identifier 90344699-8a81-471b-9dff-68eb762f3065
2025-12-05 11:59:52 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 11:59:52 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 11:59:52 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 0f2ce25c-cfc7-5302-bfad-8f8e6d4bf12b
2025-12-05 11:59:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://prod.pictures.autoscout24.net/listing-images/90344699-8a81-471b-9dff-68eb762f3065_715bcf54-00c4-4a1e-a0e6-ab730dbc884b.jpg/250x188.webp>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'emission_standard': None,
 'engine': None,
 'engine_horse_power': 150,
 'expiration_date': None,
 'fuel_type': 'Gasoline',
 'id': '0f2ce25c-cfc7-5302-bfad-8f8e6d4bf12b',
 'is_damaged': False,
 'is_operable': True,
 'license_plate': None,
 'link_to_web_offer': 'https://www.autoscout24.it/offers/audi-a1-spb-35-tfsi-s-tronic-id-black-uff-italia-promo-gasoline-grey-90344699-8a81-471b-9dff-68eb762f3065',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1',
 'odometer': 1,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f2ce25c-cfc7-5302-bfad-8f8e6d4bf12b/0f2ce25c-cfc7-5302-bfad-8f8e6d4bf12b_image_0.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3248,
             'Height': 182,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/90344699-8a81-471b-9dff-68eb762f3065_1ce56104-3c6d-4523-bd4b-fcac7b216aac.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f2ce25c-cfc7-5302-bfad-8f8e6d4bf12b/0f2ce25c-cfc7-5302-bfad-8f8e6d4bf12b_image_1.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 2386,
             'Height': 133,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/90344699-8a81-471b-9dff-68eb762f3065_0b78de0f-6f87-42cd-8806-7049a9ca4c27.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f2ce25c-cfc7-5302-bfad-8f8e6d4bf12b/0f2ce25c-cfc7-5302-bfad-8f8e6d4bf12b_image_2.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3116,
             'Height': 169,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/90344699-8a81-471b-9dff-68eb762f3065_add94c46-79e3-4b66-a808-ef086a1bbe9b.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f2ce25c-cfc7-5302-bfad-8f8e6d4bf12b/0f2ce25c-cfc7-5302-bfad-8f8e6d4bf12b_image_3.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3234,
             'Height': 162,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/90344699-8a81-471b-9dff-68eb762f3065_be9ed740-b745-4cd5-92f3-fefeab73e930.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f2ce25c-cfc7-5302-bfad-8f8e6d4bf12b/0f2ce25c-cfc7-5302-bfad-8f8e6d4bf12b_image_4.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3298,
             'Height': 164,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/90344699-8a81-471b-9dff-68eb762f3065_715bcf54-00c4-4a1e-a0e6-ab730dbc884b.jpg/250x188.webp',
             'Width': 250}],
 'price': 33500,
 'price_includes_vat': False,
 'registration_date': '2025-08-01',
 'seller_name': None,
 'title': 'Audi A1 SPB 35 TFSI S-TRONIC ID. BLACK UFF.ITALIA PROMO',
 'transmission': 'automatic',
 'trim': 'SPB 35 TFSI S-TRONIC ID. BLACK UFF.ITALIA PROMO',
 'vin': None,
 'year': 2025}
2025-12-05 11:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%2790344699-8a81-471b-9dff-68eb762f3065%27 HTTP/1.1" 200 None
2025-12-05 11:59:52 [auto_selling_autoscout24.it] INFO: Saving data for 90344699-8a81-471b-9dff-68eb762f3065: {'created_time': 1764935992.535474, 'last_price_update_time': 1764935992.535483}
2025-12-05 11:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autoscout24.it',RowKey='90344699-8a81-471b-9dff-68eb762f3065') HTTP/1.1" 204 0
2025-12-05 11:59:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/10d9e083-1baa-4938-8c38-98fdc3c20343_65a6439e-d083-4bb4-b820-1b7108dc7367.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/10d9e083-1baa-4938-8c38-98fdc3c20343_1a81a953-47ac-495a-8ed1-ae8a6bfbc473.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F10d9e083-1baa-4938-8c38-98fdc3c20343_cea1cf92-c761-4f1d-9dfe-6535a516901f.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/10d9e083-1baa-4938-8c38-98fdc3c20343_cea1cf92-c761-4f1d-9dfe-6535a516901f.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5c72050>
2025-12-05 11:59:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 11:59:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0440b762-4e8d-5702-b909-ea4a80d58dae/0440b762-4e8d-5702-b909-ea4a80d58dae_image_0.webp HTTP/1.1" 201 0
2025-12-05 11:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F10d9e083-1baa-4938-8c38-98fdc3c20343_b8087903-2488-4acb-95b5-ae2489b67cbb.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/10d9e083-1baa-4938-8c38-98fdc3c20343_b8087903-2488-4acb-95b5-ae2489b67cbb.jpg/250x188.webp saved to cache
2025-12-05 11:59:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0440b762-4e8d-5702-b909-ea4a80d58dae
2025-12-05 11:59:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9dd5e7210>
2025-12-05 11:59:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 11:59:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a486abc3-2cf6-59e1-827a-2f75e700ad51/a486abc3-2cf6-59e1-827a-2f75e700ad51_image_0.webp HTTP/1.1" 201 0
2025-12-05 11:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F68beb3a0-21dd-4413-ba50-dc3eca171456_596f0ce2-a6da-4923-904e-0806efebd387.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/68beb3a0-21dd-4413-ba50-dc3eca171456_596f0ce2-a6da-4923-904e-0806efebd387.jpg/250x188.webp saved to cache
2025-12-05 11:59:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a486abc3-2cf6-59e1-827a-2f75e700ad51
2025-12-05 11:59:53 [crawlers.middlewares.photo_download_middleware] INFO: Removing item a486abc3-2cf6-59e1-827a-2f75e700ad51 from tracking dictionaries
2025-12-05 11:59:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a486abc3-2cf6-59e1-827a-2f75e700ad51 sending to next pipeline
2025-12-05 11:59:53 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: a486abc3-2cf6-59e1-827a-2f75e700ad51 with identifier 68beb3a0-21dd-4413-ba50-dc3eca171456
2025-12-05 11:59:53 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 11:59:53 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 11:59:53 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item a486abc3-2cf6-59e1-827a-2f75e700ad51
2025-12-05 11:59:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://prod.pictures.autoscout24.net/listing-images/68beb3a0-21dd-4413-ba50-dc3eca171456_596f0ce2-a6da-4923-904e-0806efebd387.jpg/250x188.webp>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'emission_standard': None,
 'engine': None,
 'engine_horse_power': 286,
 'expiration_date': None,
 'fuel_type': 'Electric/Diesel',
 'id': 'a486abc3-2cf6-59e1-827a-2f75e700ad51',
 'is_damaged': False,
 'is_operable': True,
 'license_plate': None,
 'link_to_web_offer': 'https://www.autoscout24.it/offers/audi-q8-50-tdi-s-line-286cv-km0-2025-tetto-360-promo-electric-diesel-grey-68beb3a0-21dd-4413-ba50-dc3eca171456',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q8',
 'odometer': 1,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a486abc3-2cf6-59e1-827a-2f75e700ad51/a486abc3-2cf6-59e1-827a-2f75e700ad51_image_0.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 2754,
             'Height': 186,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/68beb3a0-21dd-4413-ba50-dc3eca171456_596f0ce2-a6da-4923-904e-0806efebd387.jpg/250x188.webp',
             'Width': 250}],
 'price': 81900,
 'price_includes_vat': False,
 'registration_date': '2025-03-01',
 'seller_name': None,
 'title': 'Audi Q8 50 TDI S-LINE 286CV KM0 2025 *TETTO+360°* PROMO',
 'transmission': 'automatic',
 'trim': '50 TDI S-LINE 286CV KM0 2025 *TETTO+360°* PROMO',
 'vin': None,
 'year': 2025}
2025-12-05 11:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%2768beb3a0-21dd-4413-ba50-dc3eca171456%27 HTTP/1.1" 200 None
2025-12-05 11:59:53 [auto_selling_autoscout24.it] INFO: Saving data for 68beb3a0-21dd-4413-ba50-dc3eca171456: {'created_time': 1764935993.143823, 'last_price_update_time': 1764935993.143835}
2025-12-05 11:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autoscout24.it',RowKey='68beb3a0-21dd-4413-ba50-dc3eca171456') HTTP/1.1" 204 0
2025-12-05 11:59:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/10d9e083-1baa-4938-8c38-98fdc3c20343_2b0c0608-3e63-4a92-a0fb-f9519553d91d.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/10d9e083-1baa-4938-8c38-98fdc3c20343_74c0a5d0-8ecc-4599-aa3e-a255b7b9b5cf.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%2708e41c24-3815-4a12-a987-77756fb652f5%27 HTTP/1.1" 200 None
2025-12-05 11:59:53 [auto_selling_autoscout24.it] INFO: Scrape type for 08e41c24-3815-4a12-a987-77756fb652f5: 1
2025-12-05 11:59:53 [auto_selling_autoscout24.it] INFO: Scraping new listing 08e41c24-3815-4a12-a987-77756fb652f5
2025-12-05 11:59:53 [auto_selling_autoscout24.it] INFO: Extracting item from listing ID: 08e41c24-3815-4a12-a987-77756fb652f5
2025-12-05 11:59:53 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 79a04ef9-3958-50eb-8514-e106c528f781 with identifier: 08e41c24-3815-4a12-a987-77756fb652f5
2025-12-05 11:59:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 7 photos for item 79a04ef9-3958-50eb-8514-e106c528f781
2025-12-05 11:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F08e41c24-3815-4a12-a987-77756fb652f5_88b4cb14-49a7-4efc-bd55-3ce85a3e8063.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/08e41c24-3815-4a12-a987-77756fb652f5_88b4cb14-49a7-4efc-bd55-3ce85a3e8063.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e8be10>
2025-12-05 11:59:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 11:59:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0440b762-4e8d-5702-b909-ea4a80d58dae/0440b762-4e8d-5702-b909-ea4a80d58dae_image_1.webp HTTP/1.1" 201 0
2025-12-05 11:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F10d9e083-1baa-4938-8c38-98fdc3c20343_65a6439e-d083-4bb4-b820-1b7108dc7367.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/10d9e083-1baa-4938-8c38-98fdc3c20343_65a6439e-d083-4bb4-b820-1b7108dc7367.jpg/250x188.webp saved to cache
2025-12-05 11:59:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0440b762-4e8d-5702-b909-ea4a80d58dae
2025-12-05 11:59:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e880d0>
2025-12-05 11:59:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 11:59:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0440b762-4e8d-5702-b909-ea4a80d58dae/0440b762-4e8d-5702-b909-ea4a80d58dae_image_2.webp HTTP/1.1" 201 0
2025-12-05 11:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F10d9e083-1baa-4938-8c38-98fdc3c20343_1a81a953-47ac-495a-8ed1-ae8a6bfbc473.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/10d9e083-1baa-4938-8c38-98fdc3c20343_1a81a953-47ac-495a-8ed1-ae8a6bfbc473.jpg/250x188.webp saved to cache
2025-12-05 11:59:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0440b762-4e8d-5702-b909-ea4a80d58dae
2025-12-05 11:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F08e41c24-3815-4a12-a987-77756fb652f5_ee5d3758-395b-4a11-bae9-88c3cc95b02f.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/08e41c24-3815-4a12-a987-77756fb652f5_ee5d3758-395b-4a11-bae9-88c3cc95b02f.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/10d9e083-1baa-4938-8c38-98fdc3c20343_8cbec173-8a3a-4065-9a75-39a70bffb329.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F08e41c24-3815-4a12-a987-77756fb652f5_61c7b31a-0a54-46dc-bba3-41619ad62f4a.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/08e41c24-3815-4a12-a987-77756fb652f5_61c7b31a-0a54-46dc-bba3-41619ad62f4a.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e4c750>
2025-12-05 11:59:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 11:59:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0440b762-4e8d-5702-b909-ea4a80d58dae/0440b762-4e8d-5702-b909-ea4a80d58dae_image_4.webp HTTP/1.1" 201 0
2025-12-05 11:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F10d9e083-1baa-4938-8c38-98fdc3c20343_2b0c0608-3e63-4a92-a0fb-f9519553d91d.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/10d9e083-1baa-4938-8c38-98fdc3c20343_2b0c0608-3e63-4a92-a0fb-f9519553d91d.jpg/250x188.webp saved to cache
2025-12-05 11:59:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0440b762-4e8d-5702-b909-ea4a80d58dae
2025-12-05 11:59:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5eaf590>
2025-12-05 11:59:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 11:59:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0440b762-4e8d-5702-b909-ea4a80d58dae/0440b762-4e8d-5702-b909-ea4a80d58dae_image_3.webp HTTP/1.1" 201 0
2025-12-05 11:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F10d9e083-1baa-4938-8c38-98fdc3c20343_74c0a5d0-8ecc-4599-aa3e-a255b7b9b5cf.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/10d9e083-1baa-4938-8c38-98fdc3c20343_74c0a5d0-8ecc-4599-aa3e-a255b7b9b5cf.jpg/250x188.webp saved to cache
2025-12-05 11:59:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0440b762-4e8d-5702-b909-ea4a80d58dae
2025-12-05 11:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F08e41c24-3815-4a12-a987-77756fb652f5_5a86325f-3af0-417d-99e9-40c95c8333dc.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/08e41c24-3815-4a12-a987-77756fb652f5_5a86325f-3af0-417d-99e9-40c95c8333dc.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/08e41c24-3815-4a12-a987-77756fb652f5_88b4cb14-49a7-4efc-bd55-3ce85a3e8063.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/10d9e083-1baa-4938-8c38-98fdc3c20343_cea1cf92-c761-4f1d-9dfe-6535a516901f.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F08e41c24-3815-4a12-a987-77756fb652f5_394028c6-8a9e-442c-80c9-c3d8cd1df384.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/08e41c24-3815-4a12-a987-77756fb652f5_394028c6-8a9e-442c-80c9-c3d8cd1df384.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9dd5d1310>
2025-12-05 11:59:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 11:59:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0440b762-4e8d-5702-b909-ea4a80d58dae/0440b762-4e8d-5702-b909-ea4a80d58dae_image_5.webp HTTP/1.1" 201 0
2025-12-05 11:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F10d9e083-1baa-4938-8c38-98fdc3c20343_8cbec173-8a3a-4065-9a75-39a70bffb329.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/10d9e083-1baa-4938-8c38-98fdc3c20343_8cbec173-8a3a-4065-9a75-39a70bffb329.jpg/250x188.webp saved to cache
2025-12-05 11:59:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0440b762-4e8d-5702-b909-ea4a80d58dae
2025-12-05 11:59:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/08e41c24-3815-4a12-a987-77756fb652f5_ee5d3758-395b-4a11-bae9-88c3cc95b02f.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F08e41c24-3815-4a12-a987-77756fb652f5_5653dd30-79e8-4c3f-a2ba-b4fc2db95457.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/08e41c24-3815-4a12-a987-77756fb652f5_5653dd30-79e8-4c3f-a2ba-b4fc2db95457.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/08e41c24-3815-4a12-a987-77756fb652f5_61c7b31a-0a54-46dc-bba3-41619ad62f4a.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F08e41c24-3815-4a12-a987-77756fb652f5_0638df11-faaa-4375-9e5f-979444316d6e.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/08e41c24-3815-4a12-a987-77756fb652f5_0638df11-faaa-4375-9e5f-979444316d6e.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e3ddd0>
2025-12-05 11:59:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 11:59:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79a04ef9-3958-50eb-8514-e106c528f781/79a04ef9-3958-50eb-8514-e106c528f781_image_0.webp HTTP/1.1" 201 0
2025-12-05 11:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F08e41c24-3815-4a12-a987-77756fb652f5_88b4cb14-49a7-4efc-bd55-3ce85a3e8063.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/08e41c24-3815-4a12-a987-77756fb652f5_88b4cb14-49a7-4efc-bd55-3ce85a3e8063.jpg/250x188.webp saved to cache
2025-12-05 11:59:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 79a04ef9-3958-50eb-8514-e106c528f781
2025-12-05 11:59:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d6ff8390>
2025-12-05 11:59:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 11:59:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0440b762-4e8d-5702-b909-ea4a80d58dae/0440b762-4e8d-5702-b909-ea4a80d58dae_image_6.webp HTTP/1.1" 201 0
2025-12-05 11:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F10d9e083-1baa-4938-8c38-98fdc3c20343_cea1cf92-c761-4f1d-9dfe-6535a516901f.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/10d9e083-1baa-4938-8c38-98fdc3c20343_cea1cf92-c761-4f1d-9dfe-6535a516901f.jpg/250x188.webp saved to cache
2025-12-05 11:59:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0440b762-4e8d-5702-b909-ea4a80d58dae
2025-12-05 11:59:55 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 0440b762-4e8d-5702-b909-ea4a80d58dae from tracking dictionaries
2025-12-05 11:59:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0440b762-4e8d-5702-b909-ea4a80d58dae sending to next pipeline
2025-12-05 11:59:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/08e41c24-3815-4a12-a987-77756fb652f5_5a86325f-3af0-417d-99e9-40c95c8333dc.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%272bb7e3d2-e2a4-44f4-8800-df6c00e88047%27 HTTP/1.1" 200 None
2025-12-05 11:59:55 [auto_selling_autoscout24.it] INFO: Scrape type for 2bb7e3d2-e2a4-44f4-8800-df6c00e88047: 1
2025-12-05 11:59:55 [auto_selling_autoscout24.it] INFO: Scraping new listing 2bb7e3d2-e2a4-44f4-8800-df6c00e88047
2025-12-05 11:59:55 [auto_selling_autoscout24.it] INFO: Extracting item from listing ID: 2bb7e3d2-e2a4-44f4-8800-df6c00e88047
2025-12-05 11:59:55 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: c9e26dad-d10d-5a26-ba90-41e2c4926cad with identifier: 2bb7e3d2-e2a4-44f4-8800-df6c00e88047
2025-12-05 11:59:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item c9e26dad-d10d-5a26-ba90-41e2c4926cad
2025-12-05 11:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F2bb7e3d2-e2a4-44f4-8800-df6c00e88047_a328a188-b668-4304-a17c-0598d48063f2.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/2bb7e3d2-e2a4-44f4-8800-df6c00e88047_a328a188-b668-4304-a17c-0598d48063f2.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:55 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 0440b762-4e8d-5702-b909-ea4a80d58dae with identifier 10d9e083-1baa-4938-8c38-98fdc3c20343
2025-12-05 11:59:55 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 11:59:55 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 11:59:55 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 0440b762-4e8d-5702-b909-ea4a80d58dae
2025-12-05 11:59:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://prod.pictures.autoscout24.net/listing-images/10d9e083-1baa-4938-8c38-98fdc3c20343_cea1cf92-c761-4f1d-9dfe-6535a516901f.jpg/250x188.webp>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'emission_standard': None,
 'engine': None,
 'engine_horse_power': 300,
 'expiration_date': None,
 'fuel_type': 'Gasoline',
 'id': '0440b762-4e8d-5702-b909-ea4a80d58dae',
 'is_damaged': False,
 'is_operable': True,
 'license_plate': None,
 'link_to_web_offer': 'https://www.autoscout24.it/offers/volkswagen-golf-gti-8-5-clubsport-2-0-tsi-dsg-tetto-black-promo-gasoline-black-10d9e083-1baa-4938-8c38-98fdc3c20343',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf GTI',
 'odometer': 26300,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 7,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0440b762-4e8d-5702-b909-ea4a80d58dae/0440b762-4e8d-5702-b909-ea4a80d58dae_image_0.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 2806,
             'Height': 159,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/10d9e083-1baa-4938-8c38-98fdc3c20343_b8087903-2488-4acb-95b5-ae2489b67cbb.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0440b762-4e8d-5702-b909-ea4a80d58dae/0440b762-4e8d-5702-b909-ea4a80d58dae_image_1.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 2978,
             'Height': 188,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/10d9e083-1baa-4938-8c38-98fdc3c20343_65a6439e-d083-4bb4-b820-1b7108dc7367.jpg/250x188.webp',
             'Width': 237},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0440b762-4e8d-5702-b909-ea4a80d58dae/0440b762-4e8d-5702-b909-ea4a80d58dae_image_2.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 2232,
             'Height': 140,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/10d9e083-1baa-4938-8c38-98fdc3c20343_1a81a953-47ac-495a-8ed1-ae8a6bfbc473.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0440b762-4e8d-5702-b909-ea4a80d58dae/0440b762-4e8d-5702-b909-ea4a80d58dae_image_3.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3350,
             'Height': 184,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/10d9e083-1baa-4938-8c38-98fdc3c20343_74c0a5d0-8ecc-4599-aa3e-a255b7b9b5cf.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0440b762-4e8d-5702-b909-ea4a80d58dae/0440b762-4e8d-5702-b909-ea4a80d58dae_image_4.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4494,
             'Height': 186,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/10d9e083-1baa-4938-8c38-98fdc3c20343_2b0c0608-3e63-4a92-a0fb-f9519553d91d.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0440b762-4e8d-5702-b909-ea4a80d58dae/0440b762-4e8d-5702-b909-ea4a80d58dae_image_5.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4308,
             'Height': 185,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/10d9e083-1baa-4938-8c38-98fdc3c20343_8cbec173-8a3a-4065-9a75-39a70bffb329.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0440b762-4e8d-5702-b909-ea4a80d58dae/0440b762-4e8d-5702-b909-ea4a80d58dae_image_6.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3574,
             'Height': 188,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/10d9e083-1baa-4938-8c38-98fdc3c20343_cea1cf92-c761-4f1d-9dfe-6535a516901f.jpg/250x188.webp',
             'Width': 248}],
 'price': 43900,
 'price_includes_vat': False,
 'registration_date': '2025-04-01',
 'seller_name': None,
 'title': 'Volkswagen Golf GTI 8.5 CLUBSPORT 2.0 TSI DSG *TETTO+BLACK* PROMO',
 'transmission': 'automatic',
 'trim': '8.5 CLUBSPORT 2.0 TSI DSG *TETTO+BLACK* PROMO',
 'vin': None,
 'year': 2025}
2025-12-05 11:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%2710d9e083-1baa-4938-8c38-98fdc3c20343%27 HTTP/1.1" 200 None
2025-12-05 11:59:55 [auto_selling_autoscout24.it] INFO: Saving data for 10d9e083-1baa-4938-8c38-98fdc3c20343: {'created_time': 1764935995.400084, 'last_price_update_time': 1764935995.400097}
2025-12-05 11:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autoscout24.it',RowKey='10d9e083-1baa-4938-8c38-98fdc3c20343') HTTP/1.1" 204 0
2025-12-05 11:59:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/08e41c24-3815-4a12-a987-77756fb652f5_394028c6-8a9e-442c-80c9-c3d8cd1df384.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/08e41c24-3815-4a12-a987-77756fb652f5_5653dd30-79e8-4c3f-a2ba-b4fc2db95457.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F2bb7e3d2-e2a4-44f4-8800-df6c00e88047_959da9e0-0703-49e7-83a9-509513ff6400.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/2bb7e3d2-e2a4-44f4-8800-df6c00e88047_959da9e0-0703-49e7-83a9-509513ff6400.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e3a0d0>
2025-12-05 11:59:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 11:59:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79a04ef9-3958-50eb-8514-e106c528f781/79a04ef9-3958-50eb-8514-e106c528f781_image_1.webp HTTP/1.1" 201 0
2025-12-05 11:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F08e41c24-3815-4a12-a987-77756fb652f5_ee5d3758-395b-4a11-bae9-88c3cc95b02f.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/08e41c24-3815-4a12-a987-77756fb652f5_ee5d3758-395b-4a11-bae9-88c3cc95b02f.jpg/250x188.webp saved to cache
2025-12-05 11:59:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 79a04ef9-3958-50eb-8514-e106c528f781
2025-12-05 11:59:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e94410>
2025-12-05 11:59:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 11:59:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79a04ef9-3958-50eb-8514-e106c528f781/79a04ef9-3958-50eb-8514-e106c528f781_image_2.webp HTTP/1.1" 201 0
2025-12-05 11:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F08e41c24-3815-4a12-a987-77756fb652f5_61c7b31a-0a54-46dc-bba3-41619ad62f4a.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/08e41c24-3815-4a12-a987-77756fb652f5_61c7b31a-0a54-46dc-bba3-41619ad62f4a.jpg/250x188.webp saved to cache
2025-12-05 11:59:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 79a04ef9-3958-50eb-8514-e106c528f781
2025-12-05 11:59:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e8a0d0>
2025-12-05 11:59:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 11:59:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79a04ef9-3958-50eb-8514-e106c528f781/79a04ef9-3958-50eb-8514-e106c528f781_image_3.webp HTTP/1.1" 201 0
2025-12-05 11:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F08e41c24-3815-4a12-a987-77756fb652f5_5a86325f-3af0-417d-99e9-40c95c8333dc.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/08e41c24-3815-4a12-a987-77756fb652f5_5a86325f-3af0-417d-99e9-40c95c8333dc.jpg/250x188.webp saved to cache
2025-12-05 11:59:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 79a04ef9-3958-50eb-8514-e106c528f781
2025-12-05 11:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F2bb7e3d2-e2a4-44f4-8800-df6c00e88047_cc897264-d8a9-4cf4-a460-f7549f9c786e.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/2bb7e3d2-e2a4-44f4-8800-df6c00e88047_cc897264-d8a9-4cf4-a460-f7549f9c786e.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/08e41c24-3815-4a12-a987-77756fb652f5_0638df11-faaa-4375-9e5f-979444316d6e.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F2bb7e3d2-e2a4-44f4-8800-df6c00e88047_2aeacd6a-308b-411b-b9ce-1c387d8a7c1a.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/2bb7e3d2-e2a4-44f4-8800-df6c00e88047_2aeacd6a-308b-411b-b9ce-1c387d8a7c1a.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5b1c590>
2025-12-05 11:59:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 11:59:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79a04ef9-3958-50eb-8514-e106c528f781/79a04ef9-3958-50eb-8514-e106c528f781_image_4.webp HTTP/1.1" 201 0
2025-12-05 11:59:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F08e41c24-3815-4a12-a987-77756fb652f5_394028c6-8a9e-442c-80c9-c3d8cd1df384.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/08e41c24-3815-4a12-a987-77756fb652f5_394028c6-8a9e-442c-80c9-c3d8cd1df384.jpg/250x188.webp saved to cache
2025-12-05 11:59:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 79a04ef9-3958-50eb-8514-e106c528f781
2025-12-05 11:59:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d6ff1e90>
2025-12-05 11:59:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 11:59:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79a04ef9-3958-50eb-8514-e106c528f781/79a04ef9-3958-50eb-8514-e106c528f781_image_5.webp HTTP/1.1" 201 0
2025-12-05 11:59:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F08e41c24-3815-4a12-a987-77756fb652f5_5653dd30-79e8-4c3f-a2ba-b4fc2db95457.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/08e41c24-3815-4a12-a987-77756fb652f5_5653dd30-79e8-4c3f-a2ba-b4fc2db95457.jpg/250x188.webp saved to cache
2025-12-05 11:59:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 79a04ef9-3958-50eb-8514-e106c528f781
2025-12-05 11:59:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/2bb7e3d2-e2a4-44f4-8800-df6c00e88047_a328a188-b668-4304-a17c-0598d48063f2.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F2bb7e3d2-e2a4-44f4-8800-df6c00e88047_97e558a2-e05c-485d-9af4-f952e46df70f.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/2bb7e3d2-e2a4-44f4-8800-df6c00e88047_97e558a2-e05c-485d-9af4-f952e46df70f.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/2bb7e3d2-e2a4-44f4-8800-df6c00e88047_959da9e0-0703-49e7-83a9-509513ff6400.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F2bb7e3d2-e2a4-44f4-8800-df6c00e88047_136b1321-4574-460e-ac00-f9b374397977.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/2bb7e3d2-e2a4-44f4-8800-df6c00e88047_136b1321-4574-460e-ac00-f9b374397977.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9dc13f1d0>
2025-12-05 11:59:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 11:59:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79a04ef9-3958-50eb-8514-e106c528f781/79a04ef9-3958-50eb-8514-e106c528f781_image_6.webp HTTP/1.1" 201 0
2025-12-05 11:59:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F08e41c24-3815-4a12-a987-77756fb652f5_0638df11-faaa-4375-9e5f-979444316d6e.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/08e41c24-3815-4a12-a987-77756fb652f5_0638df11-faaa-4375-9e5f-979444316d6e.jpg/250x188.webp saved to cache
2025-12-05 11:59:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 79a04ef9-3958-50eb-8514-e106c528f781
2025-12-05 11:59:57 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 79a04ef9-3958-50eb-8514-e106c528f781 from tracking dictionaries
2025-12-05 11:59:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 79a04ef9-3958-50eb-8514-e106c528f781 sending to next pipeline
2025-12-05 11:59:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27ba4b20c0-09d7-4688-8a2e-f935ae646c35%27 HTTP/1.1" 200 None
2025-12-05 11:59:57 [auto_selling_autoscout24.it] INFO: Scrape type for ba4b20c0-09d7-4688-8a2e-f935ae646c35: 1
2025-12-05 11:59:57 [auto_selling_autoscout24.it] INFO: Scraping new listing ba4b20c0-09d7-4688-8a2e-f935ae646c35
2025-12-05 11:59:57 [auto_selling_autoscout24.it] INFO: Extracting item from listing ID: ba4b20c0-09d7-4688-8a2e-f935ae646c35
2025-12-05 11:59:57 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 08c49a54-cf8b-5a12-8a98-c311adcc9cd5 with identifier: ba4b20c0-09d7-4688-8a2e-f935ae646c35
2025-12-05 11:59:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 14 photos for item 08c49a54-cf8b-5a12-8a98-c311adcc9cd5
2025-12-05 11:59:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fba4b20c0-09d7-4688-8a2e-f935ae646c35_35c59a06-ec78-4719-b77a-16f876e8cbd8.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/ba4b20c0-09d7-4688-8a2e-f935ae646c35_35c59a06-ec78-4719-b77a-16f876e8cbd8.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:57 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 79a04ef9-3958-50eb-8514-e106c528f781 with identifier 08e41c24-3815-4a12-a987-77756fb652f5
2025-12-05 11:59:57 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 11:59:57 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 11:59:57 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 79a04ef9-3958-50eb-8514-e106c528f781
2025-12-05 11:59:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://prod.pictures.autoscout24.net/listing-images/08e41c24-3815-4a12-a987-77756fb652f5_0638df11-faaa-4375-9e5f-979444316d6e.jpg/250x188.webp>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'emission_standard': None,
 'engine': None,
 'engine_horse_power': 150,
 'expiration_date': None,
 'fuel_type': 'Gasoline',
 'id': '79a04ef9-3958-50eb-8514-e106c528f781',
 'is_damaged': False,
 'is_operable': True,
 'license_plate': None,
 'link_to_web_offer': 'https://www.autoscout24.it/offers/audi-a3-allstreet-35-tfsi-150-cv-s-tronic-retrocam-promo-gasoline-black-08e41c24-3815-4a12-a987-77756fb652f5',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3',
 'odometer': 5600,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 7,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79a04ef9-3958-50eb-8514-e106c528f781/79a04ef9-3958-50eb-8514-e106c528f781_image_0.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4094,
             'Height': 155,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/08e41c24-3815-4a12-a987-77756fb652f5_88b4cb14-49a7-4efc-bd55-3ce85a3e8063.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79a04ef9-3958-50eb-8514-e106c528f781/79a04ef9-3958-50eb-8514-e106c528f781_image_1.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4524,
             'Height': 181,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/08e41c24-3815-4a12-a987-77756fb652f5_ee5d3758-395b-4a11-bae9-88c3cc95b02f.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79a04ef9-3958-50eb-8514-e106c528f781/79a04ef9-3958-50eb-8514-e106c528f781_image_2.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3902,
             'Height': 154,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/08e41c24-3815-4a12-a987-77756fb652f5_61c7b31a-0a54-46dc-bba3-41619ad62f4a.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79a04ef9-3958-50eb-8514-e106c528f781/79a04ef9-3958-50eb-8514-e106c528f781_image_3.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4450,
             'Height': 178,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/08e41c24-3815-4a12-a987-77756fb652f5_5a86325f-3af0-417d-99e9-40c95c8333dc.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79a04ef9-3958-50eb-8514-e106c528f781/79a04ef9-3958-50eb-8514-e106c528f781_image_4.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3052,
             'Height': 143,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/08e41c24-3815-4a12-a987-77756fb652f5_394028c6-8a9e-442c-80c9-c3d8cd1df384.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79a04ef9-3958-50eb-8514-e106c528f781/79a04ef9-3958-50eb-8514-e106c528f781_image_5.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 2778,
             'Height': 143,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/08e41c24-3815-4a12-a987-77756fb652f5_5653dd30-79e8-4c3f-a2ba-b4fc2db95457.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79a04ef9-3958-50eb-8514-e106c528f781/79a04ef9-3958-50eb-8514-e106c528f781_image_6.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 2234,
             'Height': 144,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/08e41c24-3815-4a12-a987-77756fb652f5_0638df11-faaa-4375-9e5f-979444316d6e.jpg/250x188.webp',
             'Width': 250}],
 'price': 36900,
 'price_includes_vat': False,
 'registration_date': '2024-09-01',
 'seller_name': None,
 'title': 'Audi A3 ALLSTREET 35 TFSI 150 CV S-TRONIC *RETROCAM* PROMO',
 'transmission': 'automatic',
 'trim': 'ALLSTREET 35 TFSI 150 CV S-TRONIC *RETROCAM* PROMO',
 'vin': None,
 'year': 2024}
2025-12-05 11:59:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%2708e41c24-3815-4a12-a987-77756fb652f5%27 HTTP/1.1" 200 None
2025-12-05 11:59:57 [auto_selling_autoscout24.it] INFO: Saving data for 08e41c24-3815-4a12-a987-77756fb652f5: {'created_time': 1764935997.63558, 'last_price_update_time': 1764935997.635589}
2025-12-05 11:59:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autoscout24.it',RowKey='08e41c24-3815-4a12-a987-77756fb652f5') HTTP/1.1" 204 0
2025-12-05 11:59:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/2bb7e3d2-e2a4-44f4-8800-df6c00e88047_cc897264-d8a9-4cf4-a460-f7549f9c786e.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/2bb7e3d2-e2a4-44f4-8800-df6c00e88047_2aeacd6a-308b-411b-b9ce-1c387d8a7c1a.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fba4b20c0-09d7-4688-8a2e-f935ae646c35_dd8d3f11-50b7-4f8a-8cab-20563096f57b.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/ba4b20c0-09d7-4688-8a2e-f935ae646c35_dd8d3f11-50b7-4f8a-8cab-20563096f57b.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d6fcd690>
2025-12-05 11:59:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 11:59:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9e26dad-d10d-5a26-ba90-41e2c4926cad/c9e26dad-d10d-5a26-ba90-41e2c4926cad_image_0.webp HTTP/1.1" 201 0
2025-12-05 11:59:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F2bb7e3d2-e2a4-44f4-8800-df6c00e88047_a328a188-b668-4304-a17c-0598d48063f2.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/2bb7e3d2-e2a4-44f4-8800-df6c00e88047_a328a188-b668-4304-a17c-0598d48063f2.jpg/250x188.webp saved to cache
2025-12-05 11:59:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c9e26dad-d10d-5a26-ba90-41e2c4926cad
2025-12-05 11:59:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d6ffb490>
2025-12-05 11:59:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 11:59:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9e26dad-d10d-5a26-ba90-41e2c4926cad/c9e26dad-d10d-5a26-ba90-41e2c4926cad_image_1.webp HTTP/1.1" 201 0
2025-12-05 11:59:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F2bb7e3d2-e2a4-44f4-8800-df6c00e88047_959da9e0-0703-49e7-83a9-509513ff6400.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/2bb7e3d2-e2a4-44f4-8800-df6c00e88047_959da9e0-0703-49e7-83a9-509513ff6400.jpg/250x188.webp saved to cache
2025-12-05 11:59:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c9e26dad-d10d-5a26-ba90-41e2c4926cad
2025-12-05 11:59:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fba4b20c0-09d7-4688-8a2e-f935ae646c35_c7e04605-da0d-48e9-9182-99cd6fc6cd09.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/ba4b20c0-09d7-4688-8a2e-f935ae646c35_c7e04605-da0d-48e9-9182-99cd6fc6cd09.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/2bb7e3d2-e2a4-44f4-8800-df6c00e88047_136b1321-4574-460e-ac00-f9b374397977.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/2bb7e3d2-e2a4-44f4-8800-df6c00e88047_97e558a2-e05c-485d-9af4-f952e46df70f.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fba4b20c0-09d7-4688-8a2e-f935ae646c35_c4132f91-45c7-46b4-ba3c-1bdc1317664e.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/ba4b20c0-09d7-4688-8a2e-f935ae646c35_c4132f91-45c7-46b4-ba3c-1bdc1317664e.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5ea3710>
2025-12-05 11:59:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 11:59:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9e26dad-d10d-5a26-ba90-41e2c4926cad/c9e26dad-d10d-5a26-ba90-41e2c4926cad_image_2.webp HTTP/1.1" 201 0
2025-12-05 11:59:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F2bb7e3d2-e2a4-44f4-8800-df6c00e88047_cc897264-d8a9-4cf4-a460-f7549f9c786e.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/2bb7e3d2-e2a4-44f4-8800-df6c00e88047_cc897264-d8a9-4cf4-a460-f7549f9c786e.jpg/250x188.webp saved to cache
2025-12-05 11:59:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c9e26dad-d10d-5a26-ba90-41e2c4926cad
2025-12-05 11:59:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5cc3850>
2025-12-05 11:59:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 11:59:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9e26dad-d10d-5a26-ba90-41e2c4926cad/c9e26dad-d10d-5a26-ba90-41e2c4926cad_image_3.webp HTTP/1.1" 201 0
2025-12-05 11:59:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F2bb7e3d2-e2a4-44f4-8800-df6c00e88047_2aeacd6a-308b-411b-b9ce-1c387d8a7c1a.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/2bb7e3d2-e2a4-44f4-8800-df6c00e88047_2aeacd6a-308b-411b-b9ce-1c387d8a7c1a.jpg/250x188.webp saved to cache
2025-12-05 11:59:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c9e26dad-d10d-5a26-ba90-41e2c4926cad
2025-12-05 11:59:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fba4b20c0-09d7-4688-8a2e-f935ae646c35_df837e3a-c1a7-4774-944f-ed1b065a523f.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/ba4b20c0-09d7-4688-8a2e-f935ae646c35_df837e3a-c1a7-4774-944f-ed1b065a523f.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/ba4b20c0-09d7-4688-8a2e-f935ae646c35_35c59a06-ec78-4719-b77a-16f876e8cbd8.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/ba4b20c0-09d7-4688-8a2e-f935ae646c35_dd8d3f11-50b7-4f8a-8cab-20563096f57b.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fba4b20c0-09d7-4688-8a2e-f935ae646c35_1b11f171-91d9-4a76-9505-e14b4b339f83.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/ba4b20c0-09d7-4688-8a2e-f935ae646c35_1b11f171-91d9-4a76-9505-e14b4b339f83.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e99350>
2025-12-05 11:59:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 11:59:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9e26dad-d10d-5a26-ba90-41e2c4926cad/c9e26dad-d10d-5a26-ba90-41e2c4926cad_image_5.webp HTTP/1.1" 201 0
2025-12-05 11:59:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F2bb7e3d2-e2a4-44f4-8800-df6c00e88047_136b1321-4574-460e-ac00-f9b374397977.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/2bb7e3d2-e2a4-44f4-8800-df6c00e88047_136b1321-4574-460e-ac00-f9b374397977.jpg/250x188.webp saved to cache
2025-12-05 11:59:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c9e26dad-d10d-5a26-ba90-41e2c4926cad
2025-12-05 11:59:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e7dc90>
2025-12-05 11:59:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 11:59:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 11:59:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 11:59:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 11:59:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 11:59:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9e26dad-d10d-5a26-ba90-41e2c4926cad/c9e26dad-d10d-5a26-ba90-41e2c4926cad_image_4.webp HTTP/1.1" 201 0
2025-12-05 11:59:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F2bb7e3d2-e2a4-44f4-8800-df6c00e88047_97e558a2-e05c-485d-9af4-f952e46df70f.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 11:59:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/2bb7e3d2-e2a4-44f4-8800-df6c00e88047_97e558a2-e05c-485d-9af4-f952e46df70f.jpg/250x188.webp saved to cache
2025-12-05 11:59:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c9e26dad-d10d-5a26-ba90-41e2c4926cad
2025-12-05 11:59:59 [crawlers.middlewares.photo_download_middleware] INFO: Removing item c9e26dad-d10d-5a26-ba90-41e2c4926cad from tracking dictionaries
2025-12-05 11:59:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c9e26dad-d10d-5a26-ba90-41e2c4926cad sending to next pipeline
2025-12-05 11:59:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fba4b20c0-09d7-4688-8a2e-f935ae646c35_50f2519a-a64e-42ba-a01b-439f209ae5a6.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/ba4b20c0-09d7-4688-8a2e-f935ae646c35_50f2519a-a64e-42ba-a01b-439f209ae5a6.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:59 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: c9e26dad-d10d-5a26-ba90-41e2c4926cad with identifier 2bb7e3d2-e2a4-44f4-8800-df6c00e88047
2025-12-05 11:59:59 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 11:59:59 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 11:59:59 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item c9e26dad-d10d-5a26-ba90-41e2c4926cad
2025-12-05 11:59:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://prod.pictures.autoscout24.net/listing-images/2bb7e3d2-e2a4-44f4-8800-df6c00e88047_97e558a2-e05c-485d-9af4-f952e46df70f.jpg/250x188.webp>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'emission_standard': None,
 'engine': None,
 'engine_horse_power': 367,
 'expiration_date': None,
 'fuel_type': 'Electric/Gasoline',
 'id': 'c9e26dad-d10d-5a26-ba90-41e2c4926cad',
 'is_damaged': False,
 'is_operable': True,
 'license_plate': None,
 'link_to_web_offer': 'https://www.autoscout24.it/offers/audi-sq5-facelift-sportback-tfsi-s-tronic-367cv-only-promo-electric-gasoline-black-2bb7e3d2-e2a4-44f4-8800-df6c00e88047',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'SQ5',
 'odometer': 1,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9e26dad-d10d-5a26-ba90-41e2c4926cad/c9e26dad-d10d-5a26-ba90-41e2c4926cad_image_0.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3048,
             'Height': 144,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/2bb7e3d2-e2a4-44f4-8800-df6c00e88047_a328a188-b668-4304-a17c-0598d48063f2.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9e26dad-d10d-5a26-ba90-41e2c4926cad/c9e26dad-d10d-5a26-ba90-41e2c4926cad_image_1.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 2036,
             'Height': 113,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/2bb7e3d2-e2a4-44f4-8800-df6c00e88047_959da9e0-0703-49e7-83a9-509513ff6400.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9e26dad-d10d-5a26-ba90-41e2c4926cad/c9e26dad-d10d-5a26-ba90-41e2c4926cad_image_2.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3060,
             'Height': 141,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/2bb7e3d2-e2a4-44f4-8800-df6c00e88047_cc897264-d8a9-4cf4-a460-f7549f9c786e.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9e26dad-d10d-5a26-ba90-41e2c4926cad/c9e26dad-d10d-5a26-ba90-41e2c4926cad_image_3.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 2504,
             'Height': 109,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/2bb7e3d2-e2a4-44f4-8800-df6c00e88047_2aeacd6a-308b-411b-b9ce-1c387d8a7c1a.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9e26dad-d10d-5a26-ba90-41e2c4926cad/c9e26dad-d10d-5a26-ba90-41e2c4926cad_image_4.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3102,
             'Height': 107,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/2bb7e3d2-e2a4-44f4-8800-df6c00e88047_97e558a2-e05c-485d-9af4-f952e46df70f.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9e26dad-d10d-5a26-ba90-41e2c4926cad/c9e26dad-d10d-5a26-ba90-41e2c4926cad_image_5.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 2414,
             'Height': 110,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/2bb7e3d2-e2a4-44f4-8800-df6c00e88047_136b1321-4574-460e-ac00-f9b374397977.jpg/250x188.webp',
             'Width': 250}],
 'price': 102900,
 'price_includes_vat': False,
 'registration_date': '2025-09-01',
 'seller_name': None,
 'title': 'Audi SQ5 FACELIFT SPORTBACK TFSI S-TRONIC 367CV ONLY PROMO!',
 'transmission': 'automatic',
 'trim': 'FACELIFT SPORTBACK TFSI S-TRONIC 367CV ONLY PROMO!',
 'vin': None,
 'year': 2025}
2025-12-05 11:59:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%272bb7e3d2-e2a4-44f4-8800-df6c00e88047%27 HTTP/1.1" 200 None
2025-12-05 11:59:59 [auto_selling_autoscout24.it] INFO: Saving data for 2bb7e3d2-e2a4-44f4-8800-df6c00e88047: {'created_time': 1764935999.366308, 'last_price_update_time': 1764935999.366317}
2025-12-05 11:59:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autoscout24.it',RowKey='2bb7e3d2-e2a4-44f4-8800-df6c00e88047') HTTP/1.1" 204 0
2025-12-05 11:59:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/ba4b20c0-09d7-4688-8a2e-f935ae646c35_c4132f91-45c7-46b4-ba3c-1bdc1317664e.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/ba4b20c0-09d7-4688-8a2e-f935ae646c35_c7e04605-da0d-48e9-9182-99cd6fc6cd09.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 11:59:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 11:59:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fba4b20c0-09d7-4688-8a2e-f935ae646c35_fe315011-d8d9-4c5e-8672-7435a5e8c5f5.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 11:59:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/ba4b20c0-09d7-4688-8a2e-f935ae646c35_fe315011-d8d9-4c5e-8672-7435a5e8c5f5.jpg/250x188.webp not downloaded yet
2025-12-05 11:59:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 11:59:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 11:59:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 11:59:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5c55fd0>
2025-12-05 11:59:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 11:59:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:00:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 12:00:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:00:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:00:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:00:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08c49a54-cf8b-5a12-8a98-c311adcc9cd5/08c49a54-cf8b-5a12-8a98-c311adcc9cd5_image_0.webp HTTP/1.1" 201 0
2025-12-05 12:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fba4b20c0-09d7-4688-8a2e-f935ae646c35_35c59a06-ec78-4719-b77a-16f876e8cbd8.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:00:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/ba4b20c0-09d7-4688-8a2e-f935ae646c35_35c59a06-ec78-4719-b77a-16f876e8cbd8.jpg/250x188.webp saved to cache
2025-12-05 12:00:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 08c49a54-cf8b-5a12-8a98-c311adcc9cd5
2025-12-05 12:00:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:00:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:00:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:00:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5b76710>
2025-12-05 12:00:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:00:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:00:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 12:00:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:00:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:00:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:00:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08c49a54-cf8b-5a12-8a98-c311adcc9cd5/08c49a54-cf8b-5a12-8a98-c311adcc9cd5_image_1.webp HTTP/1.1" 201 0
2025-12-05 12:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fba4b20c0-09d7-4688-8a2e-f935ae646c35_dd8d3f11-50b7-4f8a-8cab-20563096f57b.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:00:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/ba4b20c0-09d7-4688-8a2e-f935ae646c35_dd8d3f11-50b7-4f8a-8cab-20563096f57b.jpg/250x188.webp saved to cache
2025-12-05 12:00:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 08c49a54-cf8b-5a12-8a98-c311adcc9cd5
2025-12-05 12:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fba4b20c0-09d7-4688-8a2e-f935ae646c35_e654772d-eca0-460d-a069-5eba39b7578d.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:00:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/ba4b20c0-09d7-4688-8a2e-f935ae646c35_e654772d-eca0-460d-a069-5eba39b7578d.jpg/250x188.webp not downloaded yet
2025-12-05 12:00:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/ba4b20c0-09d7-4688-8a2e-f935ae646c35_df837e3a-c1a7-4774-944f-ed1b065a523f.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:00:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/ba4b20c0-09d7-4688-8a2e-f935ae646c35_1b11f171-91d9-4a76-9505-e14b4b339f83.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fba4b20c0-09d7-4688-8a2e-f935ae646c35_e3f41a90-bbf5-414e-89ed-aee7e1e42b09.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:00:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/ba4b20c0-09d7-4688-8a2e-f935ae646c35_e3f41a90-bbf5-414e-89ed-aee7e1e42b09.jpg/250x188.webp not downloaded yet
2025-12-05 12:00:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:00:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:00:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:00:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e50950>
2025-12-05 12:00:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:00:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:00:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 12:00:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:00:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:00:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:00:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08c49a54-cf8b-5a12-8a98-c311adcc9cd5/08c49a54-cf8b-5a12-8a98-c311adcc9cd5_image_3.webp HTTP/1.1" 201 0
2025-12-05 12:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fba4b20c0-09d7-4688-8a2e-f935ae646c35_c4132f91-45c7-46b4-ba3c-1bdc1317664e.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:00:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/ba4b20c0-09d7-4688-8a2e-f935ae646c35_c4132f91-45c7-46b4-ba3c-1bdc1317664e.jpg/250x188.webp saved to cache
2025-12-05 12:00:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 08c49a54-cf8b-5a12-8a98-c311adcc9cd5
2025-12-05 12:00:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:00:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:00:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:00:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5c383d0>
2025-12-05 12:00:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:00:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:00:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 12:00:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:00:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:00:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:00:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08c49a54-cf8b-5a12-8a98-c311adcc9cd5/08c49a54-cf8b-5a12-8a98-c311adcc9cd5_image_2.webp HTTP/1.1" 201 0
2025-12-05 12:00:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fba4b20c0-09d7-4688-8a2e-f935ae646c35_c7e04605-da0d-48e9-9182-99cd6fc6cd09.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:00:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/ba4b20c0-09d7-4688-8a2e-f935ae646c35_c7e04605-da0d-48e9-9182-99cd6fc6cd09.jpg/250x188.webp saved to cache
2025-12-05 12:00:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 08c49a54-cf8b-5a12-8a98-c311adcc9cd5
2025-12-05 12:00:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fba4b20c0-09d7-4688-8a2e-f935ae646c35_6ebd5c7a-3e09-40fe-98af-4522b1f1e77f.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:00:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/ba4b20c0-09d7-4688-8a2e-f935ae646c35_6ebd5c7a-3e09-40fe-98af-4522b1f1e77f.jpg/250x188.webp not downloaded yet
2025-12-05 12:00:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/ba4b20c0-09d7-4688-8a2e-f935ae646c35_50f2519a-a64e-42ba-a01b-439f209ae5a6.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:00:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/ba4b20c0-09d7-4688-8a2e-f935ae646c35_fe315011-d8d9-4c5e-8672-7435a5e8c5f5.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:00:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fba4b20c0-09d7-4688-8a2e-f935ae646c35_e7f967e9-82c9-46dc-9d73-c46b61f584bb.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:00:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/ba4b20c0-09d7-4688-8a2e-f935ae646c35_e7f967e9-82c9-46dc-9d73-c46b61f584bb.jpg/250x188.webp not downloaded yet
2025-12-05 12:00:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:00:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:00:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:00:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5c743d0>
2025-12-05 12:00:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:00:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:00:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:00:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:00:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:00:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:00:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08c49a54-cf8b-5a12-8a98-c311adcc9cd5/08c49a54-cf8b-5a12-8a98-c311adcc9cd5_image_4.webp HTTP/1.1" 201 0
2025-12-05 12:00:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fba4b20c0-09d7-4688-8a2e-f935ae646c35_df837e3a-c1a7-4774-944f-ed1b065a523f.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:00:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/ba4b20c0-09d7-4688-8a2e-f935ae646c35_df837e3a-c1a7-4774-944f-ed1b065a523f.jpg/250x188.webp saved to cache
2025-12-05 12:00:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 08c49a54-cf8b-5a12-8a98-c311adcc9cd5
2025-12-05 12:00:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:00:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:00:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:00:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5ceea90>
2025-12-05 12:00:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:00:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:00:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 12:00:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:00:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:00:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:00:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08c49a54-cf8b-5a12-8a98-c311adcc9cd5/08c49a54-cf8b-5a12-8a98-c311adcc9cd5_image_5.webp HTTP/1.1" 201 0
2025-12-05 12:00:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fba4b20c0-09d7-4688-8a2e-f935ae646c35_1b11f171-91d9-4a76-9505-e14b4b339f83.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:00:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/ba4b20c0-09d7-4688-8a2e-f935ae646c35_1b11f171-91d9-4a76-9505-e14b4b339f83.jpg/250x188.webp saved to cache
2025-12-05 12:00:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 08c49a54-cf8b-5a12-8a98-c311adcc9cd5
2025-12-05 12:00:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fba4b20c0-09d7-4688-8a2e-f935ae646c35_eb22f962-11d2-4c36-9cb7-2e04dd10774b.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:00:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/ba4b20c0-09d7-4688-8a2e-f935ae646c35_eb22f962-11d2-4c36-9cb7-2e04dd10774b.jpg/250x188.webp not downloaded yet
2025-12-05 12:00:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/ba4b20c0-09d7-4688-8a2e-f935ae646c35_e654772d-eca0-460d-a069-5eba39b7578d.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:00:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/ba4b20c0-09d7-4688-8a2e-f935ae646c35_e3f41a90-bbf5-414e-89ed-aee7e1e42b09.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:00:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fba4b20c0-09d7-4688-8a2e-f935ae646c35_00849d7a-5746-46d6-95c9-2e33675b6bdc.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:00:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/ba4b20c0-09d7-4688-8a2e-f935ae646c35_00849d7a-5746-46d6-95c9-2e33675b6bdc.jpg/250x188.webp not downloaded yet
2025-12-05 12:00:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:00:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:00:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:00:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9dc170790>
2025-12-05 12:00:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:00:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:00:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 12:00:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:00:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:00:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:00:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08c49a54-cf8b-5a12-8a98-c311adcc9cd5/08c49a54-cf8b-5a12-8a98-c311adcc9cd5_image_6.webp HTTP/1.1" 201 0
2025-12-05 12:00:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fba4b20c0-09d7-4688-8a2e-f935ae646c35_50f2519a-a64e-42ba-a01b-439f209ae5a6.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:00:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/ba4b20c0-09d7-4688-8a2e-f935ae646c35_50f2519a-a64e-42ba-a01b-439f209ae5a6.jpg/250x188.webp saved to cache
2025-12-05 12:00:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 08c49a54-cf8b-5a12-8a98-c311adcc9cd5
2025-12-05 12:00:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:00:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:00:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:00:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5c90a90>
2025-12-05 12:00:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:00:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:00:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 12:00:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:00:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:00:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:00:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08c49a54-cf8b-5a12-8a98-c311adcc9cd5/08c49a54-cf8b-5a12-8a98-c311adcc9cd5_image_7.webp HTTP/1.1" 201 0
2025-12-05 12:00:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fba4b20c0-09d7-4688-8a2e-f935ae646c35_fe315011-d8d9-4c5e-8672-7435a5e8c5f5.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:00:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/ba4b20c0-09d7-4688-8a2e-f935ae646c35_fe315011-d8d9-4c5e-8672-7435a5e8c5f5.jpg/250x188.webp saved to cache
2025-12-05 12:00:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 08c49a54-cf8b-5a12-8a98-c311adcc9cd5
2025-12-05 12:00:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%2779812bf1-69dc-4c9f-995d-9d2ce7bfd317%27 HTTP/1.1" 200 None
2025-12-05 12:00:02 [auto_selling_autoscout24.it] INFO: Scrape type for 79812bf1-69dc-4c9f-995d-9d2ce7bfd317: 1
2025-12-05 12:00:02 [auto_selling_autoscout24.it] INFO: Scraping new listing 79812bf1-69dc-4c9f-995d-9d2ce7bfd317
2025-12-05 12:00:02 [auto_selling_autoscout24.it] INFO: Extracting item from listing ID: 79812bf1-69dc-4c9f-995d-9d2ce7bfd317
2025-12-05 12:00:02 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: e3ad4866-7666-5934-8724-88d3f135e1d3 with identifier: 79812bf1-69dc-4c9f-995d-9d2ce7bfd317
2025-12-05 12:00:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item e3ad4866-7666-5934-8724-88d3f135e1d3
2025-12-05 12:00:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F79812bf1-69dc-4c9f-995d-9d2ce7bfd317_1ffa0b8d-6dfb-420e-bcfe-b6a9665a2680.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:00:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/79812bf1-69dc-4c9f-995d-9d2ce7bfd317_1ffa0b8d-6dfb-420e-bcfe-b6a9665a2680.jpg/250x188.webp not downloaded yet
2025-12-05 12:00:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/ba4b20c0-09d7-4688-8a2e-f935ae646c35_e7f967e9-82c9-46dc-9d73-c46b61f584bb.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:00:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/ba4b20c0-09d7-4688-8a2e-f935ae646c35_6ebd5c7a-3e09-40fe-98af-4522b1f1e77f.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:00:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F79812bf1-69dc-4c9f-995d-9d2ce7bfd317_9bf81aa1-12dd-4f82-a0c5-0a57f3dd4f80.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:00:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/79812bf1-69dc-4c9f-995d-9d2ce7bfd317_9bf81aa1-12dd-4f82-a0c5-0a57f3dd4f80.jpg/250x188.webp not downloaded yet
2025-12-05 12:00:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:00:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:00:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:00:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9dc10f550>
2025-12-05 12:00:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:00:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:00:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 12:00:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:00:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:00:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:00:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08c49a54-cf8b-5a12-8a98-c311adcc9cd5/08c49a54-cf8b-5a12-8a98-c311adcc9cd5_image_8.webp HTTP/1.1" 201 0
2025-12-05 12:00:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fba4b20c0-09d7-4688-8a2e-f935ae646c35_e654772d-eca0-460d-a069-5eba39b7578d.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:00:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/ba4b20c0-09d7-4688-8a2e-f935ae646c35_e654772d-eca0-460d-a069-5eba39b7578d.jpg/250x188.webp saved to cache
2025-12-05 12:00:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 08c49a54-cf8b-5a12-8a98-c311adcc9cd5
2025-12-05 12:00:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:00:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:00:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:00:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9dc1006d0>
2025-12-05 12:00:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:00:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:00:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 12:00:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:00:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:00:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:00:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08c49a54-cf8b-5a12-8a98-c311adcc9cd5/08c49a54-cf8b-5a12-8a98-c311adcc9cd5_image_9.webp HTTP/1.1" 201 0
2025-12-05 12:00:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fba4b20c0-09d7-4688-8a2e-f935ae646c35_e3f41a90-bbf5-414e-89ed-aee7e1e42b09.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:00:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/ba4b20c0-09d7-4688-8a2e-f935ae646c35_e3f41a90-bbf5-414e-89ed-aee7e1e42b09.jpg/250x188.webp saved to cache
2025-12-05 12:00:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 08c49a54-cf8b-5a12-8a98-c311adcc9cd5
2025-12-05 12:00:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F79812bf1-69dc-4c9f-995d-9d2ce7bfd317_74bcc93b-4fa6-46ee-ba08-4652c30c9761.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:00:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/79812bf1-69dc-4c9f-995d-9d2ce7bfd317_74bcc93b-4fa6-46ee-ba08-4652c30c9761.jpg/250x188.webp not downloaded yet
2025-12-05 12:00:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/ba4b20c0-09d7-4688-8a2e-f935ae646c35_eb22f962-11d2-4c36-9cb7-2e04dd10774b.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:00:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/ba4b20c0-09d7-4688-8a2e-f935ae646c35_00849d7a-5746-46d6-95c9-2e33675b6bdc.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:00:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F79812bf1-69dc-4c9f-995d-9d2ce7bfd317_b2a9fed3-c38a-45e8-b944-0b0c3841f07a.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:00:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/79812bf1-69dc-4c9f-995d-9d2ce7bfd317_b2a9fed3-c38a-45e8-b944-0b0c3841f07a.jpg/250x188.webp not downloaded yet
2025-12-05 12:00:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:00:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:00:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:00:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e51410>
2025-12-05 12:00:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:00:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:00:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 12:00:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:00:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:00:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:00:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08c49a54-cf8b-5a12-8a98-c311adcc9cd5/08c49a54-cf8b-5a12-8a98-c311adcc9cd5_image_11.webp HTTP/1.1" 201 0
2025-12-05 12:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fba4b20c0-09d7-4688-8a2e-f935ae646c35_e7f967e9-82c9-46dc-9d73-c46b61f584bb.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:00:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/ba4b20c0-09d7-4688-8a2e-f935ae646c35_e7f967e9-82c9-46dc-9d73-c46b61f584bb.jpg/250x188.webp saved to cache
2025-12-05 12:00:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 08c49a54-cf8b-5a12-8a98-c311adcc9cd5
2025-12-05 12:00:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:00:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:00:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:00:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d6f3acd0>
2025-12-05 12:00:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:00:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:00:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:00:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:00:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:00:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:00:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08c49a54-cf8b-5a12-8a98-c311adcc9cd5/08c49a54-cf8b-5a12-8a98-c311adcc9cd5_image_10.webp HTTP/1.1" 201 0
2025-12-05 12:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fba4b20c0-09d7-4688-8a2e-f935ae646c35_6ebd5c7a-3e09-40fe-98af-4522b1f1e77f.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:00:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/ba4b20c0-09d7-4688-8a2e-f935ae646c35_6ebd5c7a-3e09-40fe-98af-4522b1f1e77f.jpg/250x188.webp saved to cache
2025-12-05 12:00:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 08c49a54-cf8b-5a12-8a98-c311adcc9cd5
2025-12-05 12:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F79812bf1-69dc-4c9f-995d-9d2ce7bfd317_339c4a72-6b61-4a26-8564-c60471af1f49.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:00:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/79812bf1-69dc-4c9f-995d-9d2ce7bfd317_339c4a72-6b61-4a26-8564-c60471af1f49.jpg/250x188.webp not downloaded yet
2025-12-05 12:00:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/79812bf1-69dc-4c9f-995d-9d2ce7bfd317_9bf81aa1-12dd-4f82-a0c5-0a57f3dd4f80.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:00:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/79812bf1-69dc-4c9f-995d-9d2ce7bfd317_1ffa0b8d-6dfb-420e-bcfe-b6a9665a2680.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F79812bf1-69dc-4c9f-995d-9d2ce7bfd317_8073f92f-9ee7-4df1-a161-9abb1bd0acaa.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:00:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/79812bf1-69dc-4c9f-995d-9d2ce7bfd317_8073f92f-9ee7-4df1-a161-9abb1bd0acaa.jpg/250x188.webp not downloaded yet
2025-12-05 12:00:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:00:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:00:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:00:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d6f2a890>
2025-12-05 12:00:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:00:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:00:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:00:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:00:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:00:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:00:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08c49a54-cf8b-5a12-8a98-c311adcc9cd5/08c49a54-cf8b-5a12-8a98-c311adcc9cd5_image_12.webp HTTP/1.1" 201 0
2025-12-05 12:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fba4b20c0-09d7-4688-8a2e-f935ae646c35_eb22f962-11d2-4c36-9cb7-2e04dd10774b.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:00:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/ba4b20c0-09d7-4688-8a2e-f935ae646c35_eb22f962-11d2-4c36-9cb7-2e04dd10774b.jpg/250x188.webp saved to cache
2025-12-05 12:00:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 08c49a54-cf8b-5a12-8a98-c311adcc9cd5
2025-12-05 12:00:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:00:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:00:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:00:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d6ff2550>
2025-12-05 12:00:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:00:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:00:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 12:00:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:00:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:00:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:00:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08c49a54-cf8b-5a12-8a98-c311adcc9cd5/08c49a54-cf8b-5a12-8a98-c311adcc9cd5_image_13.webp HTTP/1.1" 201 0
2025-12-05 12:00:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fba4b20c0-09d7-4688-8a2e-f935ae646c35_00849d7a-5746-46d6-95c9-2e33675b6bdc.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:00:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/ba4b20c0-09d7-4688-8a2e-f935ae646c35_00849d7a-5746-46d6-95c9-2e33675b6bdc.jpg/250x188.webp saved to cache
2025-12-05 12:00:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 08c49a54-cf8b-5a12-8a98-c311adcc9cd5
2025-12-05 12:00:04 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 08c49a54-cf8b-5a12-8a98-c311adcc9cd5 from tracking dictionaries
2025-12-05 12:00:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 08c49a54-cf8b-5a12-8a98-c311adcc9cd5 sending to next pipeline
2025-12-05 12:00:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27e29d9a5c-64aa-4939-b3fc-4314b012f398%27 HTTP/1.1" 200 None
2025-12-05 12:00:04 [auto_selling_autoscout24.it] INFO: Scrape type for e29d9a5c-64aa-4939-b3fc-4314b012f398: 1
2025-12-05 12:00:04 [auto_selling_autoscout24.it] INFO: Scraping new listing e29d9a5c-64aa-4939-b3fc-4314b012f398
2025-12-05 12:00:04 [auto_selling_autoscout24.it] INFO: Extracting item from listing ID: e29d9a5c-64aa-4939-b3fc-4314b012f398
2025-12-05 12:00:04 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 55d6803d-e1c7-5cc4-914d-5887653f2afc with identifier: e29d9a5c-64aa-4939-b3fc-4314b012f398
2025-12-05 12:00:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 55d6803d-e1c7-5cc4-914d-5887653f2afc
2025-12-05 12:00:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fe29d9a5c-64aa-4939-b3fc-4314b012f398_1dba7e0e-6993-472c-92c3-3ed5f99e988b.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:00:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/e29d9a5c-64aa-4939-b3fc-4314b012f398_1dba7e0e-6993-472c-92c3-3ed5f99e988b.jpg/250x188.webp not downloaded yet
2025-12-05 12:00:04 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 08c49a54-cf8b-5a12-8a98-c311adcc9cd5 with identifier ba4b20c0-09d7-4688-8a2e-f935ae646c35
2025-12-05 12:00:04 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:00:04 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:00:04 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 08c49a54-cf8b-5a12-8a98-c311adcc9cd5
2025-12-05 12:00:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://prod.pictures.autoscout24.net/listing-images/ba4b20c0-09d7-4688-8a2e-f935ae646c35_00849d7a-5746-46d6-95c9-2e33675b6bdc.jpg/250x188.webp>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'emission_standard': None,
 'engine': None,
 'engine_horse_power': 231,
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': '08c49a54-cf8b-5a12-8a98-c311adcc9cd5',
 'is_damaged': False,
 'is_operable': True,
 'license_plate': None,
 'link_to_web_offer': 'https://www.autoscout24.it/offers/volkswagen-touareg-3-0-v6-tdi-dsg-4motion-prezzo-top-pronta-consegna-diesel-white-ba4b20c0-09d7-4688-8a2e-f935ae646c35',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touareg',
 'odometer': 25800,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08c49a54-cf8b-5a12-8a98-c311adcc9cd5/08c49a54-cf8b-5a12-8a98-c311adcc9cd5_image_0.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4064,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/ba4b20c0-09d7-4688-8a2e-f935ae646c35_35c59a06-ec78-4719-b77a-16f876e8cbd8.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08c49a54-cf8b-5a12-8a98-c311adcc9cd5/08c49a54-cf8b-5a12-8a98-c311adcc9cd5_image_1.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4230,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/ba4b20c0-09d7-4688-8a2e-f935ae646c35_dd8d3f11-50b7-4f8a-8cab-20563096f57b.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08c49a54-cf8b-5a12-8a98-c311adcc9cd5/08c49a54-cf8b-5a12-8a98-c311adcc9cd5_image_2.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4458,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/ba4b20c0-09d7-4688-8a2e-f935ae646c35_c7e04605-da0d-48e9-9182-99cd6fc6cd09.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08c49a54-cf8b-5a12-8a98-c311adcc9cd5/08c49a54-cf8b-5a12-8a98-c311adcc9cd5_image_3.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4238,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/ba4b20c0-09d7-4688-8a2e-f935ae646c35_c4132f91-45c7-46b4-ba3c-1bdc1317664e.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08c49a54-cf8b-5a12-8a98-c311adcc9cd5/08c49a54-cf8b-5a12-8a98-c311adcc9cd5_image_4.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5386,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/ba4b20c0-09d7-4688-8a2e-f935ae646c35_df837e3a-c1a7-4774-944f-ed1b065a523f.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08c49a54-cf8b-5a12-8a98-c311adcc9cd5/08c49a54-cf8b-5a12-8a98-c311adcc9cd5_image_5.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5634,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/ba4b20c0-09d7-4688-8a2e-f935ae646c35_1b11f171-91d9-4a76-9505-e14b4b339f83.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08c49a54-cf8b-5a12-8a98-c311adcc9cd5/08c49a54-cf8b-5a12-8a98-c311adcc9cd5_image_6.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 6930,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/ba4b20c0-09d7-4688-8a2e-f935ae646c35_50f2519a-a64e-42ba-a01b-439f209ae5a6.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08c49a54-cf8b-5a12-8a98-c311adcc9cd5/08c49a54-cf8b-5a12-8a98-c311adcc9cd5_image_7.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 6496,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/ba4b20c0-09d7-4688-8a2e-f935ae646c35_fe315011-d8d9-4c5e-8672-7435a5e8c5f5.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08c49a54-cf8b-5a12-8a98-c311adcc9cd5/08c49a54-cf8b-5a12-8a98-c311adcc9cd5_image_8.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5226,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/ba4b20c0-09d7-4688-8a2e-f935ae646c35_e654772d-eca0-460d-a069-5eba39b7578d.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08c49a54-cf8b-5a12-8a98-c311adcc9cd5/08c49a54-cf8b-5a12-8a98-c311adcc9cd5_image_9.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5646,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/ba4b20c0-09d7-4688-8a2e-f935ae646c35_e3f41a90-bbf5-414e-89ed-aee7e1e42b09.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08c49a54-cf8b-5a12-8a98-c311adcc9cd5/08c49a54-cf8b-5a12-8a98-c311adcc9cd5_image_10.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5020,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/ba4b20c0-09d7-4688-8a2e-f935ae646c35_6ebd5c7a-3e09-40fe-98af-4522b1f1e77f.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08c49a54-cf8b-5a12-8a98-c311adcc9cd5/08c49a54-cf8b-5a12-8a98-c311adcc9cd5_image_11.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4332,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/ba4b20c0-09d7-4688-8a2e-f935ae646c35_e7f967e9-82c9-46dc-9d73-c46b61f584bb.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08c49a54-cf8b-5a12-8a98-c311adcc9cd5/08c49a54-cf8b-5a12-8a98-c311adcc9cd5_image_12.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5080,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/ba4b20c0-09d7-4688-8a2e-f935ae646c35_eb22f962-11d2-4c36-9cb7-2e04dd10774b.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08c49a54-cf8b-5a12-8a98-c311adcc9cd5/08c49a54-cf8b-5a12-8a98-c311adcc9cd5_image_13.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4810,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/ba4b20c0-09d7-4688-8a2e-f935ae646c35_00849d7a-5746-46d6-95c9-2e33675b6bdc.jpg/250x188.webp',
             'Width': 250}],
 'price': 58900,
 'price_includes_vat': False,
 'registration_date': '2024-05-01',
 'seller_name': None,
 'title': 'Volkswagen Touareg 3.0 V6 TDI DSG 4MOTION PREZZO TOP PRONTA '
          'CONSEGNA!',
 'transmission': 'automatic',
 'trim': '3.0 V6 TDI DSG 4MOTION PREZZO TOP PRONTA CONSEGNA!',
 'vin': None,
 'year': 2024}
2025-12-05 12:00:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27ba4b20c0-09d7-4688-8a2e-f935ae646c35%27 HTTP/1.1" 200 None
2025-12-05 12:00:04 [auto_selling_autoscout24.it] INFO: Saving data for ba4b20c0-09d7-4688-8a2e-f935ae646c35: {'created_time': 1764936004.168788, 'last_price_update_time': 1764936004.168798}
2025-12-05 12:00:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autoscout24.it',RowKey='ba4b20c0-09d7-4688-8a2e-f935ae646c35') HTTP/1.1" 204 0
2025-12-05 12:00:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/79812bf1-69dc-4c9f-995d-9d2ce7bfd317_74bcc93b-4fa6-46ee-ba08-4652c30c9761.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:00:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/79812bf1-69dc-4c9f-995d-9d2ce7bfd317_b2a9fed3-c38a-45e8-b944-0b0c3841f07a.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:00:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fe29d9a5c-64aa-4939-b3fc-4314b012f398_72960caa-a6f8-48d0-94dc-c0b728d46823.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:00:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/e29d9a5c-64aa-4939-b3fc-4314b012f398_72960caa-a6f8-48d0-94dc-c0b728d46823.jpg/250x188.webp not downloaded yet
2025-12-05 12:00:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:00:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:00:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:00:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5ce0150>
2025-12-05 12:00:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:00:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:00:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 12:00:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:00:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:00:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:00:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3ad4866-7666-5934-8724-88d3f135e1d3/e3ad4866-7666-5934-8724-88d3f135e1d3_image_1.webp HTTP/1.1" 201 0
2025-12-05 12:00:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F79812bf1-69dc-4c9f-995d-9d2ce7bfd317_9bf81aa1-12dd-4f82-a0c5-0a57f3dd4f80.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:00:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/79812bf1-69dc-4c9f-995d-9d2ce7bfd317_9bf81aa1-12dd-4f82-a0c5-0a57f3dd4f80.jpg/250x188.webp saved to cache
2025-12-05 12:00:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e3ad4866-7666-5934-8724-88d3f135e1d3
2025-12-05 12:00:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:00:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:00:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:00:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e6eb90>
2025-12-05 12:00:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:00:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:00:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 12:00:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:00:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:00:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:00:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3ad4866-7666-5934-8724-88d3f135e1d3/e3ad4866-7666-5934-8724-88d3f135e1d3_image_0.webp HTTP/1.1" 201 0
2025-12-05 12:00:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F79812bf1-69dc-4c9f-995d-9d2ce7bfd317_1ffa0b8d-6dfb-420e-bcfe-b6a9665a2680.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:00:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/79812bf1-69dc-4c9f-995d-9d2ce7bfd317_1ffa0b8d-6dfb-420e-bcfe-b6a9665a2680.jpg/250x188.webp saved to cache
2025-12-05 12:00:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e3ad4866-7666-5934-8724-88d3f135e1d3
2025-12-05 12:00:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fe29d9a5c-64aa-4939-b3fc-4314b012f398_285f4a2d-40cb-4e72-b810-c7a9f50c0533.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:00:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/e29d9a5c-64aa-4939-b3fc-4314b012f398_285f4a2d-40cb-4e72-b810-c7a9f50c0533.jpg/250x188.webp not downloaded yet
2025-12-05 12:00:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/79812bf1-69dc-4c9f-995d-9d2ce7bfd317_8073f92f-9ee7-4df1-a161-9abb1bd0acaa.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:00:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/79812bf1-69dc-4c9f-995d-9d2ce7bfd317_339c4a72-6b61-4a26-8564-c60471af1f49.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:00:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fe29d9a5c-64aa-4939-b3fc-4314b012f398_4870521f-90f0-4040-b898-db4cad635ece.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:00:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/e29d9a5c-64aa-4939-b3fc-4314b012f398_4870521f-90f0-4040-b898-db4cad635ece.jpg/250x188.webp not downloaded yet
2025-12-05 12:00:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:00:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:00:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:00:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5b34750>
2025-12-05 12:00:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:00:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:00:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 12:00:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:00:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:00:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:00:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3ad4866-7666-5934-8724-88d3f135e1d3/e3ad4866-7666-5934-8724-88d3f135e1d3_image_2.webp HTTP/1.1" 201 0
2025-12-05 12:00:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F79812bf1-69dc-4c9f-995d-9d2ce7bfd317_74bcc93b-4fa6-46ee-ba08-4652c30c9761.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:00:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/79812bf1-69dc-4c9f-995d-9d2ce7bfd317_74bcc93b-4fa6-46ee-ba08-4652c30c9761.jpg/250x188.webp saved to cache
2025-12-05 12:00:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e3ad4866-7666-5934-8724-88d3f135e1d3
2025-12-05 12:00:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:00:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:00:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:00:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9dc1ca110>
2025-12-05 12:00:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:00:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:00:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 12:00:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:00:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:00:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:00:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3ad4866-7666-5934-8724-88d3f135e1d3/e3ad4866-7666-5934-8724-88d3f135e1d3_image_3.webp HTTP/1.1" 201 0
2025-12-05 12:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F79812bf1-69dc-4c9f-995d-9d2ce7bfd317_b2a9fed3-c38a-45e8-b944-0b0c3841f07a.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:00:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/79812bf1-69dc-4c9f-995d-9d2ce7bfd317_b2a9fed3-c38a-45e8-b944-0b0c3841f07a.jpg/250x188.webp saved to cache
2025-12-05 12:00:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e3ad4866-7666-5934-8724-88d3f135e1d3
2025-12-05 12:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fe29d9a5c-64aa-4939-b3fc-4314b012f398_785e72e5-749b-43c1-abd8-5a4b19bfadab.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:00:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/e29d9a5c-64aa-4939-b3fc-4314b012f398_785e72e5-749b-43c1-abd8-5a4b19bfadab.jpg/250x188.webp not downloaded yet
2025-12-05 12:00:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/e29d9a5c-64aa-4939-b3fc-4314b012f398_72960caa-a6f8-48d0-94dc-c0b728d46823.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:00:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/e29d9a5c-64aa-4939-b3fc-4314b012f398_1dba7e0e-6993-472c-92c3-3ed5f99e988b.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fe29d9a5c-64aa-4939-b3fc-4314b012f398_1664469e-4bb4-45ef-89bd-55146566bd55.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:00:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/e29d9a5c-64aa-4939-b3fc-4314b012f398_1664469e-4bb4-45ef-89bd-55146566bd55.jpg/250x188.webp not downloaded yet
2025-12-05 12:00:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:00:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:00:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:00:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9dc10d410>
2025-12-05 12:00:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:00:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:00:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:00:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:00:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:00:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:00:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3ad4866-7666-5934-8724-88d3f135e1d3/e3ad4866-7666-5934-8724-88d3f135e1d3_image_5.webp HTTP/1.1" 201 0
2025-12-05 12:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F79812bf1-69dc-4c9f-995d-9d2ce7bfd317_8073f92f-9ee7-4df1-a161-9abb1bd0acaa.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:00:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/79812bf1-69dc-4c9f-995d-9d2ce7bfd317_8073f92f-9ee7-4df1-a161-9abb1bd0acaa.jpg/250x188.webp saved to cache
2025-12-05 12:00:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e3ad4866-7666-5934-8724-88d3f135e1d3
2025-12-05 12:00:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:00:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:00:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:00:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5c734d0>
2025-12-05 12:00:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:00:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:00:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:00:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:00:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:00:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:00:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3ad4866-7666-5934-8724-88d3f135e1d3/e3ad4866-7666-5934-8724-88d3f135e1d3_image_4.webp HTTP/1.1" 201 0
2025-12-05 12:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F79812bf1-69dc-4c9f-995d-9d2ce7bfd317_339c4a72-6b61-4a26-8564-c60471af1f49.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:00:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/79812bf1-69dc-4c9f-995d-9d2ce7bfd317_339c4a72-6b61-4a26-8564-c60471af1f49.jpg/250x188.webp saved to cache
2025-12-05 12:00:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e3ad4866-7666-5934-8724-88d3f135e1d3
2025-12-05 12:00:05 [crawlers.middlewares.photo_download_middleware] INFO: Removing item e3ad4866-7666-5934-8724-88d3f135e1d3 from tracking dictionaries
2025-12-05 12:00:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e3ad4866-7666-5934-8724-88d3f135e1d3 sending to next pipeline
2025-12-05 12:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fe29d9a5c-64aa-4939-b3fc-4314b012f398_e0e5164c-4a92-4aa1-856f-8a8c4d5eb216.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:00:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/e29d9a5c-64aa-4939-b3fc-4314b012f398_e0e5164c-4a92-4aa1-856f-8a8c4d5eb216.jpg/250x188.webp not downloaded yet
2025-12-05 12:00:05 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: e3ad4866-7666-5934-8724-88d3f135e1d3 with identifier 79812bf1-69dc-4c9f-995d-9d2ce7bfd317
2025-12-05 12:00:05 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:00:05 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:00:05 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item e3ad4866-7666-5934-8724-88d3f135e1d3
2025-12-05 12:00:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://prod.pictures.autoscout24.net/listing-images/79812bf1-69dc-4c9f-995d-9d2ce7bfd317_339c4a72-6b61-4a26-8564-c60471af1f49.jpg/250x188.webp>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'emission_standard': None,
 'engine': None,
 'engine_horse_power': 354,
 'expiration_date': None,
 'fuel_type': 'Gasoline',
 'id': 'e3ad4866-7666-5934-8724-88d3f135e1d3',
 'is_damaged': False,
 'is_operable': True,
 'license_plate': None,
 'link_to_web_offer': 'https://www.autoscout24.it/offers/porsche-cayenne-3-0-pdk-354cv-matrix-360-bose-tetto-only-promo-gasoline-grey-79812bf1-69dc-4c9f-995d-9d2ce7bfd317',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Cayenne',
 'odometer': 1000,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3ad4866-7666-5934-8724-88d3f135e1d3/e3ad4866-7666-5934-8724-88d3f135e1d3_image_0.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4262,
             'Height': 177,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/79812bf1-69dc-4c9f-995d-9d2ce7bfd317_1ffa0b8d-6dfb-420e-bcfe-b6a9665a2680.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3ad4866-7666-5934-8724-88d3f135e1d3/e3ad4866-7666-5934-8724-88d3f135e1d3_image_1.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3380,
             'Height': 171,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/79812bf1-69dc-4c9f-995d-9d2ce7bfd317_9bf81aa1-12dd-4f82-a0c5-0a57f3dd4f80.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3ad4866-7666-5934-8724-88d3f135e1d3/e3ad4866-7666-5934-8724-88d3f135e1d3_image_2.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3590,
             'Height': 183,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/79812bf1-69dc-4c9f-995d-9d2ce7bfd317_74bcc93b-4fa6-46ee-ba08-4652c30c9761.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3ad4866-7666-5934-8724-88d3f135e1d3/e3ad4866-7666-5934-8724-88d3f135e1d3_image_3.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3082,
             'Height': 188,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/79812bf1-69dc-4c9f-995d-9d2ce7bfd317_b2a9fed3-c38a-45e8-b944-0b0c3841f07a.jpg/250x188.webp',
             'Width': 216},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3ad4866-7666-5934-8724-88d3f135e1d3/e3ad4866-7666-5934-8724-88d3f135e1d3_image_4.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 7288,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/79812bf1-69dc-4c9f-995d-9d2ce7bfd317_339c4a72-6b61-4a26-8564-c60471af1f49.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3ad4866-7666-5934-8724-88d3f135e1d3/e3ad4866-7666-5934-8724-88d3f135e1d3_image_5.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 7040,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/79812bf1-69dc-4c9f-995d-9d2ce7bfd317_8073f92f-9ee7-4df1-a161-9abb1bd0acaa.jpg/250x188.webp',
             'Width': 250}],
 'price': 119800,
 'price_includes_vat': False,
 'registration_date': '2025-02-01',
 'seller_name': None,
 'title': 'Porsche Cayenne 3.0 PDK 354CV *MATRIX+360+BOSE+TETTO* ONLY PROMO',
 'transmission': 'automatic',
 'trim': '3.0 PDK 354CV *MATRIX+360+BOSE+TETTO* ONLY PROMO',
 'vin': None,
 'year': 2025}
2025-12-05 12:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%2779812bf1-69dc-4c9f-995d-9d2ce7bfd317%27 HTTP/1.1" 200 None
2025-12-05 12:00:05 [auto_selling_autoscout24.it] INFO: Saving data for 79812bf1-69dc-4c9f-995d-9d2ce7bfd317: {'created_time': 1764936005.919267, 'last_price_update_time': 1764936005.919281}
2025-12-05 12:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autoscout24.it',RowKey='79812bf1-69dc-4c9f-995d-9d2ce7bfd317') HTTP/1.1" 204 0
2025-12-05 12:00:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/e29d9a5c-64aa-4939-b3fc-4314b012f398_4870521f-90f0-4040-b898-db4cad635ece.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:00:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/e29d9a5c-64aa-4939-b3fc-4314b012f398_285f4a2d-40cb-4e72-b810-c7a9f50c0533.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fe29d9a5c-64aa-4939-b3fc-4314b012f398_3b475efc-afbd-498f-aa63-d6b99e54c928.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/e29d9a5c-64aa-4939-b3fc-4314b012f398_3b475efc-afbd-498f-aa63-d6b99e54c928.jpg/250x188.webp not downloaded yet
2025-12-05 12:00:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:00:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:00:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:00:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e89250>
2025-12-05 12:00:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:00:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:00:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:00:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:00:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:00:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:00:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55d6803d-e1c7-5cc4-914d-5887653f2afc/55d6803d-e1c7-5cc4-914d-5887653f2afc_image_1.webp HTTP/1.1" 201 0
2025-12-05 12:00:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fe29d9a5c-64aa-4939-b3fc-4314b012f398_72960caa-a6f8-48d0-94dc-c0b728d46823.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/e29d9a5c-64aa-4939-b3fc-4314b012f398_72960caa-a6f8-48d0-94dc-c0b728d46823.jpg/250x188.webp saved to cache
2025-12-05 12:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 55d6803d-e1c7-5cc4-914d-5887653f2afc
2025-12-05 12:00:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:00:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:00:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:00:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e97910>
2025-12-05 12:00:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:00:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:00:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 12:00:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:00:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:00:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:00:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55d6803d-e1c7-5cc4-914d-5887653f2afc/55d6803d-e1c7-5cc4-914d-5887653f2afc_image_0.webp HTTP/1.1" 201 0
2025-12-05 12:00:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fe29d9a5c-64aa-4939-b3fc-4314b012f398_1dba7e0e-6993-472c-92c3-3ed5f99e988b.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/e29d9a5c-64aa-4939-b3fc-4314b012f398_1dba7e0e-6993-472c-92c3-3ed5f99e988b.jpg/250x188.webp saved to cache
2025-12-05 12:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 55d6803d-e1c7-5cc4-914d-5887653f2afc
2025-12-05 12:00:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/e29d9a5c-64aa-4939-b3fc-4314b012f398_785e72e5-749b-43c1-abd8-5a4b19bfadab.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:00:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fe29d9a5c-64aa-4939-b3fc-4314b012f398_8a267d8c-5683-42f8-b64b-47bc952d923e.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/e29d9a5c-64aa-4939-b3fc-4314b012f398_8a267d8c-5683-42f8-b64b-47bc952d923e.jpg/250x188.webp not downloaded yet
2025-12-05 12:00:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/e29d9a5c-64aa-4939-b3fc-4314b012f398_1664469e-4bb4-45ef-89bd-55146566bd55.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:00:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:00:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:00:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:00:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d6f2b4d0>
2025-12-05 12:00:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:00:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:00:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 12:00:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:00:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:00:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:00:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55d6803d-e1c7-5cc4-914d-5887653f2afc/55d6803d-e1c7-5cc4-914d-5887653f2afc_image_3.webp HTTP/1.1" 201 0
2025-12-05 12:00:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fe29d9a5c-64aa-4939-b3fc-4314b012f398_4870521f-90f0-4040-b898-db4cad635ece.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/e29d9a5c-64aa-4939-b3fc-4314b012f398_4870521f-90f0-4040-b898-db4cad635ece.jpg/250x188.webp saved to cache
2025-12-05 12:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 55d6803d-e1c7-5cc4-914d-5887653f2afc
2025-12-05 12:00:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:00:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:00:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:00:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e4fbd0>
2025-12-05 12:00:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:00:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:00:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:00:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:00:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:00:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:00:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55d6803d-e1c7-5cc4-914d-5887653f2afc/55d6803d-e1c7-5cc4-914d-5887653f2afc_image_2.webp HTTP/1.1" 201 0
2025-12-05 12:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fe29d9a5c-64aa-4939-b3fc-4314b012f398_285f4a2d-40cb-4e72-b810-c7a9f50c0533.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:00:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/e29d9a5c-64aa-4939-b3fc-4314b012f398_285f4a2d-40cb-4e72-b810-c7a9f50c0533.jpg/250x188.webp saved to cache
2025-12-05 12:00:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 55d6803d-e1c7-5cc4-914d-5887653f2afc
2025-12-05 12:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fe29d9a5c-64aa-4939-b3fc-4314b012f398_51c3f26c-1b4f-4f06-b204-fbffe6bf1d78.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:00:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/e29d9a5c-64aa-4939-b3fc-4314b012f398_51c3f26c-1b4f-4f06-b204-fbffe6bf1d78.jpg/250x188.webp not downloaded yet
2025-12-05 12:00:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/e29d9a5c-64aa-4939-b3fc-4314b012f398_e0e5164c-4a92-4aa1-856f-8a8c4d5eb216.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27ff7e076c-ad44-4d12-9112-2d93e91890a6%27 HTTP/1.1" 200 None
2025-12-05 12:00:07 [auto_selling_autoscout24.it] INFO: Scrape type for ff7e076c-ad44-4d12-9112-2d93e91890a6: 1
2025-12-05 12:00:07 [auto_selling_autoscout24.it] INFO: Scraping new listing ff7e076c-ad44-4d12-9112-2d93e91890a6
2025-12-05 12:00:07 [auto_selling_autoscout24.it] INFO: Extracting item from listing ID: ff7e076c-ad44-4d12-9112-2d93e91890a6
2025-12-05 12:00:07 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 35a81efd-5ad4-5ca4-a4e8-d32a916b3bed with identifier: ff7e076c-ad44-4d12-9112-2d93e91890a6
2025-12-05 12:00:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 4 photos for item 35a81efd-5ad4-5ca4-a4e8-d32a916b3bed
2025-12-05 12:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fff7e076c-ad44-4d12-9112-2d93e91890a6_32ffef28-6123-48d2-b785-9328980798eb.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:00:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/ff7e076c-ad44-4d12-9112-2d93e91890a6_32ffef28-6123-48d2-b785-9328980798eb.jpg/250x188.webp not downloaded yet
2025-12-05 12:00:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:00:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:00:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:00:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9dd5c8dd0>
2025-12-05 12:00:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:00:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:00:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:00:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:00:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:00:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:00:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55d6803d-e1c7-5cc4-914d-5887653f2afc/55d6803d-e1c7-5cc4-914d-5887653f2afc_image_4.webp HTTP/1.1" 201 0
2025-12-05 12:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fe29d9a5c-64aa-4939-b3fc-4314b012f398_785e72e5-749b-43c1-abd8-5a4b19bfadab.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:00:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/e29d9a5c-64aa-4939-b3fc-4314b012f398_785e72e5-749b-43c1-abd8-5a4b19bfadab.jpg/250x188.webp saved to cache
2025-12-05 12:00:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 55d6803d-e1c7-5cc4-914d-5887653f2afc
2025-12-05 12:00:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:00:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:00:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:00:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9dd5fe010>
2025-12-05 12:00:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:00:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:00:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 12:00:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:00:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:00:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:00:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55d6803d-e1c7-5cc4-914d-5887653f2afc/55d6803d-e1c7-5cc4-914d-5887653f2afc_image_5.webp HTTP/1.1" 201 0
2025-12-05 12:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fe29d9a5c-64aa-4939-b3fc-4314b012f398_1664469e-4bb4-45ef-89bd-55146566bd55.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:00:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/e29d9a5c-64aa-4939-b3fc-4314b012f398_1664469e-4bb4-45ef-89bd-55146566bd55.jpg/250x188.webp saved to cache
2025-12-05 12:00:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 55d6803d-e1c7-5cc4-914d-5887653f2afc
2025-12-05 12:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fff7e076c-ad44-4d12-9112-2d93e91890a6_5f312891-e52d-4a8c-b495-1c13d87c1a0f.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:00:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/ff7e076c-ad44-4d12-9112-2d93e91890a6_5f312891-e52d-4a8c-b495-1c13d87c1a0f.jpg/250x188.webp not downloaded yet
2025-12-05 12:00:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/e29d9a5c-64aa-4939-b3fc-4314b012f398_3b475efc-afbd-498f-aa63-d6b99e54c928.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:00:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/e29d9a5c-64aa-4939-b3fc-4314b012f398_8a267d8c-5683-42f8-b64b-47bc952d923e.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fff7e076c-ad44-4d12-9112-2d93e91890a6_94ac8861-2de2-4a24-b5ca-86741b4bf523.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:00:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/ff7e076c-ad44-4d12-9112-2d93e91890a6_94ac8861-2de2-4a24-b5ca-86741b4bf523.jpg/250x188.webp not downloaded yet
2025-12-05 12:00:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:00:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:00:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:00:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e25e50>
2025-12-05 12:00:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:00:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:00:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 12:00:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:00:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:00:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:00:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55d6803d-e1c7-5cc4-914d-5887653f2afc/55d6803d-e1c7-5cc4-914d-5887653f2afc_image_6.webp HTTP/1.1" 201 0
2025-12-05 12:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fe29d9a5c-64aa-4939-b3fc-4314b012f398_e0e5164c-4a92-4aa1-856f-8a8c4d5eb216.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:00:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/e29d9a5c-64aa-4939-b3fc-4314b012f398_e0e5164c-4a92-4aa1-856f-8a8c4d5eb216.jpg/250x188.webp saved to cache
2025-12-05 12:00:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 55d6803d-e1c7-5cc4-914d-5887653f2afc
2025-12-05 12:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fff7e076c-ad44-4d12-9112-2d93e91890a6_9c5471e1-a3ef-4d47-828b-0008b7e58f01.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:00:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/ff7e076c-ad44-4d12-9112-2d93e91890a6_9c5471e1-a3ef-4d47-828b-0008b7e58f01.jpg/250x188.webp not downloaded yet
2025-12-05 12:00:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/ff7e076c-ad44-4d12-9112-2d93e91890a6_32ffef28-6123-48d2-b785-9328980798eb.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:00:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/e29d9a5c-64aa-4939-b3fc-4314b012f398_51c3f26c-1b4f-4f06-b204-fbffe6bf1d78.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%2708299329-ec72-4339-9891-6b2b4447a33a%27 HTTP/1.1" 200 None
2025-12-05 12:00:08 [auto_selling_autoscout24.it] INFO: Scrape type for 08299329-ec72-4339-9891-6b2b4447a33a: 1
2025-12-05 12:00:08 [auto_selling_autoscout24.it] INFO: Scraping new listing 08299329-ec72-4339-9891-6b2b4447a33a
2025-12-05 12:00:08 [auto_selling_autoscout24.it] INFO: Extracting item from listing ID: 08299329-ec72-4339-9891-6b2b4447a33a
2025-12-05 12:00:08 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 99413123-5001-52d3-9979-b0fb29734709 with identifier: 08299329-ec72-4339-9891-6b2b4447a33a
2025-12-05 12:00:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 99413123-5001-52d3-9979-b0fb29734709
2025-12-05 12:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F08299329-ec72-4339-9891-6b2b4447a33a_9a62692d-de83-4ab1-94a2-5b5c608ba806.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:00:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/08299329-ec72-4339-9891-6b2b4447a33a_9a62692d-de83-4ab1-94a2-5b5c608ba806.jpg/250x188.webp not downloaded yet
2025-12-05 12:00:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:00:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:00:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:00:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e73210>
2025-12-05 12:00:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:00:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:00:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:00:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:00:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:00:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:00:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55d6803d-e1c7-5cc4-914d-5887653f2afc/55d6803d-e1c7-5cc4-914d-5887653f2afc_image_7.webp HTTP/1.1" 201 0
2025-12-05 12:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fe29d9a5c-64aa-4939-b3fc-4314b012f398_3b475efc-afbd-498f-aa63-d6b99e54c928.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:00:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/e29d9a5c-64aa-4939-b3fc-4314b012f398_3b475efc-afbd-498f-aa63-d6b99e54c928.jpg/250x188.webp saved to cache
2025-12-05 12:00:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 55d6803d-e1c7-5cc4-914d-5887653f2afc
2025-12-05 12:00:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:00:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:00:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:00:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e66850>
2025-12-05 12:00:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:00:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:00:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:00:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:00:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:00:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:00:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55d6803d-e1c7-5cc4-914d-5887653f2afc/55d6803d-e1c7-5cc4-914d-5887653f2afc_image_8.webp HTTP/1.1" 201 0
2025-12-05 12:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fe29d9a5c-64aa-4939-b3fc-4314b012f398_8a267d8c-5683-42f8-b64b-47bc952d923e.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:00:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/e29d9a5c-64aa-4939-b3fc-4314b012f398_8a267d8c-5683-42f8-b64b-47bc952d923e.jpg/250x188.webp saved to cache
2025-12-05 12:00:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 55d6803d-e1c7-5cc4-914d-5887653f2afc
2025-12-05 12:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F08299329-ec72-4339-9891-6b2b4447a33a_56fed453-8062-4417-b6e5-15e3e5bd7679.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:00:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/08299329-ec72-4339-9891-6b2b4447a33a_56fed453-8062-4417-b6e5-15e3e5bd7679.jpg/250x188.webp not downloaded yet
2025-12-05 12:00:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/ff7e076c-ad44-4d12-9112-2d93e91890a6_94ac8861-2de2-4a24-b5ca-86741b4bf523.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:00:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/ff7e076c-ad44-4d12-9112-2d93e91890a6_5f312891-e52d-4a8c-b495-1c13d87c1a0f.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F08299329-ec72-4339-9891-6b2b4447a33a_d7cf131a-0d0a-45ea-b104-769b6612b38d.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:00:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/08299329-ec72-4339-9891-6b2b4447a33a_d7cf131a-0d0a-45ea-b104-769b6612b38d.jpg/250x188.webp not downloaded yet
2025-12-05 12:00:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:00:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:00:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:00:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5c16950>
2025-12-05 12:00:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:00:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:00:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 12:00:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:00:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:00:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:00:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35a81efd-5ad4-5ca4-a4e8-d32a916b3bed/35a81efd-5ad4-5ca4-a4e8-d32a916b3bed_image_0.webp HTTP/1.1" 201 0
2025-12-05 12:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fff7e076c-ad44-4d12-9112-2d93e91890a6_32ffef28-6123-48d2-b785-9328980798eb.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:00:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/ff7e076c-ad44-4d12-9112-2d93e91890a6_32ffef28-6123-48d2-b785-9328980798eb.jpg/250x188.webp saved to cache
2025-12-05 12:00:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 35a81efd-5ad4-5ca4-a4e8-d32a916b3bed
2025-12-05 12:00:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:00:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:00:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:00:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e52610>
2025-12-05 12:00:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:00:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:00:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 12:00:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:00:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:00:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:00:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55d6803d-e1c7-5cc4-914d-5887653f2afc/55d6803d-e1c7-5cc4-914d-5887653f2afc_image_9.webp HTTP/1.1" 201 0
2025-12-05 12:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fe29d9a5c-64aa-4939-b3fc-4314b012f398_51c3f26c-1b4f-4f06-b204-fbffe6bf1d78.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:00:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/e29d9a5c-64aa-4939-b3fc-4314b012f398_51c3f26c-1b4f-4f06-b204-fbffe6bf1d78.jpg/250x188.webp saved to cache
2025-12-05 12:00:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 55d6803d-e1c7-5cc4-914d-5887653f2afc
2025-12-05 12:00:09 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 55d6803d-e1c7-5cc4-914d-5887653f2afc from tracking dictionaries
2025-12-05 12:00:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 55d6803d-e1c7-5cc4-914d-5887653f2afc sending to next pipeline
2025-12-05 12:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F08299329-ec72-4339-9891-6b2b4447a33a_18cd78d7-786c-41f6-ad8e-70c5c912d51f.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:00:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/08299329-ec72-4339-9891-6b2b4447a33a_18cd78d7-786c-41f6-ad8e-70c5c912d51f.jpg/250x188.webp not downloaded yet
2025-12-05 12:00:09 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 55d6803d-e1c7-5cc4-914d-5887653f2afc with identifier e29d9a5c-64aa-4939-b3fc-4314b012f398
2025-12-05 12:00:09 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:00:09 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:00:09 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 55d6803d-e1c7-5cc4-914d-5887653f2afc
2025-12-05 12:00:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://prod.pictures.autoscout24.net/listing-images/e29d9a5c-64aa-4939-b3fc-4314b012f398_51c3f26c-1b4f-4f06-b204-fbffe6bf1d78.jpg/250x188.webp>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'emission_standard': None,
 'engine': None,
 'engine_horse_power': 150,
 'expiration_date': None,
 'fuel_type': 'Electric/Gasoline',
 'id': '55d6803d-e1c7-5cc4-914d-5887653f2afc',
 'is_damaged': False,
 'is_operable': True,
 'license_plate': None,
 'link_to_web_offer': 'https://www.autoscout24.it/offers/audi-q3-s-line-edition-35-tfsi-m-hev-150cv-s-tronic-promo-electric-gasoline-grey-e29d9a5c-64aa-4939-b3fc-4314b012f398',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 58900,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 10,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55d6803d-e1c7-5cc4-914d-5887653f2afc/55d6803d-e1c7-5cc4-914d-5887653f2afc_image_0.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5004,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/e29d9a5c-64aa-4939-b3fc-4314b012f398_1dba7e0e-6993-472c-92c3-3ed5f99e988b.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55d6803d-e1c7-5cc4-914d-5887653f2afc/55d6803d-e1c7-5cc4-914d-5887653f2afc_image_1.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4752,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/e29d9a5c-64aa-4939-b3fc-4314b012f398_72960caa-a6f8-48d0-94dc-c0b728d46823.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55d6803d-e1c7-5cc4-914d-5887653f2afc/55d6803d-e1c7-5cc4-914d-5887653f2afc_image_2.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5090,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/e29d9a5c-64aa-4939-b3fc-4314b012f398_285f4a2d-40cb-4e72-b810-c7a9f50c0533.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55d6803d-e1c7-5cc4-914d-5887653f2afc/55d6803d-e1c7-5cc4-914d-5887653f2afc_image_3.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4738,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/e29d9a5c-64aa-4939-b3fc-4314b012f398_4870521f-90f0-4040-b898-db4cad635ece.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55d6803d-e1c7-5cc4-914d-5887653f2afc/55d6803d-e1c7-5cc4-914d-5887653f2afc_image_4.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 6252,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/e29d9a5c-64aa-4939-b3fc-4314b012f398_785e72e5-749b-43c1-abd8-5a4b19bfadab.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55d6803d-e1c7-5cc4-914d-5887653f2afc/55d6803d-e1c7-5cc4-914d-5887653f2afc_image_5.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 7166,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/e29d9a5c-64aa-4939-b3fc-4314b012f398_1664469e-4bb4-45ef-89bd-55146566bd55.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55d6803d-e1c7-5cc4-914d-5887653f2afc/55d6803d-e1c7-5cc4-914d-5887653f2afc_image_6.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 6306,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/e29d9a5c-64aa-4939-b3fc-4314b012f398_e0e5164c-4a92-4aa1-856f-8a8c4d5eb216.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55d6803d-e1c7-5cc4-914d-5887653f2afc/55d6803d-e1c7-5cc4-914d-5887653f2afc_image_7.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4604,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/e29d9a5c-64aa-4939-b3fc-4314b012f398_3b475efc-afbd-498f-aa63-d6b99e54c928.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55d6803d-e1c7-5cc4-914d-5887653f2afc/55d6803d-e1c7-5cc4-914d-5887653f2afc_image_8.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5306,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/e29d9a5c-64aa-4939-b3fc-4314b012f398_8a267d8c-5683-42f8-b64b-47bc952d923e.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55d6803d-e1c7-5cc4-914d-5887653f2afc/55d6803d-e1c7-5cc4-914d-5887653f2afc_image_9.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3906,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/e29d9a5c-64aa-4939-b3fc-4314b012f398_51c3f26c-1b4f-4f06-b204-fbffe6bf1d78.jpg/250x188.webp',
             'Width': 250}],
 'price': 29800,
 'price_includes_vat': False,
 'registration_date': '2021-02-01',
 'seller_name': None,
 'title': 'Audi Q3 S-LINE EDITION 35 TFSI M-HEV 150CV S-TRONIC PROMO!',
 'transmission': 'automatic',
 'trim': 'S-LINE EDITION 35 TFSI M-HEV 150CV S-TRONIC PROMO!',
 'vin': None,
 'year': 2021}
2025-12-05 12:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27e29d9a5c-64aa-4939-b3fc-4314b012f398%27 HTTP/1.1" 200 None
2025-12-05 12:00:09 [auto_selling_autoscout24.it] INFO: Saving data for e29d9a5c-64aa-4939-b3fc-4314b012f398: {'created_time': 1764936009.075217, 'last_price_update_time': 1764936009.075225}
2025-12-05 12:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autoscout24.it',RowKey='e29d9a5c-64aa-4939-b3fc-4314b012f398') HTTP/1.1" 204 0
2025-12-05 12:00:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/08299329-ec72-4339-9891-6b2b4447a33a_9a62692d-de83-4ab1-94a2-5b5c608ba806.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:00:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/ff7e076c-ad44-4d12-9112-2d93e91890a6_9c5471e1-a3ef-4d47-828b-0008b7e58f01.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:00:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/08299329-ec72-4339-9891-6b2b4447a33a_56fed453-8062-4417-b6e5-15e3e5bd7679.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F08299329-ec72-4339-9891-6b2b4447a33a_0290f895-5f37-4916-a38e-0f885adc81bb.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:00:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/08299329-ec72-4339-9891-6b2b4447a33a_0290f895-5f37-4916-a38e-0f885adc81bb.jpg/250x188.webp not downloaded yet
2025-12-05 12:00:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:00:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:00:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:00:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5b4e910>
2025-12-05 12:00:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:00:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:00:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 12:00:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:00:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:00:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:00:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35a81efd-5ad4-5ca4-a4e8-d32a916b3bed/35a81efd-5ad4-5ca4-a4e8-d32a916b3bed_image_2.webp HTTP/1.1" 201 0
2025-12-05 12:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fff7e076c-ad44-4d12-9112-2d93e91890a6_94ac8861-2de2-4a24-b5ca-86741b4bf523.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:00:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/ff7e076c-ad44-4d12-9112-2d93e91890a6_94ac8861-2de2-4a24-b5ca-86741b4bf523.jpg/250x188.webp saved to cache
2025-12-05 12:00:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 35a81efd-5ad4-5ca4-a4e8-d32a916b3bed
2025-12-05 12:00:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:00:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:00:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:00:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e71950>
2025-12-05 12:00:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:00:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:00:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:00:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:00:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:00:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:00:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35a81efd-5ad4-5ca4-a4e8-d32a916b3bed/35a81efd-5ad4-5ca4-a4e8-d32a916b3bed_image_1.webp HTTP/1.1" 201 0
2025-12-05 12:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fff7e076c-ad44-4d12-9112-2d93e91890a6_5f312891-e52d-4a8c-b495-1c13d87c1a0f.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:00:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/ff7e076c-ad44-4d12-9112-2d93e91890a6_5f312891-e52d-4a8c-b495-1c13d87c1a0f.jpg/250x188.webp saved to cache
2025-12-05 12:00:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 35a81efd-5ad4-5ca4-a4e8-d32a916b3bed
2025-12-05 12:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F08299329-ec72-4339-9891-6b2b4447a33a_1e149631-e112-4a1c-ac8f-4f3ec998f521.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:00:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/08299329-ec72-4339-9891-6b2b4447a33a_1e149631-e112-4a1c-ac8f-4f3ec998f521.jpg/250x188.webp not downloaded yet
2025-12-05 12:00:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/08299329-ec72-4339-9891-6b2b4447a33a_d7cf131a-0d0a-45ea-b104-769b6612b38d.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F08299329-ec72-4339-9891-6b2b4447a33a_052ead07-bb8a-49da-b2b3-17394f1731eb.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:00:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/08299329-ec72-4339-9891-6b2b4447a33a_052ead07-bb8a-49da-b2b3-17394f1731eb.jpg/250x188.webp not downloaded yet
2025-12-05 12:00:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:00:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:00:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:00:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e3e950>
2025-12-05 12:00:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:00:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:00:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 12:00:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:00:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:00:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:00:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99413123-5001-52d3-9979-b0fb29734709/99413123-5001-52d3-9979-b0fb29734709_image_0.webp HTTP/1.1" 201 0
2025-12-05 12:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F08299329-ec72-4339-9891-6b2b4447a33a_9a62692d-de83-4ab1-94a2-5b5c608ba806.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:00:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/08299329-ec72-4339-9891-6b2b4447a33a_9a62692d-de83-4ab1-94a2-5b5c608ba806.jpg/250x188.webp saved to cache
2025-12-05 12:00:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 99413123-5001-52d3-9979-b0fb29734709
2025-12-05 12:00:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:00:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:00:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:00:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5c78e10>
2025-12-05 12:00:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:00:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:00:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:00:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:00:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:00:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:00:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35a81efd-5ad4-5ca4-a4e8-d32a916b3bed/35a81efd-5ad4-5ca4-a4e8-d32a916b3bed_image_3.webp HTTP/1.1" 201 0
2025-12-05 12:00:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fff7e076c-ad44-4d12-9112-2d93e91890a6_9c5471e1-a3ef-4d47-828b-0008b7e58f01.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/ff7e076c-ad44-4d12-9112-2d93e91890a6_9c5471e1-a3ef-4d47-828b-0008b7e58f01.jpg/250x188.webp saved to cache
2025-12-05 12:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 35a81efd-5ad4-5ca4-a4e8-d32a916b3bed
2025-12-05 12:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 35a81efd-5ad4-5ca4-a4e8-d32a916b3bed from tracking dictionaries
2025-12-05 12:00:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 35a81efd-5ad4-5ca4-a4e8-d32a916b3bed sending to next pipeline
2025-12-05 12:00:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:00:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:00:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:00:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e3f950>
2025-12-05 12:00:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:00:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:00:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:00:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:00:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:00:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:00:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99413123-5001-52d3-9979-b0fb29734709/99413123-5001-52d3-9979-b0fb29734709_image_1.webp HTTP/1.1" 201 0
2025-12-05 12:00:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F08299329-ec72-4339-9891-6b2b4447a33a_56fed453-8062-4417-b6e5-15e3e5bd7679.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/08299329-ec72-4339-9891-6b2b4447a33a_56fed453-8062-4417-b6e5-15e3e5bd7679.jpg/250x188.webp saved to cache
2025-12-05 12:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 99413123-5001-52d3-9979-b0fb29734709
2025-12-05 12:00:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F08299329-ec72-4339-9891-6b2b4447a33a_73ca0175-e211-4ac1-bf21-26f1d7ad5b1d.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/08299329-ec72-4339-9891-6b2b4447a33a_73ca0175-e211-4ac1-bf21-26f1d7ad5b1d.jpg/250x188.webp not downloaded yet
2025-12-05 12:00:10 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 35a81efd-5ad4-5ca4-a4e8-d32a916b3bed with identifier ff7e076c-ad44-4d12-9112-2d93e91890a6
2025-12-05 12:00:10 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:00:10 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:00:10 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 35a81efd-5ad4-5ca4-a4e8-d32a916b3bed
2025-12-05 12:00:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://prod.pictures.autoscout24.net/listing-images/ff7e076c-ad44-4d12-9112-2d93e91890a6_9c5471e1-a3ef-4d47-828b-0008b7e58f01.jpg/250x188.webp>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'emission_standard': None,
 'engine': None,
 'engine_horse_power': 114,
 'expiration_date': None,
 'fuel_type': 'Gasoline',
 'id': '35a81efd-5ad4-5ca4-a4e8-d32a916b3bed',
 'is_damaged': False,
 'is_operable': True,
 'license_plate': None,
 'link_to_web_offer': 'https://www.autoscout24.it/offers/nissan-juke-n-connecta-1-0-dig-t-auto-114cv-newmodel-onlypromo-gasoline-white-ff7e076c-ad44-4d12-9112-2d93e91890a6',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Juke',
 'odometer': 19700,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 4,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35a81efd-5ad4-5ca4-a4e8-d32a916b3bed/35a81efd-5ad4-5ca4-a4e8-d32a916b3bed_image_0.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3094,
             'Height': 151,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/ff7e076c-ad44-4d12-9112-2d93e91890a6_32ffef28-6123-48d2-b785-9328980798eb.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35a81efd-5ad4-5ca4-a4e8-d32a916b3bed/35a81efd-5ad4-5ca4-a4e8-d32a916b3bed_image_1.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 2856,
             'Height': 149,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/ff7e076c-ad44-4d12-9112-2d93e91890a6_5f312891-e52d-4a8c-b495-1c13d87c1a0f.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35a81efd-5ad4-5ca4-a4e8-d32a916b3bed/35a81efd-5ad4-5ca4-a4e8-d32a916b3bed_image_2.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 2710,
             'Height': 144,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/ff7e076c-ad44-4d12-9112-2d93e91890a6_94ac8861-2de2-4a24-b5ca-86741b4bf523.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35a81efd-5ad4-5ca4-a4e8-d32a916b3bed/35a81efd-5ad4-5ca4-a4e8-d32a916b3bed_image_3.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3798,
             'Height': 139,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/ff7e076c-ad44-4d12-9112-2d93e91890a6_9c5471e1-a3ef-4d47-828b-0008b7e58f01.jpg/250x188.webp',
             'Width': 250}],
 'price': 21800,
 'price_includes_vat': False,
 'registration_date': '2025-01-01',
 'seller_name': None,
 'title': 'Nissan Juke N-Connecta 1.0 Dig-T AUTO 114CV NewModel ONLYPROMO',
 'transmission': 'automatic',
 'trim': 'N-Connecta 1.0 Dig-T AUTO 114CV NewModel ONLYPROMO',
 'vin': None,
 'year': 2025}
2025-12-05 12:00:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27ff7e076c-ad44-4d12-9112-2d93e91890a6%27 HTTP/1.1" 200 None
2025-12-05 12:00:10 [auto_selling_autoscout24.it] INFO: Saving data for ff7e076c-ad44-4d12-9112-2d93e91890a6: {'created_time': 1764936010.311792, 'last_price_update_time': 1764936010.311804}
2025-12-05 12:00:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autoscout24.it',RowKey='ff7e076c-ad44-4d12-9112-2d93e91890a6') HTTP/1.1" 204 0
2025-12-05 12:00:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/08299329-ec72-4339-9891-6b2b4447a33a_18cd78d7-786c-41f6-ad8e-70c5c912d51f.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:00:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/08299329-ec72-4339-9891-6b2b4447a33a_0290f895-5f37-4916-a38e-0f885adc81bb.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:00:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F08299329-ec72-4339-9891-6b2b4447a33a_a4244605-5229-49d8-ad41-e0e5524a4100.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/08299329-ec72-4339-9891-6b2b4447a33a_a4244605-5229-49d8-ad41-e0e5524a4100.jpg/250x188.webp not downloaded yet
2025-12-05 12:00:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:00:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:00:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:00:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d6f6a690>
2025-12-05 12:00:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:00:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:00:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 12:00:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:00:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:00:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:00:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99413123-5001-52d3-9979-b0fb29734709/99413123-5001-52d3-9979-b0fb29734709_image_2.webp HTTP/1.1" 201 0
2025-12-05 12:00:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F08299329-ec72-4339-9891-6b2b4447a33a_d7cf131a-0d0a-45ea-b104-769b6612b38d.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/08299329-ec72-4339-9891-6b2b4447a33a_d7cf131a-0d0a-45ea-b104-769b6612b38d.jpg/250x188.webp saved to cache
2025-12-05 12:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 99413123-5001-52d3-9979-b0fb29734709
2025-12-05 12:00:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F08299329-ec72-4339-9891-6b2b4447a33a_7463d415-7857-4153-9d43-6008d08af364.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/08299329-ec72-4339-9891-6b2b4447a33a_7463d415-7857-4153-9d43-6008d08af364.jpg/250x188.webp not downloaded yet
2025-12-05 12:00:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/08299329-ec72-4339-9891-6b2b4447a33a_052ead07-bb8a-49da-b2b3-17394f1731eb.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:00:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/08299329-ec72-4339-9891-6b2b4447a33a_1e149631-e112-4a1c-ac8f-4f3ec998f521.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:00:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F08299329-ec72-4339-9891-6b2b4447a33a_033af304-1666-43c4-822e-4be1d251da40.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/08299329-ec72-4339-9891-6b2b4447a33a_033af304-1666-43c4-822e-4be1d251da40.jpg/250x188.webp not downloaded yet
2025-12-05 12:00:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:00:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:00:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:00:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5c15f90>
2025-12-05 12:00:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:00:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:00:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 12:00:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:00:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:00:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:00:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99413123-5001-52d3-9979-b0fb29734709/99413123-5001-52d3-9979-b0fb29734709_image_3.webp HTTP/1.1" 201 0
2025-12-05 12:00:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F08299329-ec72-4339-9891-6b2b4447a33a_18cd78d7-786c-41f6-ad8e-70c5c912d51f.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/08299329-ec72-4339-9891-6b2b4447a33a_18cd78d7-786c-41f6-ad8e-70c5c912d51f.jpg/250x188.webp saved to cache
2025-12-05 12:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 99413123-5001-52d3-9979-b0fb29734709
2025-12-05 12:00:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:00:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:00:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:00:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9dc11dd90>
2025-12-05 12:00:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:00:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:00:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:00:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:00:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:00:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:00:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99413123-5001-52d3-9979-b0fb29734709/99413123-5001-52d3-9979-b0fb29734709_image_4.webp HTTP/1.1" 201 0
2025-12-05 12:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F08299329-ec72-4339-9891-6b2b4447a33a_0290f895-5f37-4916-a38e-0f885adc81bb.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:00:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/08299329-ec72-4339-9891-6b2b4447a33a_0290f895-5f37-4916-a38e-0f885adc81bb.jpg/250x188.webp saved to cache
2025-12-05 12:00:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 99413123-5001-52d3-9979-b0fb29734709
2025-12-05 12:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F08299329-ec72-4339-9891-6b2b4447a33a_c3d0c55b-5f99-4ee6-9310-f7834f87f37d.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:00:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/08299329-ec72-4339-9891-6b2b4447a33a_c3d0c55b-5f99-4ee6-9310-f7834f87f37d.jpg/250x188.webp not downloaded yet
2025-12-05 12:00:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/08299329-ec72-4339-9891-6b2b4447a33a_73ca0175-e211-4ac1-bf21-26f1d7ad5b1d.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:00:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/08299329-ec72-4339-9891-6b2b4447a33a_a4244605-5229-49d8-ad41-e0e5524a4100.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F08299329-ec72-4339-9891-6b2b4447a33a_dbb77537-ced6-4325-b8a4-df7953461ac4.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:00:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/08299329-ec72-4339-9891-6b2b4447a33a_dbb77537-ced6-4325-b8a4-df7953461ac4.jpg/250x188.webp not downloaded yet
2025-12-05 12:00:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:00:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:00:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:00:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5c79150>
2025-12-05 12:00:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:00:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:00:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 12:00:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:00:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:00:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:00:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99413123-5001-52d3-9979-b0fb29734709/99413123-5001-52d3-9979-b0fb29734709_image_6.webp HTTP/1.1" 201 0
2025-12-05 12:00:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F08299329-ec72-4339-9891-6b2b4447a33a_052ead07-bb8a-49da-b2b3-17394f1731eb.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:00:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/08299329-ec72-4339-9891-6b2b4447a33a_052ead07-bb8a-49da-b2b3-17394f1731eb.jpg/250x188.webp saved to cache
2025-12-05 12:00:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 99413123-5001-52d3-9979-b0fb29734709
2025-12-05 12:00:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:00:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:00:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:00:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e27750>
2025-12-05 12:00:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:00:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:00:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 12:00:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:00:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:00:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:00:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99413123-5001-52d3-9979-b0fb29734709/99413123-5001-52d3-9979-b0fb29734709_image_5.webp HTTP/1.1" 201 0
2025-12-05 12:00:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F08299329-ec72-4339-9891-6b2b4447a33a_1e149631-e112-4a1c-ac8f-4f3ec998f521.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:00:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/08299329-ec72-4339-9891-6b2b4447a33a_1e149631-e112-4a1c-ac8f-4f3ec998f521.jpg/250x188.webp saved to cache
2025-12-05 12:00:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 99413123-5001-52d3-9979-b0fb29734709
2025-12-05 12:00:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F08299329-ec72-4339-9891-6b2b4447a33a_b149493a-6c2b-4697-aeba-5159da995b6a.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:00:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/08299329-ec72-4339-9891-6b2b4447a33a_b149493a-6c2b-4697-aeba-5159da995b6a.jpg/250x188.webp not downloaded yet
2025-12-05 12:00:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/08299329-ec72-4339-9891-6b2b4447a33a_033af304-1666-43c4-822e-4be1d251da40.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:00:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/08299329-ec72-4339-9891-6b2b4447a33a_7463d415-7857-4153-9d43-6008d08af364.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:00:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F08299329-ec72-4339-9891-6b2b4447a33a_99bad7e2-17a5-48f5-ad06-166db901e9e0.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:00:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/08299329-ec72-4339-9891-6b2b4447a33a_99bad7e2-17a5-48f5-ad06-166db901e9e0.jpg/250x188.webp not downloaded yet
2025-12-05 12:00:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:00:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:00:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:00:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5c797d0>
2025-12-05 12:00:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:00:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:00:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 12:00:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:00:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:00:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:00:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99413123-5001-52d3-9979-b0fb29734709/99413123-5001-52d3-9979-b0fb29734709_image_7.webp HTTP/1.1" 201 0
2025-12-05 12:00:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F08299329-ec72-4339-9891-6b2b4447a33a_73ca0175-e211-4ac1-bf21-26f1d7ad5b1d.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:00:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/08299329-ec72-4339-9891-6b2b4447a33a_73ca0175-e211-4ac1-bf21-26f1d7ad5b1d.jpg/250x188.webp saved to cache
2025-12-05 12:00:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 99413123-5001-52d3-9979-b0fb29734709
2025-12-05 12:00:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:00:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:00:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:00:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9dc11d450>
2025-12-05 12:00:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:00:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:00:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 12:00:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:00:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:00:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:00:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99413123-5001-52d3-9979-b0fb29734709/99413123-5001-52d3-9979-b0fb29734709_image_8.webp HTTP/1.1" 201 0
2025-12-05 12:00:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F08299329-ec72-4339-9891-6b2b4447a33a_a4244605-5229-49d8-ad41-e0e5524a4100.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:00:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/08299329-ec72-4339-9891-6b2b4447a33a_a4244605-5229-49d8-ad41-e0e5524a4100.jpg/250x188.webp saved to cache
2025-12-05 12:00:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 99413123-5001-52d3-9979-b0fb29734709
2025-12-05 12:00:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/08299329-ec72-4339-9891-6b2b4447a33a_dbb77537-ced6-4325-b8a4-df7953461ac4.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:00:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/08299329-ec72-4339-9891-6b2b4447a33a_c3d0c55b-5f99-4ee6-9310-f7834f87f37d.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:00:12 [auto_selling_autoscout24.it] INFO: Fetching listings for customerId: 31910200, page: 3
2025-12-05 12:00:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:00:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:00:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:00:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5c464d0>
2025-12-05 12:00:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:00:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:00:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 12:00:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:00:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:00:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:00:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99413123-5001-52d3-9979-b0fb29734709/99413123-5001-52d3-9979-b0fb29734709_image_10.webp HTTP/1.1" 201 0
2025-12-05 12:00:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F08299329-ec72-4339-9891-6b2b4447a33a_033af304-1666-43c4-822e-4be1d251da40.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:00:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/08299329-ec72-4339-9891-6b2b4447a33a_033af304-1666-43c4-822e-4be1d251da40.jpg/250x188.webp saved to cache
2025-12-05 12:00:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 99413123-5001-52d3-9979-b0fb29734709
2025-12-05 12:00:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:00:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:00:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:00:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5c80710>
2025-12-05 12:00:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:00:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:00:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 12:00:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:00:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:00:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:00:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99413123-5001-52d3-9979-b0fb29734709/99413123-5001-52d3-9979-b0fb29734709_image_9.webp HTTP/1.1" 201 0
2025-12-05 12:00:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F08299329-ec72-4339-9891-6b2b4447a33a_7463d415-7857-4153-9d43-6008d08af364.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:00:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/08299329-ec72-4339-9891-6b2b4447a33a_7463d415-7857-4153-9d43-6008d08af364.jpg/250x188.webp saved to cache
2025-12-05 12:00:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 99413123-5001-52d3-9979-b0fb29734709
2025-12-05 12:00:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 12:00:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/08299329-ec72-4339-9891-6b2b4447a33a_b149493a-6c2b-4697-aeba-5159da995b6a.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:00:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:00:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:00:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:00:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9dc125f10>
2025-12-05 12:00:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:00:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:00:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 12:00:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:00:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:00:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:00:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99413123-5001-52d3-9979-b0fb29734709/99413123-5001-52d3-9979-b0fb29734709_image_12.webp HTTP/1.1" 201 0
2025-12-05 12:00:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F08299329-ec72-4339-9891-6b2b4447a33a_dbb77537-ced6-4325-b8a4-df7953461ac4.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:00:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/08299329-ec72-4339-9891-6b2b4447a33a_dbb77537-ced6-4325-b8a4-df7953461ac4.jpg/250x188.webp saved to cache
2025-12-05 12:00:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 99413123-5001-52d3-9979-b0fb29734709
2025-12-05 12:00:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:00:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:00:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:00:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9dc1e8650>
2025-12-05 12:00:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:00:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:00:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:00:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:00:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:00:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:00:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99413123-5001-52d3-9979-b0fb29734709/99413123-5001-52d3-9979-b0fb29734709_image_11.webp HTTP/1.1" 201 0
2025-12-05 12:00:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F08299329-ec72-4339-9891-6b2b4447a33a_c3d0c55b-5f99-4ee6-9310-f7834f87f37d.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:00:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/08299329-ec72-4339-9891-6b2b4447a33a_c3d0c55b-5f99-4ee6-9310-f7834f87f37d.jpg/250x188.webp saved to cache
2025-12-05 12:00:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 99413123-5001-52d3-9979-b0fb29734709
2025-12-05 12:00:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/08299329-ec72-4339-9891-6b2b4447a33a_99bad7e2-17a5-48f5-ad06-166db901e9e0.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:00:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:00:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:00:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:00:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5ce1510>
2025-12-05 12:00:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:00:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:00:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 12:00:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:00:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:00:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:00:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99413123-5001-52d3-9979-b0fb29734709/99413123-5001-52d3-9979-b0fb29734709_image_13.webp HTTP/1.1" 201 0
2025-12-05 12:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F08299329-ec72-4339-9891-6b2b4447a33a_b149493a-6c2b-4697-aeba-5159da995b6a.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:00:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/08299329-ec72-4339-9891-6b2b4447a33a_b149493a-6c2b-4697-aeba-5159da995b6a.jpg/250x188.webp saved to cache
2025-12-05 12:00:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 99413123-5001-52d3-9979-b0fb29734709
2025-12-05 12:00:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:00:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:00:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:00:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e4d510>
2025-12-05 12:00:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:00:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:00:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 12:00:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:00:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:00:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:00:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99413123-5001-52d3-9979-b0fb29734709/99413123-5001-52d3-9979-b0fb29734709_image_14.webp HTTP/1.1" 201 0
2025-12-05 12:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F08299329-ec72-4339-9891-6b2b4447a33a_99bad7e2-17a5-48f5-ad06-166db901e9e0.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:00:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/08299329-ec72-4339-9891-6b2b4447a33a_99bad7e2-17a5-48f5-ad06-166db901e9e0.jpg/250x188.webp saved to cache
2025-12-05 12:00:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 99413123-5001-52d3-9979-b0fb29734709
2025-12-05 12:00:14 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 99413123-5001-52d3-9979-b0fb29734709 from tracking dictionaries
2025-12-05 12:00:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 99413123-5001-52d3-9979-b0fb29734709 sending to next pipeline
2025-12-05 12:00:14 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 99413123-5001-52d3-9979-b0fb29734709 with identifier 08299329-ec72-4339-9891-6b2b4447a33a
2025-12-05 12:00:14 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:00:14 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:00:14 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 99413123-5001-52d3-9979-b0fb29734709
2025-12-05 12:00:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://prod.pictures.autoscout24.net/listing-images/08299329-ec72-4339-9891-6b2b4447a33a_99bad7e2-17a5-48f5-ad06-166db901e9e0.jpg/250x188.webp>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'emission_standard': None,
 'engine': None,
 'engine_horse_power': 204,
 'expiration_date': None,
 'fuel_type': 'Electric/Gasoline',
 'id': '99413123-5001-52d3-9979-b0fb29734709',
 'is_damaged': False,
 'is_operable': True,
 'license_plate': None,
 'link_to_web_offer': 'https://www.autoscout24.it/offers/audi-a5-avant-facelift-tfsi-s-tronic-204cv-my25-only-promo-electric-gasoline-grey-08299329-ec72-4339-9891-6b2b4447a33a',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5',
 'odometer': 1,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99413123-5001-52d3-9979-b0fb29734709/99413123-5001-52d3-9979-b0fb29734709_image_0.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4794,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/08299329-ec72-4339-9891-6b2b4447a33a_9a62692d-de83-4ab1-94a2-5b5c608ba806.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99413123-5001-52d3-9979-b0fb29734709/99413123-5001-52d3-9979-b0fb29734709_image_1.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4212,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/08299329-ec72-4339-9891-6b2b4447a33a_56fed453-8062-4417-b6e5-15e3e5bd7679.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99413123-5001-52d3-9979-b0fb29734709/99413123-5001-52d3-9979-b0fb29734709_image_2.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4768,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/08299329-ec72-4339-9891-6b2b4447a33a_d7cf131a-0d0a-45ea-b104-769b6612b38d.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99413123-5001-52d3-9979-b0fb29734709/99413123-5001-52d3-9979-b0fb29734709_image_3.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4438,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/08299329-ec72-4339-9891-6b2b4447a33a_18cd78d7-786c-41f6-ad8e-70c5c912d51f.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99413123-5001-52d3-9979-b0fb29734709/99413123-5001-52d3-9979-b0fb29734709_image_4.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 6660,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/08299329-ec72-4339-9891-6b2b4447a33a_0290f895-5f37-4916-a38e-0f885adc81bb.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99413123-5001-52d3-9979-b0fb29734709/99413123-5001-52d3-9979-b0fb29734709_image_5.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 8326,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/08299329-ec72-4339-9891-6b2b4447a33a_1e149631-e112-4a1c-ac8f-4f3ec998f521.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99413123-5001-52d3-9979-b0fb29734709/99413123-5001-52d3-9979-b0fb29734709_image_6.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5792,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/08299329-ec72-4339-9891-6b2b4447a33a_052ead07-bb8a-49da-b2b3-17394f1731eb.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99413123-5001-52d3-9979-b0fb29734709/99413123-5001-52d3-9979-b0fb29734709_image_7.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 6808,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/08299329-ec72-4339-9891-6b2b4447a33a_73ca0175-e211-4ac1-bf21-26f1d7ad5b1d.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99413123-5001-52d3-9979-b0fb29734709/99413123-5001-52d3-9979-b0fb29734709_image_8.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 6070,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/08299329-ec72-4339-9891-6b2b4447a33a_a4244605-5229-49d8-ad41-e0e5524a4100.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99413123-5001-52d3-9979-b0fb29734709/99413123-5001-52d3-9979-b0fb29734709_image_9.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5564,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/08299329-ec72-4339-9891-6b2b4447a33a_7463d415-7857-4153-9d43-6008d08af364.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99413123-5001-52d3-9979-b0fb29734709/99413123-5001-52d3-9979-b0fb29734709_image_10.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5398,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/08299329-ec72-4339-9891-6b2b4447a33a_033af304-1666-43c4-822e-4be1d251da40.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99413123-5001-52d3-9979-b0fb29734709/99413123-5001-52d3-9979-b0fb29734709_image_11.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5734,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/08299329-ec72-4339-9891-6b2b4447a33a_c3d0c55b-5f99-4ee6-9310-f7834f87f37d.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99413123-5001-52d3-9979-b0fb29734709/99413123-5001-52d3-9979-b0fb29734709_image_12.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4378,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/08299329-ec72-4339-9891-6b2b4447a33a_dbb77537-ced6-4325-b8a4-df7953461ac4.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99413123-5001-52d3-9979-b0fb29734709/99413123-5001-52d3-9979-b0fb29734709_image_13.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 6432,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/08299329-ec72-4339-9891-6b2b4447a33a_b149493a-6c2b-4697-aeba-5159da995b6a.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99413123-5001-52d3-9979-b0fb29734709/99413123-5001-52d3-9979-b0fb29734709_image_14.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 9268,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/08299329-ec72-4339-9891-6b2b4447a33a_99bad7e2-17a5-48f5-ad06-166db901e9e0.jpg/250x188.webp',
             'Width': 250}],
 'price': 55800,
 'price_includes_vat': False,
 'registration_date': '2025-08-01',
 'seller_name': None,
 'title': 'Audi A5 AVANT FACELIFT TFSI S-TRONIC 204CV MY25 ONLY PROMO',
 'transmission': 'automatic',
 'trim': 'AVANT FACELIFT TFSI S-TRONIC 204CV MY25 ONLY PROMO',
 'vin': None,
 'year': 2025}
2025-12-05 12:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%2708299329-ec72-4339-9891-6b2b4447a33a%27 HTTP/1.1" 200 None
2025-12-05 12:00:14 [auto_selling_autoscout24.it] INFO: Saving data for 08299329-ec72-4339-9891-6b2b4447a33a: {'created_time': 1764936014.30569, 'last_price_update_time': 1764936014.3057}
2025-12-05 12:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autoscout24.it',RowKey='08299329-ec72-4339-9891-6b2b4447a33a') HTTP/1.1" 204 0
2025-12-05 12:00:17 [scrapy.extensions.logstats] INFO: Crawled 3 pages (at 1 pages/min), scraped 40 items (at 20 items/min)
2025-12-05 12:00:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autoscout24.it/api/dealer-detail/fetch-listings> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings) ['zyte-api']
2025-12-05 12:00:51 [auto_selling_autoscout24.it] INFO: Parsing listings response for page: 3
2025-12-05 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%271d636ab6-2024-44d9-8f19-0d510e3ce286%27 HTTP/1.1" 200 None
2025-12-05 12:00:51 [auto_selling_autoscout24.it] INFO: Scrape type for 1d636ab6-2024-44d9-8f19-0d510e3ce286: 1
2025-12-05 12:00:51 [auto_selling_autoscout24.it] INFO: Scraping new listing 1d636ab6-2024-44d9-8f19-0d510e3ce286
2025-12-05 12:00:51 [auto_selling_autoscout24.it] INFO: Extracting item from listing ID: 1d636ab6-2024-44d9-8f19-0d510e3ce286
2025-12-05 12:00:51 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 18732d45-1570-5d88-a4f8-bf9d3758ce72 with identifier: 1d636ab6-2024-44d9-8f19-0d510e3ce286
2025-12-05 12:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 3 photos for item 18732d45-1570-5d88-a4f8-bf9d3758ce72
2025-12-05 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F1d636ab6-2024-44d9-8f19-0d510e3ce286_ec089dca-c885-4014-877b-71034ef9e6b0.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/1d636ab6-2024-44d9-8f19-0d510e3ce286_ec089dca-c885-4014-877b-71034ef9e6b0.jpg/250x188.webp not downloaded yet
2025-12-05 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F1d636ab6-2024-44d9-8f19-0d510e3ce286_25739066-068a-4939-9292-3c43db4dd759.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/1d636ab6-2024-44d9-8f19-0d510e3ce286_25739066-068a-4939-9292-3c43db4dd759.jpg/250x188.webp not downloaded yet
2025-12-05 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F1d636ab6-2024-44d9-8f19-0d510e3ce286_b66b8be5-8064-425a-baab-db6b6f5ea64a.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/1d636ab6-2024-44d9-8f19-0d510e3ce286_b66b8be5-8064-425a-baab-db6b6f5ea64a.jpg/250x188.webp not downloaded yet
2025-12-05 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27458a0c39-3a41-49c8-98bf-fcde84b4b0cd%27 HTTP/1.1" 200 None
2025-12-05 12:00:51 [auto_selling_autoscout24.it] INFO: Scrape type for 458a0c39-3a41-49c8-98bf-fcde84b4b0cd: 1
2025-12-05 12:00:51 [auto_selling_autoscout24.it] INFO: Scraping new listing 458a0c39-3a41-49c8-98bf-fcde84b4b0cd
2025-12-05 12:00:51 [auto_selling_autoscout24.it] INFO: Extracting item from listing ID: 458a0c39-3a41-49c8-98bf-fcde84b4b0cd
2025-12-05 12:00:51 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: d57a450d-6ffc-5e37-95a5-5548acbbc5a9 with identifier: 458a0c39-3a41-49c8-98bf-fcde84b4b0cd
2025-12-05 12:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 14 photos for item d57a450d-6ffc-5e37-95a5-5548acbbc5a9
2025-12-05 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F458a0c39-3a41-49c8-98bf-fcde84b4b0cd_b48b9a90-7e25-4174-b07a-e1e8f9c72731.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/458a0c39-3a41-49c8-98bf-fcde84b4b0cd_b48b9a90-7e25-4174-b07a-e1e8f9c72731.jpg/250x188.webp not downloaded yet
2025-12-05 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F458a0c39-3a41-49c8-98bf-fcde84b4b0cd_6ef99738-baca-4fc3-b6a0-11263e2e67f3.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/458a0c39-3a41-49c8-98bf-fcde84b4b0cd_6ef99738-baca-4fc3-b6a0-11263e2e67f3.jpg/250x188.webp not downloaded yet
2025-12-05 12:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/1d636ab6-2024-44d9-8f19-0d510e3ce286_ec089dca-c885-4014-877b-71034ef9e6b0.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F458a0c39-3a41-49c8-98bf-fcde84b4b0cd_0362a145-4fd0-4b81-ad60-9ef2abfdd573.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/458a0c39-3a41-49c8-98bf-fcde84b4b0cd_0362a145-4fd0-4b81-ad60-9ef2abfdd573.jpg/250x188.webp not downloaded yet
2025-12-05 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F458a0c39-3a41-49c8-98bf-fcde84b4b0cd_86124290-ed2b-429f-aa89-8d083bd8023b.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/458a0c39-3a41-49c8-98bf-fcde84b4b0cd_86124290-ed2b-429f-aa89-8d083bd8023b.jpg/250x188.webp not downloaded yet
2025-12-05 12:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/458a0c39-3a41-49c8-98bf-fcde84b4b0cd_b48b9a90-7e25-4174-b07a-e1e8f9c72731.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/1d636ab6-2024-44d9-8f19-0d510e3ce286_25739066-068a-4939-9292-3c43db4dd759.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F458a0c39-3a41-49c8-98bf-fcde84b4b0cd_40ed5c36-1bb6-4ab4-b714-b49b00fbc7ed.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/458a0c39-3a41-49c8-98bf-fcde84b4b0cd_40ed5c36-1bb6-4ab4-b714-b49b00fbc7ed.jpg/250x188.webp not downloaded yet
2025-12-05 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F458a0c39-3a41-49c8-98bf-fcde84b4b0cd_d7d9c1dd-8b25-4c22-ad2f-8f303d44e8b9.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/458a0c39-3a41-49c8-98bf-fcde84b4b0cd_d7d9c1dd-8b25-4c22-ad2f-8f303d44e8b9.jpg/250x188.webp not downloaded yet
2025-12-05 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F458a0c39-3a41-49c8-98bf-fcde84b4b0cd_ff1d72b7-b95d-42b6-ad9f-99b672d07d99.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/458a0c39-3a41-49c8-98bf-fcde84b4b0cd_ff1d72b7-b95d-42b6-ad9f-99b672d07d99.jpg/250x188.webp not downloaded yet
2025-12-05 12:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/458a0c39-3a41-49c8-98bf-fcde84b4b0cd_6ef99738-baca-4fc3-b6a0-11263e2e67f3.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/1d636ab6-2024-44d9-8f19-0d510e3ce286_b66b8be5-8064-425a-baab-db6b6f5ea64a.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F458a0c39-3a41-49c8-98bf-fcde84b4b0cd_6e77fa5f-83cf-4321-bdcf-a3a8b2f7cc17.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/458a0c39-3a41-49c8-98bf-fcde84b4b0cd_6e77fa5f-83cf-4321-bdcf-a3a8b2f7cc17.jpg/250x188.webp not downloaded yet
2025-12-05 12:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/458a0c39-3a41-49c8-98bf-fcde84b4b0cd_40ed5c36-1bb6-4ab4-b714-b49b00fbc7ed.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F458a0c39-3a41-49c8-98bf-fcde84b4b0cd_d4a3750d-312a-4b96-aa2e-c391d746029c.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/458a0c39-3a41-49c8-98bf-fcde84b4b0cd_d4a3750d-312a-4b96-aa2e-c391d746029c.jpg/250x188.webp not downloaded yet
2025-12-05 12:00:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:00:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:00:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:00:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5b1c390>
2025-12-05 12:00:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:00:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:00:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:00:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:00:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18732d45-1570-5d88-a4f8-bf9d3758ce72/18732d45-1570-5d88-a4f8-bf9d3758ce72_image_0.webp HTTP/1.1" 201 0
2025-12-05 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F1d636ab6-2024-44d9-8f19-0d510e3ce286_ec089dca-c885-4014-877b-71034ef9e6b0.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/1d636ab6-2024-44d9-8f19-0d510e3ce286_ec089dca-c885-4014-877b-71034ef9e6b0.jpg/250x188.webp saved to cache
2025-12-05 12:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 18732d45-1570-5d88-a4f8-bf9d3758ce72
2025-12-05 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F458a0c39-3a41-49c8-98bf-fcde84b4b0cd_99fe032b-6ba7-4ced-8717-11c34f6b2a19.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/458a0c39-3a41-49c8-98bf-fcde84b4b0cd_99fe032b-6ba7-4ced-8717-11c34f6b2a19.jpg/250x188.webp not downloaded yet
2025-12-05 12:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/458a0c39-3a41-49c8-98bf-fcde84b4b0cd_ff1d72b7-b95d-42b6-ad9f-99b672d07d99.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/458a0c39-3a41-49c8-98bf-fcde84b4b0cd_0362a145-4fd0-4b81-ad60-9ef2abfdd573.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/458a0c39-3a41-49c8-98bf-fcde84b4b0cd_86124290-ed2b-429f-aa89-8d083bd8023b.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/458a0c39-3a41-49c8-98bf-fcde84b4b0cd_d7d9c1dd-8b25-4c22-ad2f-8f303d44e8b9.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F458a0c39-3a41-49c8-98bf-fcde84b4b0cd_257011ee-ce04-4b1d-90c4-0aa20951ef21.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/458a0c39-3a41-49c8-98bf-fcde84b4b0cd_257011ee-ce04-4b1d-90c4-0aa20951ef21.jpg/250x188.webp not downloaded yet
2025-12-05 12:00:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:00:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:00:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:00:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e4a810>
2025-12-05 12:00:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:00:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:00:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 12:00:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:00:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d57a450d-6ffc-5e37-95a5-5548acbbc5a9/d57a450d-6ffc-5e37-95a5-5548acbbc5a9_image_0.webp HTTP/1.1" 201 0
2025-12-05 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F458a0c39-3a41-49c8-98bf-fcde84b4b0cd_b48b9a90-7e25-4174-b07a-e1e8f9c72731.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/458a0c39-3a41-49c8-98bf-fcde84b4b0cd_b48b9a90-7e25-4174-b07a-e1e8f9c72731.jpg/250x188.webp saved to cache
2025-12-05 12:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d57a450d-6ffc-5e37-95a5-5548acbbc5a9
2025-12-05 12:00:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:00:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:00:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:00:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d6fdb010>
2025-12-05 12:00:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:00:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:00:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 12:00:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:00:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18732d45-1570-5d88-a4f8-bf9d3758ce72/18732d45-1570-5d88-a4f8-bf9d3758ce72_image_1.webp HTTP/1.1" 201 0
2025-12-05 12:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F1d636ab6-2024-44d9-8f19-0d510e3ce286_25739066-068a-4939-9292-3c43db4dd759.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/1d636ab6-2024-44d9-8f19-0d510e3ce286_25739066-068a-4939-9292-3c43db4dd759.jpg/250x188.webp saved to cache
2025-12-05 12:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 18732d45-1570-5d88-a4f8-bf9d3758ce72
2025-12-05 12:00:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:00:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:00:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:00:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9dc107ad0>
2025-12-05 12:00:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:00:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:00:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 12:00:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:00:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d57a450d-6ffc-5e37-95a5-5548acbbc5a9/d57a450d-6ffc-5e37-95a5-5548acbbc5a9_image_1.webp HTTP/1.1" 201 0
2025-12-05 12:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F458a0c39-3a41-49c8-98bf-fcde84b4b0cd_6ef99738-baca-4fc3-b6a0-11263e2e67f3.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/458a0c39-3a41-49c8-98bf-fcde84b4b0cd_6ef99738-baca-4fc3-b6a0-11263e2e67f3.jpg/250x188.webp saved to cache
2025-12-05 12:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d57a450d-6ffc-5e37-95a5-5548acbbc5a9
2025-12-05 12:00:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:00:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:00:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:00:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5c965d0>
2025-12-05 12:00:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:00:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:00:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 12:00:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:00:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18732d45-1570-5d88-a4f8-bf9d3758ce72/18732d45-1570-5d88-a4f8-bf9d3758ce72_image_2.webp HTTP/1.1" 201 0
2025-12-05 12:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F1d636ab6-2024-44d9-8f19-0d510e3ce286_b66b8be5-8064-425a-baab-db6b6f5ea64a.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/1d636ab6-2024-44d9-8f19-0d510e3ce286_b66b8be5-8064-425a-baab-db6b6f5ea64a.jpg/250x188.webp saved to cache
2025-12-05 12:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 18732d45-1570-5d88-a4f8-bf9d3758ce72
2025-12-05 12:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 18732d45-1570-5d88-a4f8-bf9d3758ce72 from tracking dictionaries
2025-12-05 12:00:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 18732d45-1570-5d88-a4f8-bf9d3758ce72 sending to next pipeline
2025-12-05 12:00:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:00:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:00:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:00:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d6f85490>
2025-12-05 12:00:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:00:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:00:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 12:00:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:00:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d57a450d-6ffc-5e37-95a5-5548acbbc5a9/d57a450d-6ffc-5e37-95a5-5548acbbc5a9_image_4.webp HTTP/1.1" 201 0
2025-12-05 12:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F458a0c39-3a41-49c8-98bf-fcde84b4b0cd_40ed5c36-1bb6-4ab4-b714-b49b00fbc7ed.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/458a0c39-3a41-49c8-98bf-fcde84b4b0cd_40ed5c36-1bb6-4ab4-b714-b49b00fbc7ed.jpg/250x188.webp saved to cache
2025-12-05 12:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d57a450d-6ffc-5e37-95a5-5548acbbc5a9
2025-12-05 12:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F458a0c39-3a41-49c8-98bf-fcde84b4b0cd_bdacc738-6dcd-4bfc-9578-ed7a375f4e38.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/458a0c39-3a41-49c8-98bf-fcde84b4b0cd_bdacc738-6dcd-4bfc-9578-ed7a375f4e38.jpg/250x188.webp not downloaded yet
2025-12-05 12:00:54 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 18732d45-1570-5d88-a4f8-bf9d3758ce72 with identifier 1d636ab6-2024-44d9-8f19-0d510e3ce286
2025-12-05 12:00:54 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:00:54 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:00:54 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 18732d45-1570-5d88-a4f8-bf9d3758ce72
2025-12-05 12:00:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://prod.pictures.autoscout24.net/listing-images/1d636ab6-2024-44d9-8f19-0d510e3ce286_b66b8be5-8064-425a-baab-db6b6f5ea64a.jpg/250x188.webp>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'emission_standard': None,
 'engine': None,
 'engine_horse_power': 114,
 'expiration_date': None,
 'fuel_type': 'Gasoline',
 'id': '18732d45-1570-5d88-a4f8-bf9d3758ce72',
 'is_damaged': False,
 'is_operable': True,
 'license_plate': None,
 'link_to_web_offer': 'https://www.autoscout24.it/offers/nissan-juke-n-connecta-1-0-dig-t-114cv-nuovo-modello-onlypromo-gasoline-grey-1d636ab6-2024-44d9-8f19-0d510e3ce286',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Juke',
 'odometer': 18400,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 3,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18732d45-1570-5d88-a4f8-bf9d3758ce72/18732d45-1570-5d88-a4f8-bf9d3758ce72_image_0.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4160,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/1d636ab6-2024-44d9-8f19-0d510e3ce286_ec089dca-c885-4014-877b-71034ef9e6b0.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18732d45-1570-5d88-a4f8-bf9d3758ce72/18732d45-1570-5d88-a4f8-bf9d3758ce72_image_1.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 2874,
             'Height': 143,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/1d636ab6-2024-44d9-8f19-0d510e3ce286_25739066-068a-4939-9292-3c43db4dd759.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18732d45-1570-5d88-a4f8-bf9d3758ce72/18732d45-1570-5d88-a4f8-bf9d3758ce72_image_2.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3512,
             'Height': 125,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/1d636ab6-2024-44d9-8f19-0d510e3ce286_b66b8be5-8064-425a-baab-db6b6f5ea64a.jpg/250x188.webp',
             'Width': 250}],
 'price': 20500,
 'price_includes_vat': False,
 'registration_date': '2025-01-01',
 'seller_name': None,
 'title': 'Nissan Juke N-Connecta 1.0 Dig-T 114CV Nuovo Modello ONLYPROMO',
 'transmission': 'automatic',
 'trim': 'N-Connecta 1.0 Dig-T 114CV Nuovo Modello ONLYPROMO',
 'vin': None,
 'year': 2025}
2025-12-05 12:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%271d636ab6-2024-44d9-8f19-0d510e3ce286%27 HTTP/1.1" 200 None
2025-12-05 12:00:54 [auto_selling_autoscout24.it] INFO: Saving data for 1d636ab6-2024-44d9-8f19-0d510e3ce286: {'created_time': 1764936054.803058, 'last_price_update_time': 1764936054.803068}
2025-12-05 12:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autoscout24.it',RowKey='1d636ab6-2024-44d9-8f19-0d510e3ce286') HTTP/1.1" 204 0
2025-12-05 12:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/458a0c39-3a41-49c8-98bf-fcde84b4b0cd_6e77fa5f-83cf-4321-bdcf-a3a8b2f7cc17.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/458a0c39-3a41-49c8-98bf-fcde84b4b0cd_d4a3750d-312a-4b96-aa2e-c391d746029c.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F458a0c39-3a41-49c8-98bf-fcde84b4b0cd_83918ca6-fe85-41dc-8b00-41fccb4a20d7.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/458a0c39-3a41-49c8-98bf-fcde84b4b0cd_83918ca6-fe85-41dc-8b00-41fccb4a20d7.jpg/250x188.webp not downloaded yet
2025-12-05 12:00:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:00:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:00:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:00:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e94950>
2025-12-05 12:00:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:00:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:00:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:00:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:00:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d57a450d-6ffc-5e37-95a5-5548acbbc5a9/d57a450d-6ffc-5e37-95a5-5548acbbc5a9_image_6.webp HTTP/1.1" 201 0
2025-12-05 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F458a0c39-3a41-49c8-98bf-fcde84b4b0cd_ff1d72b7-b95d-42b6-ad9f-99b672d07d99.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/458a0c39-3a41-49c8-98bf-fcde84b4b0cd_ff1d72b7-b95d-42b6-ad9f-99b672d07d99.jpg/250x188.webp saved to cache
2025-12-05 12:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d57a450d-6ffc-5e37-95a5-5548acbbc5a9
2025-12-05 12:00:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:00:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:00:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:00:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9dd5d2a90>
2025-12-05 12:00:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:00:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:00:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 12:00:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:00:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d57a450d-6ffc-5e37-95a5-5548acbbc5a9/d57a450d-6ffc-5e37-95a5-5548acbbc5a9_image_2.webp HTTP/1.1" 201 0
2025-12-05 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F458a0c39-3a41-49c8-98bf-fcde84b4b0cd_0362a145-4fd0-4b81-ad60-9ef2abfdd573.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/458a0c39-3a41-49c8-98bf-fcde84b4b0cd_0362a145-4fd0-4b81-ad60-9ef2abfdd573.jpg/250x188.webp saved to cache
2025-12-05 12:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d57a450d-6ffc-5e37-95a5-5548acbbc5a9
2025-12-05 12:00:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:00:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:00:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:00:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5cca050>
2025-12-05 12:00:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:00:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:00:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 12:00:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:00:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d57a450d-6ffc-5e37-95a5-5548acbbc5a9/d57a450d-6ffc-5e37-95a5-5548acbbc5a9_image_3.webp HTTP/1.1" 201 0
2025-12-05 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F458a0c39-3a41-49c8-98bf-fcde84b4b0cd_86124290-ed2b-429f-aa89-8d083bd8023b.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/458a0c39-3a41-49c8-98bf-fcde84b4b0cd_86124290-ed2b-429f-aa89-8d083bd8023b.jpg/250x188.webp saved to cache
2025-12-05 12:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d57a450d-6ffc-5e37-95a5-5548acbbc5a9
2025-12-05 12:00:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:00:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:00:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:00:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9dc1b96d0>
2025-12-05 12:00:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:00:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:00:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 12:00:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:00:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d57a450d-6ffc-5e37-95a5-5548acbbc5a9/d57a450d-6ffc-5e37-95a5-5548acbbc5a9_image_5.webp HTTP/1.1" 201 0
2025-12-05 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F458a0c39-3a41-49c8-98bf-fcde84b4b0cd_d7d9c1dd-8b25-4c22-ad2f-8f303d44e8b9.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/458a0c39-3a41-49c8-98bf-fcde84b4b0cd_d7d9c1dd-8b25-4c22-ad2f-8f303d44e8b9.jpg/250x188.webp saved to cache
2025-12-05 12:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d57a450d-6ffc-5e37-95a5-5548acbbc5a9
2025-12-05 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F458a0c39-3a41-49c8-98bf-fcde84b4b0cd_0914e68f-9dbd-47e3-b354-f58d81d1ec32.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/458a0c39-3a41-49c8-98bf-fcde84b4b0cd_0914e68f-9dbd-47e3-b354-f58d81d1ec32.jpg/250x188.webp not downloaded yet
2025-12-05 12:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/458a0c39-3a41-49c8-98bf-fcde84b4b0cd_99fe032b-6ba7-4ced-8717-11c34f6b2a19.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/458a0c39-3a41-49c8-98bf-fcde84b4b0cd_257011ee-ce04-4b1d-90c4-0aa20951ef21.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27235cd3a8-f48b-43c5-abe6-96229395d22b%27 HTTP/1.1" 200 None
2025-12-05 12:00:55 [auto_selling_autoscout24.it] INFO: Scrape type for 235cd3a8-f48b-43c5-abe6-96229395d22b: 1
2025-12-05 12:00:55 [auto_selling_autoscout24.it] INFO: Scraping new listing 235cd3a8-f48b-43c5-abe6-96229395d22b
2025-12-05 12:00:55 [auto_selling_autoscout24.it] INFO: Extracting item from listing ID: 235cd3a8-f48b-43c5-abe6-96229395d22b
2025-12-05 12:00:55 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 194d515b-03f6-5763-9f38-f24e1351c50c with identifier: 235cd3a8-f48b-43c5-abe6-96229395d22b
2025-12-05 12:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 194d515b-03f6-5763-9f38-f24e1351c50c
2025-12-05 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F235cd3a8-f48b-43c5-abe6-96229395d22b_dded1d0a-09cc-4e11-bc78-9dbd87fd4945.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/235cd3a8-f48b-43c5-abe6-96229395d22b_dded1d0a-09cc-4e11-bc78-9dbd87fd4945.jpg/250x188.webp not downloaded yet
2025-12-05 12:00:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:00:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:00:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:00:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d6ffa910>
2025-12-05 12:00:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:00:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:00:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 12:00:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:00:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d57a450d-6ffc-5e37-95a5-5548acbbc5a9/d57a450d-6ffc-5e37-95a5-5548acbbc5a9_image_7.webp HTTP/1.1" 201 0
2025-12-05 12:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F458a0c39-3a41-49c8-98bf-fcde84b4b0cd_6e77fa5f-83cf-4321-bdcf-a3a8b2f7cc17.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/458a0c39-3a41-49c8-98bf-fcde84b4b0cd_6e77fa5f-83cf-4321-bdcf-a3a8b2f7cc17.jpg/250x188.webp saved to cache
2025-12-05 12:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d57a450d-6ffc-5e37-95a5-5548acbbc5a9
2025-12-05 12:00:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:00:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:00:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:00:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e98a50>
2025-12-05 12:00:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:00:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:00:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:00:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:00:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d57a450d-6ffc-5e37-95a5-5548acbbc5a9/d57a450d-6ffc-5e37-95a5-5548acbbc5a9_image_8.webp HTTP/1.1" 201 0
2025-12-05 12:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F458a0c39-3a41-49c8-98bf-fcde84b4b0cd_d4a3750d-312a-4b96-aa2e-c391d746029c.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/458a0c39-3a41-49c8-98bf-fcde84b4b0cd_d4a3750d-312a-4b96-aa2e-c391d746029c.jpg/250x188.webp saved to cache
2025-12-05 12:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d57a450d-6ffc-5e37-95a5-5548acbbc5a9
2025-12-05 12:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F235cd3a8-f48b-43c5-abe6-96229395d22b_40becf07-6fe4-4ee8-ae23-d0e48dcf7dfb.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/235cd3a8-f48b-43c5-abe6-96229395d22b_40becf07-6fe4-4ee8-ae23-d0e48dcf7dfb.jpg/250x188.webp not downloaded yet
2025-12-05 12:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/458a0c39-3a41-49c8-98bf-fcde84b4b0cd_bdacc738-6dcd-4bfc-9578-ed7a375f4e38.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/458a0c39-3a41-49c8-98bf-fcde84b4b0cd_83918ca6-fe85-41dc-8b00-41fccb4a20d7.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F235cd3a8-f48b-43c5-abe6-96229395d22b_43387a80-0f59-454b-92f4-2d33a4835fa2.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/235cd3a8-f48b-43c5-abe6-96229395d22b_43387a80-0f59-454b-92f4-2d33a4835fa2.jpg/250x188.webp not downloaded yet
2025-12-05 12:00:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:00:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:00:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:00:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e6c410>
2025-12-05 12:00:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:00:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:00:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:00:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:00:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d57a450d-6ffc-5e37-95a5-5548acbbc5a9/d57a450d-6ffc-5e37-95a5-5548acbbc5a9_image_9.webp HTTP/1.1" 201 0
2025-12-05 12:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F458a0c39-3a41-49c8-98bf-fcde84b4b0cd_99fe032b-6ba7-4ced-8717-11c34f6b2a19.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/458a0c39-3a41-49c8-98bf-fcde84b4b0cd_99fe032b-6ba7-4ced-8717-11c34f6b2a19.jpg/250x188.webp saved to cache
2025-12-05 12:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d57a450d-6ffc-5e37-95a5-5548acbbc5a9
2025-12-05 12:00:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:00:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:00:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:00:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5cf9990>
2025-12-05 12:00:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:00:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:00:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 12:00:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:00:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:00:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:00:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d57a450d-6ffc-5e37-95a5-5548acbbc5a9/d57a450d-6ffc-5e37-95a5-5548acbbc5a9_image_10.webp HTTP/1.1" 201 0
2025-12-05 12:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F458a0c39-3a41-49c8-98bf-fcde84b4b0cd_257011ee-ce04-4b1d-90c4-0aa20951ef21.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/458a0c39-3a41-49c8-98bf-fcde84b4b0cd_257011ee-ce04-4b1d-90c4-0aa20951ef21.jpg/250x188.webp saved to cache
2025-12-05 12:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item d57a450d-6ffc-5e37-95a5-5548acbbc5a9
2025-12-05 12:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F235cd3a8-f48b-43c5-abe6-96229395d22b_ae54dc03-d5d6-4450-bc69-867ab107b17c.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/235cd3a8-f48b-43c5-abe6-96229395d22b_ae54dc03-d5d6-4450-bc69-867ab107b17c.jpg/250x188.webp not downloaded yet
2025-12-05 12:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/235cd3a8-f48b-43c5-abe6-96229395d22b_dded1d0a-09cc-4e11-bc78-9dbd87fd4945.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/458a0c39-3a41-49c8-98bf-fcde84b4b0cd_0914e68f-9dbd-47e3-b354-f58d81d1ec32.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:00:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:00:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:00:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:00:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5c17590>
2025-12-05 12:00:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:00:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:00:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:00:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:00:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:00:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:00:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d57a450d-6ffc-5e37-95a5-5548acbbc5a9/d57a450d-6ffc-5e37-95a5-5548acbbc5a9_image_11.webp HTTP/1.1" 201 0
2025-12-05 12:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F458a0c39-3a41-49c8-98bf-fcde84b4b0cd_bdacc738-6dcd-4bfc-9578-ed7a375f4e38.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/458a0c39-3a41-49c8-98bf-fcde84b4b0cd_bdacc738-6dcd-4bfc-9578-ed7a375f4e38.jpg/250x188.webp saved to cache
2025-12-05 12:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item d57a450d-6ffc-5e37-95a5-5548acbbc5a9
2025-12-05 12:00:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:00:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:00:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:00:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5c54810>
2025-12-05 12:00:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:00:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:00:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 12:00:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:00:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:00:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:00:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d57a450d-6ffc-5e37-95a5-5548acbbc5a9/d57a450d-6ffc-5e37-95a5-5548acbbc5a9_image_12.webp HTTP/1.1" 201 0
2025-12-05 12:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F458a0c39-3a41-49c8-98bf-fcde84b4b0cd_83918ca6-fe85-41dc-8b00-41fccb4a20d7.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/458a0c39-3a41-49c8-98bf-fcde84b4b0cd_83918ca6-fe85-41dc-8b00-41fccb4a20d7.jpg/250x188.webp saved to cache
2025-12-05 12:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item d57a450d-6ffc-5e37-95a5-5548acbbc5a9
2025-12-05 12:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F235cd3a8-f48b-43c5-abe6-96229395d22b_e9e153f0-6568-4f58-ab1e-3c725f3a3f36.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/235cd3a8-f48b-43c5-abe6-96229395d22b_e9e153f0-6568-4f58-ab1e-3c725f3a3f36.jpg/250x188.webp not downloaded yet
2025-12-05 12:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/235cd3a8-f48b-43c5-abe6-96229395d22b_40becf07-6fe4-4ee8-ae23-d0e48dcf7dfb.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F235cd3a8-f48b-43c5-abe6-96229395d22b_e8355f0f-bcd9-4ca5-a027-bb3b8ddc4629.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/235cd3a8-f48b-43c5-abe6-96229395d22b_e8355f0f-bcd9-4ca5-a027-bb3b8ddc4629.jpg/250x188.webp not downloaded yet
2025-12-05 12:00:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:00:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:00:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:00:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5c78890>
2025-12-05 12:00:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:00:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:00:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 12:00:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:00:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:00:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:00:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_194d515b-03f6-5763-9f38-f24e1351c50c/194d515b-03f6-5763-9f38-f24e1351c50c_image_0.webp HTTP/1.1" 201 0
2025-12-05 12:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F235cd3a8-f48b-43c5-abe6-96229395d22b_dded1d0a-09cc-4e11-bc78-9dbd87fd4945.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/235cd3a8-f48b-43c5-abe6-96229395d22b_dded1d0a-09cc-4e11-bc78-9dbd87fd4945.jpg/250x188.webp saved to cache
2025-12-05 12:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 194d515b-03f6-5763-9f38-f24e1351c50c
2025-12-05 12:00:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:00:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:00:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:00:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5cf8810>
2025-12-05 12:00:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:00:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:00:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 12:00:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:00:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d57a450d-6ffc-5e37-95a5-5548acbbc5a9/d57a450d-6ffc-5e37-95a5-5548acbbc5a9_image_13.webp HTTP/1.1" 201 0
2025-12-05 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F458a0c39-3a41-49c8-98bf-fcde84b4b0cd_0914e68f-9dbd-47e3-b354-f58d81d1ec32.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/458a0c39-3a41-49c8-98bf-fcde84b4b0cd_0914e68f-9dbd-47e3-b354-f58d81d1ec32.jpg/250x188.webp saved to cache
2025-12-05 12:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item d57a450d-6ffc-5e37-95a5-5548acbbc5a9
2025-12-05 12:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Removing item d57a450d-6ffc-5e37-95a5-5548acbbc5a9 from tracking dictionaries
2025-12-05 12:00:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d57a450d-6ffc-5e37-95a5-5548acbbc5a9 sending to next pipeline
2025-12-05 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F235cd3a8-f48b-43c5-abe6-96229395d22b_93a1516c-2bdd-463b-bb54-d87c6157334b.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/235cd3a8-f48b-43c5-abe6-96229395d22b_93a1516c-2bdd-463b-bb54-d87c6157334b.jpg/250x188.webp not downloaded yet
2025-12-05 12:00:58 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: d57a450d-6ffc-5e37-95a5-5548acbbc5a9 with identifier 458a0c39-3a41-49c8-98bf-fcde84b4b0cd
2025-12-05 12:00:58 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:00:58 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:00:58 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item d57a450d-6ffc-5e37-95a5-5548acbbc5a9
2025-12-05 12:00:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://prod.pictures.autoscout24.net/listing-images/458a0c39-3a41-49c8-98bf-fcde84b4b0cd_0914e68f-9dbd-47e3-b354-f58d81d1ec32.jpg/250x188.webp>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'emission_standard': None,
 'engine': None,
 'engine_horse_power': 333,
 'expiration_date': None,
 'fuel_type': 'Gasoline',
 'id': 'd57a450d-6ffc-5e37-95a5-5548acbbc5a9',
 'is_damaged': False,
 'is_operable': True,
 'license_plate': None,
 'link_to_web_offer': 'https://www.autoscout24.it/offers/volkswagen-golf-r-black-edition-2-0-tsi-4motion-333-cv-tetto-promo-gasoline-black-458a0c39-3a41-49c8-98bf-fcde84b4b0cd',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf R',
 'odometer': 24800,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d57a450d-6ffc-5e37-95a5-5548acbbc5a9/d57a450d-6ffc-5e37-95a5-5548acbbc5a9_image_0.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4212,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/458a0c39-3a41-49c8-98bf-fcde84b4b0cd_b48b9a90-7e25-4174-b07a-e1e8f9c72731.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d57a450d-6ffc-5e37-95a5-5548acbbc5a9/d57a450d-6ffc-5e37-95a5-5548acbbc5a9_image_1.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5302,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/458a0c39-3a41-49c8-98bf-fcde84b4b0cd_6ef99738-baca-4fc3-b6a0-11263e2e67f3.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d57a450d-6ffc-5e37-95a5-5548acbbc5a9/d57a450d-6ffc-5e37-95a5-5548acbbc5a9_image_2.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4340,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/458a0c39-3a41-49c8-98bf-fcde84b4b0cd_0362a145-4fd0-4b81-ad60-9ef2abfdd573.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d57a450d-6ffc-5e37-95a5-5548acbbc5a9/d57a450d-6ffc-5e37-95a5-5548acbbc5a9_image_3.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4410,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/458a0c39-3a41-49c8-98bf-fcde84b4b0cd_86124290-ed2b-429f-aa89-8d083bd8023b.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d57a450d-6ffc-5e37-95a5-5548acbbc5a9/d57a450d-6ffc-5e37-95a5-5548acbbc5a9_image_4.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4776,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/458a0c39-3a41-49c8-98bf-fcde84b4b0cd_40ed5c36-1bb6-4ab4-b714-b49b00fbc7ed.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d57a450d-6ffc-5e37-95a5-5548acbbc5a9/d57a450d-6ffc-5e37-95a5-5548acbbc5a9_image_5.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4368,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/458a0c39-3a41-49c8-98bf-fcde84b4b0cd_d7d9c1dd-8b25-4c22-ad2f-8f303d44e8b9.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d57a450d-6ffc-5e37-95a5-5548acbbc5a9/d57a450d-6ffc-5e37-95a5-5548acbbc5a9_image_6.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5576,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/458a0c39-3a41-49c8-98bf-fcde84b4b0cd_ff1d72b7-b95d-42b6-ad9f-99b672d07d99.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d57a450d-6ffc-5e37-95a5-5548acbbc5a9/d57a450d-6ffc-5e37-95a5-5548acbbc5a9_image_7.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 9252,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/458a0c39-3a41-49c8-98bf-fcde84b4b0cd_6e77fa5f-83cf-4321-bdcf-a3a8b2f7cc17.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d57a450d-6ffc-5e37-95a5-5548acbbc5a9/d57a450d-6ffc-5e37-95a5-5548acbbc5a9_image_8.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 6542,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/458a0c39-3a41-49c8-98bf-fcde84b4b0cd_d4a3750d-312a-4b96-aa2e-c391d746029c.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d57a450d-6ffc-5e37-95a5-5548acbbc5a9/d57a450d-6ffc-5e37-95a5-5548acbbc5a9_image_9.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 7290,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/458a0c39-3a41-49c8-98bf-fcde84b4b0cd_99fe032b-6ba7-4ced-8717-11c34f6b2a19.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d57a450d-6ffc-5e37-95a5-5548acbbc5a9/d57a450d-6ffc-5e37-95a5-5548acbbc5a9_image_10.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 7490,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/458a0c39-3a41-49c8-98bf-fcde84b4b0cd_257011ee-ce04-4b1d-90c4-0aa20951ef21.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d57a450d-6ffc-5e37-95a5-5548acbbc5a9/d57a450d-6ffc-5e37-95a5-5548acbbc5a9_image_11.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3962,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/458a0c39-3a41-49c8-98bf-fcde84b4b0cd_bdacc738-6dcd-4bfc-9578-ed7a375f4e38.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d57a450d-6ffc-5e37-95a5-5548acbbc5a9/d57a450d-6ffc-5e37-95a5-5548acbbc5a9_image_12.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3056,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/458a0c39-3a41-49c8-98bf-fcde84b4b0cd_83918ca6-fe85-41dc-8b00-41fccb4a20d7.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d57a450d-6ffc-5e37-95a5-5548acbbc5a9/d57a450d-6ffc-5e37-95a5-5548acbbc5a9_image_13.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 6572,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/458a0c39-3a41-49c8-98bf-fcde84b4b0cd_0914e68f-9dbd-47e3-b354-f58d81d1ec32.jpg/250x188.webp',
             'Width': 250}],
 'price': 53800,
 'price_includes_vat': False,
 'registration_date': '2025-04-01',
 'seller_name': None,
 'title': 'Volkswagen Golf R BLACK EDITION 2.0 TSI 4MOTION 333 CV *TETTO* '
          'PROMO',
 'transmission': 'automatic',
 'trim': 'BLACK EDITION 2.0 TSI 4MOTION 333 CV *TETTO* PROMO',
 'vin': None,
 'year': 2025}
2025-12-05 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27458a0c39-3a41-49c8-98bf-fcde84b4b0cd%27 HTTP/1.1" 200 None
2025-12-05 12:00:58 [auto_selling_autoscout24.it] INFO: Saving data for 458a0c39-3a41-49c8-98bf-fcde84b4b0cd: {'created_time': 1764936058.272551, 'last_price_update_time': 1764936058.272563}
2025-12-05 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autoscout24.it',RowKey='458a0c39-3a41-49c8-98bf-fcde84b4b0cd') HTTP/1.1" 204 0
2025-12-05 12:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/235cd3a8-f48b-43c5-abe6-96229395d22b_ae54dc03-d5d6-4450-bc69-867ab107b17c.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/235cd3a8-f48b-43c5-abe6-96229395d22b_43387a80-0f59-454b-92f4-2d33a4835fa2.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/235cd3a8-f48b-43c5-abe6-96229395d22b_e9e153f0-6568-4f58-ab1e-3c725f3a3f36.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F235cd3a8-f48b-43c5-abe6-96229395d22b_90c6caa5-92f9-4a96-9795-528ff654300f.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/235cd3a8-f48b-43c5-abe6-96229395d22b_90c6caa5-92f9-4a96-9795-528ff654300f.jpg/250x188.webp not downloaded yet
2025-12-05 12:00:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:00:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:00:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:00:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9dd5d0590>
2025-12-05 12:00:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:00:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:00:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 12:00:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:00:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_194d515b-03f6-5763-9f38-f24e1351c50c/194d515b-03f6-5763-9f38-f24e1351c50c_image_1.webp HTTP/1.1" 201 0
2025-12-05 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F235cd3a8-f48b-43c5-abe6-96229395d22b_40becf07-6fe4-4ee8-ae23-d0e48dcf7dfb.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/235cd3a8-f48b-43c5-abe6-96229395d22b_40becf07-6fe4-4ee8-ae23-d0e48dcf7dfb.jpg/250x188.webp saved to cache
2025-12-05 12:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 194d515b-03f6-5763-9f38-f24e1351c50c
2025-12-05 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F235cd3a8-f48b-43c5-abe6-96229395d22b_76b48d40-42de-4296-aa7b-8db821e44d59.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/235cd3a8-f48b-43c5-abe6-96229395d22b_76b48d40-42de-4296-aa7b-8db821e44d59.jpg/250x188.webp not downloaded yet
2025-12-05 12:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/235cd3a8-f48b-43c5-abe6-96229395d22b_e8355f0f-bcd9-4ca5-a027-bb3b8ddc4629.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F235cd3a8-f48b-43c5-abe6-96229395d22b_af1447e7-d0b2-44a5-8c68-29b35da7a568.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/235cd3a8-f48b-43c5-abe6-96229395d22b_af1447e7-d0b2-44a5-8c68-29b35da7a568.jpg/250x188.webp not downloaded yet
2025-12-05 12:00:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:00:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:00:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:00:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e8a4d0>
2025-12-05 12:00:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:00:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:00:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 12:00:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:00:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_194d515b-03f6-5763-9f38-f24e1351c50c/194d515b-03f6-5763-9f38-f24e1351c50c_image_3.webp HTTP/1.1" 201 0
2025-12-05 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F235cd3a8-f48b-43c5-abe6-96229395d22b_ae54dc03-d5d6-4450-bc69-867ab107b17c.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/235cd3a8-f48b-43c5-abe6-96229395d22b_ae54dc03-d5d6-4450-bc69-867ab107b17c.jpg/250x188.webp saved to cache
2025-12-05 12:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 194d515b-03f6-5763-9f38-f24e1351c50c
2025-12-05 12:00:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:00:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:00:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:00:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5c6ba10>
2025-12-05 12:00:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:00:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:00:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:00:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:00:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_194d515b-03f6-5763-9f38-f24e1351c50c/194d515b-03f6-5763-9f38-f24e1351c50c_image_2.webp HTTP/1.1" 201 0
2025-12-05 12:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F235cd3a8-f48b-43c5-abe6-96229395d22b_43387a80-0f59-454b-92f4-2d33a4835fa2.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/235cd3a8-f48b-43c5-abe6-96229395d22b_43387a80-0f59-454b-92f4-2d33a4835fa2.jpg/250x188.webp saved to cache
2025-12-05 12:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 194d515b-03f6-5763-9f38-f24e1351c50c
2025-12-05 12:00:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:00:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:00:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:00:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5c903d0>
2025-12-05 12:00:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:00:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:00:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:00:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:00:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_194d515b-03f6-5763-9f38-f24e1351c50c/194d515b-03f6-5763-9f38-f24e1351c50c_image_4.webp HTTP/1.1" 201 0
2025-12-05 12:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F235cd3a8-f48b-43c5-abe6-96229395d22b_e9e153f0-6568-4f58-ab1e-3c725f3a3f36.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/235cd3a8-f48b-43c5-abe6-96229395d22b_e9e153f0-6568-4f58-ab1e-3c725f3a3f36.jpg/250x188.webp saved to cache
2025-12-05 12:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 194d515b-03f6-5763-9f38-f24e1351c50c
2025-12-05 12:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F235cd3a8-f48b-43c5-abe6-96229395d22b_2e3490ff-a201-421d-a97a-b5fd1445182e.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/235cd3a8-f48b-43c5-abe6-96229395d22b_2e3490ff-a201-421d-a97a-b5fd1445182e.jpg/250x188.webp not downloaded yet
2025-12-05 12:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/235cd3a8-f48b-43c5-abe6-96229395d22b_93a1516c-2bdd-463b-bb54-d87c6157334b.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/235cd3a8-f48b-43c5-abe6-96229395d22b_90c6caa5-92f9-4a96-9795-528ff654300f.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F235cd3a8-f48b-43c5-abe6-96229395d22b_527f0e77-b3cf-4e13-a998-7b3d996bd9ab.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/235cd3a8-f48b-43c5-abe6-96229395d22b_527f0e77-b3cf-4e13-a998-7b3d996bd9ab.jpg/250x188.webp not downloaded yet
2025-12-05 12:00:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:00:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:00:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:00:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9dd5d7810>
2025-12-05 12:00:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:00:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:00:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:00:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:00:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_194d515b-03f6-5763-9f38-f24e1351c50c/194d515b-03f6-5763-9f38-f24e1351c50c_image_5.webp HTTP/1.1" 201 0
2025-12-05 12:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F235cd3a8-f48b-43c5-abe6-96229395d22b_e8355f0f-bcd9-4ca5-a027-bb3b8ddc4629.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/235cd3a8-f48b-43c5-abe6-96229395d22b_e8355f0f-bcd9-4ca5-a027-bb3b8ddc4629.jpg/250x188.webp saved to cache
2025-12-05 12:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 194d515b-03f6-5763-9f38-f24e1351c50c
2025-12-05 12:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F235cd3a8-f48b-43c5-abe6-96229395d22b_bd73826e-f39b-4d10-83df-4df5e6924962.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/235cd3a8-f48b-43c5-abe6-96229395d22b_bd73826e-f39b-4d10-83df-4df5e6924962.jpg/250x188.webp not downloaded yet
2025-12-05 12:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/235cd3a8-f48b-43c5-abe6-96229395d22b_af1447e7-d0b2-44a5-8c68-29b35da7a568.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/235cd3a8-f48b-43c5-abe6-96229395d22b_76b48d40-42de-4296-aa7b-8db821e44d59.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F235cd3a8-f48b-43c5-abe6-96229395d22b_f0007646-6103-4ae8-a042-ab75231bdab7.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/235cd3a8-f48b-43c5-abe6-96229395d22b_f0007646-6103-4ae8-a042-ab75231bdab7.jpg/250x188.webp not downloaded yet
2025-12-05 12:00:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:00:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:00:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:00:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5c47550>
2025-12-05 12:00:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:00:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:00:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 12:00:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:00:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_194d515b-03f6-5763-9f38-f24e1351c50c/194d515b-03f6-5763-9f38-f24e1351c50c_image_6.webp HTTP/1.1" 201 0
2025-12-05 12:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F235cd3a8-f48b-43c5-abe6-96229395d22b_93a1516c-2bdd-463b-bb54-d87c6157334b.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/235cd3a8-f48b-43c5-abe6-96229395d22b_93a1516c-2bdd-463b-bb54-d87c6157334b.jpg/250x188.webp saved to cache
2025-12-05 12:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 194d515b-03f6-5763-9f38-f24e1351c50c
2025-12-05 12:00:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:00:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:00:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:00:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5c68b90>
2025-12-05 12:00:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:00:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 12:01:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_194d515b-03f6-5763-9f38-f24e1351c50c/194d515b-03f6-5763-9f38-f24e1351c50c_image_7.webp HTTP/1.1" 201 0
2025-12-05 12:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F235cd3a8-f48b-43c5-abe6-96229395d22b_90c6caa5-92f9-4a96-9795-528ff654300f.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/235cd3a8-f48b-43c5-abe6-96229395d22b_90c6caa5-92f9-4a96-9795-528ff654300f.jpg/250x188.webp saved to cache
2025-12-05 12:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 194d515b-03f6-5763-9f38-f24e1351c50c
2025-12-05 12:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F235cd3a8-f48b-43c5-abe6-96229395d22b_43832192-ad6f-45d6-b574-8c5d13613728.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/235cd3a8-f48b-43c5-abe6-96229395d22b_43832192-ad6f-45d6-b574-8c5d13613728.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/235cd3a8-f48b-43c5-abe6-96229395d22b_2e3490ff-a201-421d-a97a-b5fd1445182e.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/235cd3a8-f48b-43c5-abe6-96229395d22b_527f0e77-b3cf-4e13-a998-7b3d996bd9ab.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27cefd9030-28de-4048-b0a7-6ff06df57b05%27 HTTP/1.1" 200 None
2025-12-05 12:01:00 [auto_selling_autoscout24.it] INFO: Scrape type for cefd9030-28de-4048-b0a7-6ff06df57b05: 1
2025-12-05 12:01:00 [auto_selling_autoscout24.it] INFO: Scraping new listing cefd9030-28de-4048-b0a7-6ff06df57b05
2025-12-05 12:01:00 [auto_selling_autoscout24.it] INFO: Extracting item from listing ID: cefd9030-28de-4048-b0a7-6ff06df57b05
2025-12-05 12:01:00 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: eb2ffd11-f0bb-5ec7-94e2-46f0bb1e2671 with identifier: cefd9030-28de-4048-b0a7-6ff06df57b05
2025-12-05 12:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 14 photos for item eb2ffd11-f0bb-5ec7-94e2-46f0bb1e2671
2025-12-05 12:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fcefd9030-28de-4048-b0a7-6ff06df57b05_9f151fe3-90cb-450a-aca8-1038a4105654.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/cefd9030-28de-4048-b0a7-6ff06df57b05_9f151fe3-90cb-450a-aca8-1038a4105654.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9dc170150>
2025-12-05 12:01:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:01:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_194d515b-03f6-5763-9f38-f24e1351c50c/194d515b-03f6-5763-9f38-f24e1351c50c_image_9.webp HTTP/1.1" 201 0
2025-12-05 12:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F235cd3a8-f48b-43c5-abe6-96229395d22b_af1447e7-d0b2-44a5-8c68-29b35da7a568.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/235cd3a8-f48b-43c5-abe6-96229395d22b_af1447e7-d0b2-44a5-8c68-29b35da7a568.jpg/250x188.webp saved to cache
2025-12-05 12:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 194d515b-03f6-5763-9f38-f24e1351c50c
2025-12-05 12:01:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d6fc3590>
2025-12-05 12:01:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 12:01:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_194d515b-03f6-5763-9f38-f24e1351c50c/194d515b-03f6-5763-9f38-f24e1351c50c_image_8.webp HTTP/1.1" 201 0
2025-12-05 12:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F235cd3a8-f48b-43c5-abe6-96229395d22b_76b48d40-42de-4296-aa7b-8db821e44d59.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/235cd3a8-f48b-43c5-abe6-96229395d22b_76b48d40-42de-4296-aa7b-8db821e44d59.jpg/250x188.webp saved to cache
2025-12-05 12:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 194d515b-03f6-5763-9f38-f24e1351c50c
2025-12-05 12:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fcefd9030-28de-4048-b0a7-6ff06df57b05_bedb5366-46a6-4206-b940-ed95cd42f8cd.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/cefd9030-28de-4048-b0a7-6ff06df57b05_bedb5366-46a6-4206-b940-ed95cd42f8cd.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/235cd3a8-f48b-43c5-abe6-96229395d22b_bd73826e-f39b-4d10-83df-4df5e6924962.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/235cd3a8-f48b-43c5-abe6-96229395d22b_f0007646-6103-4ae8-a042-ab75231bdab7.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fcefd9030-28de-4048-b0a7-6ff06df57b05_2fd159c1-432c-4338-96bd-d2ae35263939.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/cefd9030-28de-4048-b0a7-6ff06df57b05_2fd159c1-432c-4338-96bd-d2ae35263939.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d6ff3950>
2025-12-05 12:01:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:01:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_194d515b-03f6-5763-9f38-f24e1351c50c/194d515b-03f6-5763-9f38-f24e1351c50c_image_10.webp HTTP/1.1" 201 0
2025-12-05 12:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F235cd3a8-f48b-43c5-abe6-96229395d22b_2e3490ff-a201-421d-a97a-b5fd1445182e.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/235cd3a8-f48b-43c5-abe6-96229395d22b_2e3490ff-a201-421d-a97a-b5fd1445182e.jpg/250x188.webp saved to cache
2025-12-05 12:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 194d515b-03f6-5763-9f38-f24e1351c50c
2025-12-05 12:01:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9dc13d4d0>
2025-12-05 12:01:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 12:01:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_194d515b-03f6-5763-9f38-f24e1351c50c/194d515b-03f6-5763-9f38-f24e1351c50c_image_11.webp HTTP/1.1" 201 0
2025-12-05 12:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F235cd3a8-f48b-43c5-abe6-96229395d22b_527f0e77-b3cf-4e13-a998-7b3d996bd9ab.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/235cd3a8-f48b-43c5-abe6-96229395d22b_527f0e77-b3cf-4e13-a998-7b3d996bd9ab.jpg/250x188.webp saved to cache
2025-12-05 12:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 194d515b-03f6-5763-9f38-f24e1351c50c
2025-12-05 12:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fcefd9030-28de-4048-b0a7-6ff06df57b05_6e962e70-cc1f-461e-a93c-ef8a2e782017.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/cefd9030-28de-4048-b0a7-6ff06df57b05_6e962e70-cc1f-461e-a93c-ef8a2e782017.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/cefd9030-28de-4048-b0a7-6ff06df57b05_9f151fe3-90cb-450a-aca8-1038a4105654.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/235cd3a8-f48b-43c5-abe6-96229395d22b_43832192-ad6f-45d6-b574-8c5d13613728.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fcefd9030-28de-4048-b0a7-6ff06df57b05_335db9dc-4e6e-4817-ae9e-340e60f264e3.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/cefd9030-28de-4048-b0a7-6ff06df57b05_335db9dc-4e6e-4817-ae9e-340e60f264e3.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e42e10>
2025-12-05 12:01:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 12:01:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_194d515b-03f6-5763-9f38-f24e1351c50c/194d515b-03f6-5763-9f38-f24e1351c50c_image_12.webp HTTP/1.1" 201 0
2025-12-05 12:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F235cd3a8-f48b-43c5-abe6-96229395d22b_bd73826e-f39b-4d10-83df-4df5e6924962.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/235cd3a8-f48b-43c5-abe6-96229395d22b_bd73826e-f39b-4d10-83df-4df5e6924962.jpg/250x188.webp saved to cache
2025-12-05 12:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 194d515b-03f6-5763-9f38-f24e1351c50c
2025-12-05 12:01:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9dc11f5d0>
2025-12-05 12:01:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 12:01:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_194d515b-03f6-5763-9f38-f24e1351c50c/194d515b-03f6-5763-9f38-f24e1351c50c_image_13.webp HTTP/1.1" 201 0
2025-12-05 12:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F235cd3a8-f48b-43c5-abe6-96229395d22b_f0007646-6103-4ae8-a042-ab75231bdab7.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/235cd3a8-f48b-43c5-abe6-96229395d22b_f0007646-6103-4ae8-a042-ab75231bdab7.jpg/250x188.webp saved to cache
2025-12-05 12:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 194d515b-03f6-5763-9f38-f24e1351c50c
2025-12-05 12:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fcefd9030-28de-4048-b0a7-6ff06df57b05_13dfdc78-8e31-4a9d-afc0-c8feb3c66c78.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/cefd9030-28de-4048-b0a7-6ff06df57b05_13dfdc78-8e31-4a9d-afc0-c8feb3c66c78.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/cefd9030-28de-4048-b0a7-6ff06df57b05_2fd159c1-432c-4338-96bd-d2ae35263939.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/cefd9030-28de-4048-b0a7-6ff06df57b05_bedb5366-46a6-4206-b940-ed95cd42f8cd.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fcefd9030-28de-4048-b0a7-6ff06df57b05_8c4f76b4-a5bf-442a-8ea6-88203d7b976e.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/cefd9030-28de-4048-b0a7-6ff06df57b05_8c4f76b4-a5bf-442a-8ea6-88203d7b976e.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5b3f950>
2025-12-05 12:01:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 12:01:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb2ffd11-f0bb-5ec7-94e2-46f0bb1e2671/eb2ffd11-f0bb-5ec7-94e2-46f0bb1e2671_image_0.webp HTTP/1.1" 201 0
2025-12-05 12:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fcefd9030-28de-4048-b0a7-6ff06df57b05_9f151fe3-90cb-450a-aca8-1038a4105654.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/cefd9030-28de-4048-b0a7-6ff06df57b05_9f151fe3-90cb-450a-aca8-1038a4105654.jpg/250x188.webp saved to cache
2025-12-05 12:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item eb2ffd11-f0bb-5ec7-94e2-46f0bb1e2671
2025-12-05 12:01:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5cd5d50>
2025-12-05 12:01:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 12:01:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_194d515b-03f6-5763-9f38-f24e1351c50c/194d515b-03f6-5763-9f38-f24e1351c50c_image_14.webp HTTP/1.1" 201 0
2025-12-05 12:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F235cd3a8-f48b-43c5-abe6-96229395d22b_43832192-ad6f-45d6-b574-8c5d13613728.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/235cd3a8-f48b-43c5-abe6-96229395d22b_43832192-ad6f-45d6-b574-8c5d13613728.jpg/250x188.webp saved to cache
2025-12-05 12:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 194d515b-03f6-5763-9f38-f24e1351c50c
2025-12-05 12:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 194d515b-03f6-5763-9f38-f24e1351c50c from tracking dictionaries
2025-12-05 12:01:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 194d515b-03f6-5763-9f38-f24e1351c50c sending to next pipeline
2025-12-05 12:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fcefd9030-28de-4048-b0a7-6ff06df57b05_bb678e3d-afc6-430b-b48f-060b72d40712.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/cefd9030-28de-4048-b0a7-6ff06df57b05_bb678e3d-afc6-430b-b48f-060b72d40712.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:02 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 194d515b-03f6-5763-9f38-f24e1351c50c with identifier 235cd3a8-f48b-43c5-abe6-96229395d22b
2025-12-05 12:01:02 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:01:02 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:01:02 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 194d515b-03f6-5763-9f38-f24e1351c50c
2025-12-05 12:01:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://prod.pictures.autoscout24.net/listing-images/235cd3a8-f48b-43c5-abe6-96229395d22b_43832192-ad6f-45d6-b574-8c5d13613728.jpg/250x188.webp>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'emission_standard': None,
 'engine': None,
 'engine_horse_power': 249,
 'expiration_date': None,
 'fuel_type': 'Gasoline',
 'id': '194d515b-03f6-5763-9f38-f24e1351c50c',
 'is_damaged': False,
 'is_operable': True,
 'license_plate': None,
 'link_to_web_offer': 'https://www.autoscout24.it/offers/lotus-elise-1-8-cup-250-uniproprietario-vettura-ufficiale-gasoline-yellow-235cd3a8-f48b-43c5-abe6-96229395d22b',
 'listing': 'auction',
 'make': 'Lotus',
 'model': 'Elise',
 'odometer': 3970,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_194d515b-03f6-5763-9f38-f24e1351c50c/194d515b-03f6-5763-9f38-f24e1351c50c_image_0.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4926,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/235cd3a8-f48b-43c5-abe6-96229395d22b_dded1d0a-09cc-4e11-bc78-9dbd87fd4945.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_194d515b-03f6-5763-9f38-f24e1351c50c/194d515b-03f6-5763-9f38-f24e1351c50c_image_1.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4718,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/235cd3a8-f48b-43c5-abe6-96229395d22b_40becf07-6fe4-4ee8-ae23-d0e48dcf7dfb.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_194d515b-03f6-5763-9f38-f24e1351c50c/194d515b-03f6-5763-9f38-f24e1351c50c_image_2.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4826,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/235cd3a8-f48b-43c5-abe6-96229395d22b_43387a80-0f59-454b-92f4-2d33a4835fa2.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_194d515b-03f6-5763-9f38-f24e1351c50c/194d515b-03f6-5763-9f38-f24e1351c50c_image_3.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4592,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/235cd3a8-f48b-43c5-abe6-96229395d22b_ae54dc03-d5d6-4450-bc69-867ab107b17c.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_194d515b-03f6-5763-9f38-f24e1351c50c/194d515b-03f6-5763-9f38-f24e1351c50c_image_4.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4608,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/235cd3a8-f48b-43c5-abe6-96229395d22b_e9e153f0-6568-4f58-ab1e-3c725f3a3f36.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_194d515b-03f6-5763-9f38-f24e1351c50c/194d515b-03f6-5763-9f38-f24e1351c50c_image_5.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 7664,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/235cd3a8-f48b-43c5-abe6-96229395d22b_e8355f0f-bcd9-4ca5-a027-bb3b8ddc4629.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_194d515b-03f6-5763-9f38-f24e1351c50c/194d515b-03f6-5763-9f38-f24e1351c50c_image_6.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 6792,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/235cd3a8-f48b-43c5-abe6-96229395d22b_93a1516c-2bdd-463b-bb54-d87c6157334b.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_194d515b-03f6-5763-9f38-f24e1351c50c/194d515b-03f6-5763-9f38-f24e1351c50c_image_7.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 6702,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/235cd3a8-f48b-43c5-abe6-96229395d22b_90c6caa5-92f9-4a96-9795-528ff654300f.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_194d515b-03f6-5763-9f38-f24e1351c50c/194d515b-03f6-5763-9f38-f24e1351c50c_image_8.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4494,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/235cd3a8-f48b-43c5-abe6-96229395d22b_76b48d40-42de-4296-aa7b-8db821e44d59.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_194d515b-03f6-5763-9f38-f24e1351c50c/194d515b-03f6-5763-9f38-f24e1351c50c_image_9.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3892,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/235cd3a8-f48b-43c5-abe6-96229395d22b_af1447e7-d0b2-44a5-8c68-29b35da7a568.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_194d515b-03f6-5763-9f38-f24e1351c50c/194d515b-03f6-5763-9f38-f24e1351c50c_image_10.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5048,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/235cd3a8-f48b-43c5-abe6-96229395d22b_2e3490ff-a201-421d-a97a-b5fd1445182e.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_194d515b-03f6-5763-9f38-f24e1351c50c/194d515b-03f6-5763-9f38-f24e1351c50c_image_11.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4418,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/235cd3a8-f48b-43c5-abe6-96229395d22b_527f0e77-b3cf-4e13-a998-7b3d996bd9ab.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_194d515b-03f6-5763-9f38-f24e1351c50c/194d515b-03f6-5763-9f38-f24e1351c50c_image_12.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4950,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/235cd3a8-f48b-43c5-abe6-96229395d22b_bd73826e-f39b-4d10-83df-4df5e6924962.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_194d515b-03f6-5763-9f38-f24e1351c50c/194d515b-03f6-5763-9f38-f24e1351c50c_image_13.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4570,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/235cd3a8-f48b-43c5-abe6-96229395d22b_f0007646-6103-4ae8-a042-ab75231bdab7.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_194d515b-03f6-5763-9f38-f24e1351c50c/194d515b-03f6-5763-9f38-f24e1351c50c_image_14.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5600,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/235cd3a8-f48b-43c5-abe6-96229395d22b_43832192-ad6f-45d6-b574-8c5d13613728.jpg/250x188.webp',
             'Width': 250}],
 'price': 89888,
 'price_includes_vat': False,
 'registration_date': '2021-10-01',
 'seller_name': None,
 'title': 'Lotus Elise 1.8 CUP 250 UNIPROPRIETARIO VETTURA UFFICIALE',
 'transmission': 'automatic',
 'trim': '1.8 CUP 250 UNIPROPRIETARIO VETTURA UFFICIALE',
 'vin': None,
 'year': 2021}
2025-12-05 12:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27235cd3a8-f48b-43c5-abe6-96229395d22b%27 HTTP/1.1" 200 None
2025-12-05 12:01:02 [auto_selling_autoscout24.it] INFO: Saving data for 235cd3a8-f48b-43c5-abe6-96229395d22b: {'created_time': 1764936062.660238, 'last_price_update_time': 1764936062.660253}
2025-12-05 12:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autoscout24.it',RowKey='235cd3a8-f48b-43c5-abe6-96229395d22b') HTTP/1.1" 204 0
2025-12-05 12:01:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/cefd9030-28de-4048-b0a7-6ff06df57b05_6e962e70-cc1f-461e-a93c-ef8a2e782017.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/cefd9030-28de-4048-b0a7-6ff06df57b05_335db9dc-4e6e-4817-ae9e-340e60f264e3.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fcefd9030-28de-4048-b0a7-6ff06df57b05_b5c810a8-ef3e-4022-8c04-4a7b4ec8eaf7.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/cefd9030-28de-4048-b0a7-6ff06df57b05_b5c810a8-ef3e-4022-8c04-4a7b4ec8eaf7.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5ccf350>
2025-12-05 12:01:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 12:01:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb2ffd11-f0bb-5ec7-94e2-46f0bb1e2671/eb2ffd11-f0bb-5ec7-94e2-46f0bb1e2671_image_2.webp HTTP/1.1" 201 0
2025-12-05 12:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fcefd9030-28de-4048-b0a7-6ff06df57b05_2fd159c1-432c-4338-96bd-d2ae35263939.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/cefd9030-28de-4048-b0a7-6ff06df57b05_2fd159c1-432c-4338-96bd-d2ae35263939.jpg/250x188.webp saved to cache
2025-12-05 12:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item eb2ffd11-f0bb-5ec7-94e2-46f0bb1e2671
2025-12-05 12:01:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9dc102b90>
2025-12-05 12:01:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 12:01:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb2ffd11-f0bb-5ec7-94e2-46f0bb1e2671/eb2ffd11-f0bb-5ec7-94e2-46f0bb1e2671_image_1.webp HTTP/1.1" 201 0
2025-12-05 12:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fcefd9030-28de-4048-b0a7-6ff06df57b05_bedb5366-46a6-4206-b940-ed95cd42f8cd.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/cefd9030-28de-4048-b0a7-6ff06df57b05_bedb5366-46a6-4206-b940-ed95cd42f8cd.jpg/250x188.webp saved to cache
2025-12-05 12:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item eb2ffd11-f0bb-5ec7-94e2-46f0bb1e2671
2025-12-05 12:01:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/cefd9030-28de-4048-b0a7-6ff06df57b05_8c4f76b4-a5bf-442a-8ea6-88203d7b976e.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/cefd9030-28de-4048-b0a7-6ff06df57b05_13dfdc78-8e31-4a9d-afc0-c8feb3c66c78.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fcefd9030-28de-4048-b0a7-6ff06df57b05_76620f11-ddef-4d70-9839-fab72800034e.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/cefd9030-28de-4048-b0a7-6ff06df57b05_76620f11-ddef-4d70-9839-fab72800034e.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9dd5d5ed0>
2025-12-05 12:01:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 12:01:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb2ffd11-f0bb-5ec7-94e2-46f0bb1e2671/eb2ffd11-f0bb-5ec7-94e2-46f0bb1e2671_image_3.webp HTTP/1.1" 201 0
2025-12-05 12:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fcefd9030-28de-4048-b0a7-6ff06df57b05_6e962e70-cc1f-461e-a93c-ef8a2e782017.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/cefd9030-28de-4048-b0a7-6ff06df57b05_6e962e70-cc1f-461e-a93c-ef8a2e782017.jpg/250x188.webp saved to cache
2025-12-05 12:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item eb2ffd11-f0bb-5ec7-94e2-46f0bb1e2671
2025-12-05 12:01:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5eae310>
2025-12-05 12:01:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 12:01:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb2ffd11-f0bb-5ec7-94e2-46f0bb1e2671/eb2ffd11-f0bb-5ec7-94e2-46f0bb1e2671_image_4.webp HTTP/1.1" 201 0
2025-12-05 12:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fcefd9030-28de-4048-b0a7-6ff06df57b05_335db9dc-4e6e-4817-ae9e-340e60f264e3.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/cefd9030-28de-4048-b0a7-6ff06df57b05_335db9dc-4e6e-4817-ae9e-340e60f264e3.jpg/250x188.webp saved to cache
2025-12-05 12:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item eb2ffd11-f0bb-5ec7-94e2-46f0bb1e2671
2025-12-05 12:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fcefd9030-28de-4048-b0a7-6ff06df57b05_e38c33c9-5aa9-4c1d-9aad-b88d74da797b.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/cefd9030-28de-4048-b0a7-6ff06df57b05_e38c33c9-5aa9-4c1d-9aad-b88d74da797b.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/cefd9030-28de-4048-b0a7-6ff06df57b05_bb678e3d-afc6-430b-b48f-060b72d40712.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fcefd9030-28de-4048-b0a7-6ff06df57b05_f10f2cea-560d-46f5-beed-b4727da5108e.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/cefd9030-28de-4048-b0a7-6ff06df57b05_f10f2cea-560d-46f5-beed-b4727da5108e.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e7f150>
2025-12-05 12:01:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:01:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb2ffd11-f0bb-5ec7-94e2-46f0bb1e2671/eb2ffd11-f0bb-5ec7-94e2-46f0bb1e2671_image_6.webp HTTP/1.1" 201 0
2025-12-05 12:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fcefd9030-28de-4048-b0a7-6ff06df57b05_8c4f76b4-a5bf-442a-8ea6-88203d7b976e.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/cefd9030-28de-4048-b0a7-6ff06df57b05_8c4f76b4-a5bf-442a-8ea6-88203d7b976e.jpg/250x188.webp saved to cache
2025-12-05 12:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item eb2ffd11-f0bb-5ec7-94e2-46f0bb1e2671
2025-12-05 12:01:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e38d50>
2025-12-05 12:01:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:01:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb2ffd11-f0bb-5ec7-94e2-46f0bb1e2671/eb2ffd11-f0bb-5ec7-94e2-46f0bb1e2671_image_5.webp HTTP/1.1" 201 0
2025-12-05 12:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fcefd9030-28de-4048-b0a7-6ff06df57b05_13dfdc78-8e31-4a9d-afc0-c8feb3c66c78.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/cefd9030-28de-4048-b0a7-6ff06df57b05_13dfdc78-8e31-4a9d-afc0-c8feb3c66c78.jpg/250x188.webp saved to cache
2025-12-05 12:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item eb2ffd11-f0bb-5ec7-94e2-46f0bb1e2671
2025-12-05 12:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fcefd9030-28de-4048-b0a7-6ff06df57b05_834ea7b9-09e0-4ede-95a4-a70849abd40e.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/cefd9030-28de-4048-b0a7-6ff06df57b05_834ea7b9-09e0-4ede-95a4-a70849abd40e.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/cefd9030-28de-4048-b0a7-6ff06df57b05_b5c810a8-ef3e-4022-8c04-4a7b4ec8eaf7.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/cefd9030-28de-4048-b0a7-6ff06df57b05_76620f11-ddef-4d70-9839-fab72800034e.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fcefd9030-28de-4048-b0a7-6ff06df57b05_eac27b2a-5e05-4c17-bad1-4a62856dc9e5.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/cefd9030-28de-4048-b0a7-6ff06df57b05_eac27b2a-5e05-4c17-bad1-4a62856dc9e5.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d6f13790>
2025-12-05 12:01:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 12:01:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb2ffd11-f0bb-5ec7-94e2-46f0bb1e2671/eb2ffd11-f0bb-5ec7-94e2-46f0bb1e2671_image_7.webp HTTP/1.1" 201 0
2025-12-05 12:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fcefd9030-28de-4048-b0a7-6ff06df57b05_bb678e3d-afc6-430b-b48f-060b72d40712.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/cefd9030-28de-4048-b0a7-6ff06df57b05_bb678e3d-afc6-430b-b48f-060b72d40712.jpg/250x188.webp saved to cache
2025-12-05 12:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item eb2ffd11-f0bb-5ec7-94e2-46f0bb1e2671
2025-12-05 12:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%276fc9ad2a-47ab-44db-9fa9-e37a59c44fd8%27 HTTP/1.1" 200 None
2025-12-05 12:01:04 [auto_selling_autoscout24.it] INFO: Scrape type for 6fc9ad2a-47ab-44db-9fa9-e37a59c44fd8: 1
2025-12-05 12:01:04 [auto_selling_autoscout24.it] INFO: Scraping new listing 6fc9ad2a-47ab-44db-9fa9-e37a59c44fd8
2025-12-05 12:01:04 [auto_selling_autoscout24.it] INFO: Extracting item from listing ID: 6fc9ad2a-47ab-44db-9fa9-e37a59c44fd8
2025-12-05 12:01:04 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 511ff7ff-4ce4-5448-b3a9-1bc87317bfe4 with identifier: 6fc9ad2a-47ab-44db-9fa9-e37a59c44fd8
2025-12-05 12:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 511ff7ff-4ce4-5448-b3a9-1bc87317bfe4
2025-12-05 12:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F6fc9ad2a-47ab-44db-9fa9-e37a59c44fd8_0660ad11-e8ec-4a10-b615-b1f4b7f1e63b.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/6fc9ad2a-47ab-44db-9fa9-e37a59c44fd8_0660ad11-e8ec-4a10-b615-b1f4b7f1e63b.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/cefd9030-28de-4048-b0a7-6ff06df57b05_e38c33c9-5aa9-4c1d-9aad-b88d74da797b.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/cefd9030-28de-4048-b0a7-6ff06df57b05_f10f2cea-560d-46f5-beed-b4727da5108e.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/cefd9030-28de-4048-b0a7-6ff06df57b05_834ea7b9-09e0-4ede-95a4-a70849abd40e.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F6fc9ad2a-47ab-44db-9fa9-e37a59c44fd8_16d936c7-8129-44f2-87bc-2db4a197800a.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/6fc9ad2a-47ab-44db-9fa9-e37a59c44fd8_16d936c7-8129-44f2-87bc-2db4a197800a.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5cf9a90>
2025-12-05 12:01:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 12:01:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb2ffd11-f0bb-5ec7-94e2-46f0bb1e2671/eb2ffd11-f0bb-5ec7-94e2-46f0bb1e2671_image_8.webp HTTP/1.1" 201 0
2025-12-05 12:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fcefd9030-28de-4048-b0a7-6ff06df57b05_b5c810a8-ef3e-4022-8c04-4a7b4ec8eaf7.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/cefd9030-28de-4048-b0a7-6ff06df57b05_b5c810a8-ef3e-4022-8c04-4a7b4ec8eaf7.jpg/250x188.webp saved to cache
2025-12-05 12:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item eb2ffd11-f0bb-5ec7-94e2-46f0bb1e2671
2025-12-05 12:01:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5c83590>
2025-12-05 12:01:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 12:01:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb2ffd11-f0bb-5ec7-94e2-46f0bb1e2671/eb2ffd11-f0bb-5ec7-94e2-46f0bb1e2671_image_9.webp HTTP/1.1" 201 0
2025-12-05 12:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fcefd9030-28de-4048-b0a7-6ff06df57b05_76620f11-ddef-4d70-9839-fab72800034e.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/cefd9030-28de-4048-b0a7-6ff06df57b05_76620f11-ddef-4d70-9839-fab72800034e.jpg/250x188.webp saved to cache
2025-12-05 12:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item eb2ffd11-f0bb-5ec7-94e2-46f0bb1e2671
2025-12-05 12:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F6fc9ad2a-47ab-44db-9fa9-e37a59c44fd8_ff06f22a-6645-4652-bcf3-e0f5d6ba74b1.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/6fc9ad2a-47ab-44db-9fa9-e37a59c44fd8_ff06f22a-6645-4652-bcf3-e0f5d6ba74b1.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/cefd9030-28de-4048-b0a7-6ff06df57b05_eac27b2a-5e05-4c17-bad1-4a62856dc9e5.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F6fc9ad2a-47ab-44db-9fa9-e37a59c44fd8_821fdaac-34ab-4f11-b729-2dcfd234a343.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/6fc9ad2a-47ab-44db-9fa9-e37a59c44fd8_821fdaac-34ab-4f11-b729-2dcfd234a343.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d6f11750>
2025-12-05 12:01:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 12:01:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb2ffd11-f0bb-5ec7-94e2-46f0bb1e2671/eb2ffd11-f0bb-5ec7-94e2-46f0bb1e2671_image_10.webp HTTP/1.1" 201 0
2025-12-05 12:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fcefd9030-28de-4048-b0a7-6ff06df57b05_e38c33c9-5aa9-4c1d-9aad-b88d74da797b.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/cefd9030-28de-4048-b0a7-6ff06df57b05_e38c33c9-5aa9-4c1d-9aad-b88d74da797b.jpg/250x188.webp saved to cache
2025-12-05 12:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item eb2ffd11-f0bb-5ec7-94e2-46f0bb1e2671
2025-12-05 12:01:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9dd5d20d0>
2025-12-05 12:01:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:01:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb2ffd11-f0bb-5ec7-94e2-46f0bb1e2671/eb2ffd11-f0bb-5ec7-94e2-46f0bb1e2671_image_11.webp HTTP/1.1" 201 0
2025-12-05 12:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fcefd9030-28de-4048-b0a7-6ff06df57b05_f10f2cea-560d-46f5-beed-b4727da5108e.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/cefd9030-28de-4048-b0a7-6ff06df57b05_f10f2cea-560d-46f5-beed-b4727da5108e.jpg/250x188.webp saved to cache
2025-12-05 12:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item eb2ffd11-f0bb-5ec7-94e2-46f0bb1e2671
2025-12-05 12:01:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5c68390>
2025-12-05 12:01:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:01:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb2ffd11-f0bb-5ec7-94e2-46f0bb1e2671/eb2ffd11-f0bb-5ec7-94e2-46f0bb1e2671_image_12.webp HTTP/1.1" 201 0
2025-12-05 12:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fcefd9030-28de-4048-b0a7-6ff06df57b05_834ea7b9-09e0-4ede-95a4-a70849abd40e.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/cefd9030-28de-4048-b0a7-6ff06df57b05_834ea7b9-09e0-4ede-95a4-a70849abd40e.jpg/250x188.webp saved to cache
2025-12-05 12:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item eb2ffd11-f0bb-5ec7-94e2-46f0bb1e2671
2025-12-05 12:01:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/6fc9ad2a-47ab-44db-9fa9-e37a59c44fd8_0660ad11-e8ec-4a10-b615-b1f4b7f1e63b.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F6fc9ad2a-47ab-44db-9fa9-e37a59c44fd8_ccf1f39b-6b85-4464-89ff-616f15a32ed8.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/6fc9ad2a-47ab-44db-9fa9-e37a59c44fd8_ccf1f39b-6b85-4464-89ff-616f15a32ed8.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/6fc9ad2a-47ab-44db-9fa9-e37a59c44fd8_16d936c7-8129-44f2-87bc-2db4a197800a.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F6fc9ad2a-47ab-44db-9fa9-e37a59c44fd8_9171b476-0c83-45a9-a990-021b1c00afae.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/6fc9ad2a-47ab-44db-9fa9-e37a59c44fd8_9171b476-0c83-45a9-a990-021b1c00afae.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5c78c90>
2025-12-05 12:01:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:01:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb2ffd11-f0bb-5ec7-94e2-46f0bb1e2671/eb2ffd11-f0bb-5ec7-94e2-46f0bb1e2671_image_13.webp HTTP/1.1" 201 0
2025-12-05 12:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fcefd9030-28de-4048-b0a7-6ff06df57b05_eac27b2a-5e05-4c17-bad1-4a62856dc9e5.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/cefd9030-28de-4048-b0a7-6ff06df57b05_eac27b2a-5e05-4c17-bad1-4a62856dc9e5.jpg/250x188.webp saved to cache
2025-12-05 12:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item eb2ffd11-f0bb-5ec7-94e2-46f0bb1e2671
2025-12-05 12:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Removing item eb2ffd11-f0bb-5ec7-94e2-46f0bb1e2671 from tracking dictionaries
2025-12-05 12:01:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item eb2ffd11-f0bb-5ec7-94e2-46f0bb1e2671 sending to next pipeline
2025-12-05 12:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F6fc9ad2a-47ab-44db-9fa9-e37a59c44fd8_c1c058a5-94ff-49e1-b2c8-a5214e84866d.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/6fc9ad2a-47ab-44db-9fa9-e37a59c44fd8_c1c058a5-94ff-49e1-b2c8-a5214e84866d.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:07 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: eb2ffd11-f0bb-5ec7-94e2-46f0bb1e2671 with identifier cefd9030-28de-4048-b0a7-6ff06df57b05
2025-12-05 12:01:07 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:01:07 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:01:07 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item eb2ffd11-f0bb-5ec7-94e2-46f0bb1e2671
2025-12-05 12:01:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://prod.pictures.autoscout24.net/listing-images/cefd9030-28de-4048-b0a7-6ff06df57b05_eac27b2a-5e05-4c17-bad1-4a62856dc9e5.jpg/250x188.webp>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'emission_standard': None,
 'engine': None,
 'engine_horse_power': 237,
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': 'eb2ffd11-f0bb-5ec7-94e2-46f0bb1e2671',
 'is_damaged': False,
 'is_operable': True,
 'license_plate': None,
 'link_to_web_offer': 'https://www.autoscout24.it/offers/mercedes-benz-v-300-d-pronta-consegna-long-avantgarde-8p-amg-4matic-diesel-black-cefd9030-28de-4048-b0a7-6ff06df57b05',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'V 300',
 'odometer': 40500,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb2ffd11-f0bb-5ec7-94e2-46f0bb1e2671/eb2ffd11-f0bb-5ec7-94e2-46f0bb1e2671_image_0.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5464,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/cefd9030-28de-4048-b0a7-6ff06df57b05_9f151fe3-90cb-450a-aca8-1038a4105654.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb2ffd11-f0bb-5ec7-94e2-46f0bb1e2671/eb2ffd11-f0bb-5ec7-94e2-46f0bb1e2671_image_1.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4256,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/cefd9030-28de-4048-b0a7-6ff06df57b05_bedb5366-46a6-4206-b940-ed95cd42f8cd.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb2ffd11-f0bb-5ec7-94e2-46f0bb1e2671/eb2ffd11-f0bb-5ec7-94e2-46f0bb1e2671_image_2.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5930,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/cefd9030-28de-4048-b0a7-6ff06df57b05_2fd159c1-432c-4338-96bd-d2ae35263939.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb2ffd11-f0bb-5ec7-94e2-46f0bb1e2671/eb2ffd11-f0bb-5ec7-94e2-46f0bb1e2671_image_3.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4400,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/cefd9030-28de-4048-b0a7-6ff06df57b05_6e962e70-cc1f-461e-a93c-ef8a2e782017.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb2ffd11-f0bb-5ec7-94e2-46f0bb1e2671/eb2ffd11-f0bb-5ec7-94e2-46f0bb1e2671_image_4.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3962,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/cefd9030-28de-4048-b0a7-6ff06df57b05_335db9dc-4e6e-4817-ae9e-340e60f264e3.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb2ffd11-f0bb-5ec7-94e2-46f0bb1e2671/eb2ffd11-f0bb-5ec7-94e2-46f0bb1e2671_image_5.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4396,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/cefd9030-28de-4048-b0a7-6ff06df57b05_13dfdc78-8e31-4a9d-afc0-c8feb3c66c78.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb2ffd11-f0bb-5ec7-94e2-46f0bb1e2671/eb2ffd11-f0bb-5ec7-94e2-46f0bb1e2671_image_6.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5202,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/cefd9030-28de-4048-b0a7-6ff06df57b05_8c4f76b4-a5bf-442a-8ea6-88203d7b976e.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb2ffd11-f0bb-5ec7-94e2-46f0bb1e2671/eb2ffd11-f0bb-5ec7-94e2-46f0bb1e2671_image_7.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4710,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/cefd9030-28de-4048-b0a7-6ff06df57b05_bb678e3d-afc6-430b-b48f-060b72d40712.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb2ffd11-f0bb-5ec7-94e2-46f0bb1e2671/eb2ffd11-f0bb-5ec7-94e2-46f0bb1e2671_image_8.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4810,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/cefd9030-28de-4048-b0a7-6ff06df57b05_b5c810a8-ef3e-4022-8c04-4a7b4ec8eaf7.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb2ffd11-f0bb-5ec7-94e2-46f0bb1e2671/eb2ffd11-f0bb-5ec7-94e2-46f0bb1e2671_image_9.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 6366,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/cefd9030-28de-4048-b0a7-6ff06df57b05_76620f11-ddef-4d70-9839-fab72800034e.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb2ffd11-f0bb-5ec7-94e2-46f0bb1e2671/eb2ffd11-f0bb-5ec7-94e2-46f0bb1e2671_image_10.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 7030,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/cefd9030-28de-4048-b0a7-6ff06df57b05_e38c33c9-5aa9-4c1d-9aad-b88d74da797b.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb2ffd11-f0bb-5ec7-94e2-46f0bb1e2671/eb2ffd11-f0bb-5ec7-94e2-46f0bb1e2671_image_11.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5158,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/cefd9030-28de-4048-b0a7-6ff06df57b05_f10f2cea-560d-46f5-beed-b4727da5108e.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb2ffd11-f0bb-5ec7-94e2-46f0bb1e2671/eb2ffd11-f0bb-5ec7-94e2-46f0bb1e2671_image_12.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4330,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/cefd9030-28de-4048-b0a7-6ff06df57b05_834ea7b9-09e0-4ede-95a4-a70849abd40e.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb2ffd11-f0bb-5ec7-94e2-46f0bb1e2671/eb2ffd11-f0bb-5ec7-94e2-46f0bb1e2671_image_13.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 6174,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/cefd9030-28de-4048-b0a7-6ff06df57b05_eac27b2a-5e05-4c17-bad1-4a62856dc9e5.jpg/250x188.webp',
             'Width': 250}],
 'price': 72900,
 'price_includes_vat': False,
 'registration_date': '2023-08-01',
 'seller_name': None,
 'title': 'Mercedes-Benz V 300 d *Pronta Consegna* LONG AVANTGARDE 8P AMG '
          '4MATIC',
 'transmission': 'automatic',
 'trim': 'd *Pronta Consegna* LONG AVANTGARDE 8P AMG 4MATIC',
 'vin': None,
 'year': 2023}
2025-12-05 12:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27cefd9030-28de-4048-b0a7-6ff06df57b05%27 HTTP/1.1" 200 None
2025-12-05 12:01:07 [auto_selling_autoscout24.it] INFO: Saving data for cefd9030-28de-4048-b0a7-6ff06df57b05: {'created_time': 1764936067.110541, 'last_price_update_time': 1764936067.11055}
2025-12-05 12:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autoscout24.it',RowKey='cefd9030-28de-4048-b0a7-6ff06df57b05') HTTP/1.1" 204 0
2025-12-05 12:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/6fc9ad2a-47ab-44db-9fa9-e37a59c44fd8_ff06f22a-6645-4652-bcf3-e0f5d6ba74b1.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/6fc9ad2a-47ab-44db-9fa9-e37a59c44fd8_821fdaac-34ab-4f11-b729-2dcfd234a343.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F6fc9ad2a-47ab-44db-9fa9-e37a59c44fd8_99326088-4f1b-4b06-9746-7cf46fa7366f.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/6fc9ad2a-47ab-44db-9fa9-e37a59c44fd8_99326088-4f1b-4b06-9746-7cf46fa7366f.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9dd5d9e10>
2025-12-05 12:01:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:01:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_511ff7ff-4ce4-5448-b3a9-1bc87317bfe4/511ff7ff-4ce4-5448-b3a9-1bc87317bfe4_image_0.webp HTTP/1.1" 201 0
2025-12-05 12:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F6fc9ad2a-47ab-44db-9fa9-e37a59c44fd8_0660ad11-e8ec-4a10-b615-b1f4b7f1e63b.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/6fc9ad2a-47ab-44db-9fa9-e37a59c44fd8_0660ad11-e8ec-4a10-b615-b1f4b7f1e63b.jpg/250x188.webp saved to cache
2025-12-05 12:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 511ff7ff-4ce4-5448-b3a9-1bc87317bfe4
2025-12-05 12:01:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5c80050>
2025-12-05 12:01:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 12:01:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_511ff7ff-4ce4-5448-b3a9-1bc87317bfe4/511ff7ff-4ce4-5448-b3a9-1bc87317bfe4_image_1.webp HTTP/1.1" 201 0
2025-12-05 12:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F6fc9ad2a-47ab-44db-9fa9-e37a59c44fd8_16d936c7-8129-44f2-87bc-2db4a197800a.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/6fc9ad2a-47ab-44db-9fa9-e37a59c44fd8_16d936c7-8129-44f2-87bc-2db4a197800a.jpg/250x188.webp saved to cache
2025-12-05 12:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 511ff7ff-4ce4-5448-b3a9-1bc87317bfe4
2025-12-05 12:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F6fc9ad2a-47ab-44db-9fa9-e37a59c44fd8_70c3b1cb-217a-4c9a-8008-f52136ce34cb.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/6fc9ad2a-47ab-44db-9fa9-e37a59c44fd8_70c3b1cb-217a-4c9a-8008-f52136ce34cb.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/6fc9ad2a-47ab-44db-9fa9-e37a59c44fd8_ccf1f39b-6b85-4464-89ff-616f15a32ed8.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/6fc9ad2a-47ab-44db-9fa9-e37a59c44fd8_9171b476-0c83-45a9-a990-021b1c00afae.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F6fc9ad2a-47ab-44db-9fa9-e37a59c44fd8_32666c10-ec7a-4587-8925-316920fe246d.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/6fc9ad2a-47ab-44db-9fa9-e37a59c44fd8_32666c10-ec7a-4587-8925-316920fe246d.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e7d090>
2025-12-05 12:01:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 12:01:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_511ff7ff-4ce4-5448-b3a9-1bc87317bfe4/511ff7ff-4ce4-5448-b3a9-1bc87317bfe4_image_2.webp HTTP/1.1" 201 0
2025-12-05 12:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F6fc9ad2a-47ab-44db-9fa9-e37a59c44fd8_ff06f22a-6645-4652-bcf3-e0f5d6ba74b1.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/6fc9ad2a-47ab-44db-9fa9-e37a59c44fd8_ff06f22a-6645-4652-bcf3-e0f5d6ba74b1.jpg/250x188.webp saved to cache
2025-12-05 12:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 511ff7ff-4ce4-5448-b3a9-1bc87317bfe4
2025-12-05 12:01:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9dc13e090>
2025-12-05 12:01:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 12:01:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_511ff7ff-4ce4-5448-b3a9-1bc87317bfe4/511ff7ff-4ce4-5448-b3a9-1bc87317bfe4_image_3.webp HTTP/1.1" 201 0
2025-12-05 12:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F6fc9ad2a-47ab-44db-9fa9-e37a59c44fd8_821fdaac-34ab-4f11-b729-2dcfd234a343.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/6fc9ad2a-47ab-44db-9fa9-e37a59c44fd8_821fdaac-34ab-4f11-b729-2dcfd234a343.jpg/250x188.webp saved to cache
2025-12-05 12:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 511ff7ff-4ce4-5448-b3a9-1bc87317bfe4
2025-12-05 12:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/6fc9ad2a-47ab-44db-9fa9-e37a59c44fd8_c1c058a5-94ff-49e1-b2c8-a5214e84866d.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/6fc9ad2a-47ab-44db-9fa9-e37a59c44fd8_99326088-4f1b-4b06-9746-7cf46fa7366f.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F6fc9ad2a-47ab-44db-9fa9-e37a59c44fd8_bb6a77bb-b1d9-4066-aff1-365885536734.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/6fc9ad2a-47ab-44db-9fa9-e37a59c44fd8_bb6a77bb-b1d9-4066-aff1-365885536734.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d6ff1b10>
2025-12-05 12:01:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:01:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_511ff7ff-4ce4-5448-b3a9-1bc87317bfe4/511ff7ff-4ce4-5448-b3a9-1bc87317bfe4_image_4.webp HTTP/1.1" 201 0
2025-12-05 12:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F6fc9ad2a-47ab-44db-9fa9-e37a59c44fd8_ccf1f39b-6b85-4464-89ff-616f15a32ed8.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/6fc9ad2a-47ab-44db-9fa9-e37a59c44fd8_ccf1f39b-6b85-4464-89ff-616f15a32ed8.jpg/250x188.webp saved to cache
2025-12-05 12:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 511ff7ff-4ce4-5448-b3a9-1bc87317bfe4
2025-12-05 12:01:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d6f4b890>
2025-12-05 12:01:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 12:01:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_511ff7ff-4ce4-5448-b3a9-1bc87317bfe4/511ff7ff-4ce4-5448-b3a9-1bc87317bfe4_image_5.webp HTTP/1.1" 201 0
2025-12-05 12:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F6fc9ad2a-47ab-44db-9fa9-e37a59c44fd8_9171b476-0c83-45a9-a990-021b1c00afae.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/6fc9ad2a-47ab-44db-9fa9-e37a59c44fd8_9171b476-0c83-45a9-a990-021b1c00afae.jpg/250x188.webp saved to cache
2025-12-05 12:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 511ff7ff-4ce4-5448-b3a9-1bc87317bfe4
2025-12-05 12:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F6fc9ad2a-47ab-44db-9fa9-e37a59c44fd8_d1e09f7c-509b-4633-b6ca-506ad06b59e8.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/6fc9ad2a-47ab-44db-9fa9-e37a59c44fd8_d1e09f7c-509b-4633-b6ca-506ad06b59e8.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/6fc9ad2a-47ab-44db-9fa9-e37a59c44fd8_70c3b1cb-217a-4c9a-8008-f52136ce34cb.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F6fc9ad2a-47ab-44db-9fa9-e37a59c44fd8_444a3f71-128a-45c3-ad69-738f9166d025.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/6fc9ad2a-47ab-44db-9fa9-e37a59c44fd8_444a3f71-128a-45c3-ad69-738f9166d025.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d6fc1b10>
2025-12-05 12:01:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:01:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_511ff7ff-4ce4-5448-b3a9-1bc87317bfe4/511ff7ff-4ce4-5448-b3a9-1bc87317bfe4_image_6.webp HTTP/1.1" 201 0
2025-12-05 12:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F6fc9ad2a-47ab-44db-9fa9-e37a59c44fd8_c1c058a5-94ff-49e1-b2c8-a5214e84866d.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/6fc9ad2a-47ab-44db-9fa9-e37a59c44fd8_c1c058a5-94ff-49e1-b2c8-a5214e84866d.jpg/250x188.webp saved to cache
2025-12-05 12:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 511ff7ff-4ce4-5448-b3a9-1bc87317bfe4
2025-12-05 12:01:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5b064d0>
2025-12-05 12:01:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 12:01:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_511ff7ff-4ce4-5448-b3a9-1bc87317bfe4/511ff7ff-4ce4-5448-b3a9-1bc87317bfe4_image_7.webp HTTP/1.1" 201 0
2025-12-05 12:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F6fc9ad2a-47ab-44db-9fa9-e37a59c44fd8_99326088-4f1b-4b06-9746-7cf46fa7366f.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/6fc9ad2a-47ab-44db-9fa9-e37a59c44fd8_99326088-4f1b-4b06-9746-7cf46fa7366f.jpg/250x188.webp saved to cache
2025-12-05 12:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 511ff7ff-4ce4-5448-b3a9-1bc87317bfe4
2025-12-05 12:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F6fc9ad2a-47ab-44db-9fa9-e37a59c44fd8_69eccc92-bc70-4917-a8b4-920fd952caed.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/6fc9ad2a-47ab-44db-9fa9-e37a59c44fd8_69eccc92-bc70-4917-a8b4-920fd952caed.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/6fc9ad2a-47ab-44db-9fa9-e37a59c44fd8_bb6a77bb-b1d9-4066-aff1-365885536734.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/6fc9ad2a-47ab-44db-9fa9-e37a59c44fd8_32666c10-ec7a-4587-8925-316920fe246d.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F6fc9ad2a-47ab-44db-9fa9-e37a59c44fd8_245818ce-4100-4bbe-bb39-b12ebd103b49.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/6fc9ad2a-47ab-44db-9fa9-e37a59c44fd8_245818ce-4100-4bbe-bb39-b12ebd103b49.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9dd5d75d0>
2025-12-05 12:01:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:01:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_511ff7ff-4ce4-5448-b3a9-1bc87317bfe4/511ff7ff-4ce4-5448-b3a9-1bc87317bfe4_image_8.webp HTTP/1.1" 201 0
2025-12-05 12:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F6fc9ad2a-47ab-44db-9fa9-e37a59c44fd8_70c3b1cb-217a-4c9a-8008-f52136ce34cb.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/6fc9ad2a-47ab-44db-9fa9-e37a59c44fd8_70c3b1cb-217a-4c9a-8008-f52136ce34cb.jpg/250x188.webp saved to cache
2025-12-05 12:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 511ff7ff-4ce4-5448-b3a9-1bc87317bfe4
2025-12-05 12:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%2713010b97-f838-474f-b3bf-5d9f7c8a6285%27 HTTP/1.1" 200 None
2025-12-05 12:01:09 [auto_selling_autoscout24.it] INFO: Scrape type for 13010b97-f838-474f-b3bf-5d9f7c8a6285: 1
2025-12-05 12:01:09 [auto_selling_autoscout24.it] INFO: Scraping new listing 13010b97-f838-474f-b3bf-5d9f7c8a6285
2025-12-05 12:01:09 [auto_selling_autoscout24.it] INFO: Extracting item from listing ID: 13010b97-f838-474f-b3bf-5d9f7c8a6285
2025-12-05 12:01:09 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: ec55bd4b-aa1d-55cb-b06e-db238b3549c9 with identifier: 13010b97-f838-474f-b3bf-5d9f7c8a6285
2025-12-05 12:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item ec55bd4b-aa1d-55cb-b06e-db238b3549c9
2025-12-05 12:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F13010b97-f838-474f-b3bf-5d9f7c8a6285_5a3037e9-bf0e-4dbe-9869-884472b1b12c.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/13010b97-f838-474f-b3bf-5d9f7c8a6285_5a3037e9-bf0e-4dbe-9869-884472b1b12c.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/6fc9ad2a-47ab-44db-9fa9-e37a59c44fd8_d1e09f7c-509b-4633-b6ca-506ad06b59e8.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/6fc9ad2a-47ab-44db-9fa9-e37a59c44fd8_444a3f71-128a-45c3-ad69-738f9166d025.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F13010b97-f838-474f-b3bf-5d9f7c8a6285_4b723859-fe42-451e-992a-358f714a7c34.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/13010b97-f838-474f-b3bf-5d9f7c8a6285_4b723859-fe42-451e-992a-358f714a7c34.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5ce2790>
2025-12-05 12:01:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 12:01:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_511ff7ff-4ce4-5448-b3a9-1bc87317bfe4/511ff7ff-4ce4-5448-b3a9-1bc87317bfe4_image_10.webp HTTP/1.1" 201 0
2025-12-05 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F6fc9ad2a-47ab-44db-9fa9-e37a59c44fd8_bb6a77bb-b1d9-4066-aff1-365885536734.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/6fc9ad2a-47ab-44db-9fa9-e37a59c44fd8_bb6a77bb-b1d9-4066-aff1-365885536734.jpg/250x188.webp saved to cache
2025-12-05 12:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 511ff7ff-4ce4-5448-b3a9-1bc87317bfe4
2025-12-05 12:01:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5ceef90>
2025-12-05 12:01:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:01:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_511ff7ff-4ce4-5448-b3a9-1bc87317bfe4/511ff7ff-4ce4-5448-b3a9-1bc87317bfe4_image_9.webp HTTP/1.1" 201 0
2025-12-05 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F6fc9ad2a-47ab-44db-9fa9-e37a59c44fd8_32666c10-ec7a-4587-8925-316920fe246d.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/6fc9ad2a-47ab-44db-9fa9-e37a59c44fd8_32666c10-ec7a-4587-8925-316920fe246d.jpg/250x188.webp saved to cache
2025-12-05 12:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 511ff7ff-4ce4-5448-b3a9-1bc87317bfe4
2025-12-05 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F13010b97-f838-474f-b3bf-5d9f7c8a6285_9b5decdb-35d1-4c76-89e0-188dbeeb43dc.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/13010b97-f838-474f-b3bf-5d9f7c8a6285_9b5decdb-35d1-4c76-89e0-188dbeeb43dc.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/6fc9ad2a-47ab-44db-9fa9-e37a59c44fd8_69eccc92-bc70-4917-a8b4-920fd952caed.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/6fc9ad2a-47ab-44db-9fa9-e37a59c44fd8_245818ce-4100-4bbe-bb39-b12ebd103b49.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F13010b97-f838-474f-b3bf-5d9f7c8a6285_acba76bb-f2ce-43e3-be38-5bea1c3f5cbc.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/13010b97-f838-474f-b3bf-5d9f7c8a6285_acba76bb-f2ce-43e3-be38-5bea1c3f5cbc.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5eaefd0>
2025-12-05 12:01:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 12:01:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_511ff7ff-4ce4-5448-b3a9-1bc87317bfe4/511ff7ff-4ce4-5448-b3a9-1bc87317bfe4_image_11.webp HTTP/1.1" 201 0
2025-12-05 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F6fc9ad2a-47ab-44db-9fa9-e37a59c44fd8_d1e09f7c-509b-4633-b6ca-506ad06b59e8.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/6fc9ad2a-47ab-44db-9fa9-e37a59c44fd8_d1e09f7c-509b-4633-b6ca-506ad06b59e8.jpg/250x188.webp saved to cache
2025-12-05 12:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 511ff7ff-4ce4-5448-b3a9-1bc87317bfe4
2025-12-05 12:01:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5b747d0>
2025-12-05 12:01:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:01:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_511ff7ff-4ce4-5448-b3a9-1bc87317bfe4/511ff7ff-4ce4-5448-b3a9-1bc87317bfe4_image_12.webp HTTP/1.1" 201 0
2025-12-05 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F6fc9ad2a-47ab-44db-9fa9-e37a59c44fd8_444a3f71-128a-45c3-ad69-738f9166d025.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/6fc9ad2a-47ab-44db-9fa9-e37a59c44fd8_444a3f71-128a-45c3-ad69-738f9166d025.jpg/250x188.webp saved to cache
2025-12-05 12:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 511ff7ff-4ce4-5448-b3a9-1bc87317bfe4
2025-12-05 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F13010b97-f838-474f-b3bf-5d9f7c8a6285_e182d08d-c532-4e21-8b8a-5d0714d8732b.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/13010b97-f838-474f-b3bf-5d9f7c8a6285_e182d08d-c532-4e21-8b8a-5d0714d8732b.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/13010b97-f838-474f-b3bf-5d9f7c8a6285_4b723859-fe42-451e-992a-358f714a7c34.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/13010b97-f838-474f-b3bf-5d9f7c8a6285_5a3037e9-bf0e-4dbe-9869-884472b1b12c.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F13010b97-f838-474f-b3bf-5d9f7c8a6285_4df906c0-119b-4a30-81e1-c913791cc335.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/13010b97-f838-474f-b3bf-5d9f7c8a6285_4df906c0-119b-4a30-81e1-c913791cc335.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9dd5d72d0>
2025-12-05 12:01:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:01:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_511ff7ff-4ce4-5448-b3a9-1bc87317bfe4/511ff7ff-4ce4-5448-b3a9-1bc87317bfe4_image_13.webp HTTP/1.1" 201 0
2025-12-05 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F6fc9ad2a-47ab-44db-9fa9-e37a59c44fd8_69eccc92-bc70-4917-a8b4-920fd952caed.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/6fc9ad2a-47ab-44db-9fa9-e37a59c44fd8_69eccc92-bc70-4917-a8b4-920fd952caed.jpg/250x188.webp saved to cache
2025-12-05 12:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 511ff7ff-4ce4-5448-b3a9-1bc87317bfe4
2025-12-05 12:01:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9dc1e5e50>
2025-12-05 12:01:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:01:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_511ff7ff-4ce4-5448-b3a9-1bc87317bfe4/511ff7ff-4ce4-5448-b3a9-1bc87317bfe4_image_14.webp HTTP/1.1" 201 0
2025-12-05 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F6fc9ad2a-47ab-44db-9fa9-e37a59c44fd8_245818ce-4100-4bbe-bb39-b12ebd103b49.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/6fc9ad2a-47ab-44db-9fa9-e37a59c44fd8_245818ce-4100-4bbe-bb39-b12ebd103b49.jpg/250x188.webp saved to cache
2025-12-05 12:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 511ff7ff-4ce4-5448-b3a9-1bc87317bfe4
2025-12-05 12:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 511ff7ff-4ce4-5448-b3a9-1bc87317bfe4 from tracking dictionaries
2025-12-05 12:01:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 511ff7ff-4ce4-5448-b3a9-1bc87317bfe4 sending to next pipeline
2025-12-05 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%271c0f5800-9353-48ab-9bfb-63f025b5d3e2%27 HTTP/1.1" 200 None
2025-12-05 12:01:11 [auto_selling_autoscout24.it] INFO: Scrape type for 1c0f5800-9353-48ab-9bfb-63f025b5d3e2: 1
2025-12-05 12:01:11 [auto_selling_autoscout24.it] INFO: Scraping new listing 1c0f5800-9353-48ab-9bfb-63f025b5d3e2
2025-12-05 12:01:11 [auto_selling_autoscout24.it] INFO: Extracting item from listing ID: 1c0f5800-9353-48ab-9bfb-63f025b5d3e2
2025-12-05 12:01:11 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 90690d5d-6bef-5ff5-a177-881e6548e42d with identifier: 1c0f5800-9353-48ab-9bfb-63f025b5d3e2
2025-12-05 12:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 90690d5d-6bef-5ff5-a177-881e6548e42d
2025-12-05 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F1c0f5800-9353-48ab-9bfb-63f025b5d3e2_6571f963-6984-4441-bbd1-5163683acb88.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/1c0f5800-9353-48ab-9bfb-63f025b5d3e2_6571f963-6984-4441-bbd1-5163683acb88.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:11 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 511ff7ff-4ce4-5448-b3a9-1bc87317bfe4 with identifier 6fc9ad2a-47ab-44db-9fa9-e37a59c44fd8
2025-12-05 12:01:11 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:01:11 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:01:11 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 511ff7ff-4ce4-5448-b3a9-1bc87317bfe4
2025-12-05 12:01:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://prod.pictures.autoscout24.net/listing-images/6fc9ad2a-47ab-44db-9fa9-e37a59c44fd8_245818ce-4100-4bbe-bb39-b12ebd103b49.jpg/250x188.webp>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'emission_standard': None,
 'engine': None,
 'engine_horse_power': 324,
 'expiration_date': None,
 'fuel_type': 'Electric/Gasoline',
 'id': '511ff7ff-4ce4-5448-b3a9-1bc87317bfe4',
 'is_damaged': False,
 'is_operable': True,
 'license_plate': None,
 'link_to_web_offer': 'https://www.autoscout24.it/offers/byd-seal-u-dmi-design-4wd-superdmtechnology-ecvt-324cv-promo-electric-gasoline-black-6fc9ad2a-47ab-44db-9fa9-e37a59c44fd8',
 'listing': 'auction',
 'make': 'BYD',
 'model': 'Seal U',
 'odometer': 1,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_511ff7ff-4ce4-5448-b3a9-1bc87317bfe4/511ff7ff-4ce4-5448-b3a9-1bc87317bfe4_image_0.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5408,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/6fc9ad2a-47ab-44db-9fa9-e37a59c44fd8_0660ad11-e8ec-4a10-b615-b1f4b7f1e63b.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_511ff7ff-4ce4-5448-b3a9-1bc87317bfe4/511ff7ff-4ce4-5448-b3a9-1bc87317bfe4_image_1.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 6200,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/6fc9ad2a-47ab-44db-9fa9-e37a59c44fd8_16d936c7-8129-44f2-87bc-2db4a197800a.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_511ff7ff-4ce4-5448-b3a9-1bc87317bfe4/511ff7ff-4ce4-5448-b3a9-1bc87317bfe4_image_2.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4898,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/6fc9ad2a-47ab-44db-9fa9-e37a59c44fd8_ff06f22a-6645-4652-bcf3-e0f5d6ba74b1.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_511ff7ff-4ce4-5448-b3a9-1bc87317bfe4/511ff7ff-4ce4-5448-b3a9-1bc87317bfe4_image_3.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5086,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/6fc9ad2a-47ab-44db-9fa9-e37a59c44fd8_821fdaac-34ab-4f11-b729-2dcfd234a343.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_511ff7ff-4ce4-5448-b3a9-1bc87317bfe4/511ff7ff-4ce4-5448-b3a9-1bc87317bfe4_image_4.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5150,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/6fc9ad2a-47ab-44db-9fa9-e37a59c44fd8_ccf1f39b-6b85-4464-89ff-616f15a32ed8.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_511ff7ff-4ce4-5448-b3a9-1bc87317bfe4/511ff7ff-4ce4-5448-b3a9-1bc87317bfe4_image_5.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5392,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/6fc9ad2a-47ab-44db-9fa9-e37a59c44fd8_9171b476-0c83-45a9-a990-021b1c00afae.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_511ff7ff-4ce4-5448-b3a9-1bc87317bfe4/511ff7ff-4ce4-5448-b3a9-1bc87317bfe4_image_6.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5752,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/6fc9ad2a-47ab-44db-9fa9-e37a59c44fd8_c1c058a5-94ff-49e1-b2c8-a5214e84866d.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_511ff7ff-4ce4-5448-b3a9-1bc87317bfe4/511ff7ff-4ce4-5448-b3a9-1bc87317bfe4_image_7.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 8604,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/6fc9ad2a-47ab-44db-9fa9-e37a59c44fd8_99326088-4f1b-4b06-9746-7cf46fa7366f.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_511ff7ff-4ce4-5448-b3a9-1bc87317bfe4/511ff7ff-4ce4-5448-b3a9-1bc87317bfe4_image_8.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 6050,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/6fc9ad2a-47ab-44db-9fa9-e37a59c44fd8_70c3b1cb-217a-4c9a-8008-f52136ce34cb.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_511ff7ff-4ce4-5448-b3a9-1bc87317bfe4/511ff7ff-4ce4-5448-b3a9-1bc87317bfe4_image_9.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 7638,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/6fc9ad2a-47ab-44db-9fa9-e37a59c44fd8_32666c10-ec7a-4587-8925-316920fe246d.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_511ff7ff-4ce4-5448-b3a9-1bc87317bfe4/511ff7ff-4ce4-5448-b3a9-1bc87317bfe4_image_10.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 6356,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/6fc9ad2a-47ab-44db-9fa9-e37a59c44fd8_bb6a77bb-b1d9-4066-aff1-365885536734.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_511ff7ff-4ce4-5448-b3a9-1bc87317bfe4/511ff7ff-4ce4-5448-b3a9-1bc87317bfe4_image_11.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5914,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/6fc9ad2a-47ab-44db-9fa9-e37a59c44fd8_d1e09f7c-509b-4633-b6ca-506ad06b59e8.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_511ff7ff-4ce4-5448-b3a9-1bc87317bfe4/511ff7ff-4ce4-5448-b3a9-1bc87317bfe4_image_12.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5096,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/6fc9ad2a-47ab-44db-9fa9-e37a59c44fd8_444a3f71-128a-45c3-ad69-738f9166d025.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_511ff7ff-4ce4-5448-b3a9-1bc87317bfe4/511ff7ff-4ce4-5448-b3a9-1bc87317bfe4_image_13.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 6314,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/6fc9ad2a-47ab-44db-9fa9-e37a59c44fd8_69eccc92-bc70-4917-a8b4-920fd952caed.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_511ff7ff-4ce4-5448-b3a9-1bc87317bfe4/511ff7ff-4ce4-5448-b3a9-1bc87317bfe4_image_14.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4228,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/6fc9ad2a-47ab-44db-9fa9-e37a59c44fd8_245818ce-4100-4bbe-bb39-b12ebd103b49.jpg/250x188.webp',
             'Width': 250}],
 'price': 40900,
 'price_includes_vat': False,
 'registration_date': '2025-09-01',
 'seller_name': None,
 'title': 'BYD Seal U DMi DESIGN 4WD SuperDMTechnology eCVT 324CV PROMO!',
 'transmission': 'automatic',
 'trim': 'DMi DESIGN 4WD SuperDMTechnology eCVT 324CV PROMO!',
 'vin': None,
 'year': 2025}
2025-12-05 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%276fc9ad2a-47ab-44db-9fa9-e37a59c44fd8%27 HTTP/1.1" 200 None
2025-12-05 12:01:11 [auto_selling_autoscout24.it] INFO: Saving data for 6fc9ad2a-47ab-44db-9fa9-e37a59c44fd8: {'created_time': 1764936071.689224, 'last_price_update_time': 1764936071.689232}
2025-12-05 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autoscout24.it',RowKey='6fc9ad2a-47ab-44db-9fa9-e37a59c44fd8') HTTP/1.1" 204 0
2025-12-05 12:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/13010b97-f838-474f-b3bf-5d9f7c8a6285_acba76bb-f2ce-43e3-be38-5bea1c3f5cbc.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/13010b97-f838-474f-b3bf-5d9f7c8a6285_9b5decdb-35d1-4c76-89e0-188dbeeb43dc.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F1c0f5800-9353-48ab-9bfb-63f025b5d3e2_4b0b7d3e-91b2-4a39-8f87-4988ceddf0e4.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/1c0f5800-9353-48ab-9bfb-63f025b5d3e2_4b0b7d3e-91b2-4a39-8f87-4988ceddf0e4.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9dc11e350>
2025-12-05 12:01:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec55bd4b-aa1d-55cb-b06e-db238b3549c9/ec55bd4b-aa1d-55cb-b06e-db238b3549c9_image_1.webp HTTP/1.1" 201 0
2025-12-05 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F13010b97-f838-474f-b3bf-5d9f7c8a6285_4b723859-fe42-451e-992a-358f714a7c34.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/13010b97-f838-474f-b3bf-5d9f7c8a6285_4b723859-fe42-451e-992a-358f714a7c34.jpg/250x188.webp saved to cache
2025-12-05 12:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ec55bd4b-aa1d-55cb-b06e-db238b3549c9
2025-12-05 12:01:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5b06210>
2025-12-05 12:01:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec55bd4b-aa1d-55cb-b06e-db238b3549c9/ec55bd4b-aa1d-55cb-b06e-db238b3549c9_image_0.webp HTTP/1.1" 201 0
2025-12-05 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F13010b97-f838-474f-b3bf-5d9f7c8a6285_5a3037e9-bf0e-4dbe-9869-884472b1b12c.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/13010b97-f838-474f-b3bf-5d9f7c8a6285_5a3037e9-bf0e-4dbe-9869-884472b1b12c.jpg/250x188.webp saved to cache
2025-12-05 12:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ec55bd4b-aa1d-55cb-b06e-db238b3549c9
2025-12-05 12:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/13010b97-f838-474f-b3bf-5d9f7c8a6285_e182d08d-c532-4e21-8b8a-5d0714d8732b.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F1c0f5800-9353-48ab-9bfb-63f025b5d3e2_225b95e2-1f50-46ef-b5b9-66d083730e40.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/1c0f5800-9353-48ab-9bfb-63f025b5d3e2_225b95e2-1f50-46ef-b5b9-66d083730e40.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/13010b97-f838-474f-b3bf-5d9f7c8a6285_4df906c0-119b-4a30-81e1-c913791cc335.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F1c0f5800-9353-48ab-9bfb-63f025b5d3e2_b965064c-0521-48c9-8dac-2ee9597c4259.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/1c0f5800-9353-48ab-9bfb-63f025b5d3e2_b965064c-0521-48c9-8dac-2ee9597c4259.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5b05350>
2025-12-05 12:01:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 12:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec55bd4b-aa1d-55cb-b06e-db238b3549c9/ec55bd4b-aa1d-55cb-b06e-db238b3549c9_image_3.webp HTTP/1.1" 201 0
2025-12-05 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F13010b97-f838-474f-b3bf-5d9f7c8a6285_acba76bb-f2ce-43e3-be38-5bea1c3f5cbc.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/13010b97-f838-474f-b3bf-5d9f7c8a6285_acba76bb-f2ce-43e3-be38-5bea1c3f5cbc.jpg/250x188.webp saved to cache
2025-12-05 12:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ec55bd4b-aa1d-55cb-b06e-db238b3549c9
2025-12-05 12:01:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d6fa4d10>
2025-12-05 12:01:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:01:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec55bd4b-aa1d-55cb-b06e-db238b3549c9/ec55bd4b-aa1d-55cb-b06e-db238b3549c9_image_2.webp HTTP/1.1" 201 0
2025-12-05 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F13010b97-f838-474f-b3bf-5d9f7c8a6285_9b5decdb-35d1-4c76-89e0-188dbeeb43dc.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/13010b97-f838-474f-b3bf-5d9f7c8a6285_9b5decdb-35d1-4c76-89e0-188dbeeb43dc.jpg/250x188.webp saved to cache
2025-12-05 12:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ec55bd4b-aa1d-55cb-b06e-db238b3549c9
2025-12-05 12:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/1c0f5800-9353-48ab-9bfb-63f025b5d3e2_6571f963-6984-4441-bbd1-5163683acb88.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/1c0f5800-9353-48ab-9bfb-63f025b5d3e2_4b0b7d3e-91b2-4a39-8f87-4988ceddf0e4.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F1c0f5800-9353-48ab-9bfb-63f025b5d3e2_4ddcaada-e599-47e4-abe2-36bed6d4fa39.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/1c0f5800-9353-48ab-9bfb-63f025b5d3e2_4ddcaada-e599-47e4-abe2-36bed6d4fa39.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e6fc50>
2025-12-05 12:01:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 12:01:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec55bd4b-aa1d-55cb-b06e-db238b3549c9/ec55bd4b-aa1d-55cb-b06e-db238b3549c9_image_4.webp HTTP/1.1" 201 0
2025-12-05 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F13010b97-f838-474f-b3bf-5d9f7c8a6285_e182d08d-c532-4e21-8b8a-5d0714d8732b.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/13010b97-f838-474f-b3bf-5d9f7c8a6285_e182d08d-c532-4e21-8b8a-5d0714d8732b.jpg/250x188.webp saved to cache
2025-12-05 12:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ec55bd4b-aa1d-55cb-b06e-db238b3549c9
2025-12-05 12:01:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5b1c890>
2025-12-05 12:01:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 12:01:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec55bd4b-aa1d-55cb-b06e-db238b3549c9/ec55bd4b-aa1d-55cb-b06e-db238b3549c9_image_5.webp HTTP/1.1" 201 0
2025-12-05 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F13010b97-f838-474f-b3bf-5d9f7c8a6285_4df906c0-119b-4a30-81e1-c913791cc335.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/13010b97-f838-474f-b3bf-5d9f7c8a6285_4df906c0-119b-4a30-81e1-c913791cc335.jpg/250x188.webp saved to cache
2025-12-05 12:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ec55bd4b-aa1d-55cb-b06e-db238b3549c9
2025-12-05 12:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Removing item ec55bd4b-aa1d-55cb-b06e-db238b3549c9 from tracking dictionaries
2025-12-05 12:01:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ec55bd4b-aa1d-55cb-b06e-db238b3549c9 sending to next pipeline
2025-12-05 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F1c0f5800-9353-48ab-9bfb-63f025b5d3e2_13eadad0-c3f7-440b-aafc-ff6f1ff7e533.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/1c0f5800-9353-48ab-9bfb-63f025b5d3e2_13eadad0-c3f7-440b-aafc-ff6f1ff7e533.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:13 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: ec55bd4b-aa1d-55cb-b06e-db238b3549c9 with identifier 13010b97-f838-474f-b3bf-5d9f7c8a6285
2025-12-05 12:01:13 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:01:13 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:01:13 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item ec55bd4b-aa1d-55cb-b06e-db238b3549c9
2025-12-05 12:01:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://prod.pictures.autoscout24.net/listing-images/13010b97-f838-474f-b3bf-5d9f7c8a6285_4df906c0-119b-4a30-81e1-c913791cc335.jpg/250x188.webp>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'emission_standard': None,
 'engine': None,
 'engine_horse_power': 204,
 'expiration_date': None,
 'fuel_type': 'Gasoline',
 'id': 'ec55bd4b-aa1d-55cb-b06e-db238b3549c9',
 'is_damaged': False,
 'is_operable': True,
 'license_plate': None,
 'link_to_web_offer': 'https://www.autoscout24.it/offers/audi-a5-avant-2-0-tfsi-s-tr-s-line-204cv-semestrale-promo-gasoline-black-13010b97-f838-474f-b3bf-5d9f7c8a6285',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5',
 'odometer': 6000,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec55bd4b-aa1d-55cb-b06e-db238b3549c9/ec55bd4b-aa1d-55cb-b06e-db238b3549c9_image_0.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 2298,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/13010b97-f838-474f-b3bf-5d9f7c8a6285_5a3037e9-bf0e-4dbe-9869-884472b1b12c.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec55bd4b-aa1d-55cb-b06e-db238b3549c9/ec55bd4b-aa1d-55cb-b06e-db238b3549c9_image_1.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 1818,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/13010b97-f838-474f-b3bf-5d9f7c8a6285_4b723859-fe42-451e-992a-358f714a7c34.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec55bd4b-aa1d-55cb-b06e-db238b3549c9/ec55bd4b-aa1d-55cb-b06e-db238b3549c9_image_2.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 2242,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/13010b97-f838-474f-b3bf-5d9f7c8a6285_9b5decdb-35d1-4c76-89e0-188dbeeb43dc.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec55bd4b-aa1d-55cb-b06e-db238b3549c9/ec55bd4b-aa1d-55cb-b06e-db238b3549c9_image_3.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 2152,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/13010b97-f838-474f-b3bf-5d9f7c8a6285_acba76bb-f2ce-43e3-be38-5bea1c3f5cbc.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec55bd4b-aa1d-55cb-b06e-db238b3549c9/ec55bd4b-aa1d-55cb-b06e-db238b3549c9_image_4.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 1606,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/13010b97-f838-474f-b3bf-5d9f7c8a6285_e182d08d-c532-4e21-8b8a-5d0714d8732b.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec55bd4b-aa1d-55cb-b06e-db238b3549c9/ec55bd4b-aa1d-55cb-b06e-db238b3549c9_image_5.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 2208,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/13010b97-f838-474f-b3bf-5d9f7c8a6285_4df906c0-119b-4a30-81e1-c913791cc335.jpg/250x188.webp',
             'Width': 250}],
 'price': 49800,
 'price_includes_vat': False,
 'registration_date': '2025-01-01',
 'seller_name': None,
 'title': 'Audi A5 AVANT 2.0 TFSI S-TR. S-LINE 204CV SEMESTRALE PROMO',
 'transmission': 'automatic',
 'trim': 'AVANT 2.0 TFSI S-TR. S-LINE 204CV SEMESTRALE PROMO',
 'vin': None,
 'year': 2025}
2025-12-05 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%2713010b97-f838-474f-b3bf-5d9f7c8a6285%27 HTTP/1.1" 200 None
2025-12-05 12:01:13 [auto_selling_autoscout24.it] INFO: Saving data for 13010b97-f838-474f-b3bf-5d9f7c8a6285: {'created_time': 1764936073.726077, 'last_price_update_time': 1764936073.726088}
2025-12-05 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autoscout24.it',RowKey='13010b97-f838-474f-b3bf-5d9f7c8a6285') HTTP/1.1" 204 0
2025-12-05 12:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/1c0f5800-9353-48ab-9bfb-63f025b5d3e2_225b95e2-1f50-46ef-b5b9-66d083730e40.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F1c0f5800-9353-48ab-9bfb-63f025b5d3e2_5d7daac4-7221-487b-93cc-9010ce7407ab.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/1c0f5800-9353-48ab-9bfb-63f025b5d3e2_5d7daac4-7221-487b-93cc-9010ce7407ab.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e6fbd0>
2025-12-05 12:01:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 12:01:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90690d5d-6bef-5ff5-a177-881e6548e42d/90690d5d-6bef-5ff5-a177-881e6548e42d_image_0.webp HTTP/1.1" 201 0
2025-12-05 12:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F1c0f5800-9353-48ab-9bfb-63f025b5d3e2_6571f963-6984-4441-bbd1-5163683acb88.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/1c0f5800-9353-48ab-9bfb-63f025b5d3e2_6571f963-6984-4441-bbd1-5163683acb88.jpg/250x188.webp saved to cache
2025-12-05 12:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 90690d5d-6bef-5ff5-a177-881e6548e42d
2025-12-05 12:01:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9dc13d850>
2025-12-05 12:01:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 12:01:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90690d5d-6bef-5ff5-a177-881e6548e42d/90690d5d-6bef-5ff5-a177-881e6548e42d_image_1.webp HTTP/1.1" 201 0
2025-12-05 12:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F1c0f5800-9353-48ab-9bfb-63f025b5d3e2_4b0b7d3e-91b2-4a39-8f87-4988ceddf0e4.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/1c0f5800-9353-48ab-9bfb-63f025b5d3e2_4b0b7d3e-91b2-4a39-8f87-4988ceddf0e4.jpg/250x188.webp saved to cache
2025-12-05 12:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 90690d5d-6bef-5ff5-a177-881e6548e42d
2025-12-05 12:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F1c0f5800-9353-48ab-9bfb-63f025b5d3e2_8443a868-bc6f-4f7d-a6dd-bd3e6ce54ba3.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/1c0f5800-9353-48ab-9bfb-63f025b5d3e2_8443a868-bc6f-4f7d-a6dd-bd3e6ce54ba3.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/1c0f5800-9353-48ab-9bfb-63f025b5d3e2_b965064c-0521-48c9-8dac-2ee9597c4259.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/1c0f5800-9353-48ab-9bfb-63f025b5d3e2_4ddcaada-e599-47e4-abe2-36bed6d4fa39.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F1c0f5800-9353-48ab-9bfb-63f025b5d3e2_52b4b787-e07a-4053-819d-145e079b38f4.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/1c0f5800-9353-48ab-9bfb-63f025b5d3e2_52b4b787-e07a-4053-819d-145e079b38f4.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5c9f890>
2025-12-05 12:01:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:01:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90690d5d-6bef-5ff5-a177-881e6548e42d/90690d5d-6bef-5ff5-a177-881e6548e42d_image_2.webp HTTP/1.1" 201 0
2025-12-05 12:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F1c0f5800-9353-48ab-9bfb-63f025b5d3e2_225b95e2-1f50-46ef-b5b9-66d083730e40.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/1c0f5800-9353-48ab-9bfb-63f025b5d3e2_225b95e2-1f50-46ef-b5b9-66d083730e40.jpg/250x188.webp saved to cache
2025-12-05 12:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 90690d5d-6bef-5ff5-a177-881e6548e42d
2025-12-05 12:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F1c0f5800-9353-48ab-9bfb-63f025b5d3e2_b1988721-c857-42b1-a49a-f3a786841e25.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/1c0f5800-9353-48ab-9bfb-63f025b5d3e2_b1988721-c857-42b1-a49a-f3a786841e25.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/1c0f5800-9353-48ab-9bfb-63f025b5d3e2_13eadad0-c3f7-440b-aafc-ff6f1ff7e533.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/1c0f5800-9353-48ab-9bfb-63f025b5d3e2_5d7daac4-7221-487b-93cc-9010ce7407ab.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F1c0f5800-9353-48ab-9bfb-63f025b5d3e2_112dfbaf-0e0c-4f29-8b3b-55a5cd30efa7.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/1c0f5800-9353-48ab-9bfb-63f025b5d3e2_112dfbaf-0e0c-4f29-8b3b-55a5cd30efa7.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5b95cd0>
2025-12-05 12:01:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 12:01:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90690d5d-6bef-5ff5-a177-881e6548e42d/90690d5d-6bef-5ff5-a177-881e6548e42d_image_3.webp HTTP/1.1" 201 0
2025-12-05 12:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F1c0f5800-9353-48ab-9bfb-63f025b5d3e2_b965064c-0521-48c9-8dac-2ee9597c4259.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/1c0f5800-9353-48ab-9bfb-63f025b5d3e2_b965064c-0521-48c9-8dac-2ee9597c4259.jpg/250x188.webp saved to cache
2025-12-05 12:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 90690d5d-6bef-5ff5-a177-881e6548e42d
2025-12-05 12:01:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9dc13fa90>
2025-12-05 12:01:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 12:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90690d5d-6bef-5ff5-a177-881e6548e42d/90690d5d-6bef-5ff5-a177-881e6548e42d_image_4.webp HTTP/1.1" 201 0
2025-12-05 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F1c0f5800-9353-48ab-9bfb-63f025b5d3e2_4ddcaada-e599-47e4-abe2-36bed6d4fa39.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/1c0f5800-9353-48ab-9bfb-63f025b5d3e2_4ddcaada-e599-47e4-abe2-36bed6d4fa39.jpg/250x188.webp saved to cache
2025-12-05 12:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 90690d5d-6bef-5ff5-a177-881e6548e42d
2025-12-05 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F1c0f5800-9353-48ab-9bfb-63f025b5d3e2_c7e6d512-6d8b-4e86-84ed-8aa9db28df28.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/1c0f5800-9353-48ab-9bfb-63f025b5d3e2_c7e6d512-6d8b-4e86-84ed-8aa9db28df28.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/1c0f5800-9353-48ab-9bfb-63f025b5d3e2_52b4b787-e07a-4053-819d-145e079b38f4.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/1c0f5800-9353-48ab-9bfb-63f025b5d3e2_8443a868-bc6f-4f7d-a6dd-bd3e6ce54ba3.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F1c0f5800-9353-48ab-9bfb-63f025b5d3e2_69a855e3-a278-4d13-bd67-ad584c7a0d76.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/1c0f5800-9353-48ab-9bfb-63f025b5d3e2_69a855e3-a278-4d13-bd67-ad584c7a0d76.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5cd64d0>
2025-12-05 12:01:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 12:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90690d5d-6bef-5ff5-a177-881e6548e42d/90690d5d-6bef-5ff5-a177-881e6548e42d_image_5.webp HTTP/1.1" 201 0
2025-12-05 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F1c0f5800-9353-48ab-9bfb-63f025b5d3e2_13eadad0-c3f7-440b-aafc-ff6f1ff7e533.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/1c0f5800-9353-48ab-9bfb-63f025b5d3e2_13eadad0-c3f7-440b-aafc-ff6f1ff7e533.jpg/250x188.webp saved to cache
2025-12-05 12:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 90690d5d-6bef-5ff5-a177-881e6548e42d
2025-12-05 12:01:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e3c610>
2025-12-05 12:01:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90690d5d-6bef-5ff5-a177-881e6548e42d/90690d5d-6bef-5ff5-a177-881e6548e42d_image_6.webp HTTP/1.1" 201 0
2025-12-05 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F1c0f5800-9353-48ab-9bfb-63f025b5d3e2_5d7daac4-7221-487b-93cc-9010ce7407ab.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/1c0f5800-9353-48ab-9bfb-63f025b5d3e2_5d7daac4-7221-487b-93cc-9010ce7407ab.jpg/250x188.webp saved to cache
2025-12-05 12:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 90690d5d-6bef-5ff5-a177-881e6548e42d
2025-12-05 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F1c0f5800-9353-48ab-9bfb-63f025b5d3e2_52793d34-54ad-483f-b5dd-2962c3fe5b64.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/1c0f5800-9353-48ab-9bfb-63f025b5d3e2_52793d34-54ad-483f-b5dd-2962c3fe5b64.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/1c0f5800-9353-48ab-9bfb-63f025b5d3e2_b1988721-c857-42b1-a49a-f3a786841e25.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/1c0f5800-9353-48ab-9bfb-63f025b5d3e2_112dfbaf-0e0c-4f29-8b3b-55a5cd30efa7.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F1c0f5800-9353-48ab-9bfb-63f025b5d3e2_5c0f2455-22ce-4dd9-8c8a-773fad96e7fa.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/1c0f5800-9353-48ab-9bfb-63f025b5d3e2_5c0f2455-22ce-4dd9-8c8a-773fad96e7fa.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5c78090>
2025-12-05 12:01:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 12:01:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90690d5d-6bef-5ff5-a177-881e6548e42d/90690d5d-6bef-5ff5-a177-881e6548e42d_image_8.webp HTTP/1.1" 201 0
2025-12-05 12:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F1c0f5800-9353-48ab-9bfb-63f025b5d3e2_52b4b787-e07a-4053-819d-145e079b38f4.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/1c0f5800-9353-48ab-9bfb-63f025b5d3e2_52b4b787-e07a-4053-819d-145e079b38f4.jpg/250x188.webp saved to cache
2025-12-05 12:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 90690d5d-6bef-5ff5-a177-881e6548e42d
2025-12-05 12:01:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e67b10>
2025-12-05 12:01:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:01:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90690d5d-6bef-5ff5-a177-881e6548e42d/90690d5d-6bef-5ff5-a177-881e6548e42d_image_7.webp HTTP/1.1" 201 0
2025-12-05 12:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F1c0f5800-9353-48ab-9bfb-63f025b5d3e2_8443a868-bc6f-4f7d-a6dd-bd3e6ce54ba3.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/1c0f5800-9353-48ab-9bfb-63f025b5d3e2_8443a868-bc6f-4f7d-a6dd-bd3e6ce54ba3.jpg/250x188.webp saved to cache
2025-12-05 12:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 90690d5d-6bef-5ff5-a177-881e6548e42d
2025-12-05 12:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%279b8d9acb-c1f8-4b97-9c25-00e49b9b7c92%27 HTTP/1.1" 200 None
2025-12-05 12:01:16 [auto_selling_autoscout24.it] INFO: Scrape type for 9b8d9acb-c1f8-4b97-9c25-00e49b9b7c92: 1
2025-12-05 12:01:16 [auto_selling_autoscout24.it] INFO: Scraping new listing 9b8d9acb-c1f8-4b97-9c25-00e49b9b7c92
2025-12-05 12:01:16 [auto_selling_autoscout24.it] INFO: Extracting item from listing ID: 9b8d9acb-c1f8-4b97-9c25-00e49b9b7c92
2025-12-05 12:01:16 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 4d687407-435b-5769-a9f4-dca45e6ce697 with identifier: 9b8d9acb-c1f8-4b97-9c25-00e49b9b7c92
2025-12-05 12:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 4 photos for item 4d687407-435b-5769-a9f4-dca45e6ce697
2025-12-05 12:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F9b8d9acb-c1f8-4b97-9c25-00e49b9b7c92_714ba060-6528-4187-b415-1efcee929260.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/9b8d9acb-c1f8-4b97-9c25-00e49b9b7c92_714ba060-6528-4187-b415-1efcee929260.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/1c0f5800-9353-48ab-9bfb-63f025b5d3e2_69a855e3-a278-4d13-bd67-ad584c7a0d76.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/1c0f5800-9353-48ab-9bfb-63f025b5d3e2_c7e6d512-6d8b-4e86-84ed-8aa9db28df28.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F9b8d9acb-c1f8-4b97-9c25-00e49b9b7c92_98ce678a-e66a-465a-aee6-f1e91ad24152.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/9b8d9acb-c1f8-4b97-9c25-00e49b9b7c92_98ce678a-e66a-465a-aee6-f1e91ad24152.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e41310>
2025-12-05 12:01:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 12:01:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90690d5d-6bef-5ff5-a177-881e6548e42d/90690d5d-6bef-5ff5-a177-881e6548e42d_image_9.webp HTTP/1.1" 201 0
2025-12-05 12:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F1c0f5800-9353-48ab-9bfb-63f025b5d3e2_b1988721-c857-42b1-a49a-f3a786841e25.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/1c0f5800-9353-48ab-9bfb-63f025b5d3e2_b1988721-c857-42b1-a49a-f3a786841e25.jpg/250x188.webp saved to cache
2025-12-05 12:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 90690d5d-6bef-5ff5-a177-881e6548e42d
2025-12-05 12:01:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e339d0>
2025-12-05 12:01:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 12:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90690d5d-6bef-5ff5-a177-881e6548e42d/90690d5d-6bef-5ff5-a177-881e6548e42d_image_10.webp HTTP/1.1" 201 0
2025-12-05 12:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F1c0f5800-9353-48ab-9bfb-63f025b5d3e2_112dfbaf-0e0c-4f29-8b3b-55a5cd30efa7.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/1c0f5800-9353-48ab-9bfb-63f025b5d3e2_112dfbaf-0e0c-4f29-8b3b-55a5cd30efa7.jpg/250x188.webp saved to cache
2025-12-05 12:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 90690d5d-6bef-5ff5-a177-881e6548e42d
2025-12-05 12:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F9b8d9acb-c1f8-4b97-9c25-00e49b9b7c92_07fc5390-9d82-4f77-a389-52cb4fc16fe3.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/9b8d9acb-c1f8-4b97-9c25-00e49b9b7c92_07fc5390-9d82-4f77-a389-52cb4fc16fe3.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/1c0f5800-9353-48ab-9bfb-63f025b5d3e2_52793d34-54ad-483f-b5dd-2962c3fe5b64.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/1c0f5800-9353-48ab-9bfb-63f025b5d3e2_5c0f2455-22ce-4dd9-8c8a-773fad96e7fa.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F9b8d9acb-c1f8-4b97-9c25-00e49b9b7c92_a226c3c2-4a99-4cc6-9a39-bc44c887375f.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/9b8d9acb-c1f8-4b97-9c25-00e49b9b7c92_a226c3c2-4a99-4cc6-9a39-bc44c887375f.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9dd5d8cd0>
2025-12-05 12:01:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 12:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90690d5d-6bef-5ff5-a177-881e6548e42d/90690d5d-6bef-5ff5-a177-881e6548e42d_image_12.webp HTTP/1.1" 201 0
2025-12-05 12:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F1c0f5800-9353-48ab-9bfb-63f025b5d3e2_69a855e3-a278-4d13-bd67-ad584c7a0d76.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/1c0f5800-9353-48ab-9bfb-63f025b5d3e2_69a855e3-a278-4d13-bd67-ad584c7a0d76.jpg/250x188.webp saved to cache
2025-12-05 12:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 90690d5d-6bef-5ff5-a177-881e6548e42d
2025-12-05 12:01:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9dd5d0d50>
2025-12-05 12:01:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 12:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90690d5d-6bef-5ff5-a177-881e6548e42d/90690d5d-6bef-5ff5-a177-881e6548e42d_image_11.webp HTTP/1.1" 201 0
2025-12-05 12:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F1c0f5800-9353-48ab-9bfb-63f025b5d3e2_c7e6d512-6d8b-4e86-84ed-8aa9db28df28.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/1c0f5800-9353-48ab-9bfb-63f025b5d3e2_c7e6d512-6d8b-4e86-84ed-8aa9db28df28.jpg/250x188.webp saved to cache
2025-12-05 12:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 90690d5d-6bef-5ff5-a177-881e6548e42d
2025-12-05 12:01:17 [scrapy.extensions.logstats] INFO: Crawled 6 pages (at 3 pages/min), scraped 46 items (at 6 items/min)
2025-12-05 12:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27f53587e2-cb07-4dfc-b4ec-3ab31f376df3%27 HTTP/1.1" 200 None
2025-12-05 12:01:17 [auto_selling_autoscout24.it] INFO: Scrape type for f53587e2-cb07-4dfc-b4ec-3ab31f376df3: 1
2025-12-05 12:01:17 [auto_selling_autoscout24.it] INFO: Scraping new listing f53587e2-cb07-4dfc-b4ec-3ab31f376df3
2025-12-05 12:01:17 [auto_selling_autoscout24.it] INFO: Extracting item from listing ID: f53587e2-cb07-4dfc-b4ec-3ab31f376df3
2025-12-05 12:01:17 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 6079c0d7-5761-5cf6-bdf4-9d69ac723dda with identifier: f53587e2-cb07-4dfc-b4ec-3ab31f376df3
2025-12-05 12:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 6079c0d7-5761-5cf6-bdf4-9d69ac723dda
2025-12-05 12:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Ff53587e2-cb07-4dfc-b4ec-3ab31f376df3_6828a36e-86ad-4596-9967-f82f29b4b888.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/f53587e2-cb07-4dfc-b4ec-3ab31f376df3_6828a36e-86ad-4596-9967-f82f29b4b888.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/9b8d9acb-c1f8-4b97-9c25-00e49b9b7c92_714ba060-6528-4187-b415-1efcee929260.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/9b8d9acb-c1f8-4b97-9c25-00e49b9b7c92_98ce678a-e66a-465a-aee6-f1e91ad24152.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Ff53587e2-cb07-4dfc-b4ec-3ab31f376df3_578c8a79-152c-43ba-af99-6fb8aff562a3.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/f53587e2-cb07-4dfc-b4ec-3ab31f376df3_578c8a79-152c-43ba-af99-6fb8aff562a3.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d6f11590>
2025-12-05 12:01:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 12:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90690d5d-6bef-5ff5-a177-881e6548e42d/90690d5d-6bef-5ff5-a177-881e6548e42d_image_13.webp HTTP/1.1" 201 0
2025-12-05 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F1c0f5800-9353-48ab-9bfb-63f025b5d3e2_52793d34-54ad-483f-b5dd-2962c3fe5b64.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/1c0f5800-9353-48ab-9bfb-63f025b5d3e2_52793d34-54ad-483f-b5dd-2962c3fe5b64.jpg/250x188.webp saved to cache
2025-12-05 12:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 90690d5d-6bef-5ff5-a177-881e6548e42d
2025-12-05 12:01:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5cf8ed0>
2025-12-05 12:01:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 12:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:18 [urllib3.connectionpool] DEBUG: Resetting dropped connection: alxproduction.blob.core.windows.net
2025-12-05 12:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90690d5d-6bef-5ff5-a177-881e6548e42d/90690d5d-6bef-5ff5-a177-881e6548e42d_image_14.webp HTTP/1.1" 201 0
2025-12-05 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F1c0f5800-9353-48ab-9bfb-63f025b5d3e2_5c0f2455-22ce-4dd9-8c8a-773fad96e7fa.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/1c0f5800-9353-48ab-9bfb-63f025b5d3e2_5c0f2455-22ce-4dd9-8c8a-773fad96e7fa.jpg/250x188.webp saved to cache
2025-12-05 12:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 90690d5d-6bef-5ff5-a177-881e6548e42d
2025-12-05 12:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 90690d5d-6bef-5ff5-a177-881e6548e42d from tracking dictionaries
2025-12-05 12:01:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 90690d5d-6bef-5ff5-a177-881e6548e42d sending to next pipeline
2025-12-05 12:01:18 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 90690d5d-6bef-5ff5-a177-881e6548e42d with identifier 1c0f5800-9353-48ab-9bfb-63f025b5d3e2
2025-12-05 12:01:18 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:01:18 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:01:18 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 90690d5d-6bef-5ff5-a177-881e6548e42d
2025-12-05 12:01:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://prod.pictures.autoscout24.net/listing-images/1c0f5800-9353-48ab-9bfb-63f025b5d3e2_5c0f2455-22ce-4dd9-8c8a-773fad96e7fa.jpg/250x188.webp>
{'auction_title': '',
 'c_o_2_emission_value': 89,
 'category': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'emission_standard': None,
 'engine': None,
 'engine_horse_power': 69,
 'expiration_date': None,
 'fuel_type': 'Electric/Gasoline',
 'id': '90690d5d-6bef-5ff5-a177-881e6548e42d',
 'is_damaged': False,
 'is_operable': True,
 'license_plate': None,
 'link_to_web_offer': 'https://www.autoscout24.it/offers/fiat-panda-cross-1-0-gse-firefly-hybrid-70cv-5posti-promo-electric-gasoline-black-1c0f5800-9353-48ab-9bfb-63f025b5d3e2',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 16900,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90690d5d-6bef-5ff5-a177-881e6548e42d/90690d5d-6bef-5ff5-a177-881e6548e42d_image_0.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3892,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/1c0f5800-9353-48ab-9bfb-63f025b5d3e2_6571f963-6984-4441-bbd1-5163683acb88.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90690d5d-6bef-5ff5-a177-881e6548e42d/90690d5d-6bef-5ff5-a177-881e6548e42d_image_1.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3846,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/1c0f5800-9353-48ab-9bfb-63f025b5d3e2_4b0b7d3e-91b2-4a39-8f87-4988ceddf0e4.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90690d5d-6bef-5ff5-a177-881e6548e42d/90690d5d-6bef-5ff5-a177-881e6548e42d_image_2.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4064,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/1c0f5800-9353-48ab-9bfb-63f025b5d3e2_225b95e2-1f50-46ef-b5b9-66d083730e40.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90690d5d-6bef-5ff5-a177-881e6548e42d/90690d5d-6bef-5ff5-a177-881e6548e42d_image_3.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3972,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/1c0f5800-9353-48ab-9bfb-63f025b5d3e2_b965064c-0521-48c9-8dac-2ee9597c4259.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90690d5d-6bef-5ff5-a177-881e6548e42d/90690d5d-6bef-5ff5-a177-881e6548e42d_image_4.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3956,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/1c0f5800-9353-48ab-9bfb-63f025b5d3e2_4ddcaada-e599-47e4-abe2-36bed6d4fa39.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90690d5d-6bef-5ff5-a177-881e6548e42d/90690d5d-6bef-5ff5-a177-881e6548e42d_image_5.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3976,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/1c0f5800-9353-48ab-9bfb-63f025b5d3e2_13eadad0-c3f7-440b-aafc-ff6f1ff7e533.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90690d5d-6bef-5ff5-a177-881e6548e42d/90690d5d-6bef-5ff5-a177-881e6548e42d_image_6.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5342,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/1c0f5800-9353-48ab-9bfb-63f025b5d3e2_5d7daac4-7221-487b-93cc-9010ce7407ab.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90690d5d-6bef-5ff5-a177-881e6548e42d/90690d5d-6bef-5ff5-a177-881e6548e42d_image_7.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5666,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/1c0f5800-9353-48ab-9bfb-63f025b5d3e2_8443a868-bc6f-4f7d-a6dd-bd3e6ce54ba3.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90690d5d-6bef-5ff5-a177-881e6548e42d/90690d5d-6bef-5ff5-a177-881e6548e42d_image_8.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5042,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/1c0f5800-9353-48ab-9bfb-63f025b5d3e2_52b4b787-e07a-4053-819d-145e079b38f4.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90690d5d-6bef-5ff5-a177-881e6548e42d/90690d5d-6bef-5ff5-a177-881e6548e42d_image_9.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5082,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/1c0f5800-9353-48ab-9bfb-63f025b5d3e2_b1988721-c857-42b1-a49a-f3a786841e25.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90690d5d-6bef-5ff5-a177-881e6548e42d/90690d5d-6bef-5ff5-a177-881e6548e42d_image_10.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5764,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/1c0f5800-9353-48ab-9bfb-63f025b5d3e2_112dfbaf-0e0c-4f29-8b3b-55a5cd30efa7.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90690d5d-6bef-5ff5-a177-881e6548e42d/90690d5d-6bef-5ff5-a177-881e6548e42d_image_11.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4006,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/1c0f5800-9353-48ab-9bfb-63f025b5d3e2_c7e6d512-6d8b-4e86-84ed-8aa9db28df28.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90690d5d-6bef-5ff5-a177-881e6548e42d/90690d5d-6bef-5ff5-a177-881e6548e42d_image_12.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5676,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/1c0f5800-9353-48ab-9bfb-63f025b5d3e2_69a855e3-a278-4d13-bd67-ad584c7a0d76.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90690d5d-6bef-5ff5-a177-881e6548e42d/90690d5d-6bef-5ff5-a177-881e6548e42d_image_13.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4936,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/1c0f5800-9353-48ab-9bfb-63f025b5d3e2_52793d34-54ad-483f-b5dd-2962c3fe5b64.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90690d5d-6bef-5ff5-a177-881e6548e42d/90690d5d-6bef-5ff5-a177-881e6548e42d_image_14.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4372,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/1c0f5800-9353-48ab-9bfb-63f025b5d3e2_5c0f2455-22ce-4dd9-8c8a-773fad96e7fa.jpg/250x188.webp',
             'Width': 250}],
 'price': 12500,
 'price_includes_vat': False,
 'registration_date': '2023-03-01',
 'seller_name': None,
 'title': 'Fiat Panda CROSS 1.0 GSE FIREFLY HYBRID 70CV 5POSTI PROMO!',
 'transmission': 'automatic',
 'trim': 'CROSS 1.0 GSE FIREFLY HYBRID 70CV 5POSTI PROMO!',
 'vin': None,
 'year': 2023}
2025-12-05 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%271c0f5800-9353-48ab-9bfb-63f025b5d3e2%27 HTTP/1.1" 200 None
2025-12-05 12:01:18 [auto_selling_autoscout24.it] INFO: Saving data for 1c0f5800-9353-48ab-9bfb-63f025b5d3e2: {'created_time': 1764936078.50182, 'last_price_update_time': 1764936078.50183}
2025-12-05 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autoscout24.it',RowKey='1c0f5800-9353-48ab-9bfb-63f025b5d3e2') HTTP/1.1" 204 0
2025-12-05 12:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/9b8d9acb-c1f8-4b97-9c25-00e49b9b7c92_a226c3c2-4a99-4cc6-9a39-bc44c887375f.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/9b8d9acb-c1f8-4b97-9c25-00e49b9b7c92_07fc5390-9d82-4f77-a389-52cb4fc16fe3.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Ff53587e2-cb07-4dfc-b4ec-3ab31f376df3_ce522ff5-d0b4-4a7d-afa1-6ca9487b96f2.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/f53587e2-cb07-4dfc-b4ec-3ab31f376df3_ce522ff5-d0b4-4a7d-afa1-6ca9487b96f2.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5cc2e90>
2025-12-05 12:01:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 12:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d687407-435b-5769-a9f4-dca45e6ce697/4d687407-435b-5769-a9f4-dca45e6ce697_image_0.webp HTTP/1.1" 201 0
2025-12-05 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F9b8d9acb-c1f8-4b97-9c25-00e49b9b7c92_714ba060-6528-4187-b415-1efcee929260.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/9b8d9acb-c1f8-4b97-9c25-00e49b9b7c92_714ba060-6528-4187-b415-1efcee929260.jpg/250x188.webp saved to cache
2025-12-05 12:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4d687407-435b-5769-a9f4-dca45e6ce697
2025-12-05 12:01:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9de91d150>
2025-12-05 12:01:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 12:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d687407-435b-5769-a9f4-dca45e6ce697/4d687407-435b-5769-a9f4-dca45e6ce697_image_1.webp HTTP/1.1" 201 0
2025-12-05 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F9b8d9acb-c1f8-4b97-9c25-00e49b9b7c92_98ce678a-e66a-465a-aee6-f1e91ad24152.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/9b8d9acb-c1f8-4b97-9c25-00e49b9b7c92_98ce678a-e66a-465a-aee6-f1e91ad24152.jpg/250x188.webp saved to cache
2025-12-05 12:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4d687407-435b-5769-a9f4-dca45e6ce697
2025-12-05 12:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/f53587e2-cb07-4dfc-b4ec-3ab31f376df3_6828a36e-86ad-4596-9967-f82f29b4b888.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Ff53587e2-cb07-4dfc-b4ec-3ab31f376df3_b0d50121-7152-403a-9b6a-a220555d6843.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/f53587e2-cb07-4dfc-b4ec-3ab31f376df3_b0d50121-7152-403a-9b6a-a220555d6843.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Ff53587e2-cb07-4dfc-b4ec-3ab31f376df3_4eb5f3d6-cb5f-4dbc-b553-7ec2f15a3025.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/f53587e2-cb07-4dfc-b4ec-3ab31f376df3_4eb5f3d6-cb5f-4dbc-b553-7ec2f15a3025.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9dd5d0cd0>
2025-12-05 12:01:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 12:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d687407-435b-5769-a9f4-dca45e6ce697/4d687407-435b-5769-a9f4-dca45e6ce697_image_3.webp HTTP/1.1" 201 0
2025-12-05 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F9b8d9acb-c1f8-4b97-9c25-00e49b9b7c92_a226c3c2-4a99-4cc6-9a39-bc44c887375f.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/9b8d9acb-c1f8-4b97-9c25-00e49b9b7c92_a226c3c2-4a99-4cc6-9a39-bc44c887375f.jpg/250x188.webp saved to cache
2025-12-05 12:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4d687407-435b-5769-a9f4-dca45e6ce697
2025-12-05 12:01:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e04b90>
2025-12-05 12:01:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d687407-435b-5769-a9f4-dca45e6ce697/4d687407-435b-5769-a9f4-dca45e6ce697_image_2.webp HTTP/1.1" 201 0
2025-12-05 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F9b8d9acb-c1f8-4b97-9c25-00e49b9b7c92_07fc5390-9d82-4f77-a389-52cb4fc16fe3.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/9b8d9acb-c1f8-4b97-9c25-00e49b9b7c92_07fc5390-9d82-4f77-a389-52cb4fc16fe3.jpg/250x188.webp saved to cache
2025-12-05 12:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4d687407-435b-5769-a9f4-dca45e6ce697
2025-12-05 12:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 4d687407-435b-5769-a9f4-dca45e6ce697 from tracking dictionaries
2025-12-05 12:01:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4d687407-435b-5769-a9f4-dca45e6ce697 sending to next pipeline
2025-12-05 12:01:19 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 4d687407-435b-5769-a9f4-dca45e6ce697 with identifier 9b8d9acb-c1f8-4b97-9c25-00e49b9b7c92
2025-12-05 12:01:19 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:01:19 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:01:19 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 4d687407-435b-5769-a9f4-dca45e6ce697
2025-12-05 12:01:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://prod.pictures.autoscout24.net/listing-images/9b8d9acb-c1f8-4b97-9c25-00e49b9b7c92_07fc5390-9d82-4f77-a389-52cb4fc16fe3.jpg/250x188.webp>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'emission_standard': None,
 'engine': None,
 'engine_horse_power': 114,
 'expiration_date': None,
 'fuel_type': 'Gasoline',
 'id': '4d687407-435b-5769-a9f4-dca45e6ce697',
 'is_damaged': False,
 'is_operable': True,
 'license_plate': None,
 'link_to_web_offer': 'https://www.autoscout24.it/offers/nissan-juke-n-connecta-1-0-dig-t-114cv-nuovo-modello-onlypromo-gasoline-white-9b8d9acb-c1f8-4b97-9c25-00e49b9b7c92',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Juke',
 'odometer': 16900,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 4,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d687407-435b-5769-a9f4-dca45e6ce697/4d687407-435b-5769-a9f4-dca45e6ce697_image_0.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3094,
             'Height': 151,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/9b8d9acb-c1f8-4b97-9c25-00e49b9b7c92_714ba060-6528-4187-b415-1efcee929260.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d687407-435b-5769-a9f4-dca45e6ce697/4d687407-435b-5769-a9f4-dca45e6ce697_image_1.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 2710,
             'Height': 144,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/9b8d9acb-c1f8-4b97-9c25-00e49b9b7c92_98ce678a-e66a-465a-aee6-f1e91ad24152.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d687407-435b-5769-a9f4-dca45e6ce697/4d687407-435b-5769-a9f4-dca45e6ce697_image_2.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 2856,
             'Height': 149,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/9b8d9acb-c1f8-4b97-9c25-00e49b9b7c92_07fc5390-9d82-4f77-a389-52cb4fc16fe3.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d687407-435b-5769-a9f4-dca45e6ce697/4d687407-435b-5769-a9f4-dca45e6ce697_image_3.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3798,
             'Height': 139,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/9b8d9acb-c1f8-4b97-9c25-00e49b9b7c92_a226c3c2-4a99-4cc6-9a39-bc44c887375f.jpg/250x188.webp',
             'Width': 250}],
 'price': 20500,
 'price_includes_vat': False,
 'registration_date': '2025-01-01',
 'seller_name': None,
 'title': 'Nissan Juke N-Connecta 1.0 Dig-T 114CV Nuovo Modello ONLYPROMO',
 'transmission': 'automatic',
 'trim': 'N-Connecta 1.0 Dig-T 114CV Nuovo Modello ONLYPROMO',
 'vin': None,
 'year': 2025}
2025-12-05 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%279b8d9acb-c1f8-4b97-9c25-00e49b9b7c92%27 HTTP/1.1" 200 None
2025-12-05 12:01:19 [auto_selling_autoscout24.it] INFO: Saving data for 9b8d9acb-c1f8-4b97-9c25-00e49b9b7c92: {'created_time': 1764936079.675197, 'last_price_update_time': 1764936079.675207}
2025-12-05 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autoscout24.it',RowKey='9b8d9acb-c1f8-4b97-9c25-00e49b9b7c92') HTTP/1.1" 204 0
2025-12-05 12:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/f53587e2-cb07-4dfc-b4ec-3ab31f376df3_ce522ff5-d0b4-4a7d-afa1-6ca9487b96f2.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/f53587e2-cb07-4dfc-b4ec-3ab31f376df3_578c8a79-152c-43ba-af99-6fb8aff562a3.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27f139cb94-dcf6-4ebc-93e7-63af60f7f414%27 HTTP/1.1" 200 None
2025-12-05 12:01:19 [auto_selling_autoscout24.it] INFO: Scrape type for f139cb94-dcf6-4ebc-93e7-63af60f7f414: 1
2025-12-05 12:01:19 [auto_selling_autoscout24.it] INFO: Scraping new listing f139cb94-dcf6-4ebc-93e7-63af60f7f414
2025-12-05 12:01:19 [auto_selling_autoscout24.it] INFO: Extracting item from listing ID: f139cb94-dcf6-4ebc-93e7-63af60f7f414
2025-12-05 12:01:19 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: e9343fe5-dfa0-5ed7-a692-2c5262692eab with identifier: f139cb94-dcf6-4ebc-93e7-63af60f7f414
2025-12-05 12:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 14 photos for item e9343fe5-dfa0-5ed7-a692-2c5262692eab
2025-12-05 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Ff139cb94-dcf6-4ebc-93e7-63af60f7f414_0cd561ed-f978-4cba-9f9a-b2bdfabb9e61.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/f139cb94-dcf6-4ebc-93e7-63af60f7f414_0cd561ed-f978-4cba-9f9a-b2bdfabb9e61.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5c56f90>
2025-12-05 12:01:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 12:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6079c0d7-5761-5cf6-bdf4-9d69ac723dda/6079c0d7-5761-5cf6-bdf4-9d69ac723dda_image_0.webp HTTP/1.1" 201 0
2025-12-05 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Ff53587e2-cb07-4dfc-b4ec-3ab31f376df3_6828a36e-86ad-4596-9967-f82f29b4b888.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/f53587e2-cb07-4dfc-b4ec-3ab31f376df3_6828a36e-86ad-4596-9967-f82f29b4b888.jpg/250x188.webp saved to cache
2025-12-05 12:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6079c0d7-5761-5cf6-bdf4-9d69ac723dda
2025-12-05 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Ff139cb94-dcf6-4ebc-93e7-63af60f7f414_519fd5b4-6c0c-41d2-894f-4b9211b7a23c.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/f139cb94-dcf6-4ebc-93e7-63af60f7f414_519fd5b4-6c0c-41d2-894f-4b9211b7a23c.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/f53587e2-cb07-4dfc-b4ec-3ab31f376df3_b0d50121-7152-403a-9b6a-a220555d6843.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Ff139cb94-dcf6-4ebc-93e7-63af60f7f414_644b4dea-1bc3-47d9-8e4c-752712c6d033.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/f139cb94-dcf6-4ebc-93e7-63af60f7f414_644b4dea-1bc3-47d9-8e4c-752712c6d033.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9dd5fef50>
2025-12-05 12:01:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6079c0d7-5761-5cf6-bdf4-9d69ac723dda/6079c0d7-5761-5cf6-bdf4-9d69ac723dda_image_2.webp HTTP/1.1" 201 0
2025-12-05 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Ff53587e2-cb07-4dfc-b4ec-3ab31f376df3_ce522ff5-d0b4-4a7d-afa1-6ca9487b96f2.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/f53587e2-cb07-4dfc-b4ec-3ab31f376df3_ce522ff5-d0b4-4a7d-afa1-6ca9487b96f2.jpg/250x188.webp saved to cache
2025-12-05 12:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6079c0d7-5761-5cf6-bdf4-9d69ac723dda
2025-12-05 12:01:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d6f0bc90>
2025-12-05 12:01:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6079c0d7-5761-5cf6-bdf4-9d69ac723dda/6079c0d7-5761-5cf6-bdf4-9d69ac723dda_image_1.webp HTTP/1.1" 201 0
2025-12-05 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Ff53587e2-cb07-4dfc-b4ec-3ab31f376df3_578c8a79-152c-43ba-af99-6fb8aff562a3.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/f53587e2-cb07-4dfc-b4ec-3ab31f376df3_578c8a79-152c-43ba-af99-6fb8aff562a3.jpg/250x188.webp saved to cache
2025-12-05 12:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6079c0d7-5761-5cf6-bdf4-9d69ac723dda
2025-12-05 12:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/f139cb94-dcf6-4ebc-93e7-63af60f7f414_0cd561ed-f978-4cba-9f9a-b2bdfabb9e61.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/f53587e2-cb07-4dfc-b4ec-3ab31f376df3_4eb5f3d6-cb5f-4dbc-b553-7ec2f15a3025.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Ff139cb94-dcf6-4ebc-93e7-63af60f7f414_8d6be9f8-beb9-499e-920c-941c625ce691.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/f139cb94-dcf6-4ebc-93e7-63af60f7f414_8d6be9f8-beb9-499e-920c-941c625ce691.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d6fa4350>
2025-12-05 12:01:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 12:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6079c0d7-5761-5cf6-bdf4-9d69ac723dda/6079c0d7-5761-5cf6-bdf4-9d69ac723dda_image_3.webp HTTP/1.1" 201 0
2025-12-05 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Ff53587e2-cb07-4dfc-b4ec-3ab31f376df3_b0d50121-7152-403a-9b6a-a220555d6843.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/f53587e2-cb07-4dfc-b4ec-3ab31f376df3_b0d50121-7152-403a-9b6a-a220555d6843.jpg/250x188.webp saved to cache
2025-12-05 12:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6079c0d7-5761-5cf6-bdf4-9d69ac723dda
2025-12-05 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Ff139cb94-dcf6-4ebc-93e7-63af60f7f414_2291a92c-f006-4d92-9339-c5e6785de0fe.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/f139cb94-dcf6-4ebc-93e7-63af60f7f414_2291a92c-f006-4d92-9339-c5e6785de0fe.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/f139cb94-dcf6-4ebc-93e7-63af60f7f414_519fd5b4-6c0c-41d2-894f-4b9211b7a23c.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Ff139cb94-dcf6-4ebc-93e7-63af60f7f414_f329b99d-fa6f-4065-b280-3a05d18b535e.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/f139cb94-dcf6-4ebc-93e7-63af60f7f414_f329b99d-fa6f-4065-b280-3a05d18b535e.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e30110>
2025-12-05 12:01:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 12:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9343fe5-dfa0-5ed7-a692-2c5262692eab/e9343fe5-dfa0-5ed7-a692-2c5262692eab_image_0.webp HTTP/1.1" 201 0
2025-12-05 12:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Ff139cb94-dcf6-4ebc-93e7-63af60f7f414_0cd561ed-f978-4cba-9f9a-b2bdfabb9e61.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/f139cb94-dcf6-4ebc-93e7-63af60f7f414_0cd561ed-f978-4cba-9f9a-b2bdfabb9e61.jpg/250x188.webp saved to cache
2025-12-05 12:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e9343fe5-dfa0-5ed7-a692-2c5262692eab
2025-12-05 12:01:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9dc11dc10>
2025-12-05 12:01:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 12:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6079c0d7-5761-5cf6-bdf4-9d69ac723dda/6079c0d7-5761-5cf6-bdf4-9d69ac723dda_image_4.webp HTTP/1.1" 201 0
2025-12-05 12:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Ff53587e2-cb07-4dfc-b4ec-3ab31f376df3_4eb5f3d6-cb5f-4dbc-b553-7ec2f15a3025.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/f53587e2-cb07-4dfc-b4ec-3ab31f376df3_4eb5f3d6-cb5f-4dbc-b553-7ec2f15a3025.jpg/250x188.webp saved to cache
2025-12-05 12:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6079c0d7-5761-5cf6-bdf4-9d69ac723dda
2025-12-05 12:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 6079c0d7-5761-5cf6-bdf4-9d69ac723dda from tracking dictionaries
2025-12-05 12:01:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6079c0d7-5761-5cf6-bdf4-9d69ac723dda sending to next pipeline
2025-12-05 12:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Ff139cb94-dcf6-4ebc-93e7-63af60f7f414_08607453-ff9b-4305-af7e-8e57cd8b4fa2.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/f139cb94-dcf6-4ebc-93e7-63af60f7f414_08607453-ff9b-4305-af7e-8e57cd8b4fa2.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:21 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 6079c0d7-5761-5cf6-bdf4-9d69ac723dda with identifier f53587e2-cb07-4dfc-b4ec-3ab31f376df3
2025-12-05 12:01:21 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:01:21 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:01:21 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 6079c0d7-5761-5cf6-bdf4-9d69ac723dda
2025-12-05 12:01:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://prod.pictures.autoscout24.net/listing-images/f53587e2-cb07-4dfc-b4ec-3ab31f376df3_4eb5f3d6-cb5f-4dbc-b553-7ec2f15a3025.jpg/250x188.webp>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'emission_standard': None,
 'engine': None,
 'engine_horse_power': 150,
 'expiration_date': None,
 'fuel_type': 'Gasoline',
 'id': '6079c0d7-5761-5cf6-bdf4-9d69ac723dda',
 'is_damaged': False,
 'is_operable': True,
 'license_plate': None,
 'link_to_web_offer': 'https://www.autoscout24.it/offers/audi-a1-spb-35-tfsi-150-cv-s-tronic-retrocam-led-promo-gasoline-blue-f53587e2-cb07-4dfc-b4ec-3ab31f376df3',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1',
 'odometer': 19900,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6079c0d7-5761-5cf6-bdf4-9d69ac723dda/6079c0d7-5761-5cf6-bdf4-9d69ac723dda_image_0.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3760,
             'Height': 154,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/f53587e2-cb07-4dfc-b4ec-3ab31f376df3_6828a36e-86ad-4596-9967-f82f29b4b888.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6079c0d7-5761-5cf6-bdf4-9d69ac723dda/6079c0d7-5761-5cf6-bdf4-9d69ac723dda_image_1.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 2664,
             'Height': 125,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/f53587e2-cb07-4dfc-b4ec-3ab31f376df3_578c8a79-152c-43ba-af99-6fb8aff562a3.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6079c0d7-5761-5cf6-bdf4-9d69ac723dda/6079c0d7-5761-5cf6-bdf4-9d69ac723dda_image_2.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3262,
             'Height': 150,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/f53587e2-cb07-4dfc-b4ec-3ab31f376df3_ce522ff5-d0b4-4a7d-afa1-6ca9487b96f2.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6079c0d7-5761-5cf6-bdf4-9d69ac723dda/6079c0d7-5761-5cf6-bdf4-9d69ac723dda_image_3.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 2840,
             'Height': 140,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/f53587e2-cb07-4dfc-b4ec-3ab31f376df3_b0d50121-7152-403a-9b6a-a220555d6843.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6079c0d7-5761-5cf6-bdf4-9d69ac723dda/6079c0d7-5761-5cf6-bdf4-9d69ac723dda_image_4.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3044,
             'Height': 144,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/f53587e2-cb07-4dfc-b4ec-3ab31f376df3_4eb5f3d6-cb5f-4dbc-b553-7ec2f15a3025.jpg/250x188.webp',
             'Width': 250}],
 'price': 27900,
 'price_includes_vat': False,
 'registration_date': '2024-11-01',
 'seller_name': None,
 'title': 'Audi A1 SPB 35 TFSI 150 CV S-TRONIC *RETROCAM+LED* PROMO!',
 'transmission': 'automatic',
 'trim': 'SPB 35 TFSI 150 CV S-TRONIC *RETROCAM+LED* PROMO!',
 'vin': None,
 'year': 2024}
2025-12-05 12:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27f53587e2-cb07-4dfc-b4ec-3ab31f376df3%27 HTTP/1.1" 200 None
2025-12-05 12:01:21 [auto_selling_autoscout24.it] INFO: Saving data for f53587e2-cb07-4dfc-b4ec-3ab31f376df3: {'created_time': 1764936081.515409, 'last_price_update_time': 1764936081.515417}
2025-12-05 12:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autoscout24.it',RowKey='f53587e2-cb07-4dfc-b4ec-3ab31f376df3') HTTP/1.1" 204 0
2025-12-05 12:01:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/f139cb94-dcf6-4ebc-93e7-63af60f7f414_8d6be9f8-beb9-499e-920c-941c625ce691.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/f139cb94-dcf6-4ebc-93e7-63af60f7f414_644b4dea-1bc3-47d9-8e4c-752712c6d033.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Ff139cb94-dcf6-4ebc-93e7-63af60f7f414_18cf6a4c-59b4-4e2c-9c4a-df4e5a60f9f8.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/f139cb94-dcf6-4ebc-93e7-63af60f7f414_18cf6a4c-59b4-4e2c-9c4a-df4e5a60f9f8.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5c93690>
2025-12-05 12:01:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 12:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9343fe5-dfa0-5ed7-a692-2c5262692eab/e9343fe5-dfa0-5ed7-a692-2c5262692eab_image_1.webp HTTP/1.1" 201 0
2025-12-05 12:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Ff139cb94-dcf6-4ebc-93e7-63af60f7f414_519fd5b4-6c0c-41d2-894f-4b9211b7a23c.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/f139cb94-dcf6-4ebc-93e7-63af60f7f414_519fd5b4-6c0c-41d2-894f-4b9211b7a23c.jpg/250x188.webp saved to cache
2025-12-05 12:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e9343fe5-dfa0-5ed7-a692-2c5262692eab
2025-12-05 12:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Ff139cb94-dcf6-4ebc-93e7-63af60f7f414_db6ccfca-ac4a-4f94-9fd0-0b79d4542f83.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/f139cb94-dcf6-4ebc-93e7-63af60f7f414_db6ccfca-ac4a-4f94-9fd0-0b79d4542f83.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/f139cb94-dcf6-4ebc-93e7-63af60f7f414_2291a92c-f006-4d92-9339-c5e6785de0fe.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/f139cb94-dcf6-4ebc-93e7-63af60f7f414_f329b99d-fa6f-4065-b280-3a05d18b535e.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Ff139cb94-dcf6-4ebc-93e7-63af60f7f414_0582e3e4-9253-4d57-95d0-cb8e3c9ba89b.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/f139cb94-dcf6-4ebc-93e7-63af60f7f414_0582e3e4-9253-4d57-95d0-cb8e3c9ba89b.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e99f90>
2025-12-05 12:01:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 12:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9343fe5-dfa0-5ed7-a692-2c5262692eab/e9343fe5-dfa0-5ed7-a692-2c5262692eab_image_3.webp HTTP/1.1" 201 0
2025-12-05 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Ff139cb94-dcf6-4ebc-93e7-63af60f7f414_8d6be9f8-beb9-499e-920c-941c625ce691.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/f139cb94-dcf6-4ebc-93e7-63af60f7f414_8d6be9f8-beb9-499e-920c-941c625ce691.jpg/250x188.webp saved to cache
2025-12-05 12:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e9343fe5-dfa0-5ed7-a692-2c5262692eab
2025-12-05 12:01:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5b1d150>
2025-12-05 12:01:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 12:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9343fe5-dfa0-5ed7-a692-2c5262692eab/e9343fe5-dfa0-5ed7-a692-2c5262692eab_image_2.webp HTTP/1.1" 201 0
2025-12-05 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Ff139cb94-dcf6-4ebc-93e7-63af60f7f414_644b4dea-1bc3-47d9-8e4c-752712c6d033.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/f139cb94-dcf6-4ebc-93e7-63af60f7f414_644b4dea-1bc3-47d9-8e4c-752712c6d033.jpg/250x188.webp saved to cache
2025-12-05 12:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e9343fe5-dfa0-5ed7-a692-2c5262692eab
2025-12-05 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Ff139cb94-dcf6-4ebc-93e7-63af60f7f414_df76ba70-f568-4392-9005-975b91395ce2.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/f139cb94-dcf6-4ebc-93e7-63af60f7f414_df76ba70-f568-4392-9005-975b91395ce2.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/f139cb94-dcf6-4ebc-93e7-63af60f7f414_08607453-ff9b-4305-af7e-8e57cd8b4fa2.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/f139cb94-dcf6-4ebc-93e7-63af60f7f414_18cf6a4c-59b4-4e2c-9c4a-df4e5a60f9f8.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Ff139cb94-dcf6-4ebc-93e7-63af60f7f414_bc1b270d-2332-41bb-83ad-222870863068.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/f139cb94-dcf6-4ebc-93e7-63af60f7f414_bc1b270d-2332-41bb-83ad-222870863068.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5b3ef50>
2025-12-05 12:01:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 12:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9343fe5-dfa0-5ed7-a692-2c5262692eab/e9343fe5-dfa0-5ed7-a692-2c5262692eab_image_4.webp HTTP/1.1" 201 0
2025-12-05 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Ff139cb94-dcf6-4ebc-93e7-63af60f7f414_2291a92c-f006-4d92-9339-c5e6785de0fe.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/f139cb94-dcf6-4ebc-93e7-63af60f7f414_2291a92c-f006-4d92-9339-c5e6785de0fe.jpg/250x188.webp saved to cache
2025-12-05 12:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e9343fe5-dfa0-5ed7-a692-2c5262692eab
2025-12-05 12:01:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5c3b590>
2025-12-05 12:01:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9343fe5-dfa0-5ed7-a692-2c5262692eab/e9343fe5-dfa0-5ed7-a692-2c5262692eab_image_5.webp HTTP/1.1" 201 0
2025-12-05 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Ff139cb94-dcf6-4ebc-93e7-63af60f7f414_f329b99d-fa6f-4065-b280-3a05d18b535e.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/f139cb94-dcf6-4ebc-93e7-63af60f7f414_f329b99d-fa6f-4065-b280-3a05d18b535e.jpg/250x188.webp saved to cache
2025-12-05 12:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e9343fe5-dfa0-5ed7-a692-2c5262692eab
2025-12-05 12:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/f139cb94-dcf6-4ebc-93e7-63af60f7f414_db6ccfca-ac4a-4f94-9fd0-0b79d4542f83.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/f139cb94-dcf6-4ebc-93e7-63af60f7f414_0582e3e4-9253-4d57-95d0-cb8e3c9ba89b.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Ff139cb94-dcf6-4ebc-93e7-63af60f7f414_c5286fbf-53f4-4219-9e7e-e7a52fbe5b86.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/f139cb94-dcf6-4ebc-93e7-63af60f7f414_c5286fbf-53f4-4219-9e7e-e7a52fbe5b86.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e737d0>
2025-12-05 12:01:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 12:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9343fe5-dfa0-5ed7-a692-2c5262692eab/e9343fe5-dfa0-5ed7-a692-2c5262692eab_image_6.webp HTTP/1.1" 201 0
2025-12-05 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Ff139cb94-dcf6-4ebc-93e7-63af60f7f414_08607453-ff9b-4305-af7e-8e57cd8b4fa2.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/f139cb94-dcf6-4ebc-93e7-63af60f7f414_08607453-ff9b-4305-af7e-8e57cd8b4fa2.jpg/250x188.webp saved to cache
2025-12-05 12:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e9343fe5-dfa0-5ed7-a692-2c5262692eab
2025-12-05 12:01:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5c38d90>
2025-12-05 12:01:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 12:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9343fe5-dfa0-5ed7-a692-2c5262692eab/e9343fe5-dfa0-5ed7-a692-2c5262692eab_image_7.webp HTTP/1.1" 201 0
2025-12-05 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Ff139cb94-dcf6-4ebc-93e7-63af60f7f414_18cf6a4c-59b4-4e2c-9c4a-df4e5a60f9f8.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/f139cb94-dcf6-4ebc-93e7-63af60f7f414_18cf6a4c-59b4-4e2c-9c4a-df4e5a60f9f8.jpg/250x188.webp saved to cache
2025-12-05 12:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e9343fe5-dfa0-5ed7-a692-2c5262692eab
2025-12-05 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Ff139cb94-dcf6-4ebc-93e7-63af60f7f414_e51b4260-2ff8-4eef-8507-7eb9bcc0d3ad.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/f139cb94-dcf6-4ebc-93e7-63af60f7f414_e51b4260-2ff8-4eef-8507-7eb9bcc0d3ad.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/f139cb94-dcf6-4ebc-93e7-63af60f7f414_df76ba70-f568-4392-9005-975b91395ce2.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27cfc53537-b27f-47cf-be77-6a7149253d50%27 HTTP/1.1" 200 None
2025-12-05 12:01:23 [auto_selling_autoscout24.it] INFO: Scrape type for cfc53537-b27f-47cf-be77-6a7149253d50: 1
2025-12-05 12:01:23 [auto_selling_autoscout24.it] INFO: Scraping new listing cfc53537-b27f-47cf-be77-6a7149253d50
2025-12-05 12:01:23 [auto_selling_autoscout24.it] INFO: Extracting item from listing ID: cfc53537-b27f-47cf-be77-6a7149253d50
2025-12-05 12:01:23 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c2715db-23b3-56de-ba6f-7ab9201cba19 with identifier: cfc53537-b27f-47cf-be77-6a7149253d50
2025-12-05 12:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 2c2715db-23b3-56de-ba6f-7ab9201cba19
2025-12-05 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fcfc53537-b27f-47cf-be77-6a7149253d50_4ea0ddf7-6cb0-430f-a2b3-1d8ed891ea69.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/cfc53537-b27f-47cf-be77-6a7149253d50_4ea0ddf7-6cb0-430f-a2b3-1d8ed891ea69.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5c91ad0>
2025-12-05 12:01:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 12:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9343fe5-dfa0-5ed7-a692-2c5262692eab/e9343fe5-dfa0-5ed7-a692-2c5262692eab_image_8.webp HTTP/1.1" 201 0
2025-12-05 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Ff139cb94-dcf6-4ebc-93e7-63af60f7f414_db6ccfca-ac4a-4f94-9fd0-0b79d4542f83.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/f139cb94-dcf6-4ebc-93e7-63af60f7f414_db6ccfca-ac4a-4f94-9fd0-0b79d4542f83.jpg/250x188.webp saved to cache
2025-12-05 12:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e9343fe5-dfa0-5ed7-a692-2c5262692eab
2025-12-05 12:01:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5c3b2d0>
2025-12-05 12:01:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 12:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9343fe5-dfa0-5ed7-a692-2c5262692eab/e9343fe5-dfa0-5ed7-a692-2c5262692eab_image_9.webp HTTP/1.1" 201 0
2025-12-05 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Ff139cb94-dcf6-4ebc-93e7-63af60f7f414_0582e3e4-9253-4d57-95d0-cb8e3c9ba89b.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/f139cb94-dcf6-4ebc-93e7-63af60f7f414_0582e3e4-9253-4d57-95d0-cb8e3c9ba89b.jpg/250x188.webp saved to cache
2025-12-05 12:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e9343fe5-dfa0-5ed7-a692-2c5262692eab
2025-12-05 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fcfc53537-b27f-47cf-be77-6a7149253d50_1f993377-9ea7-4456-80a1-7b0b71e491cc.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/cfc53537-b27f-47cf-be77-6a7149253d50_1f993377-9ea7-4456-80a1-7b0b71e491cc.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/f139cb94-dcf6-4ebc-93e7-63af60f7f414_bc1b270d-2332-41bb-83ad-222870863068.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/f139cb94-dcf6-4ebc-93e7-63af60f7f414_c5286fbf-53f4-4219-9e7e-e7a52fbe5b86.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fcfc53537-b27f-47cf-be77-6a7149253d50_b3ede4b4-de8b-422f-a598-185aed6acdac.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/cfc53537-b27f-47cf-be77-6a7149253d50_b3ede4b4-de8b-422f-a598-185aed6acdac.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e2d390>
2025-12-05 12:01:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 12:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9343fe5-dfa0-5ed7-a692-2c5262692eab/e9343fe5-dfa0-5ed7-a692-2c5262692eab_image_10.webp HTTP/1.1" 201 0
2025-12-05 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Ff139cb94-dcf6-4ebc-93e7-63af60f7f414_df76ba70-f568-4392-9005-975b91395ce2.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/f139cb94-dcf6-4ebc-93e7-63af60f7f414_df76ba70-f568-4392-9005-975b91395ce2.jpg/250x188.webp saved to cache
2025-12-05 12:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item e9343fe5-dfa0-5ed7-a692-2c5262692eab
2025-12-05 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fcfc53537-b27f-47cf-be77-6a7149253d50_92232ac4-39b9-4ca2-b34b-14c2e305b195.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/cfc53537-b27f-47cf-be77-6a7149253d50_92232ac4-39b9-4ca2-b34b-14c2e305b195.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/f139cb94-dcf6-4ebc-93e7-63af60f7f414_e51b4260-2ff8-4eef-8507-7eb9bcc0d3ad.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/cfc53537-b27f-47cf-be77-6a7149253d50_4ea0ddf7-6cb0-430f-a2b3-1d8ed891ea69.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fcfc53537-b27f-47cf-be77-6a7149253d50_4e245c53-10ec-48a0-9983-30252033770d.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/cfc53537-b27f-47cf-be77-6a7149253d50_4e245c53-10ec-48a0-9983-30252033770d.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5c9ccd0>
2025-12-05 12:01:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9343fe5-dfa0-5ed7-a692-2c5262692eab/e9343fe5-dfa0-5ed7-a692-2c5262692eab_image_11.webp HTTP/1.1" 201 0
2025-12-05 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Ff139cb94-dcf6-4ebc-93e7-63af60f7f414_bc1b270d-2332-41bb-83ad-222870863068.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/f139cb94-dcf6-4ebc-93e7-63af60f7f414_bc1b270d-2332-41bb-83ad-222870863068.jpg/250x188.webp saved to cache
2025-12-05 12:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item e9343fe5-dfa0-5ed7-a692-2c5262692eab
2025-12-05 12:01:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5c3aa50>
2025-12-05 12:01:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 12:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9343fe5-dfa0-5ed7-a692-2c5262692eab/e9343fe5-dfa0-5ed7-a692-2c5262692eab_image_12.webp HTTP/1.1" 201 0
2025-12-05 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Ff139cb94-dcf6-4ebc-93e7-63af60f7f414_c5286fbf-53f4-4219-9e7e-e7a52fbe5b86.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/f139cb94-dcf6-4ebc-93e7-63af60f7f414_c5286fbf-53f4-4219-9e7e-e7a52fbe5b86.jpg/250x188.webp saved to cache
2025-12-05 12:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item e9343fe5-dfa0-5ed7-a692-2c5262692eab
2025-12-05 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fcfc53537-b27f-47cf-be77-6a7149253d50_9c3344fd-c1a0-4573-9829-5aca43e06ea1.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/cfc53537-b27f-47cf-be77-6a7149253d50_9c3344fd-c1a0-4573-9829-5aca43e06ea1.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/cfc53537-b27f-47cf-be77-6a7149253d50_b3ede4b4-de8b-422f-a598-185aed6acdac.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/cfc53537-b27f-47cf-be77-6a7149253d50_1f993377-9ea7-4456-80a1-7b0b71e491cc.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fcfc53537-b27f-47cf-be77-6a7149253d50_1d15d966-7afa-4378-a0f7-4c484741211e.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/cfc53537-b27f-47cf-be77-6a7149253d50_1d15d966-7afa-4378-a0f7-4c484741211e.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5b3d250>
2025-12-05 12:01:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e9343fe5-dfa0-5ed7-a692-2c5262692eab/e9343fe5-dfa0-5ed7-a692-2c5262692eab_image_13.webp HTTP/1.1" 201 0
2025-12-05 12:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Ff139cb94-dcf6-4ebc-93e7-63af60f7f414_e51b4260-2ff8-4eef-8507-7eb9bcc0d3ad.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/f139cb94-dcf6-4ebc-93e7-63af60f7f414_e51b4260-2ff8-4eef-8507-7eb9bcc0d3ad.jpg/250x188.webp saved to cache
2025-12-05 12:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item e9343fe5-dfa0-5ed7-a692-2c5262692eab
2025-12-05 12:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Removing item e9343fe5-dfa0-5ed7-a692-2c5262692eab from tracking dictionaries
2025-12-05 12:01:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e9343fe5-dfa0-5ed7-a692-2c5262692eab sending to next pipeline
2025-12-05 12:01:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d6ffb890>
2025-12-05 12:01:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 12:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c2715db-23b3-56de-ba6f-7ab9201cba19/2c2715db-23b3-56de-ba6f-7ab9201cba19_image_0.webp HTTP/1.1" 201 0
2025-12-05 12:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fcfc53537-b27f-47cf-be77-6a7149253d50_4ea0ddf7-6cb0-430f-a2b3-1d8ed891ea69.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/cfc53537-b27f-47cf-be77-6a7149253d50_4ea0ddf7-6cb0-430f-a2b3-1d8ed891ea69.jpg/250x188.webp saved to cache
2025-12-05 12:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2c2715db-23b3-56de-ba6f-7ab9201cba19
2025-12-05 12:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fcfc53537-b27f-47cf-be77-6a7149253d50_3a8367f1-d32a-4500-abc9-9b6c92bf43c8.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/cfc53537-b27f-47cf-be77-6a7149253d50_3a8367f1-d32a-4500-abc9-9b6c92bf43c8.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:25 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: e9343fe5-dfa0-5ed7-a692-2c5262692eab with identifier f139cb94-dcf6-4ebc-93e7-63af60f7f414
2025-12-05 12:01:25 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:01:25 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:01:25 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item e9343fe5-dfa0-5ed7-a692-2c5262692eab
2025-12-05 12:01:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://prod.pictures.autoscout24.net/listing-images/f139cb94-dcf6-4ebc-93e7-63af60f7f414_e51b4260-2ff8-4eef-8507-7eb9bcc0d3ad.jpg/250x188.webp>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'emission_standard': None,
 'engine': None,
 'engine_horse_power': 218,
 'expiration_date': None,
 'fuel_type': 'Electric/Gasoline',
 'id': 'e9343fe5-dfa0-5ed7-a692-2c5262692eab',
 'is_damaged': False,
 'is_operable': True,
 'license_plate': None,
 'link_to_web_offer': 'https://www.autoscout24.it/offers/byd-seal-u-dmi-boost-superdmtechnology-ecvt-218cv-promo-electric-gasoline-black-f139cb94-dcf6-4ebc-93e7-63af60f7f414',
 'listing': 'auction',
 'make': 'BYD',
 'model': 'Seal U',
 'odometer': 1,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9343fe5-dfa0-5ed7-a692-2c5262692eab/e9343fe5-dfa0-5ed7-a692-2c5262692eab_image_0.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4116,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/f139cb94-dcf6-4ebc-93e7-63af60f7f414_0cd561ed-f978-4cba-9f9a-b2bdfabb9e61.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9343fe5-dfa0-5ed7-a692-2c5262692eab/e9343fe5-dfa0-5ed7-a692-2c5262692eab_image_1.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4706,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/f139cb94-dcf6-4ebc-93e7-63af60f7f414_519fd5b4-6c0c-41d2-894f-4b9211b7a23c.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9343fe5-dfa0-5ed7-a692-2c5262692eab/e9343fe5-dfa0-5ed7-a692-2c5262692eab_image_2.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4574,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/f139cb94-dcf6-4ebc-93e7-63af60f7f414_644b4dea-1bc3-47d9-8e4c-752712c6d033.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9343fe5-dfa0-5ed7-a692-2c5262692eab/e9343fe5-dfa0-5ed7-a692-2c5262692eab_image_3.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4470,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/f139cb94-dcf6-4ebc-93e7-63af60f7f414_8d6be9f8-beb9-499e-920c-941c625ce691.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9343fe5-dfa0-5ed7-a692-2c5262692eab/e9343fe5-dfa0-5ed7-a692-2c5262692eab_image_4.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3730,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/f139cb94-dcf6-4ebc-93e7-63af60f7f414_2291a92c-f006-4d92-9339-c5e6785de0fe.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9343fe5-dfa0-5ed7-a692-2c5262692eab/e9343fe5-dfa0-5ed7-a692-2c5262692eab_image_5.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4482,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/f139cb94-dcf6-4ebc-93e7-63af60f7f414_f329b99d-fa6f-4065-b280-3a05d18b535e.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9343fe5-dfa0-5ed7-a692-2c5262692eab/e9343fe5-dfa0-5ed7-a692-2c5262692eab_image_6.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3506,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/f139cb94-dcf6-4ebc-93e7-63af60f7f414_08607453-ff9b-4305-af7e-8e57cd8b4fa2.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9343fe5-dfa0-5ed7-a692-2c5262692eab/e9343fe5-dfa0-5ed7-a692-2c5262692eab_image_7.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5236,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/f139cb94-dcf6-4ebc-93e7-63af60f7f414_18cf6a4c-59b4-4e2c-9c4a-df4e5a60f9f8.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9343fe5-dfa0-5ed7-a692-2c5262692eab/e9343fe5-dfa0-5ed7-a692-2c5262692eab_image_8.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5108,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/f139cb94-dcf6-4ebc-93e7-63af60f7f414_db6ccfca-ac4a-4f94-9fd0-0b79d4542f83.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9343fe5-dfa0-5ed7-a692-2c5262692eab/e9343fe5-dfa0-5ed7-a692-2c5262692eab_image_9.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 7104,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/f139cb94-dcf6-4ebc-93e7-63af60f7f414_0582e3e4-9253-4d57-95d0-cb8e3c9ba89b.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9343fe5-dfa0-5ed7-a692-2c5262692eab/e9343fe5-dfa0-5ed7-a692-2c5262692eab_image_10.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 6332,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/f139cb94-dcf6-4ebc-93e7-63af60f7f414_df76ba70-f568-4392-9005-975b91395ce2.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9343fe5-dfa0-5ed7-a692-2c5262692eab/e9343fe5-dfa0-5ed7-a692-2c5262692eab_image_11.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 6240,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/f139cb94-dcf6-4ebc-93e7-63af60f7f414_bc1b270d-2332-41bb-83ad-222870863068.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9343fe5-dfa0-5ed7-a692-2c5262692eab/e9343fe5-dfa0-5ed7-a692-2c5262692eab_image_12.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5528,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/f139cb94-dcf6-4ebc-93e7-63af60f7f414_c5286fbf-53f4-4219-9e7e-e7a52fbe5b86.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9343fe5-dfa0-5ed7-a692-2c5262692eab/e9343fe5-dfa0-5ed7-a692-2c5262692eab_image_13.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4996,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/f139cb94-dcf6-4ebc-93e7-63af60f7f414_e51b4260-2ff8-4eef-8507-7eb9bcc0d3ad.jpg/250x188.webp',
             'Width': 250}],
 'price': 33900,
 'price_includes_vat': False,
 'registration_date': '2025-08-01',
 'seller_name': None,
 'title': 'BYD Seal U DMi BOOST  SuperDMTechnology eCVT 218CV PROMO!',
 'transmission': 'automatic',
 'trim': 'DMi BOOST  SuperDMTechnology eCVT 218CV PROMO!',
 'vin': None,
 'year': 2025}
2025-12-05 12:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27f139cb94-dcf6-4ebc-93e7-63af60f7f414%27 HTTP/1.1" 200 None
2025-12-05 12:01:25 [auto_selling_autoscout24.it] INFO: Saving data for f139cb94-dcf6-4ebc-93e7-63af60f7f414: {'created_time': 1764936085.528987, 'last_price_update_time': 1764936085.528996}
2025-12-05 12:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autoscout24.it',RowKey='f139cb94-dcf6-4ebc-93e7-63af60f7f414') HTTP/1.1" 204 0
2025-12-05 12:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/cfc53537-b27f-47cf-be77-6a7149253d50_92232ac4-39b9-4ca2-b34b-14c2e305b195.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/cfc53537-b27f-47cf-be77-6a7149253d50_4e245c53-10ec-48a0-9983-30252033770d.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fcfc53537-b27f-47cf-be77-6a7149253d50_d66ee0d2-86ee-4979-a06b-a2f828f984f2.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/cfc53537-b27f-47cf-be77-6a7149253d50_d66ee0d2-86ee-4979-a06b-a2f828f984f2.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e50690>
2025-12-05 12:01:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 12:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c2715db-23b3-56de-ba6f-7ab9201cba19/2c2715db-23b3-56de-ba6f-7ab9201cba19_image_2.webp HTTP/1.1" 201 0
2025-12-05 12:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fcfc53537-b27f-47cf-be77-6a7149253d50_b3ede4b4-de8b-422f-a598-185aed6acdac.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/cfc53537-b27f-47cf-be77-6a7149253d50_b3ede4b4-de8b-422f-a598-185aed6acdac.jpg/250x188.webp saved to cache
2025-12-05 12:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2c2715db-23b3-56de-ba6f-7ab9201cba19
2025-12-05 12:01:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5cd5bd0>
2025-12-05 12:01:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 12:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c2715db-23b3-56de-ba6f-7ab9201cba19/2c2715db-23b3-56de-ba6f-7ab9201cba19_image_1.webp HTTP/1.1" 201 0
2025-12-05 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fcfc53537-b27f-47cf-be77-6a7149253d50_1f993377-9ea7-4456-80a1-7b0b71e491cc.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/cfc53537-b27f-47cf-be77-6a7149253d50_1f993377-9ea7-4456-80a1-7b0b71e491cc.jpg/250x188.webp saved to cache
2025-12-05 12:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2c2715db-23b3-56de-ba6f-7ab9201cba19
2025-12-05 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fcfc53537-b27f-47cf-be77-6a7149253d50_d147d5ab-a6c6-41f3-bc1a-8dee7c44ddb3.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/cfc53537-b27f-47cf-be77-6a7149253d50_d147d5ab-a6c6-41f3-bc1a-8dee7c44ddb3.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/cfc53537-b27f-47cf-be77-6a7149253d50_9c3344fd-c1a0-4573-9829-5aca43e06ea1.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/cfc53537-b27f-47cf-be77-6a7149253d50_1d15d966-7afa-4378-a0f7-4c484741211e.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fcfc53537-b27f-47cf-be77-6a7149253d50_9f2da344-8a45-4926-9224-129827064bd8.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/cfc53537-b27f-47cf-be77-6a7149253d50_9f2da344-8a45-4926-9224-129827064bd8.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9dd5fcf50>
2025-12-05 12:01:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 12:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c2715db-23b3-56de-ba6f-7ab9201cba19/2c2715db-23b3-56de-ba6f-7ab9201cba19_image_3.webp HTTP/1.1" 201 0
2025-12-05 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fcfc53537-b27f-47cf-be77-6a7149253d50_92232ac4-39b9-4ca2-b34b-14c2e305b195.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/cfc53537-b27f-47cf-be77-6a7149253d50_92232ac4-39b9-4ca2-b34b-14c2e305b195.jpg/250x188.webp saved to cache
2025-12-05 12:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2c2715db-23b3-56de-ba6f-7ab9201cba19
2025-12-05 12:01:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5c92010>
2025-12-05 12:01:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 12:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c2715db-23b3-56de-ba6f-7ab9201cba19/2c2715db-23b3-56de-ba6f-7ab9201cba19_image_4.webp HTTP/1.1" 201 0
2025-12-05 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fcfc53537-b27f-47cf-be77-6a7149253d50_4e245c53-10ec-48a0-9983-30252033770d.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/cfc53537-b27f-47cf-be77-6a7149253d50_4e245c53-10ec-48a0-9983-30252033770d.jpg/250x188.webp saved to cache
2025-12-05 12:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2c2715db-23b3-56de-ba6f-7ab9201cba19
2025-12-05 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fcfc53537-b27f-47cf-be77-6a7149253d50_95b6c2ed-75a4-417a-97c8-6f13a7910aa8.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/cfc53537-b27f-47cf-be77-6a7149253d50_95b6c2ed-75a4-417a-97c8-6f13a7910aa8.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/cfc53537-b27f-47cf-be77-6a7149253d50_3a8367f1-d32a-4500-abc9-9b6c92bf43c8.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/cfc53537-b27f-47cf-be77-6a7149253d50_d66ee0d2-86ee-4979-a06b-a2f828f984f2.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fcfc53537-b27f-47cf-be77-6a7149253d50_41954b6b-dd11-4c05-b302-19a2b9810a7d.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/cfc53537-b27f-47cf-be77-6a7149253d50_41954b6b-dd11-4c05-b302-19a2b9810a7d.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5b07bd0>
2025-12-05 12:01:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 12:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c2715db-23b3-56de-ba6f-7ab9201cba19/2c2715db-23b3-56de-ba6f-7ab9201cba19_image_5.webp HTTP/1.1" 201 0
2025-12-05 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fcfc53537-b27f-47cf-be77-6a7149253d50_9c3344fd-c1a0-4573-9829-5aca43e06ea1.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/cfc53537-b27f-47cf-be77-6a7149253d50_9c3344fd-c1a0-4573-9829-5aca43e06ea1.jpg/250x188.webp saved to cache
2025-12-05 12:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2c2715db-23b3-56de-ba6f-7ab9201cba19
2025-12-05 12:01:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5b11a50>
2025-12-05 12:01:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c2715db-23b3-56de-ba6f-7ab9201cba19/2c2715db-23b3-56de-ba6f-7ab9201cba19_image_6.webp HTTP/1.1" 201 0
2025-12-05 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fcfc53537-b27f-47cf-be77-6a7149253d50_1d15d966-7afa-4378-a0f7-4c484741211e.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/cfc53537-b27f-47cf-be77-6a7149253d50_1d15d966-7afa-4378-a0f7-4c484741211e.jpg/250x188.webp saved to cache
2025-12-05 12:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2c2715db-23b3-56de-ba6f-7ab9201cba19
2025-12-05 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fcfc53537-b27f-47cf-be77-6a7149253d50_679fdd82-35b1-4eb3-9593-7959045410a2.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/cfc53537-b27f-47cf-be77-6a7149253d50_679fdd82-35b1-4eb3-9593-7959045410a2.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/cfc53537-b27f-47cf-be77-6a7149253d50_9f2da344-8a45-4926-9224-129827064bd8.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/cfc53537-b27f-47cf-be77-6a7149253d50_d147d5ab-a6c6-41f3-bc1a-8dee7c44ddb3.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fcfc53537-b27f-47cf-be77-6a7149253d50_d4cbe1c7-3ddc-4c9d-8d37-32d7e7c4f31f.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/cfc53537-b27f-47cf-be77-6a7149253d50_d4cbe1c7-3ddc-4c9d-8d37-32d7e7c4f31f.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5c9f1d0>
2025-12-05 12:01:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 12:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c2715db-23b3-56de-ba6f-7ab9201cba19/2c2715db-23b3-56de-ba6f-7ab9201cba19_image_7.webp HTTP/1.1" 201 0
2025-12-05 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fcfc53537-b27f-47cf-be77-6a7149253d50_3a8367f1-d32a-4500-abc9-9b6c92bf43c8.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/cfc53537-b27f-47cf-be77-6a7149253d50_3a8367f1-d32a-4500-abc9-9b6c92bf43c8.jpg/250x188.webp saved to cache
2025-12-05 12:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2c2715db-23b3-56de-ba6f-7ab9201cba19
2025-12-05 12:01:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9dc13e550>
2025-12-05 12:01:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c2715db-23b3-56de-ba6f-7ab9201cba19/2c2715db-23b3-56de-ba6f-7ab9201cba19_image_8.webp HTTP/1.1" 201 0
2025-12-05 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fcfc53537-b27f-47cf-be77-6a7149253d50_d66ee0d2-86ee-4979-a06b-a2f828f984f2.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/cfc53537-b27f-47cf-be77-6a7149253d50_d66ee0d2-86ee-4979-a06b-a2f828f984f2.jpg/250x188.webp saved to cache
2025-12-05 12:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2c2715db-23b3-56de-ba6f-7ab9201cba19
2025-12-05 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27c58ad43a-6c6b-4c44-995b-d67cf0e98f59%27 HTTP/1.1" 200 None
2025-12-05 12:01:28 [auto_selling_autoscout24.it] INFO: Scrape type for c58ad43a-6c6b-4c44-995b-d67cf0e98f59: 1
2025-12-05 12:01:28 [auto_selling_autoscout24.it] INFO: Scraping new listing c58ad43a-6c6b-4c44-995b-d67cf0e98f59
2025-12-05 12:01:28 [auto_selling_autoscout24.it] INFO: Extracting item from listing ID: c58ad43a-6c6b-4c44-995b-d67cf0e98f59
2025-12-05 12:01:28 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 79249bff-86cf-55b2-bb84-8e3eab527469 with identifier: c58ad43a-6c6b-4c44-995b-d67cf0e98f59
2025-12-05 12:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 79249bff-86cf-55b2-bb84-8e3eab527469
2025-12-05 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fc58ad43a-6c6b-4c44-995b-d67cf0e98f59_6b270288-33ba-4a6f-9e39-3c834792a1a7.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/c58ad43a-6c6b-4c44-995b-d67cf0e98f59_6b270288-33ba-4a6f-9e39-3c834792a1a7.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/cfc53537-b27f-47cf-be77-6a7149253d50_41954b6b-dd11-4c05-b302-19a2b9810a7d.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/cfc53537-b27f-47cf-be77-6a7149253d50_95b6c2ed-75a4-417a-97c8-6f13a7910aa8.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fc58ad43a-6c6b-4c44-995b-d67cf0e98f59_f112285c-62da-4139-9b02-7ccc5c15186b.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/c58ad43a-6c6b-4c44-995b-d67cf0e98f59_f112285c-62da-4139-9b02-7ccc5c15186b.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5c44a90>
2025-12-05 12:01:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 12:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c2715db-23b3-56de-ba6f-7ab9201cba19/2c2715db-23b3-56de-ba6f-7ab9201cba19_image_10.webp HTTP/1.1" 201 0
2025-12-05 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fcfc53537-b27f-47cf-be77-6a7149253d50_9f2da344-8a45-4926-9224-129827064bd8.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/cfc53537-b27f-47cf-be77-6a7149253d50_9f2da344-8a45-4926-9224-129827064bd8.jpg/250x188.webp saved to cache
2025-12-05 12:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 2c2715db-23b3-56de-ba6f-7ab9201cba19
2025-12-05 12:01:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5eb4850>
2025-12-05 12:01:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 12:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c2715db-23b3-56de-ba6f-7ab9201cba19/2c2715db-23b3-56de-ba6f-7ab9201cba19_image_9.webp HTTP/1.1" 201 0
2025-12-05 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fcfc53537-b27f-47cf-be77-6a7149253d50_d147d5ab-a6c6-41f3-bc1a-8dee7c44ddb3.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/cfc53537-b27f-47cf-be77-6a7149253d50_d147d5ab-a6c6-41f3-bc1a-8dee7c44ddb3.jpg/250x188.webp saved to cache
2025-12-05 12:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2c2715db-23b3-56de-ba6f-7ab9201cba19
2025-12-05 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fc58ad43a-6c6b-4c44-995b-d67cf0e98f59_d212e81f-6b20-4377-be37-c026d32ef8bf.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/c58ad43a-6c6b-4c44-995b-d67cf0e98f59_d212e81f-6b20-4377-be37-c026d32ef8bf.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/cfc53537-b27f-47cf-be77-6a7149253d50_d4cbe1c7-3ddc-4c9d-8d37-32d7e7c4f31f.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/cfc53537-b27f-47cf-be77-6a7149253d50_679fdd82-35b1-4eb3-9593-7959045410a2.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fc58ad43a-6c6b-4c44-995b-d67cf0e98f59_c740d13e-8c88-43a3-ac72-c37ab804f49d.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/c58ad43a-6c6b-4c44-995b-d67cf0e98f59_c740d13e-8c88-43a3-ac72-c37ab804f49d.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9dc13f6d0>
2025-12-05 12:01:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 12:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c2715db-23b3-56de-ba6f-7ab9201cba19/2c2715db-23b3-56de-ba6f-7ab9201cba19_image_12.webp HTTP/1.1" 201 0
2025-12-05 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fcfc53537-b27f-47cf-be77-6a7149253d50_41954b6b-dd11-4c05-b302-19a2b9810a7d.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/cfc53537-b27f-47cf-be77-6a7149253d50_41954b6b-dd11-4c05-b302-19a2b9810a7d.jpg/250x188.webp saved to cache
2025-12-05 12:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 2c2715db-23b3-56de-ba6f-7ab9201cba19
2025-12-05 12:01:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9dd5fce90>
2025-12-05 12:01:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c2715db-23b3-56de-ba6f-7ab9201cba19/2c2715db-23b3-56de-ba6f-7ab9201cba19_image_11.webp HTTP/1.1" 201 0
2025-12-05 12:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fcfc53537-b27f-47cf-be77-6a7149253d50_95b6c2ed-75a4-417a-97c8-6f13a7910aa8.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/cfc53537-b27f-47cf-be77-6a7149253d50_95b6c2ed-75a4-417a-97c8-6f13a7910aa8.jpg/250x188.webp saved to cache
2025-12-05 12:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 2c2715db-23b3-56de-ba6f-7ab9201cba19
2025-12-05 12:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fc58ad43a-6c6b-4c44-995b-d67cf0e98f59_8d362053-e859-49c9-9c42-1e620ad34a2c.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/c58ad43a-6c6b-4c44-995b-d67cf0e98f59_8d362053-e859-49c9-9c42-1e620ad34a2c.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/c58ad43a-6c6b-4c44-995b-d67cf0e98f59_6b270288-33ba-4a6f-9e39-3c834792a1a7.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/c58ad43a-6c6b-4c44-995b-d67cf0e98f59_f112285c-62da-4139-9b02-7ccc5c15186b.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fc58ad43a-6c6b-4c44-995b-d67cf0e98f59_97597d16-de60-46c8-a772-567362ffc8ec.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/c58ad43a-6c6b-4c44-995b-d67cf0e98f59_97597d16-de60-46c8-a772-567362ffc8ec.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d6fc2cd0>
2025-12-05 12:01:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 12:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c2715db-23b3-56de-ba6f-7ab9201cba19/2c2715db-23b3-56de-ba6f-7ab9201cba19_image_14.webp HTTP/1.1" 201 0
2025-12-05 12:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fcfc53537-b27f-47cf-be77-6a7149253d50_d4cbe1c7-3ddc-4c9d-8d37-32d7e7c4f31f.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/cfc53537-b27f-47cf-be77-6a7149253d50_d4cbe1c7-3ddc-4c9d-8d37-32d7e7c4f31f.jpg/250x188.webp saved to cache
2025-12-05 12:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 2c2715db-23b3-56de-ba6f-7ab9201cba19
2025-12-05 12:01:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9dc1b8310>
2025-12-05 12:01:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c2715db-23b3-56de-ba6f-7ab9201cba19/2c2715db-23b3-56de-ba6f-7ab9201cba19_image_13.webp HTTP/1.1" 201 0
2025-12-05 12:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fcfc53537-b27f-47cf-be77-6a7149253d50_679fdd82-35b1-4eb3-9593-7959045410a2.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/cfc53537-b27f-47cf-be77-6a7149253d50_679fdd82-35b1-4eb3-9593-7959045410a2.jpg/250x188.webp saved to cache
2025-12-05 12:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 2c2715db-23b3-56de-ba6f-7ab9201cba19
2025-12-05 12:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 2c2715db-23b3-56de-ba6f-7ab9201cba19 from tracking dictionaries
2025-12-05 12:01:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2c2715db-23b3-56de-ba6f-7ab9201cba19 sending to next pipeline
2025-12-05 12:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fc58ad43a-6c6b-4c44-995b-d67cf0e98f59_34cd50b2-edcb-4f5b-9181-4973fbdec220.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/c58ad43a-6c6b-4c44-995b-d67cf0e98f59_34cd50b2-edcb-4f5b-9181-4973fbdec220.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:29 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 2c2715db-23b3-56de-ba6f-7ab9201cba19 with identifier cfc53537-b27f-47cf-be77-6a7149253d50
2025-12-05 12:01:29 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:01:29 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:01:29 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 2c2715db-23b3-56de-ba6f-7ab9201cba19
2025-12-05 12:01:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://prod.pictures.autoscout24.net/listing-images/cfc53537-b27f-47cf-be77-6a7149253d50_679fdd82-35b1-4eb3-9593-7959045410a2.jpg/250x188.webp>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'emission_standard': None,
 'engine': None,
 'engine_horse_power': 333,
 'expiration_date': None,
 'fuel_type': 'Gasoline',
 'id': '2c2715db-23b3-56de-ba6f-7ab9201cba19',
 'is_damaged': False,
 'is_operable': True,
 'license_plate': None,
 'link_to_web_offer': 'https://www.autoscout24.it/offers/audi-s3-spb-tfsi-qtr-s-tr-sport-attitude-uff-italia-promo-gasoline-black-cfc53537-b27f-47cf-be77-6a7149253d50',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'S3',
 'odometer': 1,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c2715db-23b3-56de-ba6f-7ab9201cba19/2c2715db-23b3-56de-ba6f-7ab9201cba19_image_0.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4210,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/cfc53537-b27f-47cf-be77-6a7149253d50_4ea0ddf7-6cb0-430f-a2b3-1d8ed891ea69.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c2715db-23b3-56de-ba6f-7ab9201cba19/2c2715db-23b3-56de-ba6f-7ab9201cba19_image_1.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4320,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/cfc53537-b27f-47cf-be77-6a7149253d50_1f993377-9ea7-4456-80a1-7b0b71e491cc.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c2715db-23b3-56de-ba6f-7ab9201cba19/2c2715db-23b3-56de-ba6f-7ab9201cba19_image_2.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3824,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/cfc53537-b27f-47cf-be77-6a7149253d50_b3ede4b4-de8b-422f-a598-185aed6acdac.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c2715db-23b3-56de-ba6f-7ab9201cba19/2c2715db-23b3-56de-ba6f-7ab9201cba19_image_3.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4078,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/cfc53537-b27f-47cf-be77-6a7149253d50_92232ac4-39b9-4ca2-b34b-14c2e305b195.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c2715db-23b3-56de-ba6f-7ab9201cba19/2c2715db-23b3-56de-ba6f-7ab9201cba19_image_4.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3616,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/cfc53537-b27f-47cf-be77-6a7149253d50_4e245c53-10ec-48a0-9983-30252033770d.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c2715db-23b3-56de-ba6f-7ab9201cba19/2c2715db-23b3-56de-ba6f-7ab9201cba19_image_5.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4318,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/cfc53537-b27f-47cf-be77-6a7149253d50_9c3344fd-c1a0-4573-9829-5aca43e06ea1.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c2715db-23b3-56de-ba6f-7ab9201cba19/2c2715db-23b3-56de-ba6f-7ab9201cba19_image_6.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 6712,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/cfc53537-b27f-47cf-be77-6a7149253d50_1d15d966-7afa-4378-a0f7-4c484741211e.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c2715db-23b3-56de-ba6f-7ab9201cba19/2c2715db-23b3-56de-ba6f-7ab9201cba19_image_7.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5522,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/cfc53537-b27f-47cf-be77-6a7149253d50_3a8367f1-d32a-4500-abc9-9b6c92bf43c8.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c2715db-23b3-56de-ba6f-7ab9201cba19/2c2715db-23b3-56de-ba6f-7ab9201cba19_image_8.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 6566,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/cfc53537-b27f-47cf-be77-6a7149253d50_d66ee0d2-86ee-4979-a06b-a2f828f984f2.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c2715db-23b3-56de-ba6f-7ab9201cba19/2c2715db-23b3-56de-ba6f-7ab9201cba19_image_9.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3932,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/cfc53537-b27f-47cf-be77-6a7149253d50_d147d5ab-a6c6-41f3-bc1a-8dee7c44ddb3.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c2715db-23b3-56de-ba6f-7ab9201cba19/2c2715db-23b3-56de-ba6f-7ab9201cba19_image_10.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3660,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/cfc53537-b27f-47cf-be77-6a7149253d50_9f2da344-8a45-4926-9224-129827064bd8.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c2715db-23b3-56de-ba6f-7ab9201cba19/2c2715db-23b3-56de-ba6f-7ab9201cba19_image_11.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4450,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/cfc53537-b27f-47cf-be77-6a7149253d50_95b6c2ed-75a4-417a-97c8-6f13a7910aa8.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c2715db-23b3-56de-ba6f-7ab9201cba19/2c2715db-23b3-56de-ba6f-7ab9201cba19_image_12.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3810,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/cfc53537-b27f-47cf-be77-6a7149253d50_41954b6b-dd11-4c05-b302-19a2b9810a7d.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c2715db-23b3-56de-ba6f-7ab9201cba19/2c2715db-23b3-56de-ba6f-7ab9201cba19_image_13.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4914,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/cfc53537-b27f-47cf-be77-6a7149253d50_679fdd82-35b1-4eb3-9593-7959045410a2.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c2715db-23b3-56de-ba6f-7ab9201cba19/2c2715db-23b3-56de-ba6f-7ab9201cba19_image_14.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 2196,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/cfc53537-b27f-47cf-be77-6a7149253d50_d4cbe1c7-3ddc-4c9d-8d37-32d7e7c4f31f.jpg/250x188.webp',
             'Width': 250}],
 'price': 54900,
 'price_includes_vat': False,
 'registration_date': '2025-09-01',
 'seller_name': None,
 'title': 'Audi S3 SPB TFSI QTR S-TR SPORT ATTITUDE UFF.ITALIA PROMO',
 'transmission': 'automatic',
 'trim': 'SPB TFSI QTR S-TR SPORT ATTITUDE UFF.ITALIA PROMO',
 'vin': None,
 'year': 2025}
2025-12-05 12:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27cfc53537-b27f-47cf-be77-6a7149253d50%27 HTTP/1.1" 200 None
2025-12-05 12:01:29 [auto_selling_autoscout24.it] INFO: Saving data for cfc53537-b27f-47cf-be77-6a7149253d50: {'created_time': 1764936089.766639, 'last_price_update_time': 1764936089.766653}
2025-12-05 12:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autoscout24.it',RowKey='cfc53537-b27f-47cf-be77-6a7149253d50') HTTP/1.1" 204 0
2025-12-05 12:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/c58ad43a-6c6b-4c44-995b-d67cf0e98f59_d212e81f-6b20-4377-be37-c026d32ef8bf.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/c58ad43a-6c6b-4c44-995b-d67cf0e98f59_c740d13e-8c88-43a3-ac72-c37ab804f49d.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fc58ad43a-6c6b-4c44-995b-d67cf0e98f59_cb876a87-6f6a-4c78-886c-38218742a92f.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/c58ad43a-6c6b-4c44-995b-d67cf0e98f59_cb876a87-6f6a-4c78-886c-38218742a92f.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5c44a90>
2025-12-05 12:01:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 12:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79249bff-86cf-55b2-bb84-8e3eab527469/79249bff-86cf-55b2-bb84-8e3eab527469_image_0.webp HTTP/1.1" 201 0
2025-12-05 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fc58ad43a-6c6b-4c44-995b-d67cf0e98f59_6b270288-33ba-4a6f-9e39-3c834792a1a7.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/c58ad43a-6c6b-4c44-995b-d67cf0e98f59_6b270288-33ba-4a6f-9e39-3c834792a1a7.jpg/250x188.webp saved to cache
2025-12-05 12:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 79249bff-86cf-55b2-bb84-8e3eab527469
2025-12-05 12:01:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5cc93d0>
2025-12-05 12:01:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 12:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79249bff-86cf-55b2-bb84-8e3eab527469/79249bff-86cf-55b2-bb84-8e3eab527469_image_1.webp HTTP/1.1" 201 0
2025-12-05 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fc58ad43a-6c6b-4c44-995b-d67cf0e98f59_f112285c-62da-4139-9b02-7ccc5c15186b.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/c58ad43a-6c6b-4c44-995b-d67cf0e98f59_f112285c-62da-4139-9b02-7ccc5c15186b.jpg/250x188.webp saved to cache
2025-12-05 12:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 79249bff-86cf-55b2-bb84-8e3eab527469
2025-12-05 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fc58ad43a-6c6b-4c44-995b-d67cf0e98f59_128674f2-f08f-427e-ad90-47242071d8c1.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/c58ad43a-6c6b-4c44-995b-d67cf0e98f59_128674f2-f08f-427e-ad90-47242071d8c1.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/c58ad43a-6c6b-4c44-995b-d67cf0e98f59_97597d16-de60-46c8-a772-567362ffc8ec.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/c58ad43a-6c6b-4c44-995b-d67cf0e98f59_8d362053-e859-49c9-9c42-1e620ad34a2c.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fc58ad43a-6c6b-4c44-995b-d67cf0e98f59_dc1a0fff-0ba3-4fa9-be70-c5f81abe763b.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/c58ad43a-6c6b-4c44-995b-d67cf0e98f59_dc1a0fff-0ba3-4fa9-be70-c5f81abe763b.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9dc103890>
2025-12-05 12:01:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79249bff-86cf-55b2-bb84-8e3eab527469/79249bff-86cf-55b2-bb84-8e3eab527469_image_2.webp HTTP/1.1" 201 0
2025-12-05 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fc58ad43a-6c6b-4c44-995b-d67cf0e98f59_d212e81f-6b20-4377-be37-c026d32ef8bf.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/c58ad43a-6c6b-4c44-995b-d67cf0e98f59_d212e81f-6b20-4377-be37-c026d32ef8bf.jpg/250x188.webp saved to cache
2025-12-05 12:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 79249bff-86cf-55b2-bb84-8e3eab527469
2025-12-05 12:01:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5c39510>
2025-12-05 12:01:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 12:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79249bff-86cf-55b2-bb84-8e3eab527469/79249bff-86cf-55b2-bb84-8e3eab527469_image_3.webp HTTP/1.1" 201 0
2025-12-05 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fc58ad43a-6c6b-4c44-995b-d67cf0e98f59_c740d13e-8c88-43a3-ac72-c37ab804f49d.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/c58ad43a-6c6b-4c44-995b-d67cf0e98f59_c740d13e-8c88-43a3-ac72-c37ab804f49d.jpg/250x188.webp saved to cache
2025-12-05 12:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 79249bff-86cf-55b2-bb84-8e3eab527469
2025-12-05 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fc58ad43a-6c6b-4c44-995b-d67cf0e98f59_fa0e588a-cd29-41b7-a4e4-7bec5022eaa7.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/c58ad43a-6c6b-4c44-995b-d67cf0e98f59_fa0e588a-cd29-41b7-a4e4-7bec5022eaa7.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/c58ad43a-6c6b-4c44-995b-d67cf0e98f59_cb876a87-6f6a-4c78-886c-38218742a92f.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/c58ad43a-6c6b-4c44-995b-d67cf0e98f59_34cd50b2-edcb-4f5b-9181-4973fbdec220.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fc58ad43a-6c6b-4c44-995b-d67cf0e98f59_d9f308e0-1b19-44cb-b9fe-c4baba99c918.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/c58ad43a-6c6b-4c44-995b-d67cf0e98f59_d9f308e0-1b19-44cb-b9fe-c4baba99c918.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9dd5e4350>
2025-12-05 12:01:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 12:01:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79249bff-86cf-55b2-bb84-8e3eab527469/79249bff-86cf-55b2-bb84-8e3eab527469_image_5.webp HTTP/1.1" 201 0
2025-12-05 12:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fc58ad43a-6c6b-4c44-995b-d67cf0e98f59_97597d16-de60-46c8-a772-567362ffc8ec.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/c58ad43a-6c6b-4c44-995b-d67cf0e98f59_97597d16-de60-46c8-a772-567362ffc8ec.jpg/250x188.webp saved to cache
2025-12-05 12:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 79249bff-86cf-55b2-bb84-8e3eab527469
2025-12-05 12:01:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9dd5fdf50>
2025-12-05 12:01:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 12:01:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79249bff-86cf-55b2-bb84-8e3eab527469/79249bff-86cf-55b2-bb84-8e3eab527469_image_4.webp HTTP/1.1" 201 0
2025-12-05 12:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fc58ad43a-6c6b-4c44-995b-d67cf0e98f59_8d362053-e859-49c9-9c42-1e620ad34a2c.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/c58ad43a-6c6b-4c44-995b-d67cf0e98f59_8d362053-e859-49c9-9c42-1e620ad34a2c.jpg/250x188.webp saved to cache
2025-12-05 12:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 79249bff-86cf-55b2-bb84-8e3eab527469
2025-12-05 12:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fc58ad43a-6c6b-4c44-995b-d67cf0e98f59_6459c675-4b99-4461-9d1b-7f213ce1b307.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/c58ad43a-6c6b-4c44-995b-d67cf0e98f59_6459c675-4b99-4461-9d1b-7f213ce1b307.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/c58ad43a-6c6b-4c44-995b-d67cf0e98f59_dc1a0fff-0ba3-4fa9-be70-c5f81abe763b.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/c58ad43a-6c6b-4c44-995b-d67cf0e98f59_128674f2-f08f-427e-ad90-47242071d8c1.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fc58ad43a-6c6b-4c44-995b-d67cf0e98f59_16467075-5299-4748-b01d-e247c1256ec2.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/c58ad43a-6c6b-4c44-995b-d67cf0e98f59_16467075-5299-4748-b01d-e247c1256ec2.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9dc189690>
2025-12-05 12:01:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:01:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79249bff-86cf-55b2-bb84-8e3eab527469/79249bff-86cf-55b2-bb84-8e3eab527469_image_7.webp HTTP/1.1" 201 0
2025-12-05 12:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fc58ad43a-6c6b-4c44-995b-d67cf0e98f59_cb876a87-6f6a-4c78-886c-38218742a92f.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/c58ad43a-6c6b-4c44-995b-d67cf0e98f59_cb876a87-6f6a-4c78-886c-38218742a92f.jpg/250x188.webp saved to cache
2025-12-05 12:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 79249bff-86cf-55b2-bb84-8e3eab527469
2025-12-05 12:01:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d6ff9150>
2025-12-05 12:01:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:01:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79249bff-86cf-55b2-bb84-8e3eab527469/79249bff-86cf-55b2-bb84-8e3eab527469_image_6.webp HTTP/1.1" 201 0
2025-12-05 12:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fc58ad43a-6c6b-4c44-995b-d67cf0e98f59_34cd50b2-edcb-4f5b-9181-4973fbdec220.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/c58ad43a-6c6b-4c44-995b-d67cf0e98f59_34cd50b2-edcb-4f5b-9181-4973fbdec220.jpg/250x188.webp saved to cache
2025-12-05 12:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 79249bff-86cf-55b2-bb84-8e3eab527469
2025-12-05 12:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fc58ad43a-6c6b-4c44-995b-d67cf0e98f59_32cfabc0-f608-427c-a4ae-5b0604dd85ba.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/c58ad43a-6c6b-4c44-995b-d67cf0e98f59_32cfabc0-f608-427c-a4ae-5b0604dd85ba.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/c58ad43a-6c6b-4c44-995b-d67cf0e98f59_fa0e588a-cd29-41b7-a4e4-7bec5022eaa7.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/c58ad43a-6c6b-4c44-995b-d67cf0e98f59_d9f308e0-1b19-44cb-b9fe-c4baba99c918.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%2715d9b9b9-017e-408e-9465-11ce2435bb88%27 HTTP/1.1" 200 None
2025-12-05 12:01:32 [auto_selling_autoscout24.it] INFO: Scrape type for 15d9b9b9-017e-408e-9465-11ce2435bb88: 1
2025-12-05 12:01:32 [auto_selling_autoscout24.it] INFO: Scraping new listing 15d9b9b9-017e-408e-9465-11ce2435bb88
2025-12-05 12:01:32 [auto_selling_autoscout24.it] INFO: Extracting item from listing ID: 15d9b9b9-017e-408e-9465-11ce2435bb88
2025-12-05 12:01:32 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 7fa46a06-d600-58e2-8e3e-d6e54eb42d69 with identifier: 15d9b9b9-017e-408e-9465-11ce2435bb88
2025-12-05 12:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 7fa46a06-d600-58e2-8e3e-d6e54eb42d69
2025-12-05 12:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F15d9b9b9-017e-408e-9465-11ce2435bb88_66de78e9-b854-4cc0-bf8a-4d207beaeed4.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/15d9b9b9-017e-408e-9465-11ce2435bb88_66de78e9-b854-4cc0-bf8a-4d207beaeed4.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e514d0>
2025-12-05 12:01:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79249bff-86cf-55b2-bb84-8e3eab527469/79249bff-86cf-55b2-bb84-8e3eab527469_image_9.webp HTTP/1.1" 201 0
2025-12-05 12:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fc58ad43a-6c6b-4c44-995b-d67cf0e98f59_dc1a0fff-0ba3-4fa9-be70-c5f81abe763b.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/c58ad43a-6c6b-4c44-995b-d67cf0e98f59_dc1a0fff-0ba3-4fa9-be70-c5f81abe763b.jpg/250x188.webp saved to cache
2025-12-05 12:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 79249bff-86cf-55b2-bb84-8e3eab527469
2025-12-05 12:01:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5eb6d90>
2025-12-05 12:01:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 12:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79249bff-86cf-55b2-bb84-8e3eab527469/79249bff-86cf-55b2-bb84-8e3eab527469_image_8.webp HTTP/1.1" 201 0
2025-12-05 12:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fc58ad43a-6c6b-4c44-995b-d67cf0e98f59_128674f2-f08f-427e-ad90-47242071d8c1.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/c58ad43a-6c6b-4c44-995b-d67cf0e98f59_128674f2-f08f-427e-ad90-47242071d8c1.jpg/250x188.webp saved to cache
2025-12-05 12:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 79249bff-86cf-55b2-bb84-8e3eab527469
2025-12-05 12:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F15d9b9b9-017e-408e-9465-11ce2435bb88_611207a1-21b9-4d34-99cb-ac205c7721f9.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/15d9b9b9-017e-408e-9465-11ce2435bb88_611207a1-21b9-4d34-99cb-ac205c7721f9.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/c58ad43a-6c6b-4c44-995b-d67cf0e98f59_6459c675-4b99-4461-9d1b-7f213ce1b307.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/c58ad43a-6c6b-4c44-995b-d67cf0e98f59_16467075-5299-4748-b01d-e247c1256ec2.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F15d9b9b9-017e-408e-9465-11ce2435bb88_8e513e18-4d60-400b-9901-3d8f96609c21.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/15d9b9b9-017e-408e-9465-11ce2435bb88_8e513e18-4d60-400b-9901-3d8f96609c21.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9dc11ecd0>
2025-12-05 12:01:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79249bff-86cf-55b2-bb84-8e3eab527469/79249bff-86cf-55b2-bb84-8e3eab527469_image_10.webp HTTP/1.1" 201 0
2025-12-05 12:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fc58ad43a-6c6b-4c44-995b-d67cf0e98f59_fa0e588a-cd29-41b7-a4e4-7bec5022eaa7.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/c58ad43a-6c6b-4c44-995b-d67cf0e98f59_fa0e588a-cd29-41b7-a4e4-7bec5022eaa7.jpg/250x188.webp saved to cache
2025-12-05 12:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 79249bff-86cf-55b2-bb84-8e3eab527469
2025-12-05 12:01:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9dc1e5dd0>
2025-12-05 12:01:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 12:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79249bff-86cf-55b2-bb84-8e3eab527469/79249bff-86cf-55b2-bb84-8e3eab527469_image_11.webp HTTP/1.1" 201 0
2025-12-05 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fc58ad43a-6c6b-4c44-995b-d67cf0e98f59_d9f308e0-1b19-44cb-b9fe-c4baba99c918.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/c58ad43a-6c6b-4c44-995b-d67cf0e98f59_d9f308e0-1b19-44cb-b9fe-c4baba99c918.jpg/250x188.webp saved to cache
2025-12-05 12:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 79249bff-86cf-55b2-bb84-8e3eab527469
2025-12-05 12:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/15d9b9b9-017e-408e-9465-11ce2435bb88_66de78e9-b854-4cc0-bf8a-4d207beaeed4.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/c58ad43a-6c6b-4c44-995b-d67cf0e98f59_32cfabc0-f608-427c-a4ae-5b0604dd85ba.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F15d9b9b9-017e-408e-9465-11ce2435bb88_02babe74-c6e4-421c-a243-b3aced69cbef.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/15d9b9b9-017e-408e-9465-11ce2435bb88_02babe74-c6e4-421c-a243-b3aced69cbef.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5c754d0>
2025-12-05 12:01:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 12:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79249bff-86cf-55b2-bb84-8e3eab527469/79249bff-86cf-55b2-bb84-8e3eab527469_image_12.webp HTTP/1.1" 201 0
2025-12-05 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fc58ad43a-6c6b-4c44-995b-d67cf0e98f59_6459c675-4b99-4461-9d1b-7f213ce1b307.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/c58ad43a-6c6b-4c44-995b-d67cf0e98f59_6459c675-4b99-4461-9d1b-7f213ce1b307.jpg/250x188.webp saved to cache
2025-12-05 12:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 79249bff-86cf-55b2-bb84-8e3eab527469
2025-12-05 12:01:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d6f7c090>
2025-12-05 12:01:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 12:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79249bff-86cf-55b2-bb84-8e3eab527469/79249bff-86cf-55b2-bb84-8e3eab527469_image_13.webp HTTP/1.1" 201 0
2025-12-05 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fc58ad43a-6c6b-4c44-995b-d67cf0e98f59_16467075-5299-4748-b01d-e247c1256ec2.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/c58ad43a-6c6b-4c44-995b-d67cf0e98f59_16467075-5299-4748-b01d-e247c1256ec2.jpg/250x188.webp saved to cache
2025-12-05 12:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 79249bff-86cf-55b2-bb84-8e3eab527469
2025-12-05 12:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/15d9b9b9-017e-408e-9465-11ce2435bb88_611207a1-21b9-4d34-99cb-ac205c7721f9.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F15d9b9b9-017e-408e-9465-11ce2435bb88_1be30fb9-c03e-4f0b-afe1-519e44235f0a.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/15d9b9b9-017e-408e-9465-11ce2435bb88_1be30fb9-c03e-4f0b-afe1-519e44235f0a.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5c90550>
2025-12-05 12:01:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 12:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fa46a06-d600-58e2-8e3e-d6e54eb42d69/7fa46a06-d600-58e2-8e3e-d6e54eb42d69_image_0.webp HTTP/1.1" 201 0
2025-12-05 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F15d9b9b9-017e-408e-9465-11ce2435bb88_66de78e9-b854-4cc0-bf8a-4d207beaeed4.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/15d9b9b9-017e-408e-9465-11ce2435bb88_66de78e9-b854-4cc0-bf8a-4d207beaeed4.jpg/250x188.webp saved to cache
2025-12-05 12:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7fa46a06-d600-58e2-8e3e-d6e54eb42d69
2025-12-05 12:01:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e2e310>
2025-12-05 12:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 12:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79249bff-86cf-55b2-bb84-8e3eab527469/79249bff-86cf-55b2-bb84-8e3eab527469_image_14.webp HTTP/1.1" 201 0
2025-12-05 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fc58ad43a-6c6b-4c44-995b-d67cf0e98f59_32cfabc0-f608-427c-a4ae-5b0604dd85ba.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/c58ad43a-6c6b-4c44-995b-d67cf0e98f59_32cfabc0-f608-427c-a4ae-5b0604dd85ba.jpg/250x188.webp saved to cache
2025-12-05 12:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 79249bff-86cf-55b2-bb84-8e3eab527469
2025-12-05 12:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 79249bff-86cf-55b2-bb84-8e3eab527469 from tracking dictionaries
2025-12-05 12:01:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 79249bff-86cf-55b2-bb84-8e3eab527469 sending to next pipeline
2025-12-05 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F15d9b9b9-017e-408e-9465-11ce2435bb88_70f746b8-9b60-481a-9743-8a832d394327.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/15d9b9b9-017e-408e-9465-11ce2435bb88_70f746b8-9b60-481a-9743-8a832d394327.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:34 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 79249bff-86cf-55b2-bb84-8e3eab527469 with identifier c58ad43a-6c6b-4c44-995b-d67cf0e98f59
2025-12-05 12:01:34 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:01:34 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:01:34 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 79249bff-86cf-55b2-bb84-8e3eab527469
2025-12-05 12:01:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://prod.pictures.autoscout24.net/listing-images/c58ad43a-6c6b-4c44-995b-d67cf0e98f59_32cfabc0-f608-427c-a4ae-5b0604dd85ba.jpg/250x188.webp>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'emission_standard': None,
 'engine': None,
 'engine_horse_power': 177,
 'expiration_date': None,
 'fuel_type': 'LPG',
 'id': '79249bff-86cf-55b2-bb84-8e3eab527469',
 'is_damaged': False,
 'is_operable': True,
 'license_plate': None,
 'link_to_web_offer': 'https://www.autoscout24.it/offers/cirelli-cirelli-7-premium-1-5l-bifuel-pronta-consegna-only-promo-lpg-black-c58ad43a-6c6b-4c44-995b-d67cf0e98f59',
 'listing': 'auction',
 'make': 'Cirelli',
 'model': 'Cirelli 7',
 'odometer': 1,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79249bff-86cf-55b2-bb84-8e3eab527469/79249bff-86cf-55b2-bb84-8e3eab527469_image_0.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3574,
             'Height': 140,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/c58ad43a-6c6b-4c44-995b-d67cf0e98f59_6b270288-33ba-4a6f-9e39-3c834792a1a7.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79249bff-86cf-55b2-bb84-8e3eab527469/79249bff-86cf-55b2-bb84-8e3eab527469_image_1.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3170,
             'Height': 140,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/c58ad43a-6c6b-4c44-995b-d67cf0e98f59_f112285c-62da-4139-9b02-7ccc5c15186b.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79249bff-86cf-55b2-bb84-8e3eab527469/79249bff-86cf-55b2-bb84-8e3eab527469_image_2.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3046,
             'Height': 140,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/c58ad43a-6c6b-4c44-995b-d67cf0e98f59_d212e81f-6b20-4377-be37-c026d32ef8bf.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79249bff-86cf-55b2-bb84-8e3eab527469/79249bff-86cf-55b2-bb84-8e3eab527469_image_3.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3920,
             'Height': 140,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/c58ad43a-6c6b-4c44-995b-d67cf0e98f59_c740d13e-8c88-43a3-ac72-c37ab804f49d.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79249bff-86cf-55b2-bb84-8e3eab527469/79249bff-86cf-55b2-bb84-8e3eab527469_image_4.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4384,
             'Height': 140,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/c58ad43a-6c6b-4c44-995b-d67cf0e98f59_8d362053-e859-49c9-9c42-1e620ad34a2c.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79249bff-86cf-55b2-bb84-8e3eab527469/79249bff-86cf-55b2-bb84-8e3eab527469_image_5.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5416,
             'Height': 140,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/c58ad43a-6c6b-4c44-995b-d67cf0e98f59_97597d16-de60-46c8-a772-567362ffc8ec.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79249bff-86cf-55b2-bb84-8e3eab527469/79249bff-86cf-55b2-bb84-8e3eab527469_image_6.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5410,
             'Height': 140,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/c58ad43a-6c6b-4c44-995b-d67cf0e98f59_34cd50b2-edcb-4f5b-9181-4973fbdec220.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79249bff-86cf-55b2-bb84-8e3eab527469/79249bff-86cf-55b2-bb84-8e3eab527469_image_7.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4130,
             'Height': 140,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/c58ad43a-6c6b-4c44-995b-d67cf0e98f59_cb876a87-6f6a-4c78-886c-38218742a92f.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79249bff-86cf-55b2-bb84-8e3eab527469/79249bff-86cf-55b2-bb84-8e3eab527469_image_8.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5304,
             'Height': 140,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/c58ad43a-6c6b-4c44-995b-d67cf0e98f59_128674f2-f08f-427e-ad90-47242071d8c1.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79249bff-86cf-55b2-bb84-8e3eab527469/79249bff-86cf-55b2-bb84-8e3eab527469_image_9.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4734,
             'Height': 140,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/c58ad43a-6c6b-4c44-995b-d67cf0e98f59_dc1a0fff-0ba3-4fa9-be70-c5f81abe763b.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79249bff-86cf-55b2-bb84-8e3eab527469/79249bff-86cf-55b2-bb84-8e3eab527469_image_10.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3976,
             'Height': 140,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/c58ad43a-6c6b-4c44-995b-d67cf0e98f59_fa0e588a-cd29-41b7-a4e4-7bec5022eaa7.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79249bff-86cf-55b2-bb84-8e3eab527469/79249bff-86cf-55b2-bb84-8e3eab527469_image_11.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5974,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/c58ad43a-6c6b-4c44-995b-d67cf0e98f59_d9f308e0-1b19-44cb-b9fe-c4baba99c918.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79249bff-86cf-55b2-bb84-8e3eab527469/79249bff-86cf-55b2-bb84-8e3eab527469_image_12.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 1614,
             'Height': 140,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/c58ad43a-6c6b-4c44-995b-d67cf0e98f59_6459c675-4b99-4461-9d1b-7f213ce1b307.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79249bff-86cf-55b2-bb84-8e3eab527469/79249bff-86cf-55b2-bb84-8e3eab527469_image_13.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4464,
             'Height': 140,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/c58ad43a-6c6b-4c44-995b-d67cf0e98f59_16467075-5299-4748-b01d-e247c1256ec2.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79249bff-86cf-55b2-bb84-8e3eab527469/79249bff-86cf-55b2-bb84-8e3eab527469_image_14.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3332,
             'Height': 140,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/c58ad43a-6c6b-4c44-995b-d67cf0e98f59_32cfabc0-f608-427c-a4ae-5b0604dd85ba.jpg/250x188.webp',
             'Width': 250}],
 'price': 33900,
 'price_includes_vat': False,
 'registration_date': '2025-11-01',
 'seller_name': None,
 'title': 'Cirelli Cirelli 7 PREMIUM 1.5L BiFuel PRONTA CONSEGNA ONLY - PROMO',
 'transmission': 'automatic',
 'trim': 'PREMIUM 1.5L BiFuel PRONTA CONSEGNA ONLY - PROMO',
 'vin': None,
 'year': 2025}
2025-12-05 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27c58ad43a-6c6b-4c44-995b-d67cf0e98f59%27 HTTP/1.1" 200 None
2025-12-05 12:01:34 [auto_selling_autoscout24.it] INFO: Saving data for c58ad43a-6c6b-4c44-995b-d67cf0e98f59: {'created_time': 1764936094.386107, 'last_price_update_time': 1764936094.386121}
2025-12-05 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autoscout24.it',RowKey='c58ad43a-6c6b-4c44-995b-d67cf0e98f59') HTTP/1.1" 204 0
2025-12-05 12:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/15d9b9b9-017e-408e-9465-11ce2435bb88_8e513e18-4d60-400b-9901-3d8f96609c21.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/15d9b9b9-017e-408e-9465-11ce2435bb88_02babe74-c6e4-421c-a243-b3aced69cbef.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%2770112b7a-8f65-406c-92d1-be8409700b2d%27 HTTP/1.1" 200 None
2025-12-05 12:01:34 [auto_selling_autoscout24.it] INFO: Scrape type for 70112b7a-8f65-406c-92d1-be8409700b2d: 1
2025-12-05 12:01:34 [auto_selling_autoscout24.it] INFO: Scraping new listing 70112b7a-8f65-406c-92d1-be8409700b2d
2025-12-05 12:01:34 [auto_selling_autoscout24.it] INFO: Extracting item from listing ID: 70112b7a-8f65-406c-92d1-be8409700b2d
2025-12-05 12:01:34 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d43eedb-c973-5514-8b48-10b8d6506edd with identifier: 70112b7a-8f65-406c-92d1-be8409700b2d
2025-12-05 12:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 9d43eedb-c973-5514-8b48-10b8d6506edd
2025-12-05 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F70112b7a-8f65-406c-92d1-be8409700b2d_3ca1c0e8-52c7-4520-bde9-d8000df00434.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/70112b7a-8f65-406c-92d1-be8409700b2d_3ca1c0e8-52c7-4520-bde9-d8000df00434.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d6fcf610>
2025-12-05 12:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fa46a06-d600-58e2-8e3e-d6e54eb42d69/7fa46a06-d600-58e2-8e3e-d6e54eb42d69_image_1.webp HTTP/1.1" 201 0
2025-12-05 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F15d9b9b9-017e-408e-9465-11ce2435bb88_611207a1-21b9-4d34-99cb-ac205c7721f9.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/15d9b9b9-017e-408e-9465-11ce2435bb88_611207a1-21b9-4d34-99cb-ac205c7721f9.jpg/250x188.webp saved to cache
2025-12-05 12:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7fa46a06-d600-58e2-8e3e-d6e54eb42d69
2025-12-05 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F70112b7a-8f65-406c-92d1-be8409700b2d_4d5166bb-f2f9-44ac-bb35-2c7547338bb9.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/70112b7a-8f65-406c-92d1-be8409700b2d_4d5166bb-f2f9-44ac-bb35-2c7547338bb9.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/15d9b9b9-017e-408e-9465-11ce2435bb88_1be30fb9-c03e-4f0b-afe1-519e44235f0a.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F70112b7a-8f65-406c-92d1-be8409700b2d_6183f7a4-8097-40d3-b60d-aedb058c8c73.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/70112b7a-8f65-406c-92d1-be8409700b2d_6183f7a4-8097-40d3-b60d-aedb058c8c73.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e52610>
2025-12-05 12:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 12:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fa46a06-d600-58e2-8e3e-d6e54eb42d69/7fa46a06-d600-58e2-8e3e-d6e54eb42d69_image_2.webp HTTP/1.1" 201 0
2025-12-05 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F15d9b9b9-017e-408e-9465-11ce2435bb88_8e513e18-4d60-400b-9901-3d8f96609c21.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/15d9b9b9-017e-408e-9465-11ce2435bb88_8e513e18-4d60-400b-9901-3d8f96609c21.jpg/250x188.webp saved to cache
2025-12-05 12:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7fa46a06-d600-58e2-8e3e-d6e54eb42d69
2025-12-05 12:01:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9de9dcb10>
2025-12-05 12:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fa46a06-d600-58e2-8e3e-d6e54eb42d69/7fa46a06-d600-58e2-8e3e-d6e54eb42d69_image_3.webp HTTP/1.1" 201 0
2025-12-05 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F15d9b9b9-017e-408e-9465-11ce2435bb88_02babe74-c6e4-421c-a243-b3aced69cbef.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/15d9b9b9-017e-408e-9465-11ce2435bb88_02babe74-c6e4-421c-a243-b3aced69cbef.jpg/250x188.webp saved to cache
2025-12-05 12:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7fa46a06-d600-58e2-8e3e-d6e54eb42d69
2025-12-05 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F70112b7a-8f65-406c-92d1-be8409700b2d_7d778485-2893-4a6b-9d0c-d0697d31034d.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/70112b7a-8f65-406c-92d1-be8409700b2d_7d778485-2893-4a6b-9d0c-d0697d31034d.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/70112b7a-8f65-406c-92d1-be8409700b2d_3ca1c0e8-52c7-4520-bde9-d8000df00434.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/15d9b9b9-017e-408e-9465-11ce2435bb88_70f746b8-9b60-481a-9743-8a832d394327.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F70112b7a-8f65-406c-92d1-be8409700b2d_1a880084-fab5-4d0d-a0b8-e6e10ed5299f.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/70112b7a-8f65-406c-92d1-be8409700b2d_1a880084-fab5-4d0d-a0b8-e6e10ed5299f.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9dc1e7890>
2025-12-05 12:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fa46a06-d600-58e2-8e3e-d6e54eb42d69/7fa46a06-d600-58e2-8e3e-d6e54eb42d69_image_4.webp HTTP/1.1" 201 0
2025-12-05 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F15d9b9b9-017e-408e-9465-11ce2435bb88_1be30fb9-c03e-4f0b-afe1-519e44235f0a.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/15d9b9b9-017e-408e-9465-11ce2435bb88_1be30fb9-c03e-4f0b-afe1-519e44235f0a.jpg/250x188.webp saved to cache
2025-12-05 12:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7fa46a06-d600-58e2-8e3e-d6e54eb42d69
2025-12-05 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%276ccd25bd-be0f-48a2-8f0c-ef4d2c8b1685%27 HTTP/1.1" 200 None
2025-12-05 12:01:35 [auto_selling_autoscout24.it] INFO: Scrape type for 6ccd25bd-be0f-48a2-8f0c-ef4d2c8b1685: 1
2025-12-05 12:01:35 [auto_selling_autoscout24.it] INFO: Scraping new listing 6ccd25bd-be0f-48a2-8f0c-ef4d2c8b1685
2025-12-05 12:01:35 [auto_selling_autoscout24.it] INFO: Extracting item from listing ID: 6ccd25bd-be0f-48a2-8f0c-ef4d2c8b1685
2025-12-05 12:01:35 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: e308bc02-b43c-5a8e-a269-496967f83291 with identifier: 6ccd25bd-be0f-48a2-8f0c-ef4d2c8b1685
2025-12-05 12:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item e308bc02-b43c-5a8e-a269-496967f83291
2025-12-05 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F6ccd25bd-be0f-48a2-8f0c-ef4d2c8b1685_7f72a50b-12dd-4f0a-bce2-320ced61008a.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/6ccd25bd-be0f-48a2-8f0c-ef4d2c8b1685_7f72a50b-12dd-4f0a-bce2-320ced61008a.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/70112b7a-8f65-406c-92d1-be8409700b2d_6183f7a4-8097-40d3-b60d-aedb058c8c73.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/70112b7a-8f65-406c-92d1-be8409700b2d_4d5166bb-f2f9-44ac-bb35-2c7547338bb9.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F6ccd25bd-be0f-48a2-8f0c-ef4d2c8b1685_95a5fdc8-bed8-4e86-83ec-88eb23ca80ec.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/6ccd25bd-be0f-48a2-8f0c-ef4d2c8b1685_95a5fdc8-bed8-4e86-83ec-88eb23ca80ec.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e3e2d0>
2025-12-05 12:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d43eedb-c973-5514-8b48-10b8d6506edd/9d43eedb-c973-5514-8b48-10b8d6506edd_image_0.webp HTTP/1.1" 201 0
2025-12-05 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F70112b7a-8f65-406c-92d1-be8409700b2d_3ca1c0e8-52c7-4520-bde9-d8000df00434.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/70112b7a-8f65-406c-92d1-be8409700b2d_3ca1c0e8-52c7-4520-bde9-d8000df00434.jpg/250x188.webp saved to cache
2025-12-05 12:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9d43eedb-c973-5514-8b48-10b8d6506edd
2025-12-05 12:01:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e701d0>
2025-12-05 12:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fa46a06-d600-58e2-8e3e-d6e54eb42d69/7fa46a06-d600-58e2-8e3e-d6e54eb42d69_image_5.webp HTTP/1.1" 201 0
2025-12-05 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F15d9b9b9-017e-408e-9465-11ce2435bb88_70f746b8-9b60-481a-9743-8a832d394327.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/15d9b9b9-017e-408e-9465-11ce2435bb88_70f746b8-9b60-481a-9743-8a832d394327.jpg/250x188.webp saved to cache
2025-12-05 12:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7fa46a06-d600-58e2-8e3e-d6e54eb42d69
2025-12-05 12:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 7fa46a06-d600-58e2-8e3e-d6e54eb42d69 from tracking dictionaries
2025-12-05 12:01:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7fa46a06-d600-58e2-8e3e-d6e54eb42d69 sending to next pipeline
2025-12-05 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F6ccd25bd-be0f-48a2-8f0c-ef4d2c8b1685_0d625b2a-b8af-41aa-84f8-429e8f948d15.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/6ccd25bd-be0f-48a2-8f0c-ef4d2c8b1685_0d625b2a-b8af-41aa-84f8-429e8f948d15.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:36 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 7fa46a06-d600-58e2-8e3e-d6e54eb42d69 with identifier 15d9b9b9-017e-408e-9465-11ce2435bb88
2025-12-05 12:01:36 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:01:36 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:01:36 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 7fa46a06-d600-58e2-8e3e-d6e54eb42d69
2025-12-05 12:01:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://prod.pictures.autoscout24.net/listing-images/15d9b9b9-017e-408e-9465-11ce2435bb88_70f746b8-9b60-481a-9743-8a832d394327.jpg/250x188.webp>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'emission_standard': None,
 'engine': None,
 'engine_horse_power': 640,
 'expiration_date': None,
 'fuel_type': 'Electric/Gasoline',
 'id': '7fa46a06-d600-58e2-8e3e-d6e54eb42d69',
 'is_damaged': False,
 'is_operable': True,
 'license_plate': None,
 'link_to_web_offer': 'https://www.autoscout24.it/offers/audi-rs-q8-performance-tfsi-quattro-tiptronic-facelift-640cv-electric-gasoline-black-15d9b9b9-017e-408e-9465-11ce2435bb88',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'RS Q8',
 'odometer': 1,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fa46a06-d600-58e2-8e3e-d6e54eb42d69/7fa46a06-d600-58e2-8e3e-d6e54eb42d69_image_0.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3266,
             'Height': 149,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/15d9b9b9-017e-408e-9465-11ce2435bb88_66de78e9-b854-4cc0-bf8a-4d207beaeed4.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fa46a06-d600-58e2-8e3e-d6e54eb42d69/7fa46a06-d600-58e2-8e3e-d6e54eb42d69_image_1.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 1884,
             'Height': 125,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/15d9b9b9-017e-408e-9465-11ce2435bb88_611207a1-21b9-4d34-99cb-ac205c7721f9.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fa46a06-d600-58e2-8e3e-d6e54eb42d69/7fa46a06-d600-58e2-8e3e-d6e54eb42d69_image_2.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 2872,
             'Height': 146,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/15d9b9b9-017e-408e-9465-11ce2435bb88_8e513e18-4d60-400b-9901-3d8f96609c21.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fa46a06-d600-58e2-8e3e-d6e54eb42d69/7fa46a06-d600-58e2-8e3e-d6e54eb42d69_image_3.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 2950,
             'Height': 110,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/15d9b9b9-017e-408e-9465-11ce2435bb88_02babe74-c6e4-421c-a243-b3aced69cbef.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fa46a06-d600-58e2-8e3e-d6e54eb42d69/7fa46a06-d600-58e2-8e3e-d6e54eb42d69_image_4.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3542,
             'Height': 111,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/15d9b9b9-017e-408e-9465-11ce2435bb88_1be30fb9-c03e-4f0b-afe1-519e44235f0a.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fa46a06-d600-58e2-8e3e-d6e54eb42d69/7fa46a06-d600-58e2-8e3e-d6e54eb42d69_image_5.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 2370,
             'Height': 112,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/15d9b9b9-017e-408e-9465-11ce2435bb88_70f746b8-9b60-481a-9743-8a832d394327.jpg/250x188.webp',
             'Width': 250}],
 'price': 153800,
 'price_includes_vat': False,
 'registration_date': '2025-09-01',
 'seller_name': None,
 'title': 'Audi RS Q8 PERFORMANCE TFSI QUATTRO TIPTRONIC FACELIFT 640CV',
 'transmission': 'automatic',
 'trim': 'PERFORMANCE TFSI QUATTRO TIPTRONIC FACELIFT 640CV',
 'vin': None,
 'year': 2025}
2025-12-05 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%2715d9b9b9-017e-408e-9465-11ce2435bb88%27 HTTP/1.1" 200 None
2025-12-05 12:01:36 [auto_selling_autoscout24.it] INFO: Saving data for 15d9b9b9-017e-408e-9465-11ce2435bb88: {'created_time': 1764936096.114025, 'last_price_update_time': 1764936096.114035}
2025-12-05 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autoscout24.it',RowKey='15d9b9b9-017e-408e-9465-11ce2435bb88') HTTP/1.1" 204 0
2025-12-05 12:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/70112b7a-8f65-406c-92d1-be8409700b2d_1a880084-fab5-4d0d-a0b8-e6e10ed5299f.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/70112b7a-8f65-406c-92d1-be8409700b2d_7d778485-2893-4a6b-9d0c-d0697d31034d.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F6ccd25bd-be0f-48a2-8f0c-ef4d2c8b1685_028f9107-2d5d-4ff5-a2b0-ecab98c8917c.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/6ccd25bd-be0f-48a2-8f0c-ef4d2c8b1685_028f9107-2d5d-4ff5-a2b0-ecab98c8917c.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d6f14d10>
2025-12-05 12:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d43eedb-c973-5514-8b48-10b8d6506edd/9d43eedb-c973-5514-8b48-10b8d6506edd_image_2.webp HTTP/1.1" 201 0
2025-12-05 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F70112b7a-8f65-406c-92d1-be8409700b2d_6183f7a4-8097-40d3-b60d-aedb058c8c73.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/70112b7a-8f65-406c-92d1-be8409700b2d_6183f7a4-8097-40d3-b60d-aedb058c8c73.jpg/250x188.webp saved to cache
2025-12-05 12:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9d43eedb-c973-5514-8b48-10b8d6506edd
2025-12-05 12:01:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e2c950>
2025-12-05 12:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d43eedb-c973-5514-8b48-10b8d6506edd/9d43eedb-c973-5514-8b48-10b8d6506edd_image_1.webp HTTP/1.1" 201 0
2025-12-05 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F70112b7a-8f65-406c-92d1-be8409700b2d_4d5166bb-f2f9-44ac-bb35-2c7547338bb9.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/70112b7a-8f65-406c-92d1-be8409700b2d_4d5166bb-f2f9-44ac-bb35-2c7547338bb9.jpg/250x188.webp saved to cache
2025-12-05 12:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9d43eedb-c973-5514-8b48-10b8d6506edd
2025-12-05 12:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/6ccd25bd-be0f-48a2-8f0c-ef4d2c8b1685_7f72a50b-12dd-4f0a-bce2-320ced61008a.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F6ccd25bd-be0f-48a2-8f0c-ef4d2c8b1685_78cee885-476a-43a0-8737-3f15cd4afe93.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/6ccd25bd-be0f-48a2-8f0c-ef4d2c8b1685_78cee885-476a-43a0-8737-3f15cd4afe93.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/6ccd25bd-be0f-48a2-8f0c-ef4d2c8b1685_95a5fdc8-bed8-4e86-83ec-88eb23ca80ec.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27caee2e51-34ee-48dc-ac4f-82acea4e0ef5%27 HTTP/1.1" 200 None
2025-12-05 12:01:36 [auto_selling_autoscout24.it] INFO: Scrape type for caee2e51-34ee-48dc-ac4f-82acea4e0ef5: 1
2025-12-05 12:01:36 [auto_selling_autoscout24.it] INFO: Scraping new listing caee2e51-34ee-48dc-ac4f-82acea4e0ef5
2025-12-05 12:01:36 [auto_selling_autoscout24.it] INFO: Extracting item from listing ID: caee2e51-34ee-48dc-ac4f-82acea4e0ef5
2025-12-05 12:01:36 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 94d35162-155c-5119-a853-5497433d723d with identifier: caee2e51-34ee-48dc-ac4f-82acea4e0ef5
2025-12-05 12:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 94d35162-155c-5119-a853-5497433d723d
2025-12-05 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fcaee2e51-34ee-48dc-ac4f-82acea4e0ef5_5cd06304-3862-4017-a067-a51a275fc905.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/caee2e51-34ee-48dc-ac4f-82acea4e0ef5_5cd06304-3862-4017-a067-a51a275fc905.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9dc126b90>
2025-12-05 12:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 12:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d43eedb-c973-5514-8b48-10b8d6506edd/9d43eedb-c973-5514-8b48-10b8d6506edd_image_4.webp HTTP/1.1" 201 0
2025-12-05 12:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F70112b7a-8f65-406c-92d1-be8409700b2d_1a880084-fab5-4d0d-a0b8-e6e10ed5299f.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/70112b7a-8f65-406c-92d1-be8409700b2d_1a880084-fab5-4d0d-a0b8-e6e10ed5299f.jpg/250x188.webp saved to cache
2025-12-05 12:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9d43eedb-c973-5514-8b48-10b8d6506edd
2025-12-05 12:01:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d6fc3650>
2025-12-05 12:01:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 12:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d43eedb-c973-5514-8b48-10b8d6506edd/9d43eedb-c973-5514-8b48-10b8d6506edd_image_3.webp HTTP/1.1" 201 0
2025-12-05 12:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F70112b7a-8f65-406c-92d1-be8409700b2d_7d778485-2893-4a6b-9d0c-d0697d31034d.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/70112b7a-8f65-406c-92d1-be8409700b2d_7d778485-2893-4a6b-9d0c-d0697d31034d.jpg/250x188.webp saved to cache
2025-12-05 12:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9d43eedb-c973-5514-8b48-10b8d6506edd
2025-12-05 12:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 9d43eedb-c973-5514-8b48-10b8d6506edd from tracking dictionaries
2025-12-05 12:01:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9d43eedb-c973-5514-8b48-10b8d6506edd sending to next pipeline
2025-12-05 12:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/6ccd25bd-be0f-48a2-8f0c-ef4d2c8b1685_028f9107-2d5d-4ff5-a2b0-ecab98c8917c.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fcaee2e51-34ee-48dc-ac4f-82acea4e0ef5_bc78c147-4141-442a-bb8a-d05c6ff5808b.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/caee2e51-34ee-48dc-ac4f-82acea4e0ef5_bc78c147-4141-442a-bb8a-d05c6ff5808b.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:37 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 9d43eedb-c973-5514-8b48-10b8d6506edd with identifier 70112b7a-8f65-406c-92d1-be8409700b2d
2025-12-05 12:01:37 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:01:37 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:01:37 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 9d43eedb-c973-5514-8b48-10b8d6506edd
2025-12-05 12:01:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://prod.pictures.autoscout24.net/listing-images/70112b7a-8f65-406c-92d1-be8409700b2d_7d778485-2893-4a6b-9d0c-d0697d31034d.jpg/250x188.webp>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'emission_standard': None,
 'engine': None,
 'engine_horse_power': 204,
 'expiration_date': None,
 'fuel_type': 'Electric/Gasoline',
 'id': '9d43eedb-c973-5514-8b48-10b8d6506edd',
 'is_damaged': False,
 'is_operable': True,
 'license_plate': None,
 'link_to_web_offer': 'https://www.autoscout24.it/offers/audi-q5-spb-tfsi-qtr-s-tr-s-line-204cv-uff-italiapromo-electric-gasoline-black-70112b7a-8f65-406c-92d1-be8409700b2d',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 1,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d43eedb-c973-5514-8b48-10b8d6506edd/9d43eedb-c973-5514-8b48-10b8d6506edd_image_0.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3250,
             'Height': 171,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/70112b7a-8f65-406c-92d1-be8409700b2d_3ca1c0e8-52c7-4520-bde9-d8000df00434.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d43eedb-c973-5514-8b48-10b8d6506edd/9d43eedb-c973-5514-8b48-10b8d6506edd_image_1.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 2350,
             'Height': 125,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/70112b7a-8f65-406c-92d1-be8409700b2d_4d5166bb-f2f9-44ac-bb35-2c7547338bb9.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d43eedb-c973-5514-8b48-10b8d6506edd/9d43eedb-c973-5514-8b48-10b8d6506edd_image_2.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3038,
             'Height': 153,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/70112b7a-8f65-406c-92d1-be8409700b2d_6183f7a4-8097-40d3-b60d-aedb058c8c73.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d43eedb-c973-5514-8b48-10b8d6506edd/9d43eedb-c973-5514-8b48-10b8d6506edd_image_3.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 2752,
             'Height': 109,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/70112b7a-8f65-406c-92d1-be8409700b2d_7d778485-2893-4a6b-9d0c-d0697d31034d.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d43eedb-c973-5514-8b48-10b8d6506edd/9d43eedb-c973-5514-8b48-10b8d6506edd_image_4.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3206,
             'Height': 110,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/70112b7a-8f65-406c-92d1-be8409700b2d_1a880084-fab5-4d0d-a0b8-e6e10ed5299f.jpg/250x188.webp',
             'Width': 250}],
 'price': 82900,
 'price_includes_vat': False,
 'registration_date': '2025-08-01',
 'seller_name': None,
 'title': 'Audi Q5 SPB TFSI QTR S-TR S-LINE 204CV UFF. ITALIAPROMO',
 'transmission': 'automatic',
 'trim': 'SPB TFSI QTR S-TR S-LINE 204CV UFF. ITALIAPROMO',
 'vin': None,
 'year': 2025}
2025-12-05 12:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%2770112b7a-8f65-406c-92d1-be8409700b2d%27 HTTP/1.1" 200 None
2025-12-05 12:01:37 [auto_selling_autoscout24.it] INFO: Saving data for 70112b7a-8f65-406c-92d1-be8409700b2d: {'created_time': 1764936097.401221, 'last_price_update_time': 1764936097.401231}
2025-12-05 12:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autoscout24.it',RowKey='70112b7a-8f65-406c-92d1-be8409700b2d') HTTP/1.1" 204 0
2025-12-05 12:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/6ccd25bd-be0f-48a2-8f0c-ef4d2c8b1685_0d625b2a-b8af-41aa-84f8-429e8f948d15.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fcaee2e51-34ee-48dc-ac4f-82acea4e0ef5_891e74e2-32ac-4e75-9d33-eebe30110a0c.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/caee2e51-34ee-48dc-ac4f-82acea4e0ef5_891e74e2-32ac-4e75-9d33-eebe30110a0c.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e3c310>
2025-12-05 12:01:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 12:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e308bc02-b43c-5a8e-a269-496967f83291/e308bc02-b43c-5a8e-a269-496967f83291_image_0.webp HTTP/1.1" 201 0
2025-12-05 12:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F6ccd25bd-be0f-48a2-8f0c-ef4d2c8b1685_7f72a50b-12dd-4f0a-bce2-320ced61008a.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/6ccd25bd-be0f-48a2-8f0c-ef4d2c8b1685_7f72a50b-12dd-4f0a-bce2-320ced61008a.jpg/250x188.webp saved to cache
2025-12-05 12:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e308bc02-b43c-5a8e-a269-496967f83291
2025-12-05 12:01:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d6f0a810>
2025-12-05 12:01:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 12:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e308bc02-b43c-5a8e-a269-496967f83291/e308bc02-b43c-5a8e-a269-496967f83291_image_1.webp HTTP/1.1" 201 0
2025-12-05 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F6ccd25bd-be0f-48a2-8f0c-ef4d2c8b1685_95a5fdc8-bed8-4e86-83ec-88eb23ca80ec.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/6ccd25bd-be0f-48a2-8f0c-ef4d2c8b1685_95a5fdc8-bed8-4e86-83ec-88eb23ca80ec.jpg/250x188.webp saved to cache
2025-12-05 12:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e308bc02-b43c-5a8e-a269-496967f83291
2025-12-05 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fcaee2e51-34ee-48dc-ac4f-82acea4e0ef5_9ae47ca1-f91d-43ef-941f-827833362678.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/caee2e51-34ee-48dc-ac4f-82acea4e0ef5_9ae47ca1-f91d-43ef-941f-827833362678.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/caee2e51-34ee-48dc-ac4f-82acea4e0ef5_5cd06304-3862-4017-a067-a51a275fc905.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/6ccd25bd-be0f-48a2-8f0c-ef4d2c8b1685_78cee885-476a-43a0-8737-3f15cd4afe93.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fcaee2e51-34ee-48dc-ac4f-82acea4e0ef5_2a7779b2-9dc3-4420-941e-9d7eab9cb9cb.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/caee2e51-34ee-48dc-ac4f-82acea4e0ef5_2a7779b2-9dc3-4420-941e-9d7eab9cb9cb.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9dd5cbc90>
2025-12-05 12:01:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 12:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e308bc02-b43c-5a8e-a269-496967f83291/e308bc02-b43c-5a8e-a269-496967f83291_image_3.webp HTTP/1.1" 201 0
2025-12-05 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F6ccd25bd-be0f-48a2-8f0c-ef4d2c8b1685_028f9107-2d5d-4ff5-a2b0-ecab98c8917c.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/6ccd25bd-be0f-48a2-8f0c-ef4d2c8b1685_028f9107-2d5d-4ff5-a2b0-ecab98c8917c.jpg/250x188.webp saved to cache
2025-12-05 12:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e308bc02-b43c-5a8e-a269-496967f83291
2025-12-05 12:01:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e7ec50>
2025-12-05 12:01:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 12:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e308bc02-b43c-5a8e-a269-496967f83291/e308bc02-b43c-5a8e-a269-496967f83291_image_2.webp HTTP/1.1" 201 0
2025-12-05 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F6ccd25bd-be0f-48a2-8f0c-ef4d2c8b1685_0d625b2a-b8af-41aa-84f8-429e8f948d15.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/6ccd25bd-be0f-48a2-8f0c-ef4d2c8b1685_0d625b2a-b8af-41aa-84f8-429e8f948d15.jpg/250x188.webp saved to cache
2025-12-05 12:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e308bc02-b43c-5a8e-a269-496967f83291
2025-12-05 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fcaee2e51-34ee-48dc-ac4f-82acea4e0ef5_fde3517d-e1ef-40d6-a9a3-74f70788ee44.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/caee2e51-34ee-48dc-ac4f-82acea4e0ef5_fde3517d-e1ef-40d6-a9a3-74f70788ee44.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/caee2e51-34ee-48dc-ac4f-82acea4e0ef5_bc78c147-4141-442a-bb8a-d05c6ff5808b.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/caee2e51-34ee-48dc-ac4f-82acea4e0ef5_891e74e2-32ac-4e75-9d33-eebe30110a0c.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fcaee2e51-34ee-48dc-ac4f-82acea4e0ef5_76fb5760-8561-46d5-8d59-1a81c245b570.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/caee2e51-34ee-48dc-ac4f-82acea4e0ef5_76fb5760-8561-46d5-8d59-1a81c245b570.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5c16c50>
2025-12-05 12:01:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94d35162-155c-5119-a853-5497433d723d/94d35162-155c-5119-a853-5497433d723d_image_0.webp HTTP/1.1" 201 0
2025-12-05 12:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fcaee2e51-34ee-48dc-ac4f-82acea4e0ef5_5cd06304-3862-4017-a067-a51a275fc905.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/caee2e51-34ee-48dc-ac4f-82acea4e0ef5_5cd06304-3862-4017-a067-a51a275fc905.jpg/250x188.webp saved to cache
2025-12-05 12:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 94d35162-155c-5119-a853-5497433d723d
2025-12-05 12:01:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d6f0ae10>
2025-12-05 12:01:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 12:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e308bc02-b43c-5a8e-a269-496967f83291/e308bc02-b43c-5a8e-a269-496967f83291_image_4.webp HTTP/1.1" 201 0
2025-12-05 12:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F6ccd25bd-be0f-48a2-8f0c-ef4d2c8b1685_78cee885-476a-43a0-8737-3f15cd4afe93.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/6ccd25bd-be0f-48a2-8f0c-ef4d2c8b1685_78cee885-476a-43a0-8737-3f15cd4afe93.jpg/250x188.webp saved to cache
2025-12-05 12:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e308bc02-b43c-5a8e-a269-496967f83291
2025-12-05 12:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Removing item e308bc02-b43c-5a8e-a269-496967f83291 from tracking dictionaries
2025-12-05 12:01:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e308bc02-b43c-5a8e-a269-496967f83291 sending to next pipeline
2025-12-05 12:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fcaee2e51-34ee-48dc-ac4f-82acea4e0ef5_ad5fae25-0161-4423-9c75-f60127d2e30a.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/caee2e51-34ee-48dc-ac4f-82acea4e0ef5_ad5fae25-0161-4423-9c75-f60127d2e30a.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:39 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: e308bc02-b43c-5a8e-a269-496967f83291 with identifier 6ccd25bd-be0f-48a2-8f0c-ef4d2c8b1685
2025-12-05 12:01:39 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:01:39 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:01:39 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item e308bc02-b43c-5a8e-a269-496967f83291
2025-12-05 12:01:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://prod.pictures.autoscout24.net/listing-images/6ccd25bd-be0f-48a2-8f0c-ef4d2c8b1685_78cee885-476a-43a0-8737-3f15cd4afe93.jpg/250x188.webp>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'emission_standard': None,
 'engine': None,
 'engine_horse_power': 204,
 'expiration_date': None,
 'fuel_type': 'Electric/Diesel',
 'id': 'e308bc02-b43c-5a8e-a269-496967f83291',
 'is_damaged': False,
 'is_operable': True,
 'license_plate': None,
 'link_to_web_offer': 'https://www.autoscout24.it/offers/audi-a5-avant-2-0-tdi-s-tronic-2x-s-line-204cv-km0-promo-electric-diesel-grey-6ccd25bd-be0f-48a2-8f0c-ef4d2c8b1685',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5',
 'odometer': 1,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e308bc02-b43c-5a8e-a269-496967f83291/e308bc02-b43c-5a8e-a269-496967f83291_image_0.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 2924,
             'Height': 165,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/6ccd25bd-be0f-48a2-8f0c-ef4d2c8b1685_7f72a50b-12dd-4f0a-bce2-320ced61008a.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e308bc02-b43c-5a8e-a269-496967f83291/e308bc02-b43c-5a8e-a269-496967f83291_image_1.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 2110,
             'Height': 123,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/6ccd25bd-be0f-48a2-8f0c-ef4d2c8b1685_95a5fdc8-bed8-4e86-83ec-88eb23ca80ec.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e308bc02-b43c-5a8e-a269-496967f83291/e308bc02-b43c-5a8e-a269-496967f83291_image_2.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 2934,
             'Height': 134,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/6ccd25bd-be0f-48a2-8f0c-ef4d2c8b1685_0d625b2a-b8af-41aa-84f8-429e8f948d15.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e308bc02-b43c-5a8e-a269-496967f83291/e308bc02-b43c-5a8e-a269-496967f83291_image_3.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3014,
             'Height': 136,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/6ccd25bd-be0f-48a2-8f0c-ef4d2c8b1685_028f9107-2d5d-4ff5-a2b0-ecab98c8917c.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e308bc02-b43c-5a8e-a269-496967f83291/e308bc02-b43c-5a8e-a269-496967f83291_image_4.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3130,
             'Height': 138,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/6ccd25bd-be0f-48a2-8f0c-ef4d2c8b1685_78cee885-476a-43a0-8737-3f15cd4afe93.jpg/250x188.webp',
             'Width': 250}],
 'price': 59900,
 'price_includes_vat': False,
 'registration_date': '2025-06-01',
 'seller_name': None,
 'title': 'Audi A5 AVANT 2.0 TDI S-TRONIC 2X S-LINE 204CV KM0 PROMO',
 'transmission': 'automatic',
 'trim': 'AVANT 2.0 TDI S-TRONIC 2X S-LINE 204CV KM0 PROMO',
 'vin': None,
 'year': 2025}
2025-12-05 12:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%276ccd25bd-be0f-48a2-8f0c-ef4d2c8b1685%27 HTTP/1.1" 200 None
2025-12-05 12:01:39 [auto_selling_autoscout24.it] INFO: Saving data for 6ccd25bd-be0f-48a2-8f0c-ef4d2c8b1685: {'created_time': 1764936099.348251, 'last_price_update_time': 1764936099.348267}
2025-12-05 12:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autoscout24.it',RowKey='6ccd25bd-be0f-48a2-8f0c-ef4d2c8b1685') HTTP/1.1" 204 0
2025-12-05 12:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/caee2e51-34ee-48dc-ac4f-82acea4e0ef5_2a7779b2-9dc3-4420-941e-9d7eab9cb9cb.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/caee2e51-34ee-48dc-ac4f-82acea4e0ef5_9ae47ca1-f91d-43ef-941f-827833362678.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fcaee2e51-34ee-48dc-ac4f-82acea4e0ef5_1587b2d1-a37f-42f9-bb75-76e2ffde9e7a.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/caee2e51-34ee-48dc-ac4f-82acea4e0ef5_1587b2d1-a37f-42f9-bb75-76e2ffde9e7a.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9dc1c8290>
2025-12-05 12:01:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94d35162-155c-5119-a853-5497433d723d/94d35162-155c-5119-a853-5497433d723d_image_1.webp HTTP/1.1" 201 0
2025-12-05 12:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fcaee2e51-34ee-48dc-ac4f-82acea4e0ef5_bc78c147-4141-442a-bb8a-d05c6ff5808b.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/caee2e51-34ee-48dc-ac4f-82acea4e0ef5_bc78c147-4141-442a-bb8a-d05c6ff5808b.jpg/250x188.webp saved to cache
2025-12-05 12:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 94d35162-155c-5119-a853-5497433d723d
2025-12-05 12:01:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9dc13c410>
2025-12-05 12:01:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 12:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94d35162-155c-5119-a853-5497433d723d/94d35162-155c-5119-a853-5497433d723d_image_2.webp HTTP/1.1" 201 0
2025-12-05 12:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fcaee2e51-34ee-48dc-ac4f-82acea4e0ef5_891e74e2-32ac-4e75-9d33-eebe30110a0c.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/caee2e51-34ee-48dc-ac4f-82acea4e0ef5_891e74e2-32ac-4e75-9d33-eebe30110a0c.jpg/250x188.webp saved to cache
2025-12-05 12:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 94d35162-155c-5119-a853-5497433d723d
2025-12-05 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fcaee2e51-34ee-48dc-ac4f-82acea4e0ef5_83d951f9-1103-4d7a-a437-1af207261b29.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/caee2e51-34ee-48dc-ac4f-82acea4e0ef5_83d951f9-1103-4d7a-a437-1af207261b29.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/caee2e51-34ee-48dc-ac4f-82acea4e0ef5_fde3517d-e1ef-40d6-a9a3-74f70788ee44.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/caee2e51-34ee-48dc-ac4f-82acea4e0ef5_76fb5760-8561-46d5-8d59-1a81c245b570.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fcaee2e51-34ee-48dc-ac4f-82acea4e0ef5_a14ea2f2-355c-449c-8d3a-257a0290c9d0.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/caee2e51-34ee-48dc-ac4f-82acea4e0ef5_a14ea2f2-355c-449c-8d3a-257a0290c9d0.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9dd5c81d0>
2025-12-05 12:01:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94d35162-155c-5119-a853-5497433d723d/94d35162-155c-5119-a853-5497433d723d_image_4.webp HTTP/1.1" 201 0
2025-12-05 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fcaee2e51-34ee-48dc-ac4f-82acea4e0ef5_2a7779b2-9dc3-4420-941e-9d7eab9cb9cb.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/caee2e51-34ee-48dc-ac4f-82acea4e0ef5_2a7779b2-9dc3-4420-941e-9d7eab9cb9cb.jpg/250x188.webp saved to cache
2025-12-05 12:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 94d35162-155c-5119-a853-5497433d723d
2025-12-05 12:01:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5cd6bd0>
2025-12-05 12:01:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94d35162-155c-5119-a853-5497433d723d/94d35162-155c-5119-a853-5497433d723d_image_3.webp HTTP/1.1" 201 0
2025-12-05 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fcaee2e51-34ee-48dc-ac4f-82acea4e0ef5_9ae47ca1-f91d-43ef-941f-827833362678.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/caee2e51-34ee-48dc-ac4f-82acea4e0ef5_9ae47ca1-f91d-43ef-941f-827833362678.jpg/250x188.webp saved to cache
2025-12-05 12:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 94d35162-155c-5119-a853-5497433d723d
2025-12-05 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fcaee2e51-34ee-48dc-ac4f-82acea4e0ef5_5ed9e1f4-7499-4f9c-ae21-f08c097c2ba2.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/caee2e51-34ee-48dc-ac4f-82acea4e0ef5_5ed9e1f4-7499-4f9c-ae21-f08c097c2ba2.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/caee2e51-34ee-48dc-ac4f-82acea4e0ef5_1587b2d1-a37f-42f9-bb75-76e2ffde9e7a.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/caee2e51-34ee-48dc-ac4f-82acea4e0ef5_ad5fae25-0161-4423-9c75-f60127d2e30a.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fcaee2e51-34ee-48dc-ac4f-82acea4e0ef5_cf8d3267-e0e8-404f-89f5-3caa5f6af662.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/caee2e51-34ee-48dc-ac4f-82acea4e0ef5_cf8d3267-e0e8-404f-89f5-3caa5f6af662.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9dd5db190>
2025-12-05 12:01:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 12:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94d35162-155c-5119-a853-5497433d723d/94d35162-155c-5119-a853-5497433d723d_image_5.webp HTTP/1.1" 201 0
2025-12-05 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fcaee2e51-34ee-48dc-ac4f-82acea4e0ef5_fde3517d-e1ef-40d6-a9a3-74f70788ee44.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/caee2e51-34ee-48dc-ac4f-82acea4e0ef5_fde3517d-e1ef-40d6-a9a3-74f70788ee44.jpg/250x188.webp saved to cache
2025-12-05 12:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 94d35162-155c-5119-a853-5497433d723d
2025-12-05 12:01:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e98390>
2025-12-05 12:01:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 12:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94d35162-155c-5119-a853-5497433d723d/94d35162-155c-5119-a853-5497433d723d_image_6.webp HTTP/1.1" 201 0
2025-12-05 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fcaee2e51-34ee-48dc-ac4f-82acea4e0ef5_76fb5760-8561-46d5-8d59-1a81c245b570.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/caee2e51-34ee-48dc-ac4f-82acea4e0ef5_76fb5760-8561-46d5-8d59-1a81c245b570.jpg/250x188.webp saved to cache
2025-12-05 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 94d35162-155c-5119-a853-5497433d723d
2025-12-05 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fcaee2e51-34ee-48dc-ac4f-82acea4e0ef5_a1520348-0ac1-44e8-bae4-418c97143c0e.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/caee2e51-34ee-48dc-ac4f-82acea4e0ef5_a1520348-0ac1-44e8-bae4-418c97143c0e.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/caee2e51-34ee-48dc-ac4f-82acea4e0ef5_83d951f9-1103-4d7a-a437-1af207261b29.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/caee2e51-34ee-48dc-ac4f-82acea4e0ef5_a14ea2f2-355c-449c-8d3a-257a0290c9d0.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fcaee2e51-34ee-48dc-ac4f-82acea4e0ef5_87226366-f8a0-411a-b791-7891ccb40c44.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/caee2e51-34ee-48dc-ac4f-82acea4e0ef5_87226366-f8a0-411a-b791-7891ccb40c44.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9dd5e7410>
2025-12-05 12:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 12:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94d35162-155c-5119-a853-5497433d723d/94d35162-155c-5119-a853-5497433d723d_image_8.webp HTTP/1.1" 201 0
2025-12-05 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fcaee2e51-34ee-48dc-ac4f-82acea4e0ef5_1587b2d1-a37f-42f9-bb75-76e2ffde9e7a.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/caee2e51-34ee-48dc-ac4f-82acea4e0ef5_1587b2d1-a37f-42f9-bb75-76e2ffde9e7a.jpg/250x188.webp saved to cache
2025-12-05 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 94d35162-155c-5119-a853-5497433d723d
2025-12-05 12:01:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9dd5fe7d0>
2025-12-05 12:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94d35162-155c-5119-a853-5497433d723d/94d35162-155c-5119-a853-5497433d723d_image_7.webp HTTP/1.1" 201 0
2025-12-05 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fcaee2e51-34ee-48dc-ac4f-82acea4e0ef5_ad5fae25-0161-4423-9c75-f60127d2e30a.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/caee2e51-34ee-48dc-ac4f-82acea4e0ef5_ad5fae25-0161-4423-9c75-f60127d2e30a.jpg/250x188.webp saved to cache
2025-12-05 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 94d35162-155c-5119-a853-5497433d723d
2025-12-05 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%2789f21963-4f86-4d9e-9a7f-6c195a804b86%27 HTTP/1.1" 200 None
2025-12-05 12:01:41 [auto_selling_autoscout24.it] INFO: Scrape type for 89f21963-4f86-4d9e-9a7f-6c195a804b86: 1
2025-12-05 12:01:41 [auto_selling_autoscout24.it] INFO: Scraping new listing 89f21963-4f86-4d9e-9a7f-6c195a804b86
2025-12-05 12:01:41 [auto_selling_autoscout24.it] INFO: Extracting item from listing ID: 89f21963-4f86-4d9e-9a7f-6c195a804b86
2025-12-05 12:01:41 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: d6b46d75-7bf4-5833-a755-09baf4559041 with identifier: 89f21963-4f86-4d9e-9a7f-6c195a804b86
2025-12-05 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item d6b46d75-7bf4-5833-a755-09baf4559041
2025-12-05 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F89f21963-4f86-4d9e-9a7f-6c195a804b86_47276f03-83de-4cb6-8969-1ab137120d18.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/89f21963-4f86-4d9e-9a7f-6c195a804b86_47276f03-83de-4cb6-8969-1ab137120d18.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/caee2e51-34ee-48dc-ac4f-82acea4e0ef5_cf8d3267-e0e8-404f-89f5-3caa5f6af662.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/caee2e51-34ee-48dc-ac4f-82acea4e0ef5_5ed9e1f4-7499-4f9c-ae21-f08c097c2ba2.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F89f21963-4f86-4d9e-9a7f-6c195a804b86_b2f0b74c-a2d8-4b09-814e-095ca7c83b55.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/89f21963-4f86-4d9e-9a7f-6c195a804b86_b2f0b74c-a2d8-4b09-814e-095ca7c83b55.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5c77a90>
2025-12-05 12:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94d35162-155c-5119-a853-5497433d723d/94d35162-155c-5119-a853-5497433d723d_image_9.webp HTTP/1.1" 201 0
2025-12-05 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fcaee2e51-34ee-48dc-ac4f-82acea4e0ef5_83d951f9-1103-4d7a-a437-1af207261b29.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/caee2e51-34ee-48dc-ac4f-82acea4e0ef5_83d951f9-1103-4d7a-a437-1af207261b29.jpg/250x188.webp saved to cache
2025-12-05 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 94d35162-155c-5119-a853-5497433d723d
2025-12-05 12:01:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d6fa5150>
2025-12-05 12:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 12:01:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94d35162-155c-5119-a853-5497433d723d/94d35162-155c-5119-a853-5497433d723d_image_10.webp HTTP/1.1" 201 0
2025-12-05 12:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fcaee2e51-34ee-48dc-ac4f-82acea4e0ef5_a14ea2f2-355c-449c-8d3a-257a0290c9d0.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/caee2e51-34ee-48dc-ac4f-82acea4e0ef5_a14ea2f2-355c-449c-8d3a-257a0290c9d0.jpg/250x188.webp saved to cache
2025-12-05 12:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 94d35162-155c-5119-a853-5497433d723d
2025-12-05 12:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F89f21963-4f86-4d9e-9a7f-6c195a804b86_72a1027a-7ea0-4f35-aee7-5033aac91c8f.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/89f21963-4f86-4d9e-9a7f-6c195a804b86_72a1027a-7ea0-4f35-aee7-5033aac91c8f.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/caee2e51-34ee-48dc-ac4f-82acea4e0ef5_a1520348-0ac1-44e8-bae4-418c97143c0e.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/caee2e51-34ee-48dc-ac4f-82acea4e0ef5_87226366-f8a0-411a-b791-7891ccb40c44.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F89f21963-4f86-4d9e-9a7f-6c195a804b86_a3320249-8f2e-44d7-9242-296ee7e6c917.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/89f21963-4f86-4d9e-9a7f-6c195a804b86_a3320249-8f2e-44d7-9242-296ee7e6c917.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5c83c90>
2025-12-05 12:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 12:01:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94d35162-155c-5119-a853-5497433d723d/94d35162-155c-5119-a853-5497433d723d_image_12.webp HTTP/1.1" 201 0
2025-12-05 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fcaee2e51-34ee-48dc-ac4f-82acea4e0ef5_cf8d3267-e0e8-404f-89f5-3caa5f6af662.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/caee2e51-34ee-48dc-ac4f-82acea4e0ef5_cf8d3267-e0e8-404f-89f5-3caa5f6af662.jpg/250x188.webp saved to cache
2025-12-05 12:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 94d35162-155c-5119-a853-5497433d723d
2025-12-05 12:01:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d6f4b7d0>
2025-12-05 12:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94d35162-155c-5119-a853-5497433d723d/94d35162-155c-5119-a853-5497433d723d_image_11.webp HTTP/1.1" 201 0
2025-12-05 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fcaee2e51-34ee-48dc-ac4f-82acea4e0ef5_5ed9e1f4-7499-4f9c-ae21-f08c097c2ba2.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/caee2e51-34ee-48dc-ac4f-82acea4e0ef5_5ed9e1f4-7499-4f9c-ae21-f08c097c2ba2.jpg/250x188.webp saved to cache
2025-12-05 12:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 94d35162-155c-5119-a853-5497433d723d
2025-12-05 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F89f21963-4f86-4d9e-9a7f-6c195a804b86_9c2e3ef2-28ab-423d-a373-5bb9a21fdbad.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/89f21963-4f86-4d9e-9a7f-6c195a804b86_9c2e3ef2-28ab-423d-a373-5bb9a21fdbad.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/89f21963-4f86-4d9e-9a7f-6c195a804b86_b2f0b74c-a2d8-4b09-814e-095ca7c83b55.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/89f21963-4f86-4d9e-9a7f-6c195a804b86_47276f03-83de-4cb6-8969-1ab137120d18.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27c8f604fe-51e8-4bdc-8341-b5fd00fa4585%27 HTTP/1.1" 200 None
2025-12-05 12:01:43 [auto_selling_autoscout24.it] INFO: Scrape type for c8f604fe-51e8-4bdc-8341-b5fd00fa4585: 1
2025-12-05 12:01:43 [auto_selling_autoscout24.it] INFO: Scraping new listing c8f604fe-51e8-4bdc-8341-b5fd00fa4585
2025-12-05 12:01:43 [auto_selling_autoscout24.it] INFO: Extracting item from listing ID: c8f604fe-51e8-4bdc-8341-b5fd00fa4585
2025-12-05 12:01:43 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: c1e7eb68-002b-50a0-9174-6f9a0c442e53 with identifier: c8f604fe-51e8-4bdc-8341-b5fd00fa4585
2025-12-05 12:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item c1e7eb68-002b-50a0-9174-6f9a0c442e53
2025-12-05 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fc8f604fe-51e8-4bdc-8341-b5fd00fa4585_b590d1cd-0ce6-4e3d-8dd6-1ff4842b1cea.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/c8f604fe-51e8-4bdc-8341-b5fd00fa4585_b590d1cd-0ce6-4e3d-8dd6-1ff4842b1cea.jpg/250x188.webp already downloaded
2025-12-05 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fc8f604fe-51e8-4bdc-8341-b5fd00fa4585_34151c1a-ca12-4ff5-928f-fee192991799.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/c8f604fe-51e8-4bdc-8341-b5fd00fa4585_34151c1a-ca12-4ff5-928f-fee192991799.jpg/250x188.webp already downloaded
2025-12-05 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fc8f604fe-51e8-4bdc-8341-b5fd00fa4585_2ea4c962-4f13-4990-8eba-0acf06e5d3d0.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/c8f604fe-51e8-4bdc-8341-b5fd00fa4585_2ea4c962-4f13-4990-8eba-0acf06e5d3d0.jpg/250x188.webp already downloaded
2025-12-05 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fc8f604fe-51e8-4bdc-8341-b5fd00fa4585_1706f54d-1723-4b63-abbc-354d22c617ef.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/c8f604fe-51e8-4bdc-8341-b5fd00fa4585_1706f54d-1723-4b63-abbc-354d22c617ef.jpg/250x188.webp already downloaded
2025-12-05 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fc8f604fe-51e8-4bdc-8341-b5fd00fa4585_437d8191-1926-4288-9d5f-014c81466106.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/c8f604fe-51e8-4bdc-8341-b5fd00fa4585_437d8191-1926-4288-9d5f-014c81466106.jpg/250x188.webp already downloaded
2025-12-05 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fc8f604fe-51e8-4bdc-8341-b5fd00fa4585_b27747b1-53a7-491f-be5c-a0daec7a6a3f.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/c8f604fe-51e8-4bdc-8341-b5fd00fa4585_b27747b1-53a7-491f-be5c-a0daec7a6a3f.jpg/250x188.webp already downloaded
2025-12-05 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fc8f604fe-51e8-4bdc-8341-b5fd00fa4585_59f88ac1-18a1-4ac4-989e-3753e122acb9.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/c8f604fe-51e8-4bdc-8341-b5fd00fa4585_59f88ac1-18a1-4ac4-989e-3753e122acb9.jpg/250x188.webp already downloaded
2025-12-05 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fc8f604fe-51e8-4bdc-8341-b5fd00fa4585_028b01cd-00a4-4fba-904b-84b414e6b72f.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/c8f604fe-51e8-4bdc-8341-b5fd00fa4585_028b01cd-00a4-4fba-904b-84b414e6b72f.jpg/250x188.webp already downloaded
2025-12-05 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fc8f604fe-51e8-4bdc-8341-b5fd00fa4585_7436d71e-50fc-466b-a461-3fe711e88883.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/c8f604fe-51e8-4bdc-8341-b5fd00fa4585_7436d71e-50fc-466b-a461-3fe711e88883.jpg/250x188.webp already downloaded
2025-12-05 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fc8f604fe-51e8-4bdc-8341-b5fd00fa4585_d1f9accb-9f54-476a-a299-077fe35018a4.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/c8f604fe-51e8-4bdc-8341-b5fd00fa4585_d1f9accb-9f54-476a-a299-077fe35018a4.jpg/250x188.webp already downloaded
2025-12-05 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fc8f604fe-51e8-4bdc-8341-b5fd00fa4585_e2f04a02-8eba-40cf-a5ce-55e28a1e056d.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/c8f604fe-51e8-4bdc-8341-b5fd00fa4585_e2f04a02-8eba-40cf-a5ce-55e28a1e056d.jpg/250x188.webp already downloaded
2025-12-05 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fc8f604fe-51e8-4bdc-8341-b5fd00fa4585_1198a2f4-3769-44f1-b4df-7d45ae34e2a4.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/c8f604fe-51e8-4bdc-8341-b5fd00fa4585_1198a2f4-3769-44f1-b4df-7d45ae34e2a4.jpg/250x188.webp already downloaded
2025-12-05 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fc8f604fe-51e8-4bdc-8341-b5fd00fa4585_f8aa22fb-233c-4c88-bcb9-75757ed49c36.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/c8f604fe-51e8-4bdc-8341-b5fd00fa4585_f8aa22fb-233c-4c88-bcb9-75757ed49c36.jpg/250x188.webp already downloaded
2025-12-05 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fc8f604fe-51e8-4bdc-8341-b5fd00fa4585_95fdd53f-a353-40bb-89fc-45b3b274c7ee.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/c8f604fe-51e8-4bdc-8341-b5fd00fa4585_95fdd53f-a353-40bb-89fc-45b3b274c7ee.jpg/250x188.webp already downloaded
2025-12-05 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fc8f604fe-51e8-4bdc-8341-b5fd00fa4585_95e72ea0-1a16-432c-af86-f7d0da4de587.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/c8f604fe-51e8-4bdc-8341-b5fd00fa4585_95e72ea0-1a16-432c-af86-f7d0da4de587.jpg/250x188.webp already downloaded
2025-12-05 12:01:43 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: c1e7eb68-002b-50a0-9174-6f9a0c442e53 with identifier c8f604fe-51e8-4bdc-8341-b5fd00fa4585
2025-12-05 12:01:43 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:01:43 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:01:43 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:01:43 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item c1e7eb68-002b-50a0-9174-6f9a0c442e53
2025-12-05 12:01:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autoscout24.it/api/dealer-detail/fetch-listings>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'emission_standard': None,
 'engine': None,
 'engine_horse_power': 133,
 'expiration_date': None,
 'fuel_type': 'LPG',
 'id': 'c1e7eb68-002b-50a0-9174-6f9a0c442e53',
 'is_damaged': False,
 'is_operable': True,
 'license_plate': None,
 'link_to_web_offer': 'https://www.autoscout24.it/offers/cirelli-cirelli-3-sport-1-5l-bifuel-133cv-ecvt-prontaconsegna-promo-lpg-white-c8f604fe-51e8-4bdc-8341-b5fd00fa4585',
 'listing': 'auction',
 'make': 'Cirelli',
 'model': 'Cirelli 3',
 'odometer': 1,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://prod.pictures.autoscout24.net/listing-images/c8f604fe-51e8-4bdc-8341-b5fd00fa4585_b590d1cd-0ce6-4e3d-8dd6-1ff4842b1cea.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/c8f604fe-51e8-4bdc-8341-b5fd00fa4585_34151c1a-ca12-4ff5-928f-fee192991799.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/c8f604fe-51e8-4bdc-8341-b5fd00fa4585_2ea4c962-4f13-4990-8eba-0acf06e5d3d0.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/c8f604fe-51e8-4bdc-8341-b5fd00fa4585_1706f54d-1723-4b63-abbc-354d22c617ef.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/c8f604fe-51e8-4bdc-8341-b5fd00fa4585_437d8191-1926-4288-9d5f-014c81466106.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/c8f604fe-51e8-4bdc-8341-b5fd00fa4585_b27747b1-53a7-491f-be5c-a0daec7a6a3f.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/c8f604fe-51e8-4bdc-8341-b5fd00fa4585_59f88ac1-18a1-4ac4-989e-3753e122acb9.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/c8f604fe-51e8-4bdc-8341-b5fd00fa4585_028b01cd-00a4-4fba-904b-84b414e6b72f.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/c8f604fe-51e8-4bdc-8341-b5fd00fa4585_7436d71e-50fc-466b-a461-3fe711e88883.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/c8f604fe-51e8-4bdc-8341-b5fd00fa4585_d1f9accb-9f54-476a-a299-077fe35018a4.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/c8f604fe-51e8-4bdc-8341-b5fd00fa4585_e2f04a02-8eba-40cf-a5ce-55e28a1e056d.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/c8f604fe-51e8-4bdc-8341-b5fd00fa4585_1198a2f4-3769-44f1-b4df-7d45ae34e2a4.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/c8f604fe-51e8-4bdc-8341-b5fd00fa4585_f8aa22fb-233c-4c88-bcb9-75757ed49c36.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/c8f604fe-51e8-4bdc-8341-b5fd00fa4585_95fdd53f-a353-40bb-89fc-45b3b274c7ee.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/c8f604fe-51e8-4bdc-8341-b5fd00fa4585_95e72ea0-1a16-432c-af86-f7d0da4de587.jpg/250x188.webp'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90463ab1-7c3e-5f92-a7f9-d5a0461f5078/90463ab1-7c3e-5f92-a7f9-d5a0461f5078_image_0.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4166,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/c8f604fe-51e8-4bdc-8341-b5fd00fa4585_b590d1cd-0ce6-4e3d-8dd6-1ff4842b1cea.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90463ab1-7c3e-5f92-a7f9-d5a0461f5078/90463ab1-7c3e-5f92-a7f9-d5a0461f5078_image_1.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4518,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/c8f604fe-51e8-4bdc-8341-b5fd00fa4585_34151c1a-ca12-4ff5-928f-fee192991799.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90463ab1-7c3e-5f92-a7f9-d5a0461f5078/90463ab1-7c3e-5f92-a7f9-d5a0461f5078_image_2.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4560,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/c8f604fe-51e8-4bdc-8341-b5fd00fa4585_2ea4c962-4f13-4990-8eba-0acf06e5d3d0.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90463ab1-7c3e-5f92-a7f9-d5a0461f5078/90463ab1-7c3e-5f92-a7f9-d5a0461f5078_image_3.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4640,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/c8f604fe-51e8-4bdc-8341-b5fd00fa4585_1706f54d-1723-4b63-abbc-354d22c617ef.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90463ab1-7c3e-5f92-a7f9-d5a0461f5078/90463ab1-7c3e-5f92-a7f9-d5a0461f5078_image_4.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5704,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/c8f604fe-51e8-4bdc-8341-b5fd00fa4585_437d8191-1926-4288-9d5f-014c81466106.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90463ab1-7c3e-5f92-a7f9-d5a0461f5078/90463ab1-7c3e-5f92-a7f9-d5a0461f5078_image_5.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5664,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/c8f604fe-51e8-4bdc-8341-b5fd00fa4585_b27747b1-53a7-491f-be5c-a0daec7a6a3f.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90463ab1-7c3e-5f92-a7f9-d5a0461f5078/90463ab1-7c3e-5f92-a7f9-d5a0461f5078_image_6.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 6038,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/c8f604fe-51e8-4bdc-8341-b5fd00fa4585_59f88ac1-18a1-4ac4-989e-3753e122acb9.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90463ab1-7c3e-5f92-a7f9-d5a0461f5078/90463ab1-7c3e-5f92-a7f9-d5a0461f5078_image_7.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 6926,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/c8f604fe-51e8-4bdc-8341-b5fd00fa4585_028b01cd-00a4-4fba-904b-84b414e6b72f.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90463ab1-7c3e-5f92-a7f9-d5a0461f5078/90463ab1-7c3e-5f92-a7f9-d5a0461f5078_image_8.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5492,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/c8f604fe-51e8-4bdc-8341-b5fd00fa4585_7436d71e-50fc-466b-a461-3fe711e88883.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90463ab1-7c3e-5f92-a7f9-d5a0461f5078/90463ab1-7c3e-5f92-a7f9-d5a0461f5078_image_9.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5356,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/c8f604fe-51e8-4bdc-8341-b5fd00fa4585_d1f9accb-9f54-476a-a299-077fe35018a4.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90463ab1-7c3e-5f92-a7f9-d5a0461f5078/90463ab1-7c3e-5f92-a7f9-d5a0461f5078_image_10.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4796,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/c8f604fe-51e8-4bdc-8341-b5fd00fa4585_e2f04a02-8eba-40cf-a5ce-55e28a1e056d.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90463ab1-7c3e-5f92-a7f9-d5a0461f5078/90463ab1-7c3e-5f92-a7f9-d5a0461f5078_image_11.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3408,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/c8f604fe-51e8-4bdc-8341-b5fd00fa4585_1198a2f4-3769-44f1-b4df-7d45ae34e2a4.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90463ab1-7c3e-5f92-a7f9-d5a0461f5078/90463ab1-7c3e-5f92-a7f9-d5a0461f5078_image_12.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 2376,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/c8f604fe-51e8-4bdc-8341-b5fd00fa4585_f8aa22fb-233c-4c88-bcb9-75757ed49c36.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90463ab1-7c3e-5f92-a7f9-d5a0461f5078/90463ab1-7c3e-5f92-a7f9-d5a0461f5078_image_13.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4194,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/c8f604fe-51e8-4bdc-8341-b5fd00fa4585_95fdd53f-a353-40bb-89fc-45b3b274c7ee.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90463ab1-7c3e-5f92-a7f9-d5a0461f5078/90463ab1-7c3e-5f92-a7f9-d5a0461f5078_image_14.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3678,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/c8f604fe-51e8-4bdc-8341-b5fd00fa4585_95e72ea0-1a16-432c-af86-f7d0da4de587.jpg/250x188.webp',
             'Width': 250}],
 'price': 26900,
 'price_includes_vat': False,
 'registration_date': '2025-11-01',
 'seller_name': None,
 'title': 'Cirelli Cirelli 3 SPORT 1.5L BiFuel 133CV eCVT PRONTACONSEGNA! '
          'PROMO',
 'transmission': 'automatic',
 'trim': 'SPORT 1.5L BiFuel 133CV eCVT PRONTACONSEGNA! PROMO',
 'vin': None,
 'year': 2025}
2025-12-05 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27c8f604fe-51e8-4bdc-8341-b5fd00fa4585%27 HTTP/1.1" 200 None
2025-12-05 12:01:43 [auto_selling_autoscout24.it] INFO: Saving data for c8f604fe-51e8-4bdc-8341-b5fd00fa4585: {'created_time': 1764936103.642425, 'last_price_update_time': 1764936103.642433}
2025-12-05 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autoscout24.it',RowKey='c8f604fe-51e8-4bdc-8341-b5fd00fa4585') HTTP/1.1" 204 0
2025-12-05 12:01:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5c39e50>
2025-12-05 12:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94d35162-155c-5119-a853-5497433d723d/94d35162-155c-5119-a853-5497433d723d_image_13.webp HTTP/1.1" 201 0
2025-12-05 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fcaee2e51-34ee-48dc-ac4f-82acea4e0ef5_a1520348-0ac1-44e8-bae4-418c97143c0e.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/caee2e51-34ee-48dc-ac4f-82acea4e0ef5_a1520348-0ac1-44e8-bae4-418c97143c0e.jpg/250x188.webp saved to cache
2025-12-05 12:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 94d35162-155c-5119-a853-5497433d723d
2025-12-05 12:01:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5b05850>
2025-12-05 12:01:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94d35162-155c-5119-a853-5497433d723d/94d35162-155c-5119-a853-5497433d723d_image_14.webp HTTP/1.1" 201 0
2025-12-05 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fcaee2e51-34ee-48dc-ac4f-82acea4e0ef5_87226366-f8a0-411a-b791-7891ccb40c44.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/caee2e51-34ee-48dc-ac4f-82acea4e0ef5_87226366-f8a0-411a-b791-7891ccb40c44.jpg/250x188.webp saved to cache
2025-12-05 12:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 94d35162-155c-5119-a853-5497433d723d
2025-12-05 12:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 94d35162-155c-5119-a853-5497433d723d from tracking dictionaries
2025-12-05 12:01:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 94d35162-155c-5119-a853-5497433d723d sending to next pipeline
2025-12-05 12:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/89f21963-4f86-4d9e-9a7f-6c195a804b86_a3320249-8f2e-44d7-9242-296ee7e6c917.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/89f21963-4f86-4d9e-9a7f-6c195a804b86_72a1027a-7ea0-4f35-aee7-5033aac91c8f.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27bfade635-af13-45f5-b5f8-a822caf60566%27 HTTP/1.1" 200 None
2025-12-05 12:01:44 [auto_selling_autoscout24.it] INFO: Scrape type for bfade635-af13-45f5-b5f8-a822caf60566: 1
2025-12-05 12:01:44 [auto_selling_autoscout24.it] INFO: Scraping new listing bfade635-af13-45f5-b5f8-a822caf60566
2025-12-05 12:01:44 [auto_selling_autoscout24.it] INFO: Extracting item from listing ID: bfade635-af13-45f5-b5f8-a822caf60566
2025-12-05 12:01:44 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: a93280b4-9eed-590a-8706-9fda295640de with identifier: bfade635-af13-45f5-b5f8-a822caf60566
2025-12-05 12:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 4 photos for item a93280b4-9eed-590a-8706-9fda295640de
2025-12-05 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fbfade635-af13-45f5-b5f8-a822caf60566_78d7899f-93fa-4a4a-9680-3cde2a4c2c2a.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/bfade635-af13-45f5-b5f8-a822caf60566_78d7899f-93fa-4a4a-9680-3cde2a4c2c2a.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:44 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 94d35162-155c-5119-a853-5497433d723d with identifier caee2e51-34ee-48dc-ac4f-82acea4e0ef5
2025-12-05 12:01:44 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:01:44 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:01:44 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 94d35162-155c-5119-a853-5497433d723d
2025-12-05 12:01:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://prod.pictures.autoscout24.net/listing-images/caee2e51-34ee-48dc-ac4f-82acea4e0ef5_87226366-f8a0-411a-b791-7891ccb40c44.jpg/250x188.webp>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'emission_standard': None,
 'engine': None,
 'engine_horse_power': 110,
 'expiration_date': None,
 'fuel_type': 'Gasoline',
 'id': '94d35162-155c-5119-a853-5497433d723d',
 'is_damaged': False,
 'is_operable': True,
 'license_plate': None,
 'link_to_web_offer': 'https://www.autoscout24.it/offers/seat-ibiza-fr-1-0-ecotsi-110cv-km0-2024-only-promo-gasoline-red-caee2e51-34ee-48dc-ac4f-82acea4e0ef5',
 'listing': 'auction',
 'make': 'SEAT',
 'model': 'Ibiza',
 'odometer': 1,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94d35162-155c-5119-a853-5497433d723d/94d35162-155c-5119-a853-5497433d723d_image_0.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5438,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/caee2e51-34ee-48dc-ac4f-82acea4e0ef5_5cd06304-3862-4017-a067-a51a275fc905.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94d35162-155c-5119-a853-5497433d723d/94d35162-155c-5119-a853-5497433d723d_image_1.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4568,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/caee2e51-34ee-48dc-ac4f-82acea4e0ef5_bc78c147-4141-442a-bb8a-d05c6ff5808b.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94d35162-155c-5119-a853-5497433d723d/94d35162-155c-5119-a853-5497433d723d_image_2.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4978,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/caee2e51-34ee-48dc-ac4f-82acea4e0ef5_891e74e2-32ac-4e75-9d33-eebe30110a0c.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94d35162-155c-5119-a853-5497433d723d/94d35162-155c-5119-a853-5497433d723d_image_3.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4844,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/caee2e51-34ee-48dc-ac4f-82acea4e0ef5_9ae47ca1-f91d-43ef-941f-827833362678.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94d35162-155c-5119-a853-5497433d723d/94d35162-155c-5119-a853-5497433d723d_image_4.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5104,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/caee2e51-34ee-48dc-ac4f-82acea4e0ef5_2a7779b2-9dc3-4420-941e-9d7eab9cb9cb.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94d35162-155c-5119-a853-5497433d723d/94d35162-155c-5119-a853-5497433d723d_image_5.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 8274,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/caee2e51-34ee-48dc-ac4f-82acea4e0ef5_fde3517d-e1ef-40d6-a9a3-74f70788ee44.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94d35162-155c-5119-a853-5497433d723d/94d35162-155c-5119-a853-5497433d723d_image_6.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 6054,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/caee2e51-34ee-48dc-ac4f-82acea4e0ef5_76fb5760-8561-46d5-8d59-1a81c245b570.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94d35162-155c-5119-a853-5497433d723d/94d35162-155c-5119-a853-5497433d723d_image_7.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 6968,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/caee2e51-34ee-48dc-ac4f-82acea4e0ef5_ad5fae25-0161-4423-9c75-f60127d2e30a.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94d35162-155c-5119-a853-5497433d723d/94d35162-155c-5119-a853-5497433d723d_image_8.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 6070,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/caee2e51-34ee-48dc-ac4f-82acea4e0ef5_1587b2d1-a37f-42f9-bb75-76e2ffde9e7a.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94d35162-155c-5119-a853-5497433d723d/94d35162-155c-5119-a853-5497433d723d_image_9.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 7716,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/caee2e51-34ee-48dc-ac4f-82acea4e0ef5_83d951f9-1103-4d7a-a437-1af207261b29.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94d35162-155c-5119-a853-5497433d723d/94d35162-155c-5119-a853-5497433d723d_image_10.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 6192,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/caee2e51-34ee-48dc-ac4f-82acea4e0ef5_a14ea2f2-355c-449c-8d3a-257a0290c9d0.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94d35162-155c-5119-a853-5497433d723d/94d35162-155c-5119-a853-5497433d723d_image_11.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5084,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/caee2e51-34ee-48dc-ac4f-82acea4e0ef5_5ed9e1f4-7499-4f9c-ae21-f08c097c2ba2.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94d35162-155c-5119-a853-5497433d723d/94d35162-155c-5119-a853-5497433d723d_image_12.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3920,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/caee2e51-34ee-48dc-ac4f-82acea4e0ef5_cf8d3267-e0e8-404f-89f5-3caa5f6af662.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94d35162-155c-5119-a853-5497433d723d/94d35162-155c-5119-a853-5497433d723d_image_13.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 6062,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/caee2e51-34ee-48dc-ac4f-82acea4e0ef5_a1520348-0ac1-44e8-bae4-418c97143c0e.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94d35162-155c-5119-a853-5497433d723d/94d35162-155c-5119-a853-5497433d723d_image_14.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5104,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/caee2e51-34ee-48dc-ac4f-82acea4e0ef5_87226366-f8a0-411a-b791-7891ccb40c44.jpg/250x188.webp',
             'Width': 250}],
 'price': 22800,
 'price_includes_vat': False,
 'registration_date': '2024-05-01',
 'seller_name': None,
 'title': 'SEAT Ibiza FR 1.0 ECOTSI 110CV KM0 2024 ONLY PROMO',
 'transmission': 'automatic',
 'trim': 'FR 1.0 ECOTSI 110CV KM0 2024 ONLY PROMO',
 'vin': None,
 'year': 2024}
2025-12-05 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27caee2e51-34ee-48dc-ac4f-82acea4e0ef5%27 HTTP/1.1" 200 None
2025-12-05 12:01:44 [auto_selling_autoscout24.it] INFO: Saving data for caee2e51-34ee-48dc-ac4f-82acea4e0ef5: {'created_time': 1764936104.460568, 'last_price_update_time': 1764936104.460576}
2025-12-05 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autoscout24.it',RowKey='caee2e51-34ee-48dc-ac4f-82acea4e0ef5') HTTP/1.1" 204 0
2025-12-05 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fbfade635-af13-45f5-b5f8-a822caf60566_88fb2545-db9a-4253-94aa-576b9d851523.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/bfade635-af13-45f5-b5f8-a822caf60566_88fb2545-db9a-4253-94aa-576b9d851523.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d6fcce50>
2025-12-05 12:01:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6b46d75-7bf4-5833-a755-09baf4559041/d6b46d75-7bf4-5833-a755-09baf4559041_image_1.webp HTTP/1.1" 201 0
2025-12-05 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F89f21963-4f86-4d9e-9a7f-6c195a804b86_b2f0b74c-a2d8-4b09-814e-095ca7c83b55.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/89f21963-4f86-4d9e-9a7f-6c195a804b86_b2f0b74c-a2d8-4b09-814e-095ca7c83b55.jpg/250x188.webp saved to cache
2025-12-05 12:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d6b46d75-7bf4-5833-a755-09baf4559041
2025-12-05 12:01:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5c9f210>
2025-12-05 12:01:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 12:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6b46d75-7bf4-5833-a755-09baf4559041/d6b46d75-7bf4-5833-a755-09baf4559041_image_0.webp HTTP/1.1" 201 0
2025-12-05 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F89f21963-4f86-4d9e-9a7f-6c195a804b86_47276f03-83de-4cb6-8969-1ab137120d18.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/89f21963-4f86-4d9e-9a7f-6c195a804b86_47276f03-83de-4cb6-8969-1ab137120d18.jpg/250x188.webp saved to cache
2025-12-05 12:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d6b46d75-7bf4-5833-a755-09baf4559041
2025-12-05 12:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/89f21963-4f86-4d9e-9a7f-6c195a804b86_9c2e3ef2-28ab-423d-a373-5bb9a21fdbad.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fbfade635-af13-45f5-b5f8-a822caf60566_c9910c54-ae20-4ddd-89ae-158dadbbc560.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/bfade635-af13-45f5-b5f8-a822caf60566_c9910c54-ae20-4ddd-89ae-158dadbbc560.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5cacd10>
2025-12-05 12:01:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 12:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6b46d75-7bf4-5833-a755-09baf4559041/d6b46d75-7bf4-5833-a755-09baf4559041_image_3.webp HTTP/1.1" 201 0
2025-12-05 12:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F89f21963-4f86-4d9e-9a7f-6c195a804b86_a3320249-8f2e-44d7-9242-296ee7e6c917.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/89f21963-4f86-4d9e-9a7f-6c195a804b86_a3320249-8f2e-44d7-9242-296ee7e6c917.jpg/250x188.webp saved to cache
2025-12-05 12:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d6b46d75-7bf4-5833-a755-09baf4559041
2025-12-05 12:01:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e43090>
2025-12-05 12:01:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 12:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6b46d75-7bf4-5833-a755-09baf4559041/d6b46d75-7bf4-5833-a755-09baf4559041_image_2.webp HTTP/1.1" 201 0
2025-12-05 12:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F89f21963-4f86-4d9e-9a7f-6c195a804b86_72a1027a-7ea0-4f35-aee7-5033aac91c8f.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/89f21963-4f86-4d9e-9a7f-6c195a804b86_72a1027a-7ea0-4f35-aee7-5033aac91c8f.jpg/250x188.webp saved to cache
2025-12-05 12:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d6b46d75-7bf4-5833-a755-09baf4559041
2025-12-05 12:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fbfade635-af13-45f5-b5f8-a822caf60566_abc890eb-532c-4349-8f86-c0b5f0793df5.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/bfade635-af13-45f5-b5f8-a822caf60566_abc890eb-532c-4349-8f86-c0b5f0793df5.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/bfade635-af13-45f5-b5f8-a822caf60566_78d7899f-93fa-4a4a-9680-3cde2a4c2c2a.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27a3d8fcd9-87bf-4330-911f-a7a0ab355a30%27 HTTP/1.1" 200 None
2025-12-05 12:01:45 [auto_selling_autoscout24.it] INFO: Scrape type for a3d8fcd9-87bf-4330-911f-a7a0ab355a30: 1
2025-12-05 12:01:45 [auto_selling_autoscout24.it] INFO: Scraping new listing a3d8fcd9-87bf-4330-911f-a7a0ab355a30
2025-12-05 12:01:45 [auto_selling_autoscout24.it] INFO: Extracting item from listing ID: a3d8fcd9-87bf-4330-911f-a7a0ab355a30
2025-12-05 12:01:45 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f02ee85-0288-5cd9-85da-7b4361303312 with identifier: a3d8fcd9-87bf-4330-911f-a7a0ab355a30
2025-12-05 12:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 7f02ee85-0288-5cd9-85da-7b4361303312
2025-12-05 12:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fa3d8fcd9-87bf-4330-911f-a7a0ab355a30_c6d8ed41-e4e0-4406-bf85-bb14396854ba.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/a3d8fcd9-87bf-4330-911f-a7a0ab355a30_c6d8ed41-e4e0-4406-bf85-bb14396854ba.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9dc189490>
2025-12-05 12:01:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 12:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6b46d75-7bf4-5833-a755-09baf4559041/d6b46d75-7bf4-5833-a755-09baf4559041_image_4.webp HTTP/1.1" 201 0
2025-12-05 12:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F89f21963-4f86-4d9e-9a7f-6c195a804b86_9c2e3ef2-28ab-423d-a373-5bb9a21fdbad.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/89f21963-4f86-4d9e-9a7f-6c195a804b86_9c2e3ef2-28ab-423d-a373-5bb9a21fdbad.jpg/250x188.webp saved to cache
2025-12-05 12:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d6b46d75-7bf4-5833-a755-09baf4559041
2025-12-05 12:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Removing item d6b46d75-7bf4-5833-a755-09baf4559041 from tracking dictionaries
2025-12-05 12:01:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d6b46d75-7bf4-5833-a755-09baf4559041 sending to next pipeline
2025-12-05 12:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fa3d8fcd9-87bf-4330-911f-a7a0ab355a30_2ac78519-4f95-4a18-a96a-6a5d757b91e3.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/a3d8fcd9-87bf-4330-911f-a7a0ab355a30_2ac78519-4f95-4a18-a96a-6a5d757b91e3.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:45 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: d6b46d75-7bf4-5833-a755-09baf4559041 with identifier 89f21963-4f86-4d9e-9a7f-6c195a804b86
2025-12-05 12:01:45 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:01:45 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:01:45 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item d6b46d75-7bf4-5833-a755-09baf4559041
2025-12-05 12:01:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://prod.pictures.autoscout24.net/listing-images/89f21963-4f86-4d9e-9a7f-6c195a804b86_9c2e3ef2-28ab-423d-a373-5bb9a21fdbad.jpg/250x188.webp>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'emission_standard': None,
 'engine': None,
 'engine_horse_power': 333,
 'expiration_date': None,
 'fuel_type': 'Gasoline',
 'id': 'd6b46d75-7bf4-5833-a755-09baf4559041',
 'is_damaged': False,
 'is_operable': True,
 'license_plate': None,
 'link_to_web_offer': 'https://www.autoscout24.it/offers/audi-s3-spb-tfsi-quattro-s-tr-333cv-matrix-tetto-promo-gasoline-green-89f21963-4f86-4d9e-9a7f-6c195a804b86',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'S3',
 'odometer': 1,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6b46d75-7bf4-5833-a755-09baf4559041/d6b46d75-7bf4-5833-a755-09baf4559041_image_0.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3604,
             'Height': 158,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/89f21963-4f86-4d9e-9a7f-6c195a804b86_47276f03-83de-4cb6-8969-1ab137120d18.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6b46d75-7bf4-5833-a755-09baf4559041/d6b46d75-7bf4-5833-a755-09baf4559041_image_1.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 2508,
             'Height': 125,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/89f21963-4f86-4d9e-9a7f-6c195a804b86_b2f0b74c-a2d8-4b09-814e-095ca7c83b55.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6b46d75-7bf4-5833-a755-09baf4559041/d6b46d75-7bf4-5833-a755-09baf4559041_image_2.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3148,
             'Height': 136,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/89f21963-4f86-4d9e-9a7f-6c195a804b86_72a1027a-7ea0-4f35-aee7-5033aac91c8f.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6b46d75-7bf4-5833-a755-09baf4559041/d6b46d75-7bf4-5833-a755-09baf4559041_image_3.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 2890,
             'Height': 110,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/89f21963-4f86-4d9e-9a7f-6c195a804b86_a3320249-8f2e-44d7-9242-296ee7e6c917.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6b46d75-7bf4-5833-a755-09baf4559041/d6b46d75-7bf4-5833-a755-09baf4559041_image_4.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 2738,
             'Height': 110,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/89f21963-4f86-4d9e-9a7f-6c195a804b86_9c2e3ef2-28ab-423d-a373-5bb9a21fdbad.jpg/250x188.webp',
             'Width': 250}],
 'price': 51800,
 'price_includes_vat': False,
 'registration_date': '2025-07-01',
 'seller_name': None,
 'title': 'Audi S3 SPB TFSI QUATTRO S-TR. 333CV *MATRIX+TETTO* PROMO',
 'transmission': 'automatic',
 'trim': 'SPB TFSI QUATTRO S-TR. 333CV *MATRIX+TETTO* PROMO',
 'vin': None,
 'year': 2025}
2025-12-05 12:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%2789f21963-4f86-4d9e-9a7f-6c195a804b86%27 HTTP/1.1" 200 None
2025-12-05 12:01:45 [auto_selling_autoscout24.it] INFO: Saving data for 89f21963-4f86-4d9e-9a7f-6c195a804b86: {'created_time': 1764936105.958192, 'last_price_update_time': 1764936105.958203}
2025-12-05 12:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autoscout24.it',RowKey='89f21963-4f86-4d9e-9a7f-6c195a804b86') HTTP/1.1" 204 0
2025-12-05 12:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/bfade635-af13-45f5-b5f8-a822caf60566_88fb2545-db9a-4253-94aa-576b9d851523.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/bfade635-af13-45f5-b5f8-a822caf60566_c9910c54-ae20-4ddd-89ae-158dadbbc560.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fa3d8fcd9-87bf-4330-911f-a7a0ab355a30_b954f6f6-032a-4f10-818e-484bf17fe07e.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/a3d8fcd9-87bf-4330-911f-a7a0ab355a30_b954f6f6-032a-4f10-818e-484bf17fe07e.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5b1d510>
2025-12-05 12:01:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 12:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a93280b4-9eed-590a-8706-9fda295640de/a93280b4-9eed-590a-8706-9fda295640de_image_0.webp HTTP/1.1" 201 0
2025-12-05 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fbfade635-af13-45f5-b5f8-a822caf60566_78d7899f-93fa-4a4a-9680-3cde2a4c2c2a.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/bfade635-af13-45f5-b5f8-a822caf60566_78d7899f-93fa-4a4a-9680-3cde2a4c2c2a.jpg/250x188.webp saved to cache
2025-12-05 12:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a93280b4-9eed-590a-8706-9fda295640de
2025-12-05 12:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/bfade635-af13-45f5-b5f8-a822caf60566_abc890eb-532c-4349-8f86-c0b5f0793df5.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fa3d8fcd9-87bf-4330-911f-a7a0ab355a30_28b3fa9d-76f8-49a0-bfde-0dfc72ba921a.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/a3d8fcd9-87bf-4330-911f-a7a0ab355a30_28b3fa9d-76f8-49a0-bfde-0dfc72ba921a.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/a3d8fcd9-87bf-4330-911f-a7a0ab355a30_c6d8ed41-e4e0-4406-bf85-bb14396854ba.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fa3d8fcd9-87bf-4330-911f-a7a0ab355a30_660ed78a-6745-4feb-ae3f-f2abf9c7cc31.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/a3d8fcd9-87bf-4330-911f-a7a0ab355a30_660ed78a-6745-4feb-ae3f-f2abf9c7cc31.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e2c350>
2025-12-05 12:01:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a93280b4-9eed-590a-8706-9fda295640de/a93280b4-9eed-590a-8706-9fda295640de_image_1.webp HTTP/1.1" 201 0
2025-12-05 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fbfade635-af13-45f5-b5f8-a822caf60566_88fb2545-db9a-4253-94aa-576b9d851523.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/bfade635-af13-45f5-b5f8-a822caf60566_88fb2545-db9a-4253-94aa-576b9d851523.jpg/250x188.webp saved to cache
2025-12-05 12:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a93280b4-9eed-590a-8706-9fda295640de
2025-12-05 12:01:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d6f7e490>
2025-12-05 12:01:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 12:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a93280b4-9eed-590a-8706-9fda295640de/a93280b4-9eed-590a-8706-9fda295640de_image_2.webp HTTP/1.1" 201 0
2025-12-05 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fbfade635-af13-45f5-b5f8-a822caf60566_c9910c54-ae20-4ddd-89ae-158dadbbc560.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/bfade635-af13-45f5-b5f8-a822caf60566_c9910c54-ae20-4ddd-89ae-158dadbbc560.jpg/250x188.webp saved to cache
2025-12-05 12:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a93280b4-9eed-590a-8706-9fda295640de
2025-12-05 12:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/a3d8fcd9-87bf-4330-911f-a7a0ab355a30_2ac78519-4f95-4a18-a96a-6a5d757b91e3.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fa3d8fcd9-87bf-4330-911f-a7a0ab355a30_79ac8b66-7b89-437d-86f6-58bfb51f1e2f.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/a3d8fcd9-87bf-4330-911f-a7a0ab355a30_79ac8b66-7b89-437d-86f6-58bfb51f1e2f.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/a3d8fcd9-87bf-4330-911f-a7a0ab355a30_b954f6f6-032a-4f10-818e-484bf17fe07e.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fa3d8fcd9-87bf-4330-911f-a7a0ab355a30_fed5d3a3-855e-4c5c-8844-29e4d4504081.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/a3d8fcd9-87bf-4330-911f-a7a0ab355a30_fed5d3a3-855e-4c5c-8844-29e4d4504081.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e32290>
2025-12-05 12:01:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a93280b4-9eed-590a-8706-9fda295640de/a93280b4-9eed-590a-8706-9fda295640de_image_3.webp HTTP/1.1" 201 0
2025-12-05 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fbfade635-af13-45f5-b5f8-a822caf60566_abc890eb-532c-4349-8f86-c0b5f0793df5.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/bfade635-af13-45f5-b5f8-a822caf60566_abc890eb-532c-4349-8f86-c0b5f0793df5.jpg/250x188.webp saved to cache
2025-12-05 12:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a93280b4-9eed-590a-8706-9fda295640de
2025-12-05 12:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Removing item a93280b4-9eed-590a-8706-9fda295640de from tracking dictionaries
2025-12-05 12:01:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a93280b4-9eed-590a-8706-9fda295640de sending to next pipeline
2025-12-05 12:01:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e6cf90>
2025-12-05 12:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 12:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f02ee85-0288-5cd9-85da-7b4361303312/7f02ee85-0288-5cd9-85da-7b4361303312_image_0.webp HTTP/1.1" 201 0
2025-12-05 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fa3d8fcd9-87bf-4330-911f-a7a0ab355a30_c6d8ed41-e4e0-4406-bf85-bb14396854ba.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/a3d8fcd9-87bf-4330-911f-a7a0ab355a30_c6d8ed41-e4e0-4406-bf85-bb14396854ba.jpg/250x188.webp saved to cache
2025-12-05 12:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7f02ee85-0288-5cd9-85da-7b4361303312
2025-12-05 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fa3d8fcd9-87bf-4330-911f-a7a0ab355a30_60e901d4-c69a-4b07-a6cb-43defeb2a666.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/a3d8fcd9-87bf-4330-911f-a7a0ab355a30_60e901d4-c69a-4b07-a6cb-43defeb2a666.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:47 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: a93280b4-9eed-590a-8706-9fda295640de with identifier bfade635-af13-45f5-b5f8-a822caf60566
2025-12-05 12:01:47 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:01:47 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:01:47 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item a93280b4-9eed-590a-8706-9fda295640de
2025-12-05 12:01:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://prod.pictures.autoscout24.net/listing-images/bfade635-af13-45f5-b5f8-a822caf60566_abc890eb-532c-4349-8f86-c0b5f0793df5.jpg/250x188.webp>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'emission_standard': None,
 'engine': None,
 'engine_horse_power': 140,
 'expiration_date': None,
 'fuel_type': 'Electric/Gasoline',
 'id': 'a93280b4-9eed-590a-8706-9fda295640de',
 'is_damaged': False,
 'is_operable': True,
 'license_plate': None,
 'link_to_web_offer': 'https://www.autoscout24.it/offers/nissan-qashqai-newmodel-n-connecta-140cv-only-promo-electric-gasoline-grey-bfade635-af13-45f5-b5f8-a822caf60566',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 15900,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 4,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a93280b4-9eed-590a-8706-9fda295640de/a93280b4-9eed-590a-8706-9fda295640de_image_0.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3310,
             'Height': 162,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/bfade635-af13-45f5-b5f8-a822caf60566_78d7899f-93fa-4a4a-9680-3cde2a4c2c2a.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a93280b4-9eed-590a-8706-9fda295640de/a93280b4-9eed-590a-8706-9fda295640de_image_1.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 2688,
             'Height': 129,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/bfade635-af13-45f5-b5f8-a822caf60566_88fb2545-db9a-4253-94aa-576b9d851523.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a93280b4-9eed-590a-8706-9fda295640de/a93280b4-9eed-590a-8706-9fda295640de_image_2.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 2880,
             'Height': 139,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/bfade635-af13-45f5-b5f8-a822caf60566_c9910c54-ae20-4ddd-89ae-158dadbbc560.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a93280b4-9eed-590a-8706-9fda295640de/a93280b4-9eed-590a-8706-9fda295640de_image_3.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4076,
             'Height': 170,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/bfade635-af13-45f5-b5f8-a822caf60566_abc890eb-532c-4349-8f86-c0b5f0793df5.jpg/250x188.webp',
             'Width': 250}],
 'price': 26900,
 'price_includes_vat': False,
 'registration_date': '2025-02-01',
 'seller_name': None,
 'title': 'Nissan Qashqai NEWMODEL  N-CONNECTA 140CV ONLY PROMO!',
 'transmission': 'automatic',
 'trim': 'NEWMODEL  N-CONNECTA 140CV ONLY PROMO!',
 'vin': None,
 'year': 2025}
2025-12-05 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27bfade635-af13-45f5-b5f8-a822caf60566%27 HTTP/1.1" 200 None
2025-12-05 12:01:47 [auto_selling_autoscout24.it] INFO: Saving data for bfade635-af13-45f5-b5f8-a822caf60566: {'created_time': 1764936107.553178, 'last_price_update_time': 1764936107.553195}
2025-12-05 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autoscout24.it',RowKey='bfade635-af13-45f5-b5f8-a822caf60566') HTTP/1.1" 204 0
2025-12-05 12:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/a3d8fcd9-87bf-4330-911f-a7a0ab355a30_28b3fa9d-76f8-49a0-bfde-0dfc72ba921a.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/a3d8fcd9-87bf-4330-911f-a7a0ab355a30_660ed78a-6745-4feb-ae3f-f2abf9c7cc31.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fa3d8fcd9-87bf-4330-911f-a7a0ab355a30_c3f0961c-ecd3-45aa-bb86-bbfcfd79c419.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/a3d8fcd9-87bf-4330-911f-a7a0ab355a30_c3f0961c-ecd3-45aa-bb86-bbfcfd79c419.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9dc1c9f10>
2025-12-05 12:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 12:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f02ee85-0288-5cd9-85da-7b4361303312/7f02ee85-0288-5cd9-85da-7b4361303312_image_1.webp HTTP/1.1" 201 0
2025-12-05 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fa3d8fcd9-87bf-4330-911f-a7a0ab355a30_2ac78519-4f95-4a18-a96a-6a5d757b91e3.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/a3d8fcd9-87bf-4330-911f-a7a0ab355a30_2ac78519-4f95-4a18-a96a-6a5d757b91e3.jpg/250x188.webp saved to cache
2025-12-05 12:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7f02ee85-0288-5cd9-85da-7b4361303312
2025-12-05 12:01:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9dd5fd5d0>
2025-12-05 12:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 12:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f02ee85-0288-5cd9-85da-7b4361303312/7f02ee85-0288-5cd9-85da-7b4361303312_image_2.webp HTTP/1.1" 201 0
2025-12-05 12:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fa3d8fcd9-87bf-4330-911f-a7a0ab355a30_b954f6f6-032a-4f10-818e-484bf17fe07e.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/a3d8fcd9-87bf-4330-911f-a7a0ab355a30_b954f6f6-032a-4f10-818e-484bf17fe07e.jpg/250x188.webp saved to cache
2025-12-05 12:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7f02ee85-0288-5cd9-85da-7b4361303312
2025-12-05 12:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/a3d8fcd9-87bf-4330-911f-a7a0ab355a30_fed5d3a3-855e-4c5c-8844-29e4d4504081.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/a3d8fcd9-87bf-4330-911f-a7a0ab355a30_79ac8b66-7b89-437d-86f6-58bfb51f1e2f.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fa3d8fcd9-87bf-4330-911f-a7a0ab355a30_a5db07de-a4a0-4cb6-9ac1-fac9701dcb75.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/a3d8fcd9-87bf-4330-911f-a7a0ab355a30_a5db07de-a4a0-4cb6-9ac1-fac9701dcb75.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e06990>
2025-12-05 12:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 12:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f02ee85-0288-5cd9-85da-7b4361303312/7f02ee85-0288-5cd9-85da-7b4361303312_image_3.webp HTTP/1.1" 201 0
2025-12-05 12:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fa3d8fcd9-87bf-4330-911f-a7a0ab355a30_28b3fa9d-76f8-49a0-bfde-0dfc72ba921a.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/a3d8fcd9-87bf-4330-911f-a7a0ab355a30_28b3fa9d-76f8-49a0-bfde-0dfc72ba921a.jpg/250x188.webp saved to cache
2025-12-05 12:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7f02ee85-0288-5cd9-85da-7b4361303312
2025-12-05 12:01:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9dc11f5d0>
2025-12-05 12:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 12:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f02ee85-0288-5cd9-85da-7b4361303312/7f02ee85-0288-5cd9-85da-7b4361303312_image_4.webp HTTP/1.1" 201 0
2025-12-05 12:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fa3d8fcd9-87bf-4330-911f-a7a0ab355a30_660ed78a-6745-4feb-ae3f-f2abf9c7cc31.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/a3d8fcd9-87bf-4330-911f-a7a0ab355a30_660ed78a-6745-4feb-ae3f-f2abf9c7cc31.jpg/250x188.webp saved to cache
2025-12-05 12:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7f02ee85-0288-5cd9-85da-7b4361303312
2025-12-05 12:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fa3d8fcd9-87bf-4330-911f-a7a0ab355a30_c108457a-deba-4d9a-ab43-fa5524e6c423.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/a3d8fcd9-87bf-4330-911f-a7a0ab355a30_c108457a-deba-4d9a-ab43-fa5524e6c423.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/a3d8fcd9-87bf-4330-911f-a7a0ab355a30_60e901d4-c69a-4b07-a6cb-43defeb2a666.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fa3d8fcd9-87bf-4330-911f-a7a0ab355a30_8a0fb667-8f3c-4bba-ae5b-48584a3bcdd3.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/a3d8fcd9-87bf-4330-911f-a7a0ab355a30_8a0fb667-8f3c-4bba-ae5b-48584a3bcdd3.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5c90a50>
2025-12-05 12:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f02ee85-0288-5cd9-85da-7b4361303312/7f02ee85-0288-5cd9-85da-7b4361303312_image_6.webp HTTP/1.1" 201 0
2025-12-05 12:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fa3d8fcd9-87bf-4330-911f-a7a0ab355a30_fed5d3a3-855e-4c5c-8844-29e4d4504081.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/a3d8fcd9-87bf-4330-911f-a7a0ab355a30_fed5d3a3-855e-4c5c-8844-29e4d4504081.jpg/250x188.webp saved to cache
2025-12-05 12:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7f02ee85-0288-5cd9-85da-7b4361303312
2025-12-05 12:01:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e6efd0>
2025-12-05 12:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 12:01:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f02ee85-0288-5cd9-85da-7b4361303312/7f02ee85-0288-5cd9-85da-7b4361303312_image_5.webp HTTP/1.1" 201 0
2025-12-05 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fa3d8fcd9-87bf-4330-911f-a7a0ab355a30_79ac8b66-7b89-437d-86f6-58bfb51f1e2f.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/a3d8fcd9-87bf-4330-911f-a7a0ab355a30_79ac8b66-7b89-437d-86f6-58bfb51f1e2f.jpg/250x188.webp saved to cache
2025-12-05 12:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7f02ee85-0288-5cd9-85da-7b4361303312
2025-12-05 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fa3d8fcd9-87bf-4330-911f-a7a0ab355a30_924a88c4-28a5-4a5a-bd87-b9c8f031aaab.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/a3d8fcd9-87bf-4330-911f-a7a0ab355a30_924a88c4-28a5-4a5a-bd87-b9c8f031aaab.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/a3d8fcd9-87bf-4330-911f-a7a0ab355a30_c3f0961c-ecd3-45aa-bb86-bbfcfd79c419.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/a3d8fcd9-87bf-4330-911f-a7a0ab355a30_a5db07de-a4a0-4cb6-9ac1-fac9701dcb75.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fa3d8fcd9-87bf-4330-911f-a7a0ab355a30_b6d8705e-feb6-4168-ae07-96678ae002fc.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/a3d8fcd9-87bf-4330-911f-a7a0ab355a30_b6d8705e-feb6-4168-ae07-96678ae002fc.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5c9ca90>
2025-12-05 12:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:01:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f02ee85-0288-5cd9-85da-7b4361303312/7f02ee85-0288-5cd9-85da-7b4361303312_image_7.webp HTTP/1.1" 201 0
2025-12-05 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fa3d8fcd9-87bf-4330-911f-a7a0ab355a30_60e901d4-c69a-4b07-a6cb-43defeb2a666.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/a3d8fcd9-87bf-4330-911f-a7a0ab355a30_60e901d4-c69a-4b07-a6cb-43defeb2a666.jpg/250x188.webp saved to cache
2025-12-05 12:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7f02ee85-0288-5cd9-85da-7b4361303312
2025-12-05 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fa3d8fcd9-87bf-4330-911f-a7a0ab355a30_e9d3cd83-db09-46c6-a380-8326e3d688c4.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/a3d8fcd9-87bf-4330-911f-a7a0ab355a30_e9d3cd83-db09-46c6-a380-8326e3d688c4.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/a3d8fcd9-87bf-4330-911f-a7a0ab355a30_c108457a-deba-4d9a-ab43-fa5524e6c423.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/a3d8fcd9-87bf-4330-911f-a7a0ab355a30_8a0fb667-8f3c-4bba-ae5b-48584a3bcdd3.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:49 [auto_selling_autoscout24.it] INFO: Fetching listings for customerId: 31910200, page: 4
2025-12-05 12:01:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5c826d0>
2025-12-05 12:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:01:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f02ee85-0288-5cd9-85da-7b4361303312/7f02ee85-0288-5cd9-85da-7b4361303312_image_8.webp HTTP/1.1" 201 0
2025-12-05 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fa3d8fcd9-87bf-4330-911f-a7a0ab355a30_c3f0961c-ecd3-45aa-bb86-bbfcfd79c419.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/a3d8fcd9-87bf-4330-911f-a7a0ab355a30_c3f0961c-ecd3-45aa-bb86-bbfcfd79c419.jpg/250x188.webp saved to cache
2025-12-05 12:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7f02ee85-0288-5cd9-85da-7b4361303312
2025-12-05 12:01:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5cf9fd0>
2025-12-05 12:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 12:01:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f02ee85-0288-5cd9-85da-7b4361303312/7f02ee85-0288-5cd9-85da-7b4361303312_image_9.webp HTTP/1.1" 201 0
2025-12-05 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fa3d8fcd9-87bf-4330-911f-a7a0ab355a30_a5db07de-a4a0-4cb6-9ac1-fac9701dcb75.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/a3d8fcd9-87bf-4330-911f-a7a0ab355a30_a5db07de-a4a0-4cb6-9ac1-fac9701dcb75.jpg/250x188.webp saved to cache
2025-12-05 12:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7f02ee85-0288-5cd9-85da-7b4361303312
2025-12-05 12:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/a3d8fcd9-87bf-4330-911f-a7a0ab355a30_b6d8705e-feb6-4168-ae07-96678ae002fc.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/a3d8fcd9-87bf-4330-911f-a7a0ab355a30_924a88c4-28a5-4a5a-bd87-b9c8f031aaab.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 12:01:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d6f6a9d0>
2025-12-05 12:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 12:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f02ee85-0288-5cd9-85da-7b4361303312/7f02ee85-0288-5cd9-85da-7b4361303312_image_10.webp HTTP/1.1" 201 0
2025-12-05 12:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fa3d8fcd9-87bf-4330-911f-a7a0ab355a30_c108457a-deba-4d9a-ab43-fa5524e6c423.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/a3d8fcd9-87bf-4330-911f-a7a0ab355a30_c108457a-deba-4d9a-ab43-fa5524e6c423.jpg/250x188.webp saved to cache
2025-12-05 12:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 7f02ee85-0288-5cd9-85da-7b4361303312
2025-12-05 12:01:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d6fda2d0>
2025-12-05 12:01:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 12:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f02ee85-0288-5cd9-85da-7b4361303312/7f02ee85-0288-5cd9-85da-7b4361303312_image_11.webp HTTP/1.1" 201 0
2025-12-05 12:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fa3d8fcd9-87bf-4330-911f-a7a0ab355a30_8a0fb667-8f3c-4bba-ae5b-48584a3bcdd3.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/a3d8fcd9-87bf-4330-911f-a7a0ab355a30_8a0fb667-8f3c-4bba-ae5b-48584a3bcdd3.jpg/250x188.webp saved to cache
2025-12-05 12:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 7f02ee85-0288-5cd9-85da-7b4361303312
2025-12-05 12:01:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/a3d8fcd9-87bf-4330-911f-a7a0ab355a30_e9d3cd83-db09-46c6-a380-8326e3d688c4.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9dc13f950>
2025-12-05 12:01:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f02ee85-0288-5cd9-85da-7b4361303312/7f02ee85-0288-5cd9-85da-7b4361303312_image_13.webp HTTP/1.1" 201 0
2025-12-05 12:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fa3d8fcd9-87bf-4330-911f-a7a0ab355a30_b6d8705e-feb6-4168-ae07-96678ae002fc.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/a3d8fcd9-87bf-4330-911f-a7a0ab355a30_b6d8705e-feb6-4168-ae07-96678ae002fc.jpg/250x188.webp saved to cache
2025-12-05 12:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 7f02ee85-0288-5cd9-85da-7b4361303312
2025-12-05 12:01:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9dc189990>
2025-12-05 12:01:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 12:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f02ee85-0288-5cd9-85da-7b4361303312/7f02ee85-0288-5cd9-85da-7b4361303312_image_12.webp HTTP/1.1" 201 0
2025-12-05 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fa3d8fcd9-87bf-4330-911f-a7a0ab355a30_924a88c4-28a5-4a5a-bd87-b9c8f031aaab.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/a3d8fcd9-87bf-4330-911f-a7a0ab355a30_924a88c4-28a5-4a5a-bd87-b9c8f031aaab.jpg/250x188.webp saved to cache
2025-12-05 12:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 7f02ee85-0288-5cd9-85da-7b4361303312
2025-12-05 12:01:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e734d0>
2025-12-05 12:01:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 12:01:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f02ee85-0288-5cd9-85da-7b4361303312/7f02ee85-0288-5cd9-85da-7b4361303312_image_14.webp HTTP/1.1" 201 0
2025-12-05 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fa3d8fcd9-87bf-4330-911f-a7a0ab355a30_e9d3cd83-db09-46c6-a380-8326e3d688c4.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/a3d8fcd9-87bf-4330-911f-a7a0ab355a30_e9d3cd83-db09-46c6-a380-8326e3d688c4.jpg/250x188.webp saved to cache
2025-12-05 12:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 7f02ee85-0288-5cd9-85da-7b4361303312
2025-12-05 12:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 7f02ee85-0288-5cd9-85da-7b4361303312 from tracking dictionaries
2025-12-05 12:01:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7f02ee85-0288-5cd9-85da-7b4361303312 sending to next pipeline
2025-12-05 12:01:51 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 7f02ee85-0288-5cd9-85da-7b4361303312 with identifier a3d8fcd9-87bf-4330-911f-a7a0ab355a30
2025-12-05 12:01:51 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:01:51 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:01:51 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 7f02ee85-0288-5cd9-85da-7b4361303312
2025-12-05 12:01:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://prod.pictures.autoscout24.net/listing-images/a3d8fcd9-87bf-4330-911f-a7a0ab355a30_e9d3cd83-db09-46c6-a380-8326e3d688c4.jpg/250x188.webp>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'emission_standard': None,
 'engine': None,
 'engine_horse_power': 333,
 'expiration_date': None,
 'fuel_type': 'Gasoline',
 'id': '7f02ee85-0288-5cd9-85da-7b4361303312',
 'is_damaged': False,
 'is_operable': True,
 'license_plate': None,
 'link_to_web_offer': 'https://www.autoscout24.it/offers/audi-s3-sport-attitude-quattro-s-tronic-333cv-onlypromo-gasoline-black-a3d8fcd9-87bf-4330-911f-a7a0ab355a30',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'S3',
 'odometer': 1,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f02ee85-0288-5cd9-85da-7b4361303312/7f02ee85-0288-5cd9-85da-7b4361303312_image_0.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4210,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/a3d8fcd9-87bf-4330-911f-a7a0ab355a30_c6d8ed41-e4e0-4406-bf85-bb14396854ba.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f02ee85-0288-5cd9-85da-7b4361303312/7f02ee85-0288-5cd9-85da-7b4361303312_image_1.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4320,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/a3d8fcd9-87bf-4330-911f-a7a0ab355a30_2ac78519-4f95-4a18-a96a-6a5d757b91e3.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f02ee85-0288-5cd9-85da-7b4361303312/7f02ee85-0288-5cd9-85da-7b4361303312_image_2.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3824,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/a3d8fcd9-87bf-4330-911f-a7a0ab355a30_b954f6f6-032a-4f10-818e-484bf17fe07e.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f02ee85-0288-5cd9-85da-7b4361303312/7f02ee85-0288-5cd9-85da-7b4361303312_image_3.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4078,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/a3d8fcd9-87bf-4330-911f-a7a0ab355a30_28b3fa9d-76f8-49a0-bfde-0dfc72ba921a.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f02ee85-0288-5cd9-85da-7b4361303312/7f02ee85-0288-5cd9-85da-7b4361303312_image_4.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3616,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/a3d8fcd9-87bf-4330-911f-a7a0ab355a30_660ed78a-6745-4feb-ae3f-f2abf9c7cc31.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f02ee85-0288-5cd9-85da-7b4361303312/7f02ee85-0288-5cd9-85da-7b4361303312_image_5.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4318,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/a3d8fcd9-87bf-4330-911f-a7a0ab355a30_79ac8b66-7b89-437d-86f6-58bfb51f1e2f.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f02ee85-0288-5cd9-85da-7b4361303312/7f02ee85-0288-5cd9-85da-7b4361303312_image_6.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 6712,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/a3d8fcd9-87bf-4330-911f-a7a0ab355a30_fed5d3a3-855e-4c5c-8844-29e4d4504081.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f02ee85-0288-5cd9-85da-7b4361303312/7f02ee85-0288-5cd9-85da-7b4361303312_image_7.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5522,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/a3d8fcd9-87bf-4330-911f-a7a0ab355a30_60e901d4-c69a-4b07-a6cb-43defeb2a666.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f02ee85-0288-5cd9-85da-7b4361303312/7f02ee85-0288-5cd9-85da-7b4361303312_image_8.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 6566,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/a3d8fcd9-87bf-4330-911f-a7a0ab355a30_c3f0961c-ecd3-45aa-bb86-bbfcfd79c419.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f02ee85-0288-5cd9-85da-7b4361303312/7f02ee85-0288-5cd9-85da-7b4361303312_image_9.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3932,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/a3d8fcd9-87bf-4330-911f-a7a0ab355a30_a5db07de-a4a0-4cb6-9ac1-fac9701dcb75.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f02ee85-0288-5cd9-85da-7b4361303312/7f02ee85-0288-5cd9-85da-7b4361303312_image_10.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3810,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/a3d8fcd9-87bf-4330-911f-a7a0ab355a30_c108457a-deba-4d9a-ab43-fa5524e6c423.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f02ee85-0288-5cd9-85da-7b4361303312/7f02ee85-0288-5cd9-85da-7b4361303312_image_11.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3660,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/a3d8fcd9-87bf-4330-911f-a7a0ab355a30_8a0fb667-8f3c-4bba-ae5b-48584a3bcdd3.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f02ee85-0288-5cd9-85da-7b4361303312/7f02ee85-0288-5cd9-85da-7b4361303312_image_12.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4450,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/a3d8fcd9-87bf-4330-911f-a7a0ab355a30_924a88c4-28a5-4a5a-bd87-b9c8f031aaab.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f02ee85-0288-5cd9-85da-7b4361303312/7f02ee85-0288-5cd9-85da-7b4361303312_image_13.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 6960,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/a3d8fcd9-87bf-4330-911f-a7a0ab355a30_b6d8705e-feb6-4168-ae07-96678ae002fc.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f02ee85-0288-5cd9-85da-7b4361303312/7f02ee85-0288-5cd9-85da-7b4361303312_image_14.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4344,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/a3d8fcd9-87bf-4330-911f-a7a0ab355a30_e9d3cd83-db09-46c6-a380-8326e3d688c4.jpg/250x188.webp',
             'Width': 250}],
 'price': 55800,
 'price_includes_vat': False,
 'registration_date': '2025-08-01',
 'seller_name': None,
 'title': 'Audi S3 SPORT ATTITUDE QUATTRO S-TRONIC 333CV *ONLYPROMO*',
 'transmission': 'automatic',
 'trim': 'SPORT ATTITUDE QUATTRO S-TRONIC 333CV *ONLYPROMO*',
 'vin': None,
 'year': 2025}
2025-12-05 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27a3d8fcd9-87bf-4330-911f-a7a0ab355a30%27 HTTP/1.1" 200 None
2025-12-05 12:01:51 [auto_selling_autoscout24.it] INFO: Saving data for a3d8fcd9-87bf-4330-911f-a7a0ab355a30: {'created_time': 1764936111.333013, 'last_price_update_time': 1764936111.333023}
2025-12-05 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autoscout24.it',RowKey='a3d8fcd9-87bf-4330-911f-a7a0ab355a30') HTTP/1.1" 204 0
2025-12-05 12:01:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autoscout24.it/api/dealer-detail/fetch-listings> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings) ['zyte-api']
2025-12-05 12:01:59 [auto_selling_autoscout24.it] INFO: Parsing listings response for page: 4
2025-12-05 12:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%2725bfac62-7be8-464b-bfb0-8633134d704a%27 HTTP/1.1" 200 None
2025-12-05 12:01:59 [auto_selling_autoscout24.it] INFO: Scrape type for 25bfac62-7be8-464b-bfb0-8633134d704a: 1
2025-12-05 12:01:59 [auto_selling_autoscout24.it] INFO: Scraping new listing 25bfac62-7be8-464b-bfb0-8633134d704a
2025-12-05 12:01:59 [auto_selling_autoscout24.it] INFO: Extracting item from listing ID: 25bfac62-7be8-464b-bfb0-8633134d704a
2025-12-05 12:01:59 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: b3945d15-8aad-57af-81c1-3b0e55e51e9c with identifier: 25bfac62-7be8-464b-bfb0-8633134d704a
2025-12-05 12:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item b3945d15-8aad-57af-81c1-3b0e55e51e9c
2025-12-05 12:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F25bfac62-7be8-464b-bfb0-8633134d704a_d5cd2131-21ff-4a65-befc-2f57abdae26f.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/25bfac62-7be8-464b-bfb0-8633134d704a_d5cd2131-21ff-4a65-befc-2f57abdae26f.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F25bfac62-7be8-464b-bfb0-8633134d704a_ac4a8d8b-cb8d-4ef5-bedd-db5d70642ca8.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/25bfac62-7be8-464b-bfb0-8633134d704a_ac4a8d8b-cb8d-4ef5-bedd-db5d70642ca8.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F25bfac62-7be8-464b-bfb0-8633134d704a_11344217-015f-497e-aaa8-8bdcebce40af.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/25bfac62-7be8-464b-bfb0-8633134d704a_11344217-015f-497e-aaa8-8bdcebce40af.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F25bfac62-7be8-464b-bfb0-8633134d704a_9db5569b-0919-455c-86fa-01e039e74f23.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/25bfac62-7be8-464b-bfb0-8633134d704a_9db5569b-0919-455c-86fa-01e039e74f23.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F25bfac62-7be8-464b-bfb0-8633134d704a_6f0bcb7c-acf6-45c1-a139-0bdbbd98de66.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/25bfac62-7be8-464b-bfb0-8633134d704a_6f0bcb7c-acf6-45c1-a139-0bdbbd98de66.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/25bfac62-7be8-464b-bfb0-8633134d704a_d5cd2131-21ff-4a65-befc-2f57abdae26f.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F25bfac62-7be8-464b-bfb0-8633134d704a_301db017-bb61-400a-86ea-44b381fe1b71.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/25bfac62-7be8-464b-bfb0-8633134d704a_301db017-bb61-400a-86ea-44b381fe1b71.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F25bfac62-7be8-464b-bfb0-8633134d704a_d471f838-0d80-42cf-bc88-3eb21334267c.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/25bfac62-7be8-464b-bfb0-8633134d704a_d471f838-0d80-42cf-bc88-3eb21334267c.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F25bfac62-7be8-464b-bfb0-8633134d704a_f4261dc4-c488-4e45-9e88-998f95364099.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/25bfac62-7be8-464b-bfb0-8633134d704a_f4261dc4-c488-4e45-9e88-998f95364099.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F25bfac62-7be8-464b-bfb0-8633134d704a_b319eee5-b578-467d-8c98-96153c5da4b8.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/25bfac62-7be8-464b-bfb0-8633134d704a_b319eee5-b578-467d-8c98-96153c5da4b8.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27016de992-233a-4bd1-8c43-076947fb0779%27 HTTP/1.1" 200 None
2025-12-05 12:01:59 [auto_selling_autoscout24.it] INFO: Scrape type for 016de992-233a-4bd1-8c43-076947fb0779: 1
2025-12-05 12:01:59 [auto_selling_autoscout24.it] INFO: Scraping new listing 016de992-233a-4bd1-8c43-076947fb0779
2025-12-05 12:01:59 [auto_selling_autoscout24.it] INFO: Extracting item from listing ID: 016de992-233a-4bd1-8c43-076947fb0779
2025-12-05 12:01:59 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: d788fc68-b349-566d-877d-21dbbb7d5d26 with identifier: 016de992-233a-4bd1-8c43-076947fb0779
2025-12-05 12:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item d788fc68-b349-566d-877d-21dbbb7d5d26
2025-12-05 12:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F016de992-233a-4bd1-8c43-076947fb0779_e99e77de-6418-42fc-b9aa-c14b98a27d75.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/016de992-233a-4bd1-8c43-076947fb0779_e99e77de-6418-42fc-b9aa-c14b98a27d75.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:01:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:01:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:01:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5b94790>
2025-12-05 12:01:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:01:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 12:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:01:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3945d15-8aad-57af-81c1-3b0e55e51e9c/b3945d15-8aad-57af-81c1-3b0e55e51e9c_image_0.webp HTTP/1.1" 201 0
2025-12-05 12:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F25bfac62-7be8-464b-bfb0-8633134d704a_d5cd2131-21ff-4a65-befc-2f57abdae26f.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/25bfac62-7be8-464b-bfb0-8633134d704a_d5cd2131-21ff-4a65-befc-2f57abdae26f.jpg/250x188.webp saved to cache
2025-12-05 12:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b3945d15-8aad-57af-81c1-3b0e55e51e9c
2025-12-05 12:01:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/25bfac62-7be8-464b-bfb0-8633134d704a_ac4a8d8b-cb8d-4ef5-bedd-db5d70642ca8.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/25bfac62-7be8-464b-bfb0-8633134d704a_11344217-015f-497e-aaa8-8bdcebce40af.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F016de992-233a-4bd1-8c43-076947fb0779_d84b0273-31ee-48ce-9ce0-5351e2f032c3.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/016de992-233a-4bd1-8c43-076947fb0779_d84b0273-31ee-48ce-9ce0-5351e2f032c3.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/25bfac62-7be8-464b-bfb0-8633134d704a_9db5569b-0919-455c-86fa-01e039e74f23.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/25bfac62-7be8-464b-bfb0-8633134d704a_6f0bcb7c-acf6-45c1-a139-0bdbbd98de66.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/25bfac62-7be8-464b-bfb0-8633134d704a_301db017-bb61-400a-86ea-44b381fe1b71.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F016de992-233a-4bd1-8c43-076947fb0779_a3032fbc-c88b-4e33-935b-1978a43a311c.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/016de992-233a-4bd1-8c43-076947fb0779_a3032fbc-c88b-4e33-935b-1978a43a311c.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F016de992-233a-4bd1-8c43-076947fb0779_53aea22b-204f-4e1e-b328-f9dca088b29e.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/016de992-233a-4bd1-8c43-076947fb0779_53aea22b-204f-4e1e-b328-f9dca088b29e.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F016de992-233a-4bd1-8c43-076947fb0779_7a47485e-d266-4273-a03c-64e9da7f370c.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/016de992-233a-4bd1-8c43-076947fb0779_7a47485e-d266-4273-a03c-64e9da7f370c.jpg/250x188.webp not downloaded yet
2025-12-05 12:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F016de992-233a-4bd1-8c43-076947fb0779_a292de92-8458-46ce-8d25-6930e9c818bd.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/016de992-233a-4bd1-8c43-076947fb0779_a292de92-8458-46ce-8d25-6930e9c818bd.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/016de992-233a-4bd1-8c43-076947fb0779_d84b0273-31ee-48ce-9ce0-5351e2f032c3.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/016de992-233a-4bd1-8c43-076947fb0779_e99e77de-6418-42fc-b9aa-c14b98a27d75.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/25bfac62-7be8-464b-bfb0-8633134d704a_b319eee5-b578-467d-8c98-96153c5da4b8.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/25bfac62-7be8-464b-bfb0-8633134d704a_f4261dc4-c488-4e45-9e88-998f95364099.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/25bfac62-7be8-464b-bfb0-8633134d704a_d471f838-0d80-42cf-bc88-3eb21334267c.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27b3dbb372-dd37-4b17-8166-d3b6f0a70f84%27 HTTP/1.1" 200 None
2025-12-05 12:02:00 [auto_selling_autoscout24.it] INFO: Scrape type for b3dbb372-dd37-4b17-8166-d3b6f0a70f84: 1
2025-12-05 12:02:00 [auto_selling_autoscout24.it] INFO: Scraping new listing b3dbb372-dd37-4b17-8166-d3b6f0a70f84
2025-12-05 12:02:00 [auto_selling_autoscout24.it] INFO: Extracting item from listing ID: b3dbb372-dd37-4b17-8166-d3b6f0a70f84
2025-12-05 12:02:00 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 099d9b66-c023-5d33-8756-0b8e51cb07dd with identifier: b3dbb372-dd37-4b17-8166-d3b6f0a70f84
2025-12-05 12:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 14 photos for item 099d9b66-c023-5d33-8756-0b8e51cb07dd
2025-12-05 12:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fb3dbb372-dd37-4b17-8166-d3b6f0a70f84_023fee56-8e92-4343-8a9e-65cf17adff91.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/b3dbb372-dd37-4b17-8166-d3b6f0a70f84_023fee56-8e92-4343-8a9e-65cf17adff91.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9dc160890>
2025-12-05 12:02:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 12:02:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3945d15-8aad-57af-81c1-3b0e55e51e9c/b3945d15-8aad-57af-81c1-3b0e55e51e9c_image_1.webp HTTP/1.1" 201 0
2025-12-05 12:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F25bfac62-7be8-464b-bfb0-8633134d704a_ac4a8d8b-cb8d-4ef5-bedd-db5d70642ca8.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/25bfac62-7be8-464b-bfb0-8633134d704a_ac4a8d8b-cb8d-4ef5-bedd-db5d70642ca8.jpg/250x188.webp saved to cache
2025-12-05 12:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b3945d15-8aad-57af-81c1-3b0e55e51e9c
2025-12-05 12:02:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e5ca10>
2025-12-05 12:02:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:02:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3945d15-8aad-57af-81c1-3b0e55e51e9c/b3945d15-8aad-57af-81c1-3b0e55e51e9c_image_2.webp HTTP/1.1" 201 0
2025-12-05 12:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F25bfac62-7be8-464b-bfb0-8633134d704a_11344217-015f-497e-aaa8-8bdcebce40af.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/25bfac62-7be8-464b-bfb0-8633134d704a_11344217-015f-497e-aaa8-8bdcebce40af.jpg/250x188.webp saved to cache
2025-12-05 12:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b3945d15-8aad-57af-81c1-3b0e55e51e9c
2025-12-05 12:02:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d6faf4d0>
2025-12-05 12:02:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:02:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3945d15-8aad-57af-81c1-3b0e55e51e9c/b3945d15-8aad-57af-81c1-3b0e55e51e9c_image_3.webp HTTP/1.1" 201 0
2025-12-05 12:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F25bfac62-7be8-464b-bfb0-8633134d704a_9db5569b-0919-455c-86fa-01e039e74f23.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/25bfac62-7be8-464b-bfb0-8633134d704a_9db5569b-0919-455c-86fa-01e039e74f23.jpg/250x188.webp saved to cache
2025-12-05 12:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b3945d15-8aad-57af-81c1-3b0e55e51e9c
2025-12-05 12:02:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e78690>
2025-12-05 12:02:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3945d15-8aad-57af-81c1-3b0e55e51e9c/b3945d15-8aad-57af-81c1-3b0e55e51e9c_image_4.webp HTTP/1.1" 201 0
2025-12-05 12:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F25bfac62-7be8-464b-bfb0-8633134d704a_6f0bcb7c-acf6-45c1-a139-0bdbbd98de66.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/25bfac62-7be8-464b-bfb0-8633134d704a_6f0bcb7c-acf6-45c1-a139-0bdbbd98de66.jpg/250x188.webp saved to cache
2025-12-05 12:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b3945d15-8aad-57af-81c1-3b0e55e51e9c
2025-12-05 12:02:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d6f8f4d0>
2025-12-05 12:02:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 12:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3945d15-8aad-57af-81c1-3b0e55e51e9c/b3945d15-8aad-57af-81c1-3b0e55e51e9c_image_5.webp HTTP/1.1" 201 0
2025-12-05 12:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F25bfac62-7be8-464b-bfb0-8633134d704a_301db017-bb61-400a-86ea-44b381fe1b71.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/25bfac62-7be8-464b-bfb0-8633134d704a_301db017-bb61-400a-86ea-44b381fe1b71.jpg/250x188.webp saved to cache
2025-12-05 12:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b3945d15-8aad-57af-81c1-3b0e55e51e9c
2025-12-05 12:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fb3dbb372-dd37-4b17-8166-d3b6f0a70f84_2e556cab-2e25-4894-900d-290c05d6a90d.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/b3dbb372-dd37-4b17-8166-d3b6f0a70f84_2e556cab-2e25-4894-900d-290c05d6a90d.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fb3dbb372-dd37-4b17-8166-d3b6f0a70f84_26b15de4-de4b-4a44-ab29-7f87c038cc09.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/b3dbb372-dd37-4b17-8166-d3b6f0a70f84_26b15de4-de4b-4a44-ab29-7f87c038cc09.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5eb47d0>
2025-12-05 12:02:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 12:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d788fc68-b349-566d-877d-21dbbb7d5d26/d788fc68-b349-566d-877d-21dbbb7d5d26_image_1.webp HTTP/1.1" 201 0
2025-12-05 12:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F016de992-233a-4bd1-8c43-076947fb0779_d84b0273-31ee-48ce-9ce0-5351e2f032c3.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/016de992-233a-4bd1-8c43-076947fb0779_d84b0273-31ee-48ce-9ce0-5351e2f032c3.jpg/250x188.webp saved to cache
2025-12-05 12:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d788fc68-b349-566d-877d-21dbbb7d5d26
2025-12-05 12:02:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d6f28290>
2025-12-05 12:02:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 12:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d788fc68-b349-566d-877d-21dbbb7d5d26/d788fc68-b349-566d-877d-21dbbb7d5d26_image_0.webp HTTP/1.1" 201 0
2025-12-05 12:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F016de992-233a-4bd1-8c43-076947fb0779_e99e77de-6418-42fc-b9aa-c14b98a27d75.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/016de992-233a-4bd1-8c43-076947fb0779_e99e77de-6418-42fc-b9aa-c14b98a27d75.jpg/250x188.webp saved to cache
2025-12-05 12:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d788fc68-b349-566d-877d-21dbbb7d5d26
2025-12-05 12:02:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9dc1b9fd0>
2025-12-05 12:02:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3945d15-8aad-57af-81c1-3b0e55e51e9c/b3945d15-8aad-57af-81c1-3b0e55e51e9c_image_8.webp HTTP/1.1" 201 0
2025-12-05 12:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F25bfac62-7be8-464b-bfb0-8633134d704a_b319eee5-b578-467d-8c98-96153c5da4b8.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/25bfac62-7be8-464b-bfb0-8633134d704a_b319eee5-b578-467d-8c98-96153c5da4b8.jpg/250x188.webp saved to cache
2025-12-05 12:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b3945d15-8aad-57af-81c1-3b0e55e51e9c
2025-12-05 12:02:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5b97810>
2025-12-05 12:02:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 12:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3945d15-8aad-57af-81c1-3b0e55e51e9c/b3945d15-8aad-57af-81c1-3b0e55e51e9c_image_7.webp HTTP/1.1" 201 0
2025-12-05 12:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F25bfac62-7be8-464b-bfb0-8633134d704a_f4261dc4-c488-4e45-9e88-998f95364099.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/25bfac62-7be8-464b-bfb0-8633134d704a_f4261dc4-c488-4e45-9e88-998f95364099.jpg/250x188.webp saved to cache
2025-12-05 12:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b3945d15-8aad-57af-81c1-3b0e55e51e9c
2025-12-05 12:02:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5ce0390>
2025-12-05 12:02:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 12:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3945d15-8aad-57af-81c1-3b0e55e51e9c/b3945d15-8aad-57af-81c1-3b0e55e51e9c_image_6.webp HTTP/1.1" 201 0
2025-12-05 12:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F25bfac62-7be8-464b-bfb0-8633134d704a_d471f838-0d80-42cf-bc88-3eb21334267c.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/25bfac62-7be8-464b-bfb0-8633134d704a_d471f838-0d80-42cf-bc88-3eb21334267c.jpg/250x188.webp saved to cache
2025-12-05 12:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b3945d15-8aad-57af-81c1-3b0e55e51e9c
2025-12-05 12:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Removing item b3945d15-8aad-57af-81c1-3b0e55e51e9c from tracking dictionaries
2025-12-05 12:02:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b3945d15-8aad-57af-81c1-3b0e55e51e9c sending to next pipeline
2025-12-05 12:02:02 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: b3945d15-8aad-57af-81c1-3b0e55e51e9c with identifier 25bfac62-7be8-464b-bfb0-8633134d704a
2025-12-05 12:02:02 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:02:02 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:02:02 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item b3945d15-8aad-57af-81c1-3b0e55e51e9c
2025-12-05 12:02:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://prod.pictures.autoscout24.net/listing-images/25bfac62-7be8-464b-bfb0-8633134d704a_d471f838-0d80-42cf-bc88-3eb21334267c.jpg/250x188.webp>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'emission_standard': None,
 'engine': None,
 'engine_horse_power': 252,
 'expiration_date': None,
 'fuel_type': 'Gasoline',
 'id': 'b3945d15-8aad-57af-81c1-3b0e55e51e9c',
 'is_damaged': False,
 'is_operable': True,
 'license_plate': None,
 'link_to_web_offer': 'https://www.autoscout24.it/offers/porsche-boxster-s-3-2-252cv-tagliandi-certificati-garantita-gasoline-silver-25bfac62-7be8-464b-bfb0-8633134d704a',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Boxster',
 'odometer': 44400,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3945d15-8aad-57af-81c1-3b0e55e51e9c/b3945d15-8aad-57af-81c1-3b0e55e51e9c_image_0.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3126,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/25bfac62-7be8-464b-bfb0-8633134d704a_d5cd2131-21ff-4a65-befc-2f57abdae26f.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3945d15-8aad-57af-81c1-3b0e55e51e9c/b3945d15-8aad-57af-81c1-3b0e55e51e9c_image_1.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 2834,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/25bfac62-7be8-464b-bfb0-8633134d704a_ac4a8d8b-cb8d-4ef5-bedd-db5d70642ca8.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3945d15-8aad-57af-81c1-3b0e55e51e9c/b3945d15-8aad-57af-81c1-3b0e55e51e9c_image_2.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3060,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/25bfac62-7be8-464b-bfb0-8633134d704a_11344217-015f-497e-aaa8-8bdcebce40af.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3945d15-8aad-57af-81c1-3b0e55e51e9c/b3945d15-8aad-57af-81c1-3b0e55e51e9c_image_3.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3048,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/25bfac62-7be8-464b-bfb0-8633134d704a_9db5569b-0919-455c-86fa-01e039e74f23.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3945d15-8aad-57af-81c1-3b0e55e51e9c/b3945d15-8aad-57af-81c1-3b0e55e51e9c_image_4.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 6570,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/25bfac62-7be8-464b-bfb0-8633134d704a_6f0bcb7c-acf6-45c1-a139-0bdbbd98de66.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3945d15-8aad-57af-81c1-3b0e55e51e9c/b3945d15-8aad-57af-81c1-3b0e55e51e9c_image_5.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5772,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/25bfac62-7be8-464b-bfb0-8633134d704a_301db017-bb61-400a-86ea-44b381fe1b71.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3945d15-8aad-57af-81c1-3b0e55e51e9c/b3945d15-8aad-57af-81c1-3b0e55e51e9c_image_6.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4244,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/25bfac62-7be8-464b-bfb0-8633134d704a_d471f838-0d80-42cf-bc88-3eb21334267c.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3945d15-8aad-57af-81c1-3b0e55e51e9c/b3945d15-8aad-57af-81c1-3b0e55e51e9c_image_7.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4590,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/25bfac62-7be8-464b-bfb0-8633134d704a_f4261dc4-c488-4e45-9e88-998f95364099.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3945d15-8aad-57af-81c1-3b0e55e51e9c/b3945d15-8aad-57af-81c1-3b0e55e51e9c_image_8.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3084,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/25bfac62-7be8-464b-bfb0-8633134d704a_b319eee5-b578-467d-8c98-96153c5da4b8.jpg/250x188.webp',
             'Width': 250}],
 'price': 38500,
 'price_includes_vat': False,
 'registration_date': '2001-09-01',
 'seller_name': None,
 'title': 'Porsche Boxster S 3.2 252CV TAGLIANDI CERTIFICATI GARANTITA',
 'transmission': 'automatic',
 'trim': 'S 3.2 252CV TAGLIANDI CERTIFICATI GARANTITA',
 'vin': None,
 'year': 2001}
2025-12-05 12:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%2725bfac62-7be8-464b-bfb0-8633134d704a%27 HTTP/1.1" 200 None
2025-12-05 12:02:02 [auto_selling_autoscout24.it] INFO: Saving data for 25bfac62-7be8-464b-bfb0-8633134d704a: {'created_time': 1764936122.813382, 'last_price_update_time': 1764936122.81339}
2025-12-05 12:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autoscout24.it',RowKey='25bfac62-7be8-464b-bfb0-8633134d704a') HTTP/1.1" 204 0
2025-12-05 12:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/b3dbb372-dd37-4b17-8166-d3b6f0a70f84_023fee56-8e92-4343-8a9e-65cf17adff91.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/016de992-233a-4bd1-8c43-076947fb0779_a292de92-8458-46ce-8d25-6930e9c818bd.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/016de992-233a-4bd1-8c43-076947fb0779_a3032fbc-c88b-4e33-935b-1978a43a311c.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/016de992-233a-4bd1-8c43-076947fb0779_7a47485e-d266-4273-a03c-64e9da7f370c.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/016de992-233a-4bd1-8c43-076947fb0779_53aea22b-204f-4e1e-b328-f9dca088b29e.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fb3dbb372-dd37-4b17-8166-d3b6f0a70f84_d13dcd86-9b88-4f5c-a840-4b965d869078.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/b3dbb372-dd37-4b17-8166-d3b6f0a70f84_d13dcd86-9b88-4f5c-a840-4b965d869078.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fb3dbb372-dd37-4b17-8166-d3b6f0a70f84_c529fa0a-2d44-429e-b268-c841eeaeb2a0.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/b3dbb372-dd37-4b17-8166-d3b6f0a70f84_c529fa0a-2d44-429e-b268-c841eeaeb2a0.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fb3dbb372-dd37-4b17-8166-d3b6f0a70f84_a34bb119-7fea-49cc-9144-a56ba1c1e026.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/b3dbb372-dd37-4b17-8166-d3b6f0a70f84_a34bb119-7fea-49cc-9144-a56ba1c1e026.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fb3dbb372-dd37-4b17-8166-d3b6f0a70f84_3d586db1-55fd-4ef5-b99a-fc21095fd4d4.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/b3dbb372-dd37-4b17-8166-d3b6f0a70f84_3d586db1-55fd-4ef5-b99a-fc21095fd4d4.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fb3dbb372-dd37-4b17-8166-d3b6f0a70f84_070dd7c3-b863-410b-996a-23e76af61946.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/b3dbb372-dd37-4b17-8166-d3b6f0a70f84_070dd7c3-b863-410b-996a-23e76af61946.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fb3dbb372-dd37-4b17-8166-d3b6f0a70f84_6436b646-a887-4317-9224-490e5fdbb687.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/b3dbb372-dd37-4b17-8166-d3b6f0a70f84_6436b646-a887-4317-9224-490e5fdbb687.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fb3dbb372-dd37-4b17-8166-d3b6f0a70f84_a690fb5f-8cf7-4a3f-a86b-08a6d626745d.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/b3dbb372-dd37-4b17-8166-d3b6f0a70f84_a690fb5f-8cf7-4a3f-a86b-08a6d626745d.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fb3dbb372-dd37-4b17-8166-d3b6f0a70f84_553b53b6-16a2-44bb-a677-3df08cf9f160.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/b3dbb372-dd37-4b17-8166-d3b6f0a70f84_553b53b6-16a2-44bb-a677-3df08cf9f160.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e79950>
2025-12-05 12:02:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_099d9b66-c023-5d33-8756-0b8e51cb07dd/099d9b66-c023-5d33-8756-0b8e51cb07dd_image_0.webp HTTP/1.1" 201 0
2025-12-05 12:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fb3dbb372-dd37-4b17-8166-d3b6f0a70f84_023fee56-8e92-4343-8a9e-65cf17adff91.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/b3dbb372-dd37-4b17-8166-d3b6f0a70f84_023fee56-8e92-4343-8a9e-65cf17adff91.jpg/250x188.webp saved to cache
2025-12-05 12:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 099d9b66-c023-5d33-8756-0b8e51cb07dd
2025-12-05 12:02:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9dc106e90>
2025-12-05 12:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 12:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d788fc68-b349-566d-877d-21dbbb7d5d26/d788fc68-b349-566d-877d-21dbbb7d5d26_image_5.webp HTTP/1.1" 201 0
2025-12-05 12:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F016de992-233a-4bd1-8c43-076947fb0779_a292de92-8458-46ce-8d25-6930e9c818bd.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/016de992-233a-4bd1-8c43-076947fb0779_a292de92-8458-46ce-8d25-6930e9c818bd.jpg/250x188.webp saved to cache
2025-12-05 12:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d788fc68-b349-566d-877d-21dbbb7d5d26
2025-12-05 12:02:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e99210>
2025-12-05 12:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 12:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d788fc68-b349-566d-877d-21dbbb7d5d26/d788fc68-b349-566d-877d-21dbbb7d5d26_image_2.webp HTTP/1.1" 201 0
2025-12-05 12:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F016de992-233a-4bd1-8c43-076947fb0779_a3032fbc-c88b-4e33-935b-1978a43a311c.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/016de992-233a-4bd1-8c43-076947fb0779_a3032fbc-c88b-4e33-935b-1978a43a311c.jpg/250x188.webp saved to cache
2025-12-05 12:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d788fc68-b349-566d-877d-21dbbb7d5d26
2025-12-05 12:02:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e9aed0>
2025-12-05 12:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d788fc68-b349-566d-877d-21dbbb7d5d26/d788fc68-b349-566d-877d-21dbbb7d5d26_image_4.webp HTTP/1.1" 201 0
2025-12-05 12:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F016de992-233a-4bd1-8c43-076947fb0779_7a47485e-d266-4273-a03c-64e9da7f370c.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/016de992-233a-4bd1-8c43-076947fb0779_7a47485e-d266-4273-a03c-64e9da7f370c.jpg/250x188.webp saved to cache
2025-12-05 12:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d788fc68-b349-566d-877d-21dbbb7d5d26
2025-12-05 12:02:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9dc105150>
2025-12-05 12:02:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 12:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d788fc68-b349-566d-877d-21dbbb7d5d26/d788fc68-b349-566d-877d-21dbbb7d5d26_image_3.webp HTTP/1.1" 201 0
2025-12-05 12:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F016de992-233a-4bd1-8c43-076947fb0779_53aea22b-204f-4e1e-b328-f9dca088b29e.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/016de992-233a-4bd1-8c43-076947fb0779_53aea22b-204f-4e1e-b328-f9dca088b29e.jpg/250x188.webp saved to cache
2025-12-05 12:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d788fc68-b349-566d-877d-21dbbb7d5d26
2025-12-05 12:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Removing item d788fc68-b349-566d-877d-21dbbb7d5d26 from tracking dictionaries
2025-12-05 12:02:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d788fc68-b349-566d-877d-21dbbb7d5d26 sending to next pipeline
2025-12-05 12:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fb3dbb372-dd37-4b17-8166-d3b6f0a70f84_a269b14c-a534-458d-805e-90b64b37439e.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/b3dbb372-dd37-4b17-8166-d3b6f0a70f84_a269b14c-a534-458d-805e-90b64b37439e.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:04 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: d788fc68-b349-566d-877d-21dbbb7d5d26 with identifier 016de992-233a-4bd1-8c43-076947fb0779
2025-12-05 12:02:04 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:02:04 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:02:04 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item d788fc68-b349-566d-877d-21dbbb7d5d26
2025-12-05 12:02:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://prod.pictures.autoscout24.net/listing-images/016de992-233a-4bd1-8c43-076947fb0779_53aea22b-204f-4e1e-b328-f9dca088b29e.jpg/250x188.webp>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'emission_standard': None,
 'engine': None,
 'engine_horse_power': 204,
 'expiration_date': None,
 'fuel_type': 'Electric/Diesel',
 'id': 'd788fc68-b349-566d-877d-21dbbb7d5d26',
 'is_damaged': False,
 'is_operable': True,
 'license_plate': None,
 'link_to_web_offer': 'https://www.autoscout24.it/offers/audi-q5-facelift-tdi-quattro-s-tronic-204cv-my2025-promo-electric-diesel-grey-016de992-233a-4bd1-8c43-076947fb0779',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 1,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d788fc68-b349-566d-877d-21dbbb7d5d26/d788fc68-b349-566d-877d-21dbbb7d5d26_image_0.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3880,
             'Height': 148,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/016de992-233a-4bd1-8c43-076947fb0779_e99e77de-6418-42fc-b9aa-c14b98a27d75.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d788fc68-b349-566d-877d-21dbbb7d5d26/d788fc68-b349-566d-877d-21dbbb7d5d26_image_1.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 2932,
             'Height': 122,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/016de992-233a-4bd1-8c43-076947fb0779_d84b0273-31ee-48ce-9ce0-5351e2f032c3.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d788fc68-b349-566d-877d-21dbbb7d5d26/d788fc68-b349-566d-877d-21dbbb7d5d26_image_2.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3662,
             'Height': 145,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/016de992-233a-4bd1-8c43-076947fb0779_a3032fbc-c88b-4e33-935b-1978a43a311c.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d788fc68-b349-566d-877d-21dbbb7d5d26/d788fc68-b349-566d-877d-21dbbb7d5d26_image_3.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 2470,
             'Height': 107,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/016de992-233a-4bd1-8c43-076947fb0779_53aea22b-204f-4e1e-b328-f9dca088b29e.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d788fc68-b349-566d-877d-21dbbb7d5d26/d788fc68-b349-566d-877d-21dbbb7d5d26_image_4.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 2834,
             'Height': 110,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/016de992-233a-4bd1-8c43-076947fb0779_7a47485e-d266-4273-a03c-64e9da7f370c.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d788fc68-b349-566d-877d-21dbbb7d5d26/d788fc68-b349-566d-877d-21dbbb7d5d26_image_5.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 1916,
             'Height': 108,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/016de992-233a-4bd1-8c43-076947fb0779_a292de92-8458-46ce-8d25-6930e9c818bd.jpg/250x188.webp',
             'Width': 250}],
 'price': 76500,
 'price_includes_vat': False,
 'registration_date': '2025-09-01',
 'seller_name': None,
 'title': 'Audi Q5 FACELIFT TDI QUATTRO S-TRONIC 204CV MY2025 PROMO!',
 'transmission': 'automatic',
 'trim': 'FACELIFT TDI QUATTRO S-TRONIC 204CV MY2025 PROMO!',
 'vin': None,
 'year': 2025}
2025-12-05 12:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27016de992-233a-4bd1-8c43-076947fb0779%27 HTTP/1.1" 200 None
2025-12-05 12:02:04 [auto_selling_autoscout24.it] INFO: Saving data for 016de992-233a-4bd1-8c43-076947fb0779: {'created_time': 1764936124.369795, 'last_price_update_time': 1764936124.369804}
2025-12-05 12:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autoscout24.it',RowKey='016de992-233a-4bd1-8c43-076947fb0779') HTTP/1.1" 204 0
2025-12-05 12:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/b3dbb372-dd37-4b17-8166-d3b6f0a70f84_2e556cab-2e25-4894-900d-290c05d6a90d.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/b3dbb372-dd37-4b17-8166-d3b6f0a70f84_26b15de4-de4b-4a44-ab29-7f87c038cc09.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/b3dbb372-dd37-4b17-8166-d3b6f0a70f84_c529fa0a-2d44-429e-b268-c841eeaeb2a0.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/b3dbb372-dd37-4b17-8166-d3b6f0a70f84_d13dcd86-9b88-4f5c-a840-4b965d869078.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/b3dbb372-dd37-4b17-8166-d3b6f0a70f84_a34bb119-7fea-49cc-9144-a56ba1c1e026.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fb3dbb372-dd37-4b17-8166-d3b6f0a70f84_ef153d24-7b9e-41f2-a802-7f509f2e5233.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/b3dbb372-dd37-4b17-8166-d3b6f0a70f84_ef153d24-7b9e-41f2-a802-7f509f2e5233.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fb3dbb372-dd37-4b17-8166-d3b6f0a70f84_be46d50d-a767-4d8d-a36f-92cfa93603c1.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/b3dbb372-dd37-4b17-8166-d3b6f0a70f84_be46d50d-a767-4d8d-a36f-92cfa93603c1.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%2701145911-c8f1-4f92-bfcf-49c8d88d3075%27 HTTP/1.1" 200 None
2025-12-05 12:02:04 [auto_selling_autoscout24.it] INFO: Scrape type for 01145911-c8f1-4f92-bfcf-49c8d88d3075: 1
2025-12-05 12:02:04 [auto_selling_autoscout24.it] INFO: Scraping new listing 01145911-c8f1-4f92-bfcf-49c8d88d3075
2025-12-05 12:02:04 [auto_selling_autoscout24.it] INFO: Extracting item from listing ID: 01145911-c8f1-4f92-bfcf-49c8d88d3075
2025-12-05 12:02:04 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 84d0dbf5-4fac-5144-84bf-ccdfb26d9f0f with identifier: 01145911-c8f1-4f92-bfcf-49c8d88d3075
2025-12-05 12:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 84d0dbf5-4fac-5144-84bf-ccdfb26d9f0f
2025-12-05 12:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F01145911-c8f1-4f92-bfcf-49c8d88d3075_993424ca-ec11-4d46-8cf8-6362338caf06.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/01145911-c8f1-4f92-bfcf-49c8d88d3075_993424ca-ec11-4d46-8cf8-6362338caf06.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F01145911-c8f1-4f92-bfcf-49c8d88d3075_e2fd3a7e-9c69-415d-ba90-aa2087b90509.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/01145911-c8f1-4f92-bfcf-49c8d88d3075_e2fd3a7e-9c69-415d-ba90-aa2087b90509.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F01145911-c8f1-4f92-bfcf-49c8d88d3075_544055fe-3453-44d5-8795-d1ec868ec208.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/01145911-c8f1-4f92-bfcf-49c8d88d3075_544055fe-3453-44d5-8795-d1ec868ec208.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F01145911-c8f1-4f92-bfcf-49c8d88d3075_21031d5f-d620-411d-99f1-7e33b76de3ec.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/01145911-c8f1-4f92-bfcf-49c8d88d3075_21031d5f-d620-411d-99f1-7e33b76de3ec.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9dc101890>
2025-12-05 12:02:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_099d9b66-c023-5d33-8756-0b8e51cb07dd/099d9b66-c023-5d33-8756-0b8e51cb07dd_image_1.webp HTTP/1.1" 201 0
2025-12-05 12:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fb3dbb372-dd37-4b17-8166-d3b6f0a70f84_2e556cab-2e25-4894-900d-290c05d6a90d.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/b3dbb372-dd37-4b17-8166-d3b6f0a70f84_2e556cab-2e25-4894-900d-290c05d6a90d.jpg/250x188.webp saved to cache
2025-12-05 12:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 099d9b66-c023-5d33-8756-0b8e51cb07dd
2025-12-05 12:02:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9dd5d3dd0>
2025-12-05 12:02:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_099d9b66-c023-5d33-8756-0b8e51cb07dd/099d9b66-c023-5d33-8756-0b8e51cb07dd_image_2.webp HTTP/1.1" 201 0
2025-12-05 12:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fb3dbb372-dd37-4b17-8166-d3b6f0a70f84_26b15de4-de4b-4a44-ab29-7f87c038cc09.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/b3dbb372-dd37-4b17-8166-d3b6f0a70f84_26b15de4-de4b-4a44-ab29-7f87c038cc09.jpg/250x188.webp saved to cache
2025-12-05 12:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 099d9b66-c023-5d33-8756-0b8e51cb07dd
2025-12-05 12:02:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e5f6d0>
2025-12-05 12:02:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_099d9b66-c023-5d33-8756-0b8e51cb07dd/099d9b66-c023-5d33-8756-0b8e51cb07dd_image_4.webp HTTP/1.1" 201 0
2025-12-05 12:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fb3dbb372-dd37-4b17-8166-d3b6f0a70f84_c529fa0a-2d44-429e-b268-c841eeaeb2a0.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/b3dbb372-dd37-4b17-8166-d3b6f0a70f84_c529fa0a-2d44-429e-b268-c841eeaeb2a0.jpg/250x188.webp saved to cache
2025-12-05 12:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 099d9b66-c023-5d33-8756-0b8e51cb07dd
2025-12-05 12:02:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d6f5ae90>
2025-12-05 12:02:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 12:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_099d9b66-c023-5d33-8756-0b8e51cb07dd/099d9b66-c023-5d33-8756-0b8e51cb07dd_image_3.webp HTTP/1.1" 201 0
2025-12-05 12:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fb3dbb372-dd37-4b17-8166-d3b6f0a70f84_d13dcd86-9b88-4f5c-a840-4b965d869078.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/b3dbb372-dd37-4b17-8166-d3b6f0a70f84_d13dcd86-9b88-4f5c-a840-4b965d869078.jpg/250x188.webp saved to cache
2025-12-05 12:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 099d9b66-c023-5d33-8756-0b8e51cb07dd
2025-12-05 12:02:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5c5c3d0>
2025-12-05 12:02:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 12:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_099d9b66-c023-5d33-8756-0b8e51cb07dd/099d9b66-c023-5d33-8756-0b8e51cb07dd_image_5.webp HTTP/1.1" 201 0
2025-12-05 12:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fb3dbb372-dd37-4b17-8166-d3b6f0a70f84_a34bb119-7fea-49cc-9144-a56ba1c1e026.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/b3dbb372-dd37-4b17-8166-d3b6f0a70f84_a34bb119-7fea-49cc-9144-a56ba1c1e026.jpg/250x188.webp saved to cache
2025-12-05 12:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 099d9b66-c023-5d33-8756-0b8e51cb07dd
2025-12-05 12:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F01145911-c8f1-4f92-bfcf-49c8d88d3075_e28c013d-0470-461e-a26b-5c2d7cac6c6a.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/01145911-c8f1-4f92-bfcf-49c8d88d3075_e28c013d-0470-461e-a26b-5c2d7cac6c6a.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/b3dbb372-dd37-4b17-8166-d3b6f0a70f84_3d586db1-55fd-4ef5-b99a-fc21095fd4d4.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/b3dbb372-dd37-4b17-8166-d3b6f0a70f84_553b53b6-16a2-44bb-a677-3df08cf9f160.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/b3dbb372-dd37-4b17-8166-d3b6f0a70f84_070dd7c3-b863-410b-996a-23e76af61946.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/b3dbb372-dd37-4b17-8166-d3b6f0a70f84_a690fb5f-8cf7-4a3f-a86b-08a6d626745d.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/b3dbb372-dd37-4b17-8166-d3b6f0a70f84_6436b646-a887-4317-9224-490e5fdbb687.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F01145911-c8f1-4f92-bfcf-49c8d88d3075_38a3744a-ff79-4ed3-ba54-1b98949f660d.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/01145911-c8f1-4f92-bfcf-49c8d88d3075_38a3744a-ff79-4ed3-ba54-1b98949f660d.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F01145911-c8f1-4f92-bfcf-49c8d88d3075_d10fa548-8741-4720-b94c-49f624d0e593.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/01145911-c8f1-4f92-bfcf-49c8d88d3075_d10fa548-8741-4720-b94c-49f624d0e593.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F01145911-c8f1-4f92-bfcf-49c8d88d3075_b2b603b4-192b-4f22-9d1f-63f2e1c7e081.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/01145911-c8f1-4f92-bfcf-49c8d88d3075_b2b603b4-192b-4f22-9d1f-63f2e1c7e081.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/01145911-c8f1-4f92-bfcf-49c8d88d3075_21031d5f-d620-411d-99f1-7e33b76de3ec.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/01145911-c8f1-4f92-bfcf-49c8d88d3075_544055fe-3453-44d5-8795-d1ec868ec208.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F01145911-c8f1-4f92-bfcf-49c8d88d3075_290e0fca-781a-479d-ac1d-dfe9957779b4.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/01145911-c8f1-4f92-bfcf-49c8d88d3075_290e0fca-781a-479d-ac1d-dfe9957779b4.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/01145911-c8f1-4f92-bfcf-49c8d88d3075_993424ca-ec11-4d46-8cf8-6362338caf06.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F01145911-c8f1-4f92-bfcf-49c8d88d3075_0583cb14-0226-4944-9cc8-6821932c2ec7.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/01145911-c8f1-4f92-bfcf-49c8d88d3075_0583cb14-0226-4944-9cc8-6821932c2ec7.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F01145911-c8f1-4f92-bfcf-49c8d88d3075_ad901f9b-c75e-43dc-9b48-48d69241cacc.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/01145911-c8f1-4f92-bfcf-49c8d88d3075_ad901f9b-c75e-43dc-9b48-48d69241cacc.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F01145911-c8f1-4f92-bfcf-49c8d88d3075_2e3d06ae-6920-4428-9298-35233380626e.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/01145911-c8f1-4f92-bfcf-49c8d88d3075_2e3d06ae-6920-4428-9298-35233380626e.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d6fc2ed0>
2025-12-05 12:02:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 12:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_099d9b66-c023-5d33-8756-0b8e51cb07dd/099d9b66-c023-5d33-8756-0b8e51cb07dd_image_6.webp HTTP/1.1" 201 0
2025-12-05 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fb3dbb372-dd37-4b17-8166-d3b6f0a70f84_3d586db1-55fd-4ef5-b99a-fc21095fd4d4.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/b3dbb372-dd37-4b17-8166-d3b6f0a70f84_3d586db1-55fd-4ef5-b99a-fc21095fd4d4.jpg/250x188.webp saved to cache
2025-12-05 12:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 099d9b66-c023-5d33-8756-0b8e51cb07dd
2025-12-05 12:02:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d6fad0d0>
2025-12-05 12:02:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 12:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_099d9b66-c023-5d33-8756-0b8e51cb07dd/099d9b66-c023-5d33-8756-0b8e51cb07dd_image_10.webp HTTP/1.1" 201 0
2025-12-05 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fb3dbb372-dd37-4b17-8166-d3b6f0a70f84_553b53b6-16a2-44bb-a677-3df08cf9f160.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/b3dbb372-dd37-4b17-8166-d3b6f0a70f84_553b53b6-16a2-44bb-a677-3df08cf9f160.jpg/250x188.webp saved to cache
2025-12-05 12:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 099d9b66-c023-5d33-8756-0b8e51cb07dd
2025-12-05 12:02:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e26cd0>
2025-12-05 12:02:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_099d9b66-c023-5d33-8756-0b8e51cb07dd/099d9b66-c023-5d33-8756-0b8e51cb07dd_image_7.webp HTTP/1.1" 201 0
2025-12-05 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fb3dbb372-dd37-4b17-8166-d3b6f0a70f84_070dd7c3-b863-410b-996a-23e76af61946.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/b3dbb372-dd37-4b17-8166-d3b6f0a70f84_070dd7c3-b863-410b-996a-23e76af61946.jpg/250x188.webp saved to cache
2025-12-05 12:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 099d9b66-c023-5d33-8756-0b8e51cb07dd
2025-12-05 12:02:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9dc101790>
2025-12-05 12:02:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 12:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_099d9b66-c023-5d33-8756-0b8e51cb07dd/099d9b66-c023-5d33-8756-0b8e51cb07dd_image_9.webp HTTP/1.1" 201 0
2025-12-05 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fb3dbb372-dd37-4b17-8166-d3b6f0a70f84_a690fb5f-8cf7-4a3f-a86b-08a6d626745d.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/b3dbb372-dd37-4b17-8166-d3b6f0a70f84_a690fb5f-8cf7-4a3f-a86b-08a6d626745d.jpg/250x188.webp saved to cache
2025-12-05 12:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 099d9b66-c023-5d33-8756-0b8e51cb07dd
2025-12-05 12:02:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9dc154790>
2025-12-05 12:02:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 12:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_099d9b66-c023-5d33-8756-0b8e51cb07dd/099d9b66-c023-5d33-8756-0b8e51cb07dd_image_8.webp HTTP/1.1" 201 0
2025-12-05 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fb3dbb372-dd37-4b17-8166-d3b6f0a70f84_6436b646-a887-4317-9224-490e5fdbb687.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/b3dbb372-dd37-4b17-8166-d3b6f0a70f84_6436b646-a887-4317-9224-490e5fdbb687.jpg/250x188.webp saved to cache
2025-12-05 12:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 099d9b66-c023-5d33-8756-0b8e51cb07dd
2025-12-05 12:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/01145911-c8f1-4f92-bfcf-49c8d88d3075_d10fa548-8741-4720-b94c-49f624d0e593.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/01145911-c8f1-4f92-bfcf-49c8d88d3075_38a3744a-ff79-4ed3-ba54-1b98949f660d.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F01145911-c8f1-4f92-bfcf-49c8d88d3075_fa4b19ae-a723-43d1-9644-4c6e4a69435a.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/01145911-c8f1-4f92-bfcf-49c8d88d3075_fa4b19ae-a723-43d1-9644-4c6e4a69435a.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/01145911-c8f1-4f92-bfcf-49c8d88d3075_e2fd3a7e-9c69-415d-ba90-aa2087b90509.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/b3dbb372-dd37-4b17-8166-d3b6f0a70f84_be46d50d-a767-4d8d-a36f-92cfa93603c1.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/01145911-c8f1-4f92-bfcf-49c8d88d3075_b2b603b4-192b-4f22-9d1f-63f2e1c7e081.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F01145911-c8f1-4f92-bfcf-49c8d88d3075_13df28df-a822-4e08-a2d4-b19083b14272.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/01145911-c8f1-4f92-bfcf-49c8d88d3075_13df28df-a822-4e08-a2d4-b19083b14272.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F01145911-c8f1-4f92-bfcf-49c8d88d3075_6c936796-16ba-4ed2-9c4c-e42bbeba2116.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/01145911-c8f1-4f92-bfcf-49c8d88d3075_6c936796-16ba-4ed2-9c4c-e42bbeba2116.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d6f8fb90>
2025-12-05 12:02:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 12:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84d0dbf5-4fac-5144-84bf-ccdfb26d9f0f/84d0dbf5-4fac-5144-84bf-ccdfb26d9f0f_image_3.webp HTTP/1.1" 201 0
2025-12-05 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F01145911-c8f1-4f92-bfcf-49c8d88d3075_21031d5f-d620-411d-99f1-7e33b76de3ec.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/01145911-c8f1-4f92-bfcf-49c8d88d3075_21031d5f-d620-411d-99f1-7e33b76de3ec.jpg/250x188.webp saved to cache
2025-12-05 12:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 84d0dbf5-4fac-5144-84bf-ccdfb26d9f0f
2025-12-05 12:02:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d6fe6ed0>
2025-12-05 12:02:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 12:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84d0dbf5-4fac-5144-84bf-ccdfb26d9f0f/84d0dbf5-4fac-5144-84bf-ccdfb26d9f0f_image_2.webp HTTP/1.1" 201 0
2025-12-05 12:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F01145911-c8f1-4f92-bfcf-49c8d88d3075_544055fe-3453-44d5-8795-d1ec868ec208.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/01145911-c8f1-4f92-bfcf-49c8d88d3075_544055fe-3453-44d5-8795-d1ec868ec208.jpg/250x188.webp saved to cache
2025-12-05 12:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 84d0dbf5-4fac-5144-84bf-ccdfb26d9f0f
2025-12-05 12:02:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e24f10>
2025-12-05 12:02:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 12:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84d0dbf5-4fac-5144-84bf-ccdfb26d9f0f/84d0dbf5-4fac-5144-84bf-ccdfb26d9f0f_image_0.webp HTTP/1.1" 201 0
2025-12-05 12:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F01145911-c8f1-4f92-bfcf-49c8d88d3075_993424ca-ec11-4d46-8cf8-6362338caf06.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/01145911-c8f1-4f92-bfcf-49c8d88d3075_993424ca-ec11-4d46-8cf8-6362338caf06.jpg/250x188.webp saved to cache
2025-12-05 12:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 84d0dbf5-4fac-5144-84bf-ccdfb26d9f0f
2025-12-05 12:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/01145911-c8f1-4f92-bfcf-49c8d88d3075_2e3d06ae-6920-4428-9298-35233380626e.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/01145911-c8f1-4f92-bfcf-49c8d88d3075_e28c013d-0470-461e-a26b-5c2d7cac6c6a.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/01145911-c8f1-4f92-bfcf-49c8d88d3075_290e0fca-781a-479d-ac1d-dfe9957779b4.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/01145911-c8f1-4f92-bfcf-49c8d88d3075_0583cb14-0226-4944-9cc8-6821932c2ec7.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/01145911-c8f1-4f92-bfcf-49c8d88d3075_ad901f9b-c75e-43dc-9b48-48d69241cacc.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%273cb12178-cf5a-451e-b0f7-cc647e30ee49%27 HTTP/1.1" 200 None
2025-12-05 12:02:08 [auto_selling_autoscout24.it] INFO: Scrape type for 3cb12178-cf5a-451e-b0f7-cc647e30ee49: 1
2025-12-05 12:02:08 [auto_selling_autoscout24.it] INFO: Scraping new listing 3cb12178-cf5a-451e-b0f7-cc647e30ee49
2025-12-05 12:02:08 [auto_selling_autoscout24.it] INFO: Extracting item from listing ID: 3cb12178-cf5a-451e-b0f7-cc647e30ee49
2025-12-05 12:02:08 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 30d46f39-68a1-55da-a72e-3788ffee3aef with identifier: 3cb12178-cf5a-451e-b0f7-cc647e30ee49
2025-12-05 12:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 4 photos for item 30d46f39-68a1-55da-a72e-3788ffee3aef
2025-12-05 12:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F3cb12178-cf5a-451e-b0f7-cc647e30ee49_cecb411d-ab9c-4c25-b2f1-ee266dcc7929.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/3cb12178-cf5a-451e-b0f7-cc647e30ee49_cecb411d-ab9c-4c25-b2f1-ee266dcc7929.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F3cb12178-cf5a-451e-b0f7-cc647e30ee49_1f151ab9-aa75-447e-a451-4343d8179cb4.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/3cb12178-cf5a-451e-b0f7-cc647e30ee49_1f151ab9-aa75-447e-a451-4343d8179cb4.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d6f0bad0>
2025-12-05 12:02:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 12:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84d0dbf5-4fac-5144-84bf-ccdfb26d9f0f/84d0dbf5-4fac-5144-84bf-ccdfb26d9f0f_image_6.webp HTTP/1.1" 201 0
2025-12-05 12:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F01145911-c8f1-4f92-bfcf-49c8d88d3075_d10fa548-8741-4720-b94c-49f624d0e593.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/01145911-c8f1-4f92-bfcf-49c8d88d3075_d10fa548-8741-4720-b94c-49f624d0e593.jpg/250x188.webp saved to cache
2025-12-05 12:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 84d0dbf5-4fac-5144-84bf-ccdfb26d9f0f
2025-12-05 12:02:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5ce00d0>
2025-12-05 12:02:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 12:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84d0dbf5-4fac-5144-84bf-ccdfb26d9f0f/84d0dbf5-4fac-5144-84bf-ccdfb26d9f0f_image_5.webp HTTP/1.1" 201 0
2025-12-05 12:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F01145911-c8f1-4f92-bfcf-49c8d88d3075_38a3744a-ff79-4ed3-ba54-1b98949f660d.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/01145911-c8f1-4f92-bfcf-49c8d88d3075_38a3744a-ff79-4ed3-ba54-1b98949f660d.jpg/250x188.webp saved to cache
2025-12-05 12:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 84d0dbf5-4fac-5144-84bf-ccdfb26d9f0f
2025-12-05 12:02:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d6f09dd0>
2025-12-05 12:02:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 12:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84d0dbf5-4fac-5144-84bf-ccdfb26d9f0f/84d0dbf5-4fac-5144-84bf-ccdfb26d9f0f_image_1.webp HTTP/1.1" 201 0
2025-12-05 12:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F01145911-c8f1-4f92-bfcf-49c8d88d3075_e2fd3a7e-9c69-415d-ba90-aa2087b90509.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/01145911-c8f1-4f92-bfcf-49c8d88d3075_e2fd3a7e-9c69-415d-ba90-aa2087b90509.jpg/250x188.webp saved to cache
2025-12-05 12:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 84d0dbf5-4fac-5144-84bf-ccdfb26d9f0f
2025-12-05 12:02:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d6f0b450>
2025-12-05 12:02:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 12:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_099d9b66-c023-5d33-8756-0b8e51cb07dd/099d9b66-c023-5d33-8756-0b8e51cb07dd_image_13.webp HTTP/1.1" 201 0
2025-12-05 12:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fb3dbb372-dd37-4b17-8166-d3b6f0a70f84_be46d50d-a767-4d8d-a36f-92cfa93603c1.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/b3dbb372-dd37-4b17-8166-d3b6f0a70f84_be46d50d-a767-4d8d-a36f-92cfa93603c1.jpg/250x188.webp saved to cache
2025-12-05 12:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 099d9b66-c023-5d33-8756-0b8e51cb07dd
2025-12-05 12:02:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5c93bd0>
2025-12-05 12:02:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 12:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84d0dbf5-4fac-5144-84bf-ccdfb26d9f0f/84d0dbf5-4fac-5144-84bf-ccdfb26d9f0f_image_7.webp HTTP/1.1" 201 0
2025-12-05 12:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F01145911-c8f1-4f92-bfcf-49c8d88d3075_b2b603b4-192b-4f22-9d1f-63f2e1c7e081.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/01145911-c8f1-4f92-bfcf-49c8d88d3075_b2b603b4-192b-4f22-9d1f-63f2e1c7e081.jpg/250x188.webp saved to cache
2025-12-05 12:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 84d0dbf5-4fac-5144-84bf-ccdfb26d9f0f
2025-12-05 12:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F3cb12178-cf5a-451e-b0f7-cc647e30ee49_a321ddb1-c6e0-4ef3-8fcd-40b51e5f1852.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/3cb12178-cf5a-451e-b0f7-cc647e30ee49_a321ddb1-c6e0-4ef3-8fcd-40b51e5f1852.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/01145911-c8f1-4f92-bfcf-49c8d88d3075_13df28df-a822-4e08-a2d4-b19083b14272.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/01145911-c8f1-4f92-bfcf-49c8d88d3075_6c936796-16ba-4ed2-9c4c-e42bbeba2116.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/01145911-c8f1-4f92-bfcf-49c8d88d3075_fa4b19ae-a723-43d1-9644-4c6e4a69435a.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/b3dbb372-dd37-4b17-8166-d3b6f0a70f84_ef153d24-7b9e-41f2-a802-7f509f2e5233.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/b3dbb372-dd37-4b17-8166-d3b6f0a70f84_a269b14c-a534-458d-805e-90b64b37439e.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F3cb12178-cf5a-451e-b0f7-cc647e30ee49_b5126d7c-226c-44d5-a6c7-58e8f6d6d906.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/3cb12178-cf5a-451e-b0f7-cc647e30ee49_b5126d7c-226c-44d5-a6c7-58e8f6d6d906.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5b80550>
2025-12-05 12:02:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 12:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84d0dbf5-4fac-5144-84bf-ccdfb26d9f0f/84d0dbf5-4fac-5144-84bf-ccdfb26d9f0f_image_11.webp HTTP/1.1" 201 0
2025-12-05 12:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F01145911-c8f1-4f92-bfcf-49c8d88d3075_2e3d06ae-6920-4428-9298-35233380626e.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/01145911-c8f1-4f92-bfcf-49c8d88d3075_2e3d06ae-6920-4428-9298-35233380626e.jpg/250x188.webp saved to cache
2025-12-05 12:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 84d0dbf5-4fac-5144-84bf-ccdfb26d9f0f
2025-12-05 12:02:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5cb2b10>
2025-12-05 12:02:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84d0dbf5-4fac-5144-84bf-ccdfb26d9f0f/84d0dbf5-4fac-5144-84bf-ccdfb26d9f0f_image_4.webp HTTP/1.1" 201 0
2025-12-05 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F01145911-c8f1-4f92-bfcf-49c8d88d3075_e28c013d-0470-461e-a26b-5c2d7cac6c6a.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/01145911-c8f1-4f92-bfcf-49c8d88d3075_e28c013d-0470-461e-a26b-5c2d7cac6c6a.jpg/250x188.webp saved to cache
2025-12-05 12:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 84d0dbf5-4fac-5144-84bf-ccdfb26d9f0f
2025-12-05 12:02:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5cf9a50>
2025-12-05 12:02:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 12:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84d0dbf5-4fac-5144-84bf-ccdfb26d9f0f/84d0dbf5-4fac-5144-84bf-ccdfb26d9f0f_image_8.webp HTTP/1.1" 201 0
2025-12-05 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F01145911-c8f1-4f92-bfcf-49c8d88d3075_290e0fca-781a-479d-ac1d-dfe9957779b4.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/01145911-c8f1-4f92-bfcf-49c8d88d3075_290e0fca-781a-479d-ac1d-dfe9957779b4.jpg/250x188.webp saved to cache
2025-12-05 12:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 84d0dbf5-4fac-5144-84bf-ccdfb26d9f0f
2025-12-05 12:02:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9dd5c8910>
2025-12-05 12:02:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 12:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84d0dbf5-4fac-5144-84bf-ccdfb26d9f0f/84d0dbf5-4fac-5144-84bf-ccdfb26d9f0f_image_9.webp HTTP/1.1" 201 0
2025-12-05 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F01145911-c8f1-4f92-bfcf-49c8d88d3075_0583cb14-0226-4944-9cc8-6821932c2ec7.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/01145911-c8f1-4f92-bfcf-49c8d88d3075_0583cb14-0226-4944-9cc8-6821932c2ec7.jpg/250x188.webp saved to cache
2025-12-05 12:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 84d0dbf5-4fac-5144-84bf-ccdfb26d9f0f
2025-12-05 12:02:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5b060d0>
2025-12-05 12:02:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84d0dbf5-4fac-5144-84bf-ccdfb26d9f0f/84d0dbf5-4fac-5144-84bf-ccdfb26d9f0f_image_10.webp HTTP/1.1" 201 0
2025-12-05 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F01145911-c8f1-4f92-bfcf-49c8d88d3075_ad901f9b-c75e-43dc-9b48-48d69241cacc.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/01145911-c8f1-4f92-bfcf-49c8d88d3075_ad901f9b-c75e-43dc-9b48-48d69241cacc.jpg/250x188.webp saved to cache
2025-12-05 12:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 84d0dbf5-4fac-5144-84bf-ccdfb26d9f0f
2025-12-05 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27daf8e92f-b98a-4d02-a6f5-eed330f88b38%27 HTTP/1.1" 200 None
2025-12-05 12:02:10 [auto_selling_autoscout24.it] INFO: Scrape type for daf8e92f-b98a-4d02-a6f5-eed330f88b38: 1
2025-12-05 12:02:10 [auto_selling_autoscout24.it] INFO: Scraping new listing daf8e92f-b98a-4d02-a6f5-eed330f88b38
2025-12-05 12:02:10 [auto_selling_autoscout24.it] INFO: Extracting item from listing ID: daf8e92f-b98a-4d02-a6f5-eed330f88b38
2025-12-05 12:02:10 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 79e51637-e4eb-5d63-9c96-15cfc53dc6c1 with identifier: daf8e92f-b98a-4d02-a6f5-eed330f88b38
2025-12-05 12:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 79e51637-e4eb-5d63-9c96-15cfc53dc6c1
2025-12-05 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fdaf8e92f-b98a-4d02-a6f5-eed330f88b38_55e3ac8b-9a4c-43b7-9f8e-349f460bb6da.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/daf8e92f-b98a-4d02-a6f5-eed330f88b38_55e3ac8b-9a4c-43b7-9f8e-349f460bb6da.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/3cb12178-cf5a-451e-b0f7-cc647e30ee49_cecb411d-ab9c-4c25-b2f1-ee266dcc7929.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/3cb12178-cf5a-451e-b0f7-cc647e30ee49_1f151ab9-aa75-447e-a451-4343d8179cb4.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fdaf8e92f-b98a-4d02-a6f5-eed330f88b38_f2ad02d9-17e6-4d10-a43f-37ed0b3c356f.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/daf8e92f-b98a-4d02-a6f5-eed330f88b38_f2ad02d9-17e6-4d10-a43f-37ed0b3c356f.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d6fd9b90>
2025-12-05 12:02:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:02:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84d0dbf5-4fac-5144-84bf-ccdfb26d9f0f/84d0dbf5-4fac-5144-84bf-ccdfb26d9f0f_image_13.webp HTTP/1.1" 201 0
2025-12-05 12:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F01145911-c8f1-4f92-bfcf-49c8d88d3075_13df28df-a822-4e08-a2d4-b19083b14272.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/01145911-c8f1-4f92-bfcf-49c8d88d3075_13df28df-a822-4e08-a2d4-b19083b14272.jpg/250x188.webp saved to cache
2025-12-05 12:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 84d0dbf5-4fac-5144-84bf-ccdfb26d9f0f
2025-12-05 12:02:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d6f86c50>
2025-12-05 12:02:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:02:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84d0dbf5-4fac-5144-84bf-ccdfb26d9f0f/84d0dbf5-4fac-5144-84bf-ccdfb26d9f0f_image_14.webp HTTP/1.1" 201 0
2025-12-05 12:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F01145911-c8f1-4f92-bfcf-49c8d88d3075_6c936796-16ba-4ed2-9c4c-e42bbeba2116.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/01145911-c8f1-4f92-bfcf-49c8d88d3075_6c936796-16ba-4ed2-9c4c-e42bbeba2116.jpg/250x188.webp saved to cache
2025-12-05 12:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 84d0dbf5-4fac-5144-84bf-ccdfb26d9f0f
2025-12-05 12:02:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e2f510>
2025-12-05 12:02:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:02:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84d0dbf5-4fac-5144-84bf-ccdfb26d9f0f/84d0dbf5-4fac-5144-84bf-ccdfb26d9f0f_image_12.webp HTTP/1.1" 201 0
2025-12-05 12:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F01145911-c8f1-4f92-bfcf-49c8d88d3075_fa4b19ae-a723-43d1-9644-4c6e4a69435a.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/01145911-c8f1-4f92-bfcf-49c8d88d3075_fa4b19ae-a723-43d1-9644-4c6e4a69435a.jpg/250x188.webp saved to cache
2025-12-05 12:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 84d0dbf5-4fac-5144-84bf-ccdfb26d9f0f
2025-12-05 12:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 84d0dbf5-4fac-5144-84bf-ccdfb26d9f0f from tracking dictionaries
2025-12-05 12:02:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 84d0dbf5-4fac-5144-84bf-ccdfb26d9f0f sending to next pipeline
2025-12-05 12:02:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d6fd9090>
2025-12-05 12:02:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 12:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_099d9b66-c023-5d33-8756-0b8e51cb07dd/099d9b66-c023-5d33-8756-0b8e51cb07dd_image_12.webp HTTP/1.1" 201 0
2025-12-05 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fb3dbb372-dd37-4b17-8166-d3b6f0a70f84_ef153d24-7b9e-41f2-a802-7f509f2e5233.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/b3dbb372-dd37-4b17-8166-d3b6f0a70f84_ef153d24-7b9e-41f2-a802-7f509f2e5233.jpg/250x188.webp saved to cache
2025-12-05 12:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 099d9b66-c023-5d33-8756-0b8e51cb07dd
2025-12-05 12:02:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e8ab50>
2025-12-05 12:02:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_099d9b66-c023-5d33-8756-0b8e51cb07dd/099d9b66-c023-5d33-8756-0b8e51cb07dd_image_11.webp HTTP/1.1" 201 0
2025-12-05 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fb3dbb372-dd37-4b17-8166-d3b6f0a70f84_a269b14c-a534-458d-805e-90b64b37439e.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/b3dbb372-dd37-4b17-8166-d3b6f0a70f84_a269b14c-a534-458d-805e-90b64b37439e.jpg/250x188.webp saved to cache
2025-12-05 12:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 099d9b66-c023-5d33-8756-0b8e51cb07dd
2025-12-05 12:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 099d9b66-c023-5d33-8756-0b8e51cb07dd from tracking dictionaries
2025-12-05 12:02:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 099d9b66-c023-5d33-8756-0b8e51cb07dd sending to next pipeline
2025-12-05 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fdaf8e92f-b98a-4d02-a6f5-eed330f88b38_b57e452d-9271-4813-b86c-fd12d35d2951.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/daf8e92f-b98a-4d02-a6f5-eed330f88b38_b57e452d-9271-4813-b86c-fd12d35d2951.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:12 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 84d0dbf5-4fac-5144-84bf-ccdfb26d9f0f with identifier 01145911-c8f1-4f92-bfcf-49c8d88d3075
2025-12-05 12:02:12 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:02:12 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:02:12 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 84d0dbf5-4fac-5144-84bf-ccdfb26d9f0f
2025-12-05 12:02:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://prod.pictures.autoscout24.net/listing-images/01145911-c8f1-4f92-bfcf-49c8d88d3075_fa4b19ae-a723-43d1-9644-4c6e4a69435a.jpg/250x188.webp>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'emission_standard': None,
 'engine': None,
 'engine_horse_power': 265,
 'expiration_date': None,
 'fuel_type': 'Gasoline',
 'id': '84d0dbf5-4fac-5144-84bf-ccdfb26d9f0f',
 'is_damaged': False,
 'is_operable': True,
 'license_plate': None,
 'link_to_web_offer': 'https://www.autoscout24.it/offers/volkswagen-tiguan-new-model-r-line-2-0-tsi-dsg-265cv-4motion-promo-gasoline-black-01145911-c8f1-4f92-bfcf-49c8d88d3075',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 25900,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84d0dbf5-4fac-5144-84bf-ccdfb26d9f0f/84d0dbf5-4fac-5144-84bf-ccdfb26d9f0f_image_0.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4898,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/01145911-c8f1-4f92-bfcf-49c8d88d3075_993424ca-ec11-4d46-8cf8-6362338caf06.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84d0dbf5-4fac-5144-84bf-ccdfb26d9f0f/84d0dbf5-4fac-5144-84bf-ccdfb26d9f0f_image_1.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4646,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/01145911-c8f1-4f92-bfcf-49c8d88d3075_e2fd3a7e-9c69-415d-ba90-aa2087b90509.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84d0dbf5-4fac-5144-84bf-ccdfb26d9f0f/84d0dbf5-4fac-5144-84bf-ccdfb26d9f0f_image_2.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4976,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/01145911-c8f1-4f92-bfcf-49c8d88d3075_544055fe-3453-44d5-8795-d1ec868ec208.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84d0dbf5-4fac-5144-84bf-ccdfb26d9f0f/84d0dbf5-4fac-5144-84bf-ccdfb26d9f0f_image_3.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4702,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/01145911-c8f1-4f92-bfcf-49c8d88d3075_21031d5f-d620-411d-99f1-7e33b76de3ec.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84d0dbf5-4fac-5144-84bf-ccdfb26d9f0f/84d0dbf5-4fac-5144-84bf-ccdfb26d9f0f_image_4.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5980,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/01145911-c8f1-4f92-bfcf-49c8d88d3075_e28c013d-0470-461e-a26b-5c2d7cac6c6a.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84d0dbf5-4fac-5144-84bf-ccdfb26d9f0f/84d0dbf5-4fac-5144-84bf-ccdfb26d9f0f_image_5.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 8680,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/01145911-c8f1-4f92-bfcf-49c8d88d3075_38a3744a-ff79-4ed3-ba54-1b98949f660d.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84d0dbf5-4fac-5144-84bf-ccdfb26d9f0f/84d0dbf5-4fac-5144-84bf-ccdfb26d9f0f_image_6.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 6702,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/01145911-c8f1-4f92-bfcf-49c8d88d3075_d10fa548-8741-4720-b94c-49f624d0e593.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84d0dbf5-4fac-5144-84bf-ccdfb26d9f0f/84d0dbf5-4fac-5144-84bf-ccdfb26d9f0f_image_7.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 7648,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/01145911-c8f1-4f92-bfcf-49c8d88d3075_b2b603b4-192b-4f22-9d1f-63f2e1c7e081.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84d0dbf5-4fac-5144-84bf-ccdfb26d9f0f/84d0dbf5-4fac-5144-84bf-ccdfb26d9f0f_image_8.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 7160,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/01145911-c8f1-4f92-bfcf-49c8d88d3075_290e0fca-781a-479d-ac1d-dfe9957779b4.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84d0dbf5-4fac-5144-84bf-ccdfb26d9f0f/84d0dbf5-4fac-5144-84bf-ccdfb26d9f0f_image_9.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 6480,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/01145911-c8f1-4f92-bfcf-49c8d88d3075_0583cb14-0226-4944-9cc8-6821932c2ec7.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84d0dbf5-4fac-5144-84bf-ccdfb26d9f0f/84d0dbf5-4fac-5144-84bf-ccdfb26d9f0f_image_10.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5462,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/01145911-c8f1-4f92-bfcf-49c8d88d3075_ad901f9b-c75e-43dc-9b48-48d69241cacc.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84d0dbf5-4fac-5144-84bf-ccdfb26d9f0f/84d0dbf5-4fac-5144-84bf-ccdfb26d9f0f_image_11.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4124,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/01145911-c8f1-4f92-bfcf-49c8d88d3075_2e3d06ae-6920-4428-9298-35233380626e.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84d0dbf5-4fac-5144-84bf-ccdfb26d9f0f/84d0dbf5-4fac-5144-84bf-ccdfb26d9f0f_image_12.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 6188,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/01145911-c8f1-4f92-bfcf-49c8d88d3075_fa4b19ae-a723-43d1-9644-4c6e4a69435a.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84d0dbf5-4fac-5144-84bf-ccdfb26d9f0f/84d0dbf5-4fac-5144-84bf-ccdfb26d9f0f_image_13.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 7352,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/01145911-c8f1-4f92-bfcf-49c8d88d3075_13df28df-a822-4e08-a2d4-b19083b14272.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84d0dbf5-4fac-5144-84bf-ccdfb26d9f0f/84d0dbf5-4fac-5144-84bf-ccdfb26d9f0f_image_14.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 7566,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/01145911-c8f1-4f92-bfcf-49c8d88d3075_6c936796-16ba-4ed2-9c4c-e42bbeba2116.jpg/250x188.webp',
             'Width': 250}],
 'price': 52800,
 'price_includes_vat': False,
 'registration_date': '2024-12-01',
 'seller_name': None,
 'title': 'Volkswagen Tiguan *new model* R-LINE 2.0 TSI DSG 265CV 4MOTION '
          'PROMO',
 'transmission': 'automatic',
 'trim': '*new model* R-LINE 2.0 TSI DSG 265CV 4MOTION PROMO',
 'vin': None,
 'year': 2024}
2025-12-05 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%2701145911-c8f1-4f92-bfcf-49c8d88d3075%27 HTTP/1.1" 200 None
2025-12-05 12:02:12 [auto_selling_autoscout24.it] INFO: Saving data for 01145911-c8f1-4f92-bfcf-49c8d88d3075: {'created_time': 1764936132.391952, 'last_price_update_time': 1764936132.391967}
2025-12-05 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autoscout24.it',RowKey='01145911-c8f1-4f92-bfcf-49c8d88d3075') HTTP/1.1" 204 0
2025-12-05 12:02:12 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 099d9b66-c023-5d33-8756-0b8e51cb07dd with identifier b3dbb372-dd37-4b17-8166-d3b6f0a70f84
2025-12-05 12:02:12 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:02:12 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:02:12 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 099d9b66-c023-5d33-8756-0b8e51cb07dd
2025-12-05 12:02:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://prod.pictures.autoscout24.net/listing-images/b3dbb372-dd37-4b17-8166-d3b6f0a70f84_a269b14c-a534-458d-805e-90b64b37439e.jpg/250x188.webp>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'emission_standard': None,
 'engine': None,
 'engine_horse_power': 237,
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': '099d9b66-c023-5d33-8756-0b8e51cb07dd',
 'is_damaged': False,
 'is_operable': True,
 'license_plate': None,
 'link_to_web_offer': 'https://www.autoscout24.it/offers/mercedes-benz-v-300-d-pronta-consegna-long-avantgarde-8p-amg-4matic-diesel-grey-b3dbb372-dd37-4b17-8166-d3b6f0a70f84',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'V 300',
 'odometer': 32400,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099d9b66-c023-5d33-8756-0b8e51cb07dd/099d9b66-c023-5d33-8756-0b8e51cb07dd_image_0.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5000,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/b3dbb372-dd37-4b17-8166-d3b6f0a70f84_023fee56-8e92-4343-8a9e-65cf17adff91.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099d9b66-c023-5d33-8756-0b8e51cb07dd/099d9b66-c023-5d33-8756-0b8e51cb07dd_image_1.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4172,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/b3dbb372-dd37-4b17-8166-d3b6f0a70f84_2e556cab-2e25-4894-900d-290c05d6a90d.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099d9b66-c023-5d33-8756-0b8e51cb07dd/099d9b66-c023-5d33-8756-0b8e51cb07dd_image_2.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5398,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/b3dbb372-dd37-4b17-8166-d3b6f0a70f84_26b15de4-de4b-4a44-ab29-7f87c038cc09.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099d9b66-c023-5d33-8756-0b8e51cb07dd/099d9b66-c023-5d33-8756-0b8e51cb07dd_image_3.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4278,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/b3dbb372-dd37-4b17-8166-d3b6f0a70f84_d13dcd86-9b88-4f5c-a840-4b965d869078.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099d9b66-c023-5d33-8756-0b8e51cb07dd/099d9b66-c023-5d33-8756-0b8e51cb07dd_image_4.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3944,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/b3dbb372-dd37-4b17-8166-d3b6f0a70f84_c529fa0a-2d44-429e-b268-c841eeaeb2a0.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099d9b66-c023-5d33-8756-0b8e51cb07dd/099d9b66-c023-5d33-8756-0b8e51cb07dd_image_5.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 7668,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/b3dbb372-dd37-4b17-8166-d3b6f0a70f84_a34bb119-7fea-49cc-9144-a56ba1c1e026.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099d9b66-c023-5d33-8756-0b8e51cb07dd/099d9b66-c023-5d33-8756-0b8e51cb07dd_image_6.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 6626,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/b3dbb372-dd37-4b17-8166-d3b6f0a70f84_3d586db1-55fd-4ef5-b99a-fc21095fd4d4.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099d9b66-c023-5d33-8756-0b8e51cb07dd/099d9b66-c023-5d33-8756-0b8e51cb07dd_image_7.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4900,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/b3dbb372-dd37-4b17-8166-d3b6f0a70f84_070dd7c3-b863-410b-996a-23e76af61946.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099d9b66-c023-5d33-8756-0b8e51cb07dd/099d9b66-c023-5d33-8756-0b8e51cb07dd_image_8.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5352,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/b3dbb372-dd37-4b17-8166-d3b6f0a70f84_6436b646-a887-4317-9224-490e5fdbb687.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099d9b66-c023-5d33-8756-0b8e51cb07dd/099d9b66-c023-5d33-8756-0b8e51cb07dd_image_9.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5204,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/b3dbb372-dd37-4b17-8166-d3b6f0a70f84_a690fb5f-8cf7-4a3f-a86b-08a6d626745d.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099d9b66-c023-5d33-8756-0b8e51cb07dd/099d9b66-c023-5d33-8756-0b8e51cb07dd_image_10.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5500,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/b3dbb372-dd37-4b17-8166-d3b6f0a70f84_553b53b6-16a2-44bb-a677-3df08cf9f160.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099d9b66-c023-5d33-8756-0b8e51cb07dd/099d9b66-c023-5d33-8756-0b8e51cb07dd_image_11.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4144,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/b3dbb372-dd37-4b17-8166-d3b6f0a70f84_a269b14c-a534-458d-805e-90b64b37439e.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099d9b66-c023-5d33-8756-0b8e51cb07dd/099d9b66-c023-5d33-8756-0b8e51cb07dd_image_12.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 6844,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/b3dbb372-dd37-4b17-8166-d3b6f0a70f84_ef153d24-7b9e-41f2-a802-7f509f2e5233.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_099d9b66-c023-5d33-8756-0b8e51cb07dd/099d9b66-c023-5d33-8756-0b8e51cb07dd_image_13.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5396,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/b3dbb372-dd37-4b17-8166-d3b6f0a70f84_be46d50d-a767-4d8d-a36f-92cfa93603c1.jpg/250x188.webp',
             'Width': 250}],
 'price': 73900,
 'price_includes_vat': False,
 'registration_date': '2023-08-01',
 'seller_name': None,
 'title': 'Mercedes-Benz V 300 d *Pronta Consegna* LONG AVANTGARDE 8P AMG '
          '4MATIC',
 'transmission': 'automatic',
 'trim': 'd *Pronta Consegna* LONG AVANTGARDE 8P AMG 4MATIC',
 'vin': None,
 'year': 2023}
2025-12-05 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27b3dbb372-dd37-4b17-8166-d3b6f0a70f84%27 HTTP/1.1" 200 None
2025-12-05 12:02:12 [auto_selling_autoscout24.it] INFO: Saving data for b3dbb372-dd37-4b17-8166-d3b6f0a70f84: {'created_time': 1764936132.437793, 'last_price_update_time': 1764936132.437801}
2025-12-05 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autoscout24.it',RowKey='b3dbb372-dd37-4b17-8166-d3b6f0a70f84') HTTP/1.1" 204 0
2025-12-05 12:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/3cb12178-cf5a-451e-b0f7-cc647e30ee49_a321ddb1-c6e0-4ef3-8fcd-40b51e5f1852.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/3cb12178-cf5a-451e-b0f7-cc647e30ee49_b5126d7c-226c-44d5-a6c7-58e8f6d6d906.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/daf8e92f-b98a-4d02-a6f5-eed330f88b38_55e3ac8b-9a4c-43b7-9f8e-349f460bb6da.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fdaf8e92f-b98a-4d02-a6f5-eed330f88b38_7501d427-eef7-4042-aea4-c2273bf793af.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/daf8e92f-b98a-4d02-a6f5-eed330f88b38_7501d427-eef7-4042-aea4-c2273bf793af.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d6f8ead0>
2025-12-05 12:02:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30d46f39-68a1-55da-a72e-3788ffee3aef/30d46f39-68a1-55da-a72e-3788ffee3aef_image_0.webp HTTP/1.1" 201 0
2025-12-05 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F3cb12178-cf5a-451e-b0f7-cc647e30ee49_cecb411d-ab9c-4c25-b2f1-ee266dcc7929.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/3cb12178-cf5a-451e-b0f7-cc647e30ee49_cecb411d-ab9c-4c25-b2f1-ee266dcc7929.jpg/250x188.webp saved to cache
2025-12-05 12:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 30d46f39-68a1-55da-a72e-3788ffee3aef
2025-12-05 12:02:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5b97f90>
2025-12-05 12:02:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 12:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30d46f39-68a1-55da-a72e-3788ffee3aef/30d46f39-68a1-55da-a72e-3788ffee3aef_image_1.webp HTTP/1.1" 201 0
2025-12-05 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F3cb12178-cf5a-451e-b0f7-cc647e30ee49_1f151ab9-aa75-447e-a451-4343d8179cb4.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/3cb12178-cf5a-451e-b0f7-cc647e30ee49_1f151ab9-aa75-447e-a451-4343d8179cb4.jpg/250x188.webp saved to cache
2025-12-05 12:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 30d46f39-68a1-55da-a72e-3788ffee3aef
2025-12-05 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fdaf8e92f-b98a-4d02-a6f5-eed330f88b38_6d1b80be-7361-4e4f-ba53-3927d4d27b30.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/daf8e92f-b98a-4d02-a6f5-eed330f88b38_6d1b80be-7361-4e4f-ba53-3927d4d27b30.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/daf8e92f-b98a-4d02-a6f5-eed330f88b38_f2ad02d9-17e6-4d10-a43f-37ed0b3c356f.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%271575328c-73cf-4790-9bd6-a18ad4cf4eb6%27 HTTP/1.1" 200 None
2025-12-05 12:02:13 [auto_selling_autoscout24.it] INFO: Scrape type for 1575328c-73cf-4790-9bd6-a18ad4cf4eb6: 1
2025-12-05 12:02:13 [auto_selling_autoscout24.it] INFO: Scraping new listing 1575328c-73cf-4790-9bd6-a18ad4cf4eb6
2025-12-05 12:02:13 [auto_selling_autoscout24.it] INFO: Extracting item from listing ID: 1575328c-73cf-4790-9bd6-a18ad4cf4eb6
2025-12-05 12:02:13 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 135f457c-b4f1-56f2-bf1f-dfb2c4259431 with identifier: 1575328c-73cf-4790-9bd6-a18ad4cf4eb6
2025-12-05 12:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 12 photos for item 135f457c-b4f1-56f2-bf1f-dfb2c4259431
2025-12-05 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F1575328c-73cf-4790-9bd6-a18ad4cf4eb6_6b5c9071-2cf3-48b3-99f4-67feb0aa53ce.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/1575328c-73cf-4790-9bd6-a18ad4cf4eb6_6b5c9071-2cf3-48b3-99f4-67feb0aa53ce.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d6fc0510>
2025-12-05 12:02:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 12:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30d46f39-68a1-55da-a72e-3788ffee3aef/30d46f39-68a1-55da-a72e-3788ffee3aef_image_2.webp HTTP/1.1" 201 0
2025-12-05 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F3cb12178-cf5a-451e-b0f7-cc647e30ee49_a321ddb1-c6e0-4ef3-8fcd-40b51e5f1852.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/3cb12178-cf5a-451e-b0f7-cc647e30ee49_a321ddb1-c6e0-4ef3-8fcd-40b51e5f1852.jpg/250x188.webp saved to cache
2025-12-05 12:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 30d46f39-68a1-55da-a72e-3788ffee3aef
2025-12-05 12:02:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9dc125190>
2025-12-05 12:02:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 12:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30d46f39-68a1-55da-a72e-3788ffee3aef/30d46f39-68a1-55da-a72e-3788ffee3aef_image_3.webp HTTP/1.1" 201 0
2025-12-05 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F3cb12178-cf5a-451e-b0f7-cc647e30ee49_b5126d7c-226c-44d5-a6c7-58e8f6d6d906.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/3cb12178-cf5a-451e-b0f7-cc647e30ee49_b5126d7c-226c-44d5-a6c7-58e8f6d6d906.jpg/250x188.webp saved to cache
2025-12-05 12:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 30d46f39-68a1-55da-a72e-3788ffee3aef
2025-12-05 12:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 30d46f39-68a1-55da-a72e-3788ffee3aef from tracking dictionaries
2025-12-05 12:02:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 30d46f39-68a1-55da-a72e-3788ffee3aef sending to next pipeline
2025-12-05 12:02:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5cc8610>
2025-12-05 12:02:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 12:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79e51637-e4eb-5d63-9c96-15cfc53dc6c1/79e51637-e4eb-5d63-9c96-15cfc53dc6c1_image_0.webp HTTP/1.1" 201 0
2025-12-05 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fdaf8e92f-b98a-4d02-a6f5-eed330f88b38_55e3ac8b-9a4c-43b7-9f8e-349f460bb6da.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/daf8e92f-b98a-4d02-a6f5-eed330f88b38_55e3ac8b-9a4c-43b7-9f8e-349f460bb6da.jpg/250x188.webp saved to cache
2025-12-05 12:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 79e51637-e4eb-5d63-9c96-15cfc53dc6c1
2025-12-05 12:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F1575328c-73cf-4790-9bd6-a18ad4cf4eb6_d2ca9abc-f74f-4791-9276-8c8cfd387127.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/1575328c-73cf-4790-9bd6-a18ad4cf4eb6_d2ca9abc-f74f-4791-9276-8c8cfd387127.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:14 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 30d46f39-68a1-55da-a72e-3788ffee3aef with identifier 3cb12178-cf5a-451e-b0f7-cc647e30ee49
2025-12-05 12:02:14 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:02:14 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:02:14 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 30d46f39-68a1-55da-a72e-3788ffee3aef
2025-12-05 12:02:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://prod.pictures.autoscout24.net/listing-images/3cb12178-cf5a-451e-b0f7-cc647e30ee49_b5126d7c-226c-44d5-a6c7-58e8f6d6d906.jpg/250x188.webp>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'emission_standard': None,
 'engine': None,
 'engine_horse_power': 150,
 'expiration_date': None,
 'fuel_type': 'Gasoline',
 'id': '30d46f39-68a1-55da-a72e-3788ffee3aef',
 'is_damaged': False,
 'is_operable': True,
 'license_plate': None,
 'link_to_web_offer': 'https://www.autoscout24.it/offers/audi-q2-advanced-35tfsi-s-tronic-150cv-retrocamera-promo-gasoline-blue-3cb12178-cf5a-451e-b0f7-cc647e30ee49',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q2',
 'odometer': 29200,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 4,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30d46f39-68a1-55da-a72e-3788ffee3aef/30d46f39-68a1-55da-a72e-3788ffee3aef_image_0.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3892,
             'Height': 177,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/3cb12178-cf5a-451e-b0f7-cc647e30ee49_cecb411d-ab9c-4c25-b2f1-ee266dcc7929.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30d46f39-68a1-55da-a72e-3788ffee3aef/30d46f39-68a1-55da-a72e-3788ffee3aef_image_1.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3698,
             'Height': 158,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/3cb12178-cf5a-451e-b0f7-cc647e30ee49_1f151ab9-aa75-447e-a451-4343d8179cb4.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30d46f39-68a1-55da-a72e-3788ffee3aef/30d46f39-68a1-55da-a72e-3788ffee3aef_image_2.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 2696,
             'Height': 132,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/3cb12178-cf5a-451e-b0f7-cc647e30ee49_a321ddb1-c6e0-4ef3-8fcd-40b51e5f1852.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30d46f39-68a1-55da-a72e-3788ffee3aef/30d46f39-68a1-55da-a72e-3788ffee3aef_image_3.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5254,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/3cb12178-cf5a-451e-b0f7-cc647e30ee49_b5126d7c-226c-44d5-a6c7-58e8f6d6d906.jpg/250x188.webp',
             'Width': 250}],
 'price': 28900,
 'price_includes_vat': False,
 'registration_date': '2024-09-01',
 'seller_name': None,
 'title': 'Audi Q2 ADVANCED 35TFSI S-TRONIC 150CV *RETROCAMERA* PROMO',
 'transmission': 'automatic',
 'trim': 'ADVANCED 35TFSI S-TRONIC 150CV *RETROCAMERA* PROMO',
 'vin': None,
 'year': 2024}
2025-12-05 12:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%273cb12178-cf5a-451e-b0f7-cc647e30ee49%27 HTTP/1.1" 200 None
2025-12-05 12:02:14 [auto_selling_autoscout24.it] INFO: Saving data for 3cb12178-cf5a-451e-b0f7-cc647e30ee49: {'created_time': 1764936134.056479, 'last_price_update_time': 1764936134.056488}
2025-12-05 12:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autoscout24.it',RowKey='3cb12178-cf5a-451e-b0f7-cc647e30ee49') HTTP/1.1" 204 0
2025-12-05 12:02:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/daf8e92f-b98a-4d02-a6f5-eed330f88b38_b57e452d-9271-4813-b86c-fd12d35d2951.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/daf8e92f-b98a-4d02-a6f5-eed330f88b38_7501d427-eef7-4042-aea4-c2273bf793af.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F1575328c-73cf-4790-9bd6-a18ad4cf4eb6_820460b8-8f5d-43f0-8bcb-43aebf56a8ae.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/1575328c-73cf-4790-9bd6-a18ad4cf4eb6_820460b8-8f5d-43f0-8bcb-43aebf56a8ae.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5cb3650>
2025-12-05 12:02:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 12:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79e51637-e4eb-5d63-9c96-15cfc53dc6c1/79e51637-e4eb-5d63-9c96-15cfc53dc6c1_image_1.webp HTTP/1.1" 201 0
2025-12-05 12:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fdaf8e92f-b98a-4d02-a6f5-eed330f88b38_f2ad02d9-17e6-4d10-a43f-37ed0b3c356f.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/daf8e92f-b98a-4d02-a6f5-eed330f88b38_f2ad02d9-17e6-4d10-a43f-37ed0b3c356f.jpg/250x188.webp saved to cache
2025-12-05 12:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 79e51637-e4eb-5d63-9c96-15cfc53dc6c1
2025-12-05 12:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F1575328c-73cf-4790-9bd6-a18ad4cf4eb6_90a3024e-6e34-40ac-ab9d-0c0906f6e517.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/1575328c-73cf-4790-9bd6-a18ad4cf4eb6_90a3024e-6e34-40ac-ab9d-0c0906f6e517.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/1575328c-73cf-4790-9bd6-a18ad4cf4eb6_6b5c9071-2cf3-48b3-99f4-67feb0aa53ce.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/daf8e92f-b98a-4d02-a6f5-eed330f88b38_6d1b80be-7361-4e4f-ba53-3927d4d27b30.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F1575328c-73cf-4790-9bd6-a18ad4cf4eb6_5fdae77e-2f38-44b6-855e-d6719a08b02d.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/1575328c-73cf-4790-9bd6-a18ad4cf4eb6_5fdae77e-2f38-44b6-855e-d6719a08b02d.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9dd5fced0>
2025-12-05 12:02:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 12:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79e51637-e4eb-5d63-9c96-15cfc53dc6c1/79e51637-e4eb-5d63-9c96-15cfc53dc6c1_image_2.webp HTTP/1.1" 201 0
2025-12-05 12:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fdaf8e92f-b98a-4d02-a6f5-eed330f88b38_b57e452d-9271-4813-b86c-fd12d35d2951.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/daf8e92f-b98a-4d02-a6f5-eed330f88b38_b57e452d-9271-4813-b86c-fd12d35d2951.jpg/250x188.webp saved to cache
2025-12-05 12:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 79e51637-e4eb-5d63-9c96-15cfc53dc6c1
2025-12-05 12:02:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e5c510>
2025-12-05 12:02:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 12:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79e51637-e4eb-5d63-9c96-15cfc53dc6c1/79e51637-e4eb-5d63-9c96-15cfc53dc6c1_image_3.webp HTTP/1.1" 201 0
2025-12-05 12:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fdaf8e92f-b98a-4d02-a6f5-eed330f88b38_7501d427-eef7-4042-aea4-c2273bf793af.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/daf8e92f-b98a-4d02-a6f5-eed330f88b38_7501d427-eef7-4042-aea4-c2273bf793af.jpg/250x188.webp saved to cache
2025-12-05 12:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 79e51637-e4eb-5d63-9c96-15cfc53dc6c1
2025-12-05 12:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F1575328c-73cf-4790-9bd6-a18ad4cf4eb6_06881535-dfd8-493b-97be-9742212f973a.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/1575328c-73cf-4790-9bd6-a18ad4cf4eb6_06881535-dfd8-493b-97be-9742212f973a.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/1575328c-73cf-4790-9bd6-a18ad4cf4eb6_d2ca9abc-f74f-4791-9276-8c8cfd387127.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/1575328c-73cf-4790-9bd6-a18ad4cf4eb6_820460b8-8f5d-43f0-8bcb-43aebf56a8ae.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F1575328c-73cf-4790-9bd6-a18ad4cf4eb6_063308b0-2e49-4314-8b98-c2a2cac34061.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/1575328c-73cf-4790-9bd6-a18ad4cf4eb6_063308b0-2e49-4314-8b98-c2a2cac34061.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5b4eb90>
2025-12-05 12:02:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 12:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_135f457c-b4f1-56f2-bf1f-dfb2c4259431/135f457c-b4f1-56f2-bf1f-dfb2c4259431_image_0.webp HTTP/1.1" 201 0
2025-12-05 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F1575328c-73cf-4790-9bd6-a18ad4cf4eb6_6b5c9071-2cf3-48b3-99f4-67feb0aa53ce.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/1575328c-73cf-4790-9bd6-a18ad4cf4eb6_6b5c9071-2cf3-48b3-99f4-67feb0aa53ce.jpg/250x188.webp saved to cache
2025-12-05 12:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 135f457c-b4f1-56f2-bf1f-dfb2c4259431
2025-12-05 12:02:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9de911b50>
2025-12-05 12:02:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 12:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79e51637-e4eb-5d63-9c96-15cfc53dc6c1/79e51637-e4eb-5d63-9c96-15cfc53dc6c1_image_4.webp HTTP/1.1" 201 0
2025-12-05 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fdaf8e92f-b98a-4d02-a6f5-eed330f88b38_6d1b80be-7361-4e4f-ba53-3927d4d27b30.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/daf8e92f-b98a-4d02-a6f5-eed330f88b38_6d1b80be-7361-4e4f-ba53-3927d4d27b30.jpg/250x188.webp saved to cache
2025-12-05 12:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 79e51637-e4eb-5d63-9c96-15cfc53dc6c1
2025-12-05 12:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 79e51637-e4eb-5d63-9c96-15cfc53dc6c1 from tracking dictionaries
2025-12-05 12:02:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 79e51637-e4eb-5d63-9c96-15cfc53dc6c1 sending to next pipeline
2025-12-05 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F1575328c-73cf-4790-9bd6-a18ad4cf4eb6_294079fd-0ab8-44f7-acb9-8f6d66f40376.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/1575328c-73cf-4790-9bd6-a18ad4cf4eb6_294079fd-0ab8-44f7-acb9-8f6d66f40376.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:15 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 79e51637-e4eb-5d63-9c96-15cfc53dc6c1 with identifier daf8e92f-b98a-4d02-a6f5-eed330f88b38
2025-12-05 12:02:15 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:02:15 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:02:15 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 79e51637-e4eb-5d63-9c96-15cfc53dc6c1
2025-12-05 12:02:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://prod.pictures.autoscout24.net/listing-images/daf8e92f-b98a-4d02-a6f5-eed330f88b38_6d1b80be-7361-4e4f-ba53-3927d4d27b30.jpg/250x188.webp>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'emission_standard': None,
 'engine': None,
 'engine_horse_power': 367,
 'expiration_date': None,
 'fuel_type': 'Electric/Gasoline',
 'id': '79e51637-e4eb-5d63-9c96-15cfc53dc6c1',
 'is_damaged': False,
 'is_operable': True,
 'license_plate': None,
 'link_to_web_offer': 'https://www.autoscout24.it/offers/audi-sq5-spb-tfsi-quattro-s-tronic-367cv-new-model-promo-electric-gasoline-grey-daf8e92f-b98a-4d02-a6f5-eed330f88b38',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'SQ5',
 'odometer': 1,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79e51637-e4eb-5d63-9c96-15cfc53dc6c1/79e51637-e4eb-5d63-9c96-15cfc53dc6c1_image_0.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3436,
             'Height': 157,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/daf8e92f-b98a-4d02-a6f5-eed330f88b38_55e3ac8b-9a4c-43b7-9f8e-349f460bb6da.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79e51637-e4eb-5d63-9c96-15cfc53dc6c1/79e51637-e4eb-5d63-9c96-15cfc53dc6c1_image_1.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 2690,
             'Height': 126,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/daf8e92f-b98a-4d02-a6f5-eed330f88b38_f2ad02d9-17e6-4d10-a43f-37ed0b3c356f.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79e51637-e4eb-5d63-9c96-15cfc53dc6c1/79e51637-e4eb-5d63-9c96-15cfc53dc6c1_image_2.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3614,
             'Height': 157,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/daf8e92f-b98a-4d02-a6f5-eed330f88b38_b57e452d-9271-4813-b86c-fd12d35d2951.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79e51637-e4eb-5d63-9c96-15cfc53dc6c1/79e51637-e4eb-5d63-9c96-15cfc53dc6c1_image_3.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 2522,
             'Height': 110,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/daf8e92f-b98a-4d02-a6f5-eed330f88b38_7501d427-eef7-4042-aea4-c2273bf793af.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79e51637-e4eb-5d63-9c96-15cfc53dc6c1/79e51637-e4eb-5d63-9c96-15cfc53dc6c1_image_4.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 2772,
             'Height': 110,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/daf8e92f-b98a-4d02-a6f5-eed330f88b38_6d1b80be-7361-4e4f-ba53-3927d4d27b30.jpg/250x188.webp',
             'Width': 250}],
 'price': 86900,
 'price_includes_vat': False,
 'registration_date': '2025-08-01',
 'seller_name': None,
 'title': 'Audi SQ5 SPB TFSI QUATTRO S-TRONIC 367CV *NEW MODEL* PROMO',
 'transmission': 'automatic',
 'trim': 'SPB TFSI QUATTRO S-TRONIC 367CV *NEW MODEL* PROMO',
 'vin': None,
 'year': 2025}
2025-12-05 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27daf8e92f-b98a-4d02-a6f5-eed330f88b38%27 HTTP/1.1" 200 None
2025-12-05 12:02:15 [auto_selling_autoscout24.it] INFO: Saving data for daf8e92f-b98a-4d02-a6f5-eed330f88b38: {'created_time': 1764936135.613869, 'last_price_update_time': 1764936135.613878}
2025-12-05 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autoscout24.it',RowKey='daf8e92f-b98a-4d02-a6f5-eed330f88b38') HTTP/1.1" 204 0
2025-12-05 12:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/1575328c-73cf-4790-9bd6-a18ad4cf4eb6_5fdae77e-2f38-44b6-855e-d6719a08b02d.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/1575328c-73cf-4790-9bd6-a18ad4cf4eb6_90a3024e-6e34-40ac-ab9d-0c0906f6e517.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F1575328c-73cf-4790-9bd6-a18ad4cf4eb6_bcbde4e4-d1a6-4c00-94bb-cef94d0f7483.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/1575328c-73cf-4790-9bd6-a18ad4cf4eb6_bcbde4e4-d1a6-4c00-94bb-cef94d0f7483.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5cb1810>
2025-12-05 12:02:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 12:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_135f457c-b4f1-56f2-bf1f-dfb2c4259431/135f457c-b4f1-56f2-bf1f-dfb2c4259431_image_1.webp HTTP/1.1" 201 0
2025-12-05 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F1575328c-73cf-4790-9bd6-a18ad4cf4eb6_d2ca9abc-f74f-4791-9276-8c8cfd387127.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/1575328c-73cf-4790-9bd6-a18ad4cf4eb6_d2ca9abc-f74f-4791-9276-8c8cfd387127.jpg/250x188.webp saved to cache
2025-12-05 12:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 135f457c-b4f1-56f2-bf1f-dfb2c4259431
2025-12-05 12:02:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5cc24d0>
2025-12-05 12:02:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 12:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_135f457c-b4f1-56f2-bf1f-dfb2c4259431/135f457c-b4f1-56f2-bf1f-dfb2c4259431_image_2.webp HTTP/1.1" 201 0
2025-12-05 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F1575328c-73cf-4790-9bd6-a18ad4cf4eb6_820460b8-8f5d-43f0-8bcb-43aebf56a8ae.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/1575328c-73cf-4790-9bd6-a18ad4cf4eb6_820460b8-8f5d-43f0-8bcb-43aebf56a8ae.jpg/250x188.webp saved to cache
2025-12-05 12:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 135f457c-b4f1-56f2-bf1f-dfb2c4259431
2025-12-05 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F1575328c-73cf-4790-9bd6-a18ad4cf4eb6_06869f5b-5892-4068-b479-4a714189fdbe.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/1575328c-73cf-4790-9bd6-a18ad4cf4eb6_06869f5b-5892-4068-b479-4a714189fdbe.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/1575328c-73cf-4790-9bd6-a18ad4cf4eb6_063308b0-2e49-4314-8b98-c2a2cac34061.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/1575328c-73cf-4790-9bd6-a18ad4cf4eb6_06881535-dfd8-493b-97be-9742212f973a.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F1575328c-73cf-4790-9bd6-a18ad4cf4eb6_b6a066f7-7c0e-4515-8eb8-e2059d7acbf4.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/1575328c-73cf-4790-9bd6-a18ad4cf4eb6_b6a066f7-7c0e-4515-8eb8-e2059d7acbf4.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9dc13ed10>
2025-12-05 12:02:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 12:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_135f457c-b4f1-56f2-bf1f-dfb2c4259431/135f457c-b4f1-56f2-bf1f-dfb2c4259431_image_4.webp HTTP/1.1" 201 0
2025-12-05 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F1575328c-73cf-4790-9bd6-a18ad4cf4eb6_5fdae77e-2f38-44b6-855e-d6719a08b02d.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/1575328c-73cf-4790-9bd6-a18ad4cf4eb6_5fdae77e-2f38-44b6-855e-d6719a08b02d.jpg/250x188.webp saved to cache
2025-12-05 12:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 135f457c-b4f1-56f2-bf1f-dfb2c4259431
2025-12-05 12:02:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e52210>
2025-12-05 12:02:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 12:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_135f457c-b4f1-56f2-bf1f-dfb2c4259431/135f457c-b4f1-56f2-bf1f-dfb2c4259431_image_3.webp HTTP/1.1" 201 0
2025-12-05 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F1575328c-73cf-4790-9bd6-a18ad4cf4eb6_90a3024e-6e34-40ac-ab9d-0c0906f6e517.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/1575328c-73cf-4790-9bd6-a18ad4cf4eb6_90a3024e-6e34-40ac-ab9d-0c0906f6e517.jpg/250x188.webp saved to cache
2025-12-05 12:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 135f457c-b4f1-56f2-bf1f-dfb2c4259431
2025-12-05 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F1575328c-73cf-4790-9bd6-a18ad4cf4eb6_a3248bec-ecb4-452d-a96f-6348700491f7.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/1575328c-73cf-4790-9bd6-a18ad4cf4eb6_a3248bec-ecb4-452d-a96f-6348700491f7.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/1575328c-73cf-4790-9bd6-a18ad4cf4eb6_294079fd-0ab8-44f7-acb9-8f6d66f40376.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/1575328c-73cf-4790-9bd6-a18ad4cf4eb6_bcbde4e4-d1a6-4c00-94bb-cef94d0f7483.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%2768b8438c-77fc-4970-9132-f36a4769a6ad%27 HTTP/1.1" 200 None
2025-12-05 12:02:16 [auto_selling_autoscout24.it] INFO: Scrape type for 68b8438c-77fc-4970-9132-f36a4769a6ad: 1
2025-12-05 12:02:16 [auto_selling_autoscout24.it] INFO: Scraping new listing 68b8438c-77fc-4970-9132-f36a4769a6ad
2025-12-05 12:02:16 [auto_selling_autoscout24.it] INFO: Extracting item from listing ID: 68b8438c-77fc-4970-9132-f36a4769a6ad
2025-12-05 12:02:16 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 613bdfd7-e94d-5698-a11c-47077907666f with identifier: 68b8438c-77fc-4970-9132-f36a4769a6ad
2025-12-05 12:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 613bdfd7-e94d-5698-a11c-47077907666f
2025-12-05 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F68b8438c-77fc-4970-9132-f36a4769a6ad_6ba99edb-a548-40d5-a001-792bcf8d2902.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/68b8438c-77fc-4970-9132-f36a4769a6ad_6ba99edb-a548-40d5-a001-792bcf8d2902.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9dd5d10d0>
2025-12-05 12:02:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_135f457c-b4f1-56f2-bf1f-dfb2c4259431/135f457c-b4f1-56f2-bf1f-dfb2c4259431_image_6.webp HTTP/1.1" 201 0
2025-12-05 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F1575328c-73cf-4790-9bd6-a18ad4cf4eb6_063308b0-2e49-4314-8b98-c2a2cac34061.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/1575328c-73cf-4790-9bd6-a18ad4cf4eb6_063308b0-2e49-4314-8b98-c2a2cac34061.jpg/250x188.webp saved to cache
2025-12-05 12:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 135f457c-b4f1-56f2-bf1f-dfb2c4259431
2025-12-05 12:02:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5cc1a50>
2025-12-05 12:02:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 12:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_135f457c-b4f1-56f2-bf1f-dfb2c4259431/135f457c-b4f1-56f2-bf1f-dfb2c4259431_image_5.webp HTTP/1.1" 201 0
2025-12-05 12:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F1575328c-73cf-4790-9bd6-a18ad4cf4eb6_06881535-dfd8-493b-97be-9742212f973a.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/1575328c-73cf-4790-9bd6-a18ad4cf4eb6_06881535-dfd8-493b-97be-9742212f973a.jpg/250x188.webp saved to cache
2025-12-05 12:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 135f457c-b4f1-56f2-bf1f-dfb2c4259431
2025-12-05 12:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F68b8438c-77fc-4970-9132-f36a4769a6ad_dbcaec39-5578-484d-879d-3091d6c72dd7.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/68b8438c-77fc-4970-9132-f36a4769a6ad_dbcaec39-5578-484d-879d-3091d6c72dd7.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/1575328c-73cf-4790-9bd6-a18ad4cf4eb6_06869f5b-5892-4068-b479-4a714189fdbe.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/1575328c-73cf-4790-9bd6-a18ad4cf4eb6_b6a066f7-7c0e-4515-8eb8-e2059d7acbf4.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F68b8438c-77fc-4970-9132-f36a4769a6ad_68b5ccf4-8cb1-424a-9519-7ac62ed16a5b.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/68b8438c-77fc-4970-9132-f36a4769a6ad_68b5ccf4-8cb1-424a-9519-7ac62ed16a5b.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5c73e50>
2025-12-05 12:02:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_135f457c-b4f1-56f2-bf1f-dfb2c4259431/135f457c-b4f1-56f2-bf1f-dfb2c4259431_image_7.webp HTTP/1.1" 201 0
2025-12-05 12:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F1575328c-73cf-4790-9bd6-a18ad4cf4eb6_294079fd-0ab8-44f7-acb9-8f6d66f40376.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/1575328c-73cf-4790-9bd6-a18ad4cf4eb6_294079fd-0ab8-44f7-acb9-8f6d66f40376.jpg/250x188.webp saved to cache
2025-12-05 12:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 135f457c-b4f1-56f2-bf1f-dfb2c4259431
2025-12-05 12:02:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5b3d310>
2025-12-05 12:02:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_135f457c-b4f1-56f2-bf1f-dfb2c4259431/135f457c-b4f1-56f2-bf1f-dfb2c4259431_image_8.webp HTTP/1.1" 201 0
2025-12-05 12:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F1575328c-73cf-4790-9bd6-a18ad4cf4eb6_bcbde4e4-d1a6-4c00-94bb-cef94d0f7483.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/1575328c-73cf-4790-9bd6-a18ad4cf4eb6_bcbde4e4-d1a6-4c00-94bb-cef94d0f7483.jpg/250x188.webp saved to cache
2025-12-05 12:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 135f457c-b4f1-56f2-bf1f-dfb2c4259431
2025-12-05 12:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/68b8438c-77fc-4970-9132-f36a4769a6ad_6ba99edb-a548-40d5-a001-792bcf8d2902.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:17 [scrapy.extensions.logstats] INFO: Crawled 8 pages (at 2 pages/min), scraped 66 items (at 20 items/min)
2025-12-05 12:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F68b8438c-77fc-4970-9132-f36a4769a6ad_992538ef-3303-4c7b-ba15-0f99afeec906.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/68b8438c-77fc-4970-9132-f36a4769a6ad_992538ef-3303-4c7b-ba15-0f99afeec906.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/1575328c-73cf-4790-9bd6-a18ad4cf4eb6_a3248bec-ecb4-452d-a96f-6348700491f7.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F68b8438c-77fc-4970-9132-f36a4769a6ad_dc231ed4-b008-4211-96a8-14a0fc287503.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/68b8438c-77fc-4970-9132-f36a4769a6ad_dc231ed4-b008-4211-96a8-14a0fc287503.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5cb3690>
2025-12-05 12:02:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 12:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_135f457c-b4f1-56f2-bf1f-dfb2c4259431/135f457c-b4f1-56f2-bf1f-dfb2c4259431_image_9.webp HTTP/1.1" 201 0
2025-12-05 12:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F1575328c-73cf-4790-9bd6-a18ad4cf4eb6_06869f5b-5892-4068-b479-4a714189fdbe.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/1575328c-73cf-4790-9bd6-a18ad4cf4eb6_06869f5b-5892-4068-b479-4a714189fdbe.jpg/250x188.webp saved to cache
2025-12-05 12:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 135f457c-b4f1-56f2-bf1f-dfb2c4259431
2025-12-05 12:02:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d6fc19d0>
2025-12-05 12:02:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 12:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_135f457c-b4f1-56f2-bf1f-dfb2c4259431/135f457c-b4f1-56f2-bf1f-dfb2c4259431_image_10.webp HTTP/1.1" 201 0
2025-12-05 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F1575328c-73cf-4790-9bd6-a18ad4cf4eb6_b6a066f7-7c0e-4515-8eb8-e2059d7acbf4.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/1575328c-73cf-4790-9bd6-a18ad4cf4eb6_b6a066f7-7c0e-4515-8eb8-e2059d7acbf4.jpg/250x188.webp saved to cache
2025-12-05 12:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 135f457c-b4f1-56f2-bf1f-dfb2c4259431
2025-12-05 12:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/68b8438c-77fc-4970-9132-f36a4769a6ad_68b5ccf4-8cb1-424a-9519-7ac62ed16a5b.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/68b8438c-77fc-4970-9132-f36a4769a6ad_dbcaec39-5578-484d-879d-3091d6c72dd7.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27a754b7d0-b906-45ce-93ae-8a0e9cc7e81d%27 HTTP/1.1" 200 None
2025-12-05 12:02:18 [auto_selling_autoscout24.it] INFO: Scrape type for a754b7d0-b906-45ce-93ae-8a0e9cc7e81d: 1
2025-12-05 12:02:18 [auto_selling_autoscout24.it] INFO: Scraping new listing a754b7d0-b906-45ce-93ae-8a0e9cc7e81d
2025-12-05 12:02:18 [auto_selling_autoscout24.it] INFO: Extracting item from listing ID: a754b7d0-b906-45ce-93ae-8a0e9cc7e81d
2025-12-05 12:02:18 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 963db493-e306-5510-b389-61e17e2acbee with identifier: a754b7d0-b906-45ce-93ae-8a0e9cc7e81d
2025-12-05 12:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 4 photos for item 963db493-e306-5510-b389-61e17e2acbee
2025-12-05 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fa754b7d0-b906-45ce-93ae-8a0e9cc7e81d_e52e0550-c2a4-48d6-95e0-7342760fb62c.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/a754b7d0-b906-45ce-93ae-8a0e9cc7e81d_e52e0550-c2a4-48d6-95e0-7342760fb62c.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d6f68310>
2025-12-05 12:02:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 12:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_613bdfd7-e94d-5698-a11c-47077907666f/613bdfd7-e94d-5698-a11c-47077907666f_image_0.webp HTTP/1.1" 201 0
2025-12-05 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F68b8438c-77fc-4970-9132-f36a4769a6ad_6ba99edb-a548-40d5-a001-792bcf8d2902.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/68b8438c-77fc-4970-9132-f36a4769a6ad_6ba99edb-a548-40d5-a001-792bcf8d2902.jpg/250x188.webp saved to cache
2025-12-05 12:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 613bdfd7-e94d-5698-a11c-47077907666f
2025-12-05 12:02:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9dc13f090>
2025-12-05 12:02:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_135f457c-b4f1-56f2-bf1f-dfb2c4259431/135f457c-b4f1-56f2-bf1f-dfb2c4259431_image_11.webp HTTP/1.1" 201 0
2025-12-05 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F1575328c-73cf-4790-9bd6-a18ad4cf4eb6_a3248bec-ecb4-452d-a96f-6348700491f7.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/1575328c-73cf-4790-9bd6-a18ad4cf4eb6_a3248bec-ecb4-452d-a96f-6348700491f7.jpg/250x188.webp saved to cache
2025-12-05 12:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 135f457c-b4f1-56f2-bf1f-dfb2c4259431
2025-12-05 12:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 135f457c-b4f1-56f2-bf1f-dfb2c4259431 from tracking dictionaries
2025-12-05 12:02:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 135f457c-b4f1-56f2-bf1f-dfb2c4259431 sending to next pipeline
2025-12-05 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fa754b7d0-b906-45ce-93ae-8a0e9cc7e81d_433da368-0afd-4ade-8cff-5c56548857d4.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/a754b7d0-b906-45ce-93ae-8a0e9cc7e81d_433da368-0afd-4ade-8cff-5c56548857d4.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:18 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 135f457c-b4f1-56f2-bf1f-dfb2c4259431 with identifier 1575328c-73cf-4790-9bd6-a18ad4cf4eb6
2025-12-05 12:02:18 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:02:18 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:02:18 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 135f457c-b4f1-56f2-bf1f-dfb2c4259431
2025-12-05 12:02:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://prod.pictures.autoscout24.net/listing-images/1575328c-73cf-4790-9bd6-a18ad4cf4eb6_a3248bec-ecb4-452d-a96f-6348700491f7.jpg/250x188.webp>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'emission_standard': None,
 'engine': None,
 'engine_horse_power': 194,
 'expiration_date': None,
 'fuel_type': 'Electric/Gasoline',
 'id': '135f457c-b4f1-56f2-bf1f-dfb2c4259431',
 'is_damaged': False,
 'is_operable': True,
 'license_plate': None,
 'link_to_web_offer': 'https://www.autoscout24.it/offers/mg-mg3-1-5-hybrid-luxury-194cv-km0-my2025-only-promo-electric-gasoline-silver-1575328c-73cf-4790-9bd6-a18ad4cf4eb6',
 'listing': 'auction',
 'make': 'MG',
 'model': 'MG3',
 'odometer': 1,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_135f457c-b4f1-56f2-bf1f-dfb2c4259431/135f457c-b4f1-56f2-bf1f-dfb2c4259431_image_0.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4148,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/1575328c-73cf-4790-9bd6-a18ad4cf4eb6_6b5c9071-2cf3-48b3-99f4-67feb0aa53ce.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_135f457c-b4f1-56f2-bf1f-dfb2c4259431/135f457c-b4f1-56f2-bf1f-dfb2c4259431_image_1.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4478,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/1575328c-73cf-4790-9bd6-a18ad4cf4eb6_d2ca9abc-f74f-4791-9276-8c8cfd387127.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_135f457c-b4f1-56f2-bf1f-dfb2c4259431/135f457c-b4f1-56f2-bf1f-dfb2c4259431_image_2.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5058,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/1575328c-73cf-4790-9bd6-a18ad4cf4eb6_820460b8-8f5d-43f0-8bcb-43aebf56a8ae.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_135f457c-b4f1-56f2-bf1f-dfb2c4259431/135f457c-b4f1-56f2-bf1f-dfb2c4259431_image_3.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 6786,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/1575328c-73cf-4790-9bd6-a18ad4cf4eb6_90a3024e-6e34-40ac-ab9d-0c0906f6e517.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_135f457c-b4f1-56f2-bf1f-dfb2c4259431/135f457c-b4f1-56f2-bf1f-dfb2c4259431_image_4.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5886,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/1575328c-73cf-4790-9bd6-a18ad4cf4eb6_5fdae77e-2f38-44b6-855e-d6719a08b02d.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_135f457c-b4f1-56f2-bf1f-dfb2c4259431/135f457c-b4f1-56f2-bf1f-dfb2c4259431_image_5.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5552,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/1575328c-73cf-4790-9bd6-a18ad4cf4eb6_06881535-dfd8-493b-97be-9742212f973a.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_135f457c-b4f1-56f2-bf1f-dfb2c4259431/135f457c-b4f1-56f2-bf1f-dfb2c4259431_image_6.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4508,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/1575328c-73cf-4790-9bd6-a18ad4cf4eb6_063308b0-2e49-4314-8b98-c2a2cac34061.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_135f457c-b4f1-56f2-bf1f-dfb2c4259431/135f457c-b4f1-56f2-bf1f-dfb2c4259431_image_7.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4518,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/1575328c-73cf-4790-9bd6-a18ad4cf4eb6_294079fd-0ab8-44f7-acb9-8f6d66f40376.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_135f457c-b4f1-56f2-bf1f-dfb2c4259431/135f457c-b4f1-56f2-bf1f-dfb2c4259431_image_8.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4622,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/1575328c-73cf-4790-9bd6-a18ad4cf4eb6_bcbde4e4-d1a6-4c00-94bb-cef94d0f7483.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_135f457c-b4f1-56f2-bf1f-dfb2c4259431/135f457c-b4f1-56f2-bf1f-dfb2c4259431_image_9.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5346,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/1575328c-73cf-4790-9bd6-a18ad4cf4eb6_06869f5b-5892-4068-b479-4a714189fdbe.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_135f457c-b4f1-56f2-bf1f-dfb2c4259431/135f457c-b4f1-56f2-bf1f-dfb2c4259431_image_10.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4962,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/1575328c-73cf-4790-9bd6-a18ad4cf4eb6_b6a066f7-7c0e-4515-8eb8-e2059d7acbf4.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_135f457c-b4f1-56f2-bf1f-dfb2c4259431/135f457c-b4f1-56f2-bf1f-dfb2c4259431_image_11.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4370,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/1575328c-73cf-4790-9bd6-a18ad4cf4eb6_a3248bec-ecb4-452d-a96f-6348700491f7.jpg/250x188.webp',
             'Width': 250}],
 'price': 20800,
 'price_includes_vat': False,
 'registration_date': '2025-07-01',
 'seller_name': None,
 'title': 'MG MG3 1.5 HYBRID+ LUXURY 194CV KM0 MY2025 ONLY PROMO',
 'transmission': 'automatic',
 'trim': '1.5 HYBRID+ LUXURY 194CV KM0 MY2025 ONLY PROMO',
 'vin': None,
 'year': 2025}
2025-12-05 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%271575328c-73cf-4790-9bd6-a18ad4cf4eb6%27 HTTP/1.1" 200 None
2025-12-05 12:02:18 [auto_selling_autoscout24.it] INFO: Saving data for 1575328c-73cf-4790-9bd6-a18ad4cf4eb6: {'created_time': 1764936138.740832, 'last_price_update_time': 1764936138.74084}
2025-12-05 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autoscout24.it',RowKey='1575328c-73cf-4790-9bd6-a18ad4cf4eb6') HTTP/1.1" 204 0
2025-12-05 12:02:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/68b8438c-77fc-4970-9132-f36a4769a6ad_992538ef-3303-4c7b-ba15-0f99afeec906.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fa754b7d0-b906-45ce-93ae-8a0e9cc7e81d_0196a422-0f19-40e9-81f7-79b43da1ce74.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/a754b7d0-b906-45ce-93ae-8a0e9cc7e81d_0196a422-0f19-40e9-81f7-79b43da1ce74.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5b1c110>
2025-12-05 12:02:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 12:02:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_613bdfd7-e94d-5698-a11c-47077907666f/613bdfd7-e94d-5698-a11c-47077907666f_image_2.webp HTTP/1.1" 201 0
2025-12-05 12:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F68b8438c-77fc-4970-9132-f36a4769a6ad_68b5ccf4-8cb1-424a-9519-7ac62ed16a5b.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/68b8438c-77fc-4970-9132-f36a4769a6ad_68b5ccf4-8cb1-424a-9519-7ac62ed16a5b.jpg/250x188.webp saved to cache
2025-12-05 12:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 613bdfd7-e94d-5698-a11c-47077907666f
2025-12-05 12:02:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5ceffd0>
2025-12-05 12:02:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 12:02:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_613bdfd7-e94d-5698-a11c-47077907666f/613bdfd7-e94d-5698-a11c-47077907666f_image_1.webp HTTP/1.1" 201 0
2025-12-05 12:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F68b8438c-77fc-4970-9132-f36a4769a6ad_dbcaec39-5578-484d-879d-3091d6c72dd7.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/68b8438c-77fc-4970-9132-f36a4769a6ad_dbcaec39-5578-484d-879d-3091d6c72dd7.jpg/250x188.webp saved to cache
2025-12-05 12:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 613bdfd7-e94d-5698-a11c-47077907666f
2025-12-05 12:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fa754b7d0-b906-45ce-93ae-8a0e9cc7e81d_c2354cb9-16fc-4542-870e-666b5793dabc.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/a754b7d0-b906-45ce-93ae-8a0e9cc7e81d_c2354cb9-16fc-4542-870e-666b5793dabc.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/68b8438c-77fc-4970-9132-f36a4769a6ad_dc231ed4-b008-4211-96a8-14a0fc287503.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/a754b7d0-b906-45ce-93ae-8a0e9cc7e81d_e52e0550-c2a4-48d6-95e0-7342760fb62c.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27edea561c-07b2-486e-a175-1db0160c247d%27 HTTP/1.1" 200 None
2025-12-05 12:02:20 [auto_selling_autoscout24.it] INFO: Scrape type for edea561c-07b2-486e-a175-1db0160c247d: 1
2025-12-05 12:02:20 [auto_selling_autoscout24.it] INFO: Scraping new listing edea561c-07b2-486e-a175-1db0160c247d
2025-12-05 12:02:20 [auto_selling_autoscout24.it] INFO: Extracting item from listing ID: edea561c-07b2-486e-a175-1db0160c247d
2025-12-05 12:02:20 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d8e8875-9450-52f8-b210-7387575db400 with identifier: edea561c-07b2-486e-a175-1db0160c247d
2025-12-05 12:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 14 photos for item 7d8e8875-9450-52f8-b210-7387575db400
2025-12-05 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fedea561c-07b2-486e-a175-1db0160c247d_e3a42201-5494-44c3-8237-b48af0d05c36.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/edea561c-07b2-486e-a175-1db0160c247d_e3a42201-5494-44c3-8237-b48af0d05c36.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e33f10>
2025-12-05 12:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_613bdfd7-e94d-5698-a11c-47077907666f/613bdfd7-e94d-5698-a11c-47077907666f_image_3.webp HTTP/1.1" 201 0
2025-12-05 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F68b8438c-77fc-4970-9132-f36a4769a6ad_992538ef-3303-4c7b-ba15-0f99afeec906.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/68b8438c-77fc-4970-9132-f36a4769a6ad_992538ef-3303-4c7b-ba15-0f99afeec906.jpg/250x188.webp saved to cache
2025-12-05 12:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 613bdfd7-e94d-5698-a11c-47077907666f
2025-12-05 12:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/a754b7d0-b906-45ce-93ae-8a0e9cc7e81d_433da368-0afd-4ade-8cff-5c56548857d4.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fedea561c-07b2-486e-a175-1db0160c247d_fc41fef3-bf12-4a76-855f-19d5ee84b2ed.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/edea561c-07b2-486e-a175-1db0160c247d_fc41fef3-bf12-4a76-855f-19d5ee84b2ed.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/a754b7d0-b906-45ce-93ae-8a0e9cc7e81d_0196a422-0f19-40e9-81f7-79b43da1ce74.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fedea561c-07b2-486e-a175-1db0160c247d_6ef2e88f-14be-4776-a1d0-beaf07dea67a.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/edea561c-07b2-486e-a175-1db0160c247d_6ef2e88f-14be-4776-a1d0-beaf07dea67a.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e4f990>
2025-12-05 12:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 12:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_613bdfd7-e94d-5698-a11c-47077907666f/613bdfd7-e94d-5698-a11c-47077907666f_image_4.webp HTTP/1.1" 201 0
2025-12-05 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F68b8438c-77fc-4970-9132-f36a4769a6ad_dc231ed4-b008-4211-96a8-14a0fc287503.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/68b8438c-77fc-4970-9132-f36a4769a6ad_dc231ed4-b008-4211-96a8-14a0fc287503.jpg/250x188.webp saved to cache
2025-12-05 12:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 613bdfd7-e94d-5698-a11c-47077907666f
2025-12-05 12:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 613bdfd7-e94d-5698-a11c-47077907666f from tracking dictionaries
2025-12-05 12:02:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 613bdfd7-e94d-5698-a11c-47077907666f sending to next pipeline
2025-12-05 12:02:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d6fe71d0>
2025-12-05 12:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 12:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_963db493-e306-5510-b389-61e17e2acbee/963db493-e306-5510-b389-61e17e2acbee_image_0.webp HTTP/1.1" 201 0
2025-12-05 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fa754b7d0-b906-45ce-93ae-8a0e9cc7e81d_e52e0550-c2a4-48d6-95e0-7342760fb62c.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/a754b7d0-b906-45ce-93ae-8a0e9cc7e81d_e52e0550-c2a4-48d6-95e0-7342760fb62c.jpg/250x188.webp saved to cache
2025-12-05 12:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 963db493-e306-5510-b389-61e17e2acbee
2025-12-05 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fedea561c-07b2-486e-a175-1db0160c247d_2bb48d80-bef1-462b-97f2-bfcdce0df5a7.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/edea561c-07b2-486e-a175-1db0160c247d_2bb48d80-bef1-462b-97f2-bfcdce0df5a7.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:20 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 613bdfd7-e94d-5698-a11c-47077907666f with identifier 68b8438c-77fc-4970-9132-f36a4769a6ad
2025-12-05 12:02:20 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:02:20 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:02:20 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 613bdfd7-e94d-5698-a11c-47077907666f
2025-12-05 12:02:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://prod.pictures.autoscout24.net/listing-images/68b8438c-77fc-4970-9132-f36a4769a6ad_dc231ed4-b008-4211-96a8-14a0fc287503.jpg/250x188.webp>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'emission_standard': None,
 'engine': None,
 'engine_horse_power': 204,
 'expiration_date': None,
 'fuel_type': 'Electric/Diesel',
 'id': '613bdfd7-e94d-5698-a11c-47077907666f',
 'is_damaged': False,
 'is_operable': True,
 'license_plate': None,
 'link_to_web_offer': 'https://www.autoscout24.it/offers/audi-q5-facelift-tdi-quattro-s-tronic-204cv-my2025-promo-electric-diesel-black-68b8438c-77fc-4970-9132-f36a4769a6ad',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 1,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_613bdfd7-e94d-5698-a11c-47077907666f/613bdfd7-e94d-5698-a11c-47077907666f_image_0.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4128,
             'Height': 143,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/68b8438c-77fc-4970-9132-f36a4769a6ad_6ba99edb-a548-40d5-a001-792bcf8d2902.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_613bdfd7-e94d-5698-a11c-47077907666f/613bdfd7-e94d-5698-a11c-47077907666f_image_1.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 2914,
             'Height': 117,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/68b8438c-77fc-4970-9132-f36a4769a6ad_dbcaec39-5578-484d-879d-3091d6c72dd7.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_613bdfd7-e94d-5698-a11c-47077907666f/613bdfd7-e94d-5698-a11c-47077907666f_image_2.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3622,
             'Height': 140,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/68b8438c-77fc-4970-9132-f36a4769a6ad_68b5ccf4-8cb1-424a-9519-7ac62ed16a5b.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_613bdfd7-e94d-5698-a11c-47077907666f/613bdfd7-e94d-5698-a11c-47077907666f_image_3.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 2728,
             'Height': 109,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/68b8438c-77fc-4970-9132-f36a4769a6ad_992538ef-3303-4c7b-ba15-0f99afeec906.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_613bdfd7-e94d-5698-a11c-47077907666f/613bdfd7-e94d-5698-a11c-47077907666f_image_4.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 2850,
             'Height': 108,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/68b8438c-77fc-4970-9132-f36a4769a6ad_dc231ed4-b008-4211-96a8-14a0fc287503.jpg/250x188.webp',
             'Width': 250}],
 'price': 69900,
 'price_includes_vat': False,
 'registration_date': '2025-09-01',
 'seller_name': None,
 'title': 'Audi Q5 FACELIFT TDI QUATTRO S-TRONIC 204CV MY2025 PROMO!',
 'transmission': 'automatic',
 'trim': 'FACELIFT TDI QUATTRO S-TRONIC 204CV MY2025 PROMO!',
 'vin': None,
 'year': 2025}
2025-12-05 12:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%2768b8438c-77fc-4970-9132-f36a4769a6ad%27 HTTP/1.1" 200 None
2025-12-05 12:02:21 [auto_selling_autoscout24.it] INFO: Saving data for 68b8438c-77fc-4970-9132-f36a4769a6ad: {'created_time': 1764936141.011947, 'last_price_update_time': 1764936141.011958}
2025-12-05 12:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autoscout24.it',RowKey='68b8438c-77fc-4970-9132-f36a4769a6ad') HTTP/1.1" 204 0
2025-12-05 12:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/a754b7d0-b906-45ce-93ae-8a0e9cc7e81d_c2354cb9-16fc-4542-870e-666b5793dabc.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/edea561c-07b2-486e-a175-1db0160c247d_e3a42201-5494-44c3-8237-b48af0d05c36.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fedea561c-07b2-486e-a175-1db0160c247d_cb70f43d-295d-4a58-a2f1-aeff9b7a873b.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/edea561c-07b2-486e-a175-1db0160c247d_cb70f43d-295d-4a58-a2f1-aeff9b7a873b.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5ceff90>
2025-12-05 12:02:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 12:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_963db493-e306-5510-b389-61e17e2acbee/963db493-e306-5510-b389-61e17e2acbee_image_1.webp HTTP/1.1" 201 0
2025-12-05 12:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fa754b7d0-b906-45ce-93ae-8a0e9cc7e81d_433da368-0afd-4ade-8cff-5c56548857d4.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/a754b7d0-b906-45ce-93ae-8a0e9cc7e81d_433da368-0afd-4ade-8cff-5c56548857d4.jpg/250x188.webp saved to cache
2025-12-05 12:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 963db493-e306-5510-b389-61e17e2acbee
2025-12-05 12:02:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e37850>
2025-12-05 12:02:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_963db493-e306-5510-b389-61e17e2acbee/963db493-e306-5510-b389-61e17e2acbee_image_2.webp HTTP/1.1" 201 0
2025-12-05 12:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fa754b7d0-b906-45ce-93ae-8a0e9cc7e81d_0196a422-0f19-40e9-81f7-79b43da1ce74.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/a754b7d0-b906-45ce-93ae-8a0e9cc7e81d_0196a422-0f19-40e9-81f7-79b43da1ce74.jpg/250x188.webp saved to cache
2025-12-05 12:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 963db493-e306-5510-b389-61e17e2acbee
2025-12-05 12:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fedea561c-07b2-486e-a175-1db0160c247d_ccf4d8b2-c602-41fb-9594-b11961ce1102.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/edea561c-07b2-486e-a175-1db0160c247d_ccf4d8b2-c602-41fb-9594-b11961ce1102.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/edea561c-07b2-486e-a175-1db0160c247d_fc41fef3-bf12-4a76-855f-19d5ee84b2ed.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/edea561c-07b2-486e-a175-1db0160c247d_6ef2e88f-14be-4776-a1d0-beaf07dea67a.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fedea561c-07b2-486e-a175-1db0160c247d_57e30be6-0422-423a-bfa5-19c2e20a4bf4.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/edea561c-07b2-486e-a175-1db0160c247d_57e30be6-0422-423a-bfa5-19c2e20a4bf4.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9e0116350>
2025-12-05 12:02:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 12:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_963db493-e306-5510-b389-61e17e2acbee/963db493-e306-5510-b389-61e17e2acbee_image_3.webp HTTP/1.1" 201 0
2025-12-05 12:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fa754b7d0-b906-45ce-93ae-8a0e9cc7e81d_c2354cb9-16fc-4542-870e-666b5793dabc.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/a754b7d0-b906-45ce-93ae-8a0e9cc7e81d_c2354cb9-16fc-4542-870e-666b5793dabc.jpg/250x188.webp saved to cache
2025-12-05 12:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 963db493-e306-5510-b389-61e17e2acbee
2025-12-05 12:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 963db493-e306-5510-b389-61e17e2acbee from tracking dictionaries
2025-12-05 12:02:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 963db493-e306-5510-b389-61e17e2acbee sending to next pipeline
2025-12-05 12:02:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d6fc0990>
2025-12-05 12:02:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 12:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d8e8875-9450-52f8-b210-7387575db400/7d8e8875-9450-52f8-b210-7387575db400_image_0.webp HTTP/1.1" 201 0
2025-12-05 12:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fedea561c-07b2-486e-a175-1db0160c247d_e3a42201-5494-44c3-8237-b48af0d05c36.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/edea561c-07b2-486e-a175-1db0160c247d_e3a42201-5494-44c3-8237-b48af0d05c36.jpg/250x188.webp saved to cache
2025-12-05 12:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7d8e8875-9450-52f8-b210-7387575db400
2025-12-05 12:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fedea561c-07b2-486e-a175-1db0160c247d_bd58cdeb-7b1b-467d-9849-894115fb89c3.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/edea561c-07b2-486e-a175-1db0160c247d_bd58cdeb-7b1b-467d-9849-894115fb89c3.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:22 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 963db493-e306-5510-b389-61e17e2acbee with identifier a754b7d0-b906-45ce-93ae-8a0e9cc7e81d
2025-12-05 12:02:22 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:02:22 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:02:22 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 963db493-e306-5510-b389-61e17e2acbee
2025-12-05 12:02:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://prod.pictures.autoscout24.net/listing-images/a754b7d0-b906-45ce-93ae-8a0e9cc7e81d_c2354cb9-16fc-4542-870e-666b5793dabc.jpg/250x188.webp>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'emission_standard': None,
 'engine': None,
 'engine_horse_power': 367,
 'expiration_date': None,
 'fuel_type': 'Electric/Gasoline',
 'id': '963db493-e306-5510-b389-61e17e2acbee',
 'is_damaged': False,
 'is_operable': True,
 'license_plate': None,
 'link_to_web_offer': 'https://www.autoscout24.it/offers/audi-s5-avant-edition-one-tfsi-quattro-s-tronic-367cv-electric-gasoline-black-a754b7d0-b906-45ce-93ae-8a0e9cc7e81d',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'S5',
 'odometer': 4600,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 4,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_963db493-e306-5510-b389-61e17e2acbee/963db493-e306-5510-b389-61e17e2acbee_image_0.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4010,
             'Height': 153,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/a754b7d0-b906-45ce-93ae-8a0e9cc7e81d_e52e0550-c2a4-48d6-95e0-7342760fb62c.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_963db493-e306-5510-b389-61e17e2acbee/963db493-e306-5510-b389-61e17e2acbee_image_1.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3654,
             'Height': 150,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/a754b7d0-b906-45ce-93ae-8a0e9cc7e81d_433da368-0afd-4ade-8cff-5c56548857d4.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_963db493-e306-5510-b389-61e17e2acbee/963db493-e306-5510-b389-61e17e2acbee_image_2.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 2742,
             'Height': 155,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/a754b7d0-b906-45ce-93ae-8a0e9cc7e81d_0196a422-0f19-40e9-81f7-79b43da1ce74.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_963db493-e306-5510-b389-61e17e2acbee/963db493-e306-5510-b389-61e17e2acbee_image_3.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 2950,
             'Height': 152,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/a754b7d0-b906-45ce-93ae-8a0e9cc7e81d_c2354cb9-16fc-4542-870e-666b5793dabc.jpg/250x188.webp',
             'Width': 250}],
 'price': 82500,
 'price_includes_vat': False,
 'registration_date': '2024-12-01',
 'seller_name': None,
 'title': 'Audi S5 AVANT EDITION ONE TFSI QUATTRO S-TRONIC 367CV',
 'transmission': 'automatic',
 'trim': 'AVANT EDITION ONE TFSI QUATTRO S-TRONIC 367CV',
 'vin': None,
 'year': 2024}
2025-12-05 12:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27a754b7d0-b906-45ce-93ae-8a0e9cc7e81d%27 HTTP/1.1" 200 None
2025-12-05 12:02:22 [auto_selling_autoscout24.it] INFO: Saving data for a754b7d0-b906-45ce-93ae-8a0e9cc7e81d: {'created_time': 1764936142.135404, 'last_price_update_time': 1764936142.135413}
2025-12-05 12:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autoscout24.it',RowKey='a754b7d0-b906-45ce-93ae-8a0e9cc7e81d') HTTP/1.1" 204 0
2025-12-05 12:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/edea561c-07b2-486e-a175-1db0160c247d_cb70f43d-295d-4a58-a2f1-aeff9b7a873b.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/edea561c-07b2-486e-a175-1db0160c247d_2bb48d80-bef1-462b-97f2-bfcdce0df5a7.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fedea561c-07b2-486e-a175-1db0160c247d_6c61aa7a-8acc-4e67-9f8b-8dd65e9bd9ec.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/edea561c-07b2-486e-a175-1db0160c247d_6c61aa7a-8acc-4e67-9f8b-8dd65e9bd9ec.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9dc1b8350>
2025-12-05 12:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 12:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d8e8875-9450-52f8-b210-7387575db400/7d8e8875-9450-52f8-b210-7387575db400_image_1.webp HTTP/1.1" 201 0
2025-12-05 12:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fedea561c-07b2-486e-a175-1db0160c247d_fc41fef3-bf12-4a76-855f-19d5ee84b2ed.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/edea561c-07b2-486e-a175-1db0160c247d_fc41fef3-bf12-4a76-855f-19d5ee84b2ed.jpg/250x188.webp saved to cache
2025-12-05 12:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7d8e8875-9450-52f8-b210-7387575db400
2025-12-05 12:02:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d6f84990>
2025-12-05 12:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 12:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d8e8875-9450-52f8-b210-7387575db400/7d8e8875-9450-52f8-b210-7387575db400_image_2.webp HTTP/1.1" 201 0
2025-12-05 12:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fedea561c-07b2-486e-a175-1db0160c247d_6ef2e88f-14be-4776-a1d0-beaf07dea67a.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/edea561c-07b2-486e-a175-1db0160c247d_6ef2e88f-14be-4776-a1d0-beaf07dea67a.jpg/250x188.webp saved to cache
2025-12-05 12:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7d8e8875-9450-52f8-b210-7387575db400
2025-12-05 12:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fedea561c-07b2-486e-a175-1db0160c247d_4accc556-5199-4e7a-a751-1df8673707ce.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/edea561c-07b2-486e-a175-1db0160c247d_4accc556-5199-4e7a-a751-1df8673707ce.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/edea561c-07b2-486e-a175-1db0160c247d_57e30be6-0422-423a-bfa5-19c2e20a4bf4.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/edea561c-07b2-486e-a175-1db0160c247d_ccf4d8b2-c602-41fb-9594-b11961ce1102.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fedea561c-07b2-486e-a175-1db0160c247d_3d7e64f2-444e-41a0-bfd0-7a78067fbe83.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/edea561c-07b2-486e-a175-1db0160c247d_3d7e64f2-444e-41a0-bfd0-7a78067fbe83.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e7f450>
2025-12-05 12:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 12:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d8e8875-9450-52f8-b210-7387575db400/7d8e8875-9450-52f8-b210-7387575db400_image_4.webp HTTP/1.1" 201 0
2025-12-05 12:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fedea561c-07b2-486e-a175-1db0160c247d_cb70f43d-295d-4a58-a2f1-aeff9b7a873b.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/edea561c-07b2-486e-a175-1db0160c247d_cb70f43d-295d-4a58-a2f1-aeff9b7a873b.jpg/250x188.webp saved to cache
2025-12-05 12:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7d8e8875-9450-52f8-b210-7387575db400
2025-12-05 12:02:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d6fd9d90>
2025-12-05 12:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d8e8875-9450-52f8-b210-7387575db400/7d8e8875-9450-52f8-b210-7387575db400_image_3.webp HTTP/1.1" 201 0
2025-12-05 12:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fedea561c-07b2-486e-a175-1db0160c247d_2bb48d80-bef1-462b-97f2-bfcdce0df5a7.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/edea561c-07b2-486e-a175-1db0160c247d_2bb48d80-bef1-462b-97f2-bfcdce0df5a7.jpg/250x188.webp saved to cache
2025-12-05 12:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7d8e8875-9450-52f8-b210-7387575db400
2025-12-05 12:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/edea561c-07b2-486e-a175-1db0160c247d_bd58cdeb-7b1b-467d-9849-894115fb89c3.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/edea561c-07b2-486e-a175-1db0160c247d_6c61aa7a-8acc-4e67-9f8b-8dd65e9bd9ec.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fedea561c-07b2-486e-a175-1db0160c247d_7d366344-983c-4e60-8ba5-c25498392d32.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/edea561c-07b2-486e-a175-1db0160c247d_7d366344-983c-4e60-8ba5-c25498392d32.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5b1d950>
2025-12-05 12:02:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d8e8875-9450-52f8-b210-7387575db400/7d8e8875-9450-52f8-b210-7387575db400_image_6.webp HTTP/1.1" 201 0
2025-12-05 12:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fedea561c-07b2-486e-a175-1db0160c247d_57e30be6-0422-423a-bfa5-19c2e20a4bf4.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/edea561c-07b2-486e-a175-1db0160c247d_57e30be6-0422-423a-bfa5-19c2e20a4bf4.jpg/250x188.webp saved to cache
2025-12-05 12:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7d8e8875-9450-52f8-b210-7387575db400
2025-12-05 12:02:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5c71610>
2025-12-05 12:02:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d8e8875-9450-52f8-b210-7387575db400/7d8e8875-9450-52f8-b210-7387575db400_image_5.webp HTTP/1.1" 201 0
2025-12-05 12:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fedea561c-07b2-486e-a175-1db0160c247d_ccf4d8b2-c602-41fb-9594-b11961ce1102.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/edea561c-07b2-486e-a175-1db0160c247d_ccf4d8b2-c602-41fb-9594-b11961ce1102.jpg/250x188.webp saved to cache
2025-12-05 12:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7d8e8875-9450-52f8-b210-7387575db400
2025-12-05 12:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fedea561c-07b2-486e-a175-1db0160c247d_3be1af68-65d1-45e4-bf2a-7908f175e6a7.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/edea561c-07b2-486e-a175-1db0160c247d_3be1af68-65d1-45e4-bf2a-7908f175e6a7.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/edea561c-07b2-486e-a175-1db0160c247d_4accc556-5199-4e7a-a751-1df8673707ce.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fedea561c-07b2-486e-a175-1db0160c247d_66f196ad-9da9-4dc3-adee-4f52e097649d.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/edea561c-07b2-486e-a175-1db0160c247d_66f196ad-9da9-4dc3-adee-4f52e097649d.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9dd5d1910>
2025-12-05 12:02:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d8e8875-9450-52f8-b210-7387575db400/7d8e8875-9450-52f8-b210-7387575db400_image_7.webp HTTP/1.1" 201 0
2025-12-05 12:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fedea561c-07b2-486e-a175-1db0160c247d_bd58cdeb-7b1b-467d-9849-894115fb89c3.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/edea561c-07b2-486e-a175-1db0160c247d_bd58cdeb-7b1b-467d-9849-894115fb89c3.jpg/250x188.webp saved to cache
2025-12-05 12:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7d8e8875-9450-52f8-b210-7387575db400
2025-12-05 12:02:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9dc13ee90>
2025-12-05 12:02:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 12:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d8e8875-9450-52f8-b210-7387575db400/7d8e8875-9450-52f8-b210-7387575db400_image_8.webp HTTP/1.1" 201 0
2025-12-05 12:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fedea561c-07b2-486e-a175-1db0160c247d_6c61aa7a-8acc-4e67-9f8b-8dd65e9bd9ec.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/edea561c-07b2-486e-a175-1db0160c247d_6c61aa7a-8acc-4e67-9f8b-8dd65e9bd9ec.jpg/250x188.webp saved to cache
2025-12-05 12:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7d8e8875-9450-52f8-b210-7387575db400
2025-12-05 12:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%270a58f9ba-3145-45ca-9114-9e9a3ad6f5c2%27 HTTP/1.1" 200 None
2025-12-05 12:02:24 [auto_selling_autoscout24.it] INFO: Scrape type for 0a58f9ba-3145-45ca-9114-9e9a3ad6f5c2: 1
2025-12-05 12:02:24 [auto_selling_autoscout24.it] INFO: Scraping new listing 0a58f9ba-3145-45ca-9114-9e9a3ad6f5c2
2025-12-05 12:02:24 [auto_selling_autoscout24.it] INFO: Extracting item from listing ID: 0a58f9ba-3145-45ca-9114-9e9a3ad6f5c2
2025-12-05 12:02:24 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 3add5f16-8355-53f2-9a28-4fe2bc57531c with identifier: 0a58f9ba-3145-45ca-9114-9e9a3ad6f5c2
2025-12-05 12:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 3 photos for item 3add5f16-8355-53f2-9a28-4fe2bc57531c
2025-12-05 12:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F0a58f9ba-3145-45ca-9114-9e9a3ad6f5c2_01ca3a05-9980-45fc-8f80-97ed9a12bb30.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/0a58f9ba-3145-45ca-9114-9e9a3ad6f5c2_01ca3a05-9980-45fc-8f80-97ed9a12bb30.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/edea561c-07b2-486e-a175-1db0160c247d_3d7e64f2-444e-41a0-bfd0-7a78067fbe83.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/edea561c-07b2-486e-a175-1db0160c247d_7d366344-983c-4e60-8ba5-c25498392d32.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F0a58f9ba-3145-45ca-9114-9e9a3ad6f5c2_b65ed713-3353-49db-9542-05a433f7df91.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/0a58f9ba-3145-45ca-9114-9e9a3ad6f5c2_b65ed713-3353-49db-9542-05a433f7df91.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5ccb3d0>
2025-12-05 12:02:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 12:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d8e8875-9450-52f8-b210-7387575db400/7d8e8875-9450-52f8-b210-7387575db400_image_9.webp HTTP/1.1" 201 0
2025-12-05 12:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fedea561c-07b2-486e-a175-1db0160c247d_4accc556-5199-4e7a-a751-1df8673707ce.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/edea561c-07b2-486e-a175-1db0160c247d_4accc556-5199-4e7a-a751-1df8673707ce.jpg/250x188.webp saved to cache
2025-12-05 12:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7d8e8875-9450-52f8-b210-7387575db400
2025-12-05 12:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F0a58f9ba-3145-45ca-9114-9e9a3ad6f5c2_5ca8cafa-1c7a-4e9e-9564-bed0d490e24d.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/0a58f9ba-3145-45ca-9114-9e9a3ad6f5c2_5ca8cafa-1c7a-4e9e-9564-bed0d490e24d.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/edea561c-07b2-486e-a175-1db0160c247d_3be1af68-65d1-45e4-bf2a-7908f175e6a7.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/edea561c-07b2-486e-a175-1db0160c247d_66f196ad-9da9-4dc3-adee-4f52e097649d.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%2719b0ff2a-9dd2-4480-b693-eae1f76c5540%27 HTTP/1.1" 200 None
2025-12-05 12:02:24 [auto_selling_autoscout24.it] INFO: Scrape type for 19b0ff2a-9dd2-4480-b693-eae1f76c5540: 1
2025-12-05 12:02:24 [auto_selling_autoscout24.it] INFO: Scraping new listing 19b0ff2a-9dd2-4480-b693-eae1f76c5540
2025-12-05 12:02:24 [auto_selling_autoscout24.it] INFO: Extracting item from listing ID: 19b0ff2a-9dd2-4480-b693-eae1f76c5540
2025-12-05 12:02:24 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d3c0799-21f3-50aa-b14e-901fde34fe8e with identifier: 19b0ff2a-9dd2-4480-b693-eae1f76c5540
2025-12-05 12:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 1d3c0799-21f3-50aa-b14e-901fde34fe8e
2025-12-05 12:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F19b0ff2a-9dd2-4480-b693-eae1f76c5540_54f5727d-e89d-4f58-8d5e-9cf91db1469d.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/19b0ff2a-9dd2-4480-b693-eae1f76c5540_54f5727d-e89d-4f58-8d5e-9cf91db1469d.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e34b50>
2025-12-05 12:02:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 12:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d8e8875-9450-52f8-b210-7387575db400/7d8e8875-9450-52f8-b210-7387575db400_image_10.webp HTTP/1.1" 201 0
2025-12-05 12:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fedea561c-07b2-486e-a175-1db0160c247d_3d7e64f2-444e-41a0-bfd0-7a78067fbe83.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/edea561c-07b2-486e-a175-1db0160c247d_3d7e64f2-444e-41a0-bfd0-7a78067fbe83.jpg/250x188.webp saved to cache
2025-12-05 12:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 7d8e8875-9450-52f8-b210-7387575db400
2025-12-05 12:02:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5c16210>
2025-12-05 12:02:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 12:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d8e8875-9450-52f8-b210-7387575db400/7d8e8875-9450-52f8-b210-7387575db400_image_11.webp HTTP/1.1" 201 0
2025-12-05 12:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fedea561c-07b2-486e-a175-1db0160c247d_7d366344-983c-4e60-8ba5-c25498392d32.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/edea561c-07b2-486e-a175-1db0160c247d_7d366344-983c-4e60-8ba5-c25498392d32.jpg/250x188.webp saved to cache
2025-12-05 12:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 7d8e8875-9450-52f8-b210-7387575db400
2025-12-05 12:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/0a58f9ba-3145-45ca-9114-9e9a3ad6f5c2_01ca3a05-9980-45fc-8f80-97ed9a12bb30.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F19b0ff2a-9dd2-4480-b693-eae1f76c5540_f885c474-b648-4c01-bfde-86080fe9bb57.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/19b0ff2a-9dd2-4480-b693-eae1f76c5540_f885c474-b648-4c01-bfde-86080fe9bb57.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/0a58f9ba-3145-45ca-9114-9e9a3ad6f5c2_b65ed713-3353-49db-9542-05a433f7df91.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F19b0ff2a-9dd2-4480-b693-eae1f76c5540_7844ff4b-5bfe-4373-bdc0-018ce9def105.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/19b0ff2a-9dd2-4480-b693-eae1f76c5540_7844ff4b-5bfe-4373-bdc0-018ce9def105.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5cb1210>
2025-12-05 12:02:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d8e8875-9450-52f8-b210-7387575db400/7d8e8875-9450-52f8-b210-7387575db400_image_12.webp HTTP/1.1" 201 0
2025-12-05 12:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fedea561c-07b2-486e-a175-1db0160c247d_3be1af68-65d1-45e4-bf2a-7908f175e6a7.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/edea561c-07b2-486e-a175-1db0160c247d_3be1af68-65d1-45e4-bf2a-7908f175e6a7.jpg/250x188.webp saved to cache
2025-12-05 12:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 7d8e8875-9450-52f8-b210-7387575db400
2025-12-05 12:02:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5b3c490>
2025-12-05 12:02:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d8e8875-9450-52f8-b210-7387575db400/7d8e8875-9450-52f8-b210-7387575db400_image_13.webp HTTP/1.1" 201 0
2025-12-05 12:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fedea561c-07b2-486e-a175-1db0160c247d_66f196ad-9da9-4dc3-adee-4f52e097649d.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/edea561c-07b2-486e-a175-1db0160c247d_66f196ad-9da9-4dc3-adee-4f52e097649d.jpg/250x188.webp saved to cache
2025-12-05 12:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 7d8e8875-9450-52f8-b210-7387575db400
2025-12-05 12:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 7d8e8875-9450-52f8-b210-7387575db400 from tracking dictionaries
2025-12-05 12:02:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7d8e8875-9450-52f8-b210-7387575db400 sending to next pipeline
2025-12-05 12:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F19b0ff2a-9dd2-4480-b693-eae1f76c5540_1dcf7364-9f9e-4014-83ad-078f64308695.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/19b0ff2a-9dd2-4480-b693-eae1f76c5540_1dcf7364-9f9e-4014-83ad-078f64308695.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:25 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 7d8e8875-9450-52f8-b210-7387575db400 with identifier edea561c-07b2-486e-a175-1db0160c247d
2025-12-05 12:02:25 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:02:25 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:02:25 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 7d8e8875-9450-52f8-b210-7387575db400
2025-12-05 12:02:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://prod.pictures.autoscout24.net/listing-images/edea561c-07b2-486e-a175-1db0160c247d_66f196ad-9da9-4dc3-adee-4f52e097649d.jpg/250x188.webp>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'emission_standard': None,
 'engine': None,
 'engine_horse_power': 218,
 'expiration_date': None,
 'fuel_type': 'Electric/Gasoline',
 'id': '7d8e8875-9450-52f8-b210-7387575db400',
 'is_damaged': False,
 'is_operable': True,
 'license_plate': None,
 'link_to_web_offer': 'https://www.autoscout24.it/offers/byd-seal-u-dmi-comfort-super-dm-technology-ecvt-218cv-promo-electric-gasoline-white-edea561c-07b2-486e-a175-1db0160c247d',
 'listing': 'auction',
 'make': 'BYD',
 'model': 'Seal U',
 'odometer': 1,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d8e8875-9450-52f8-b210-7387575db400/7d8e8875-9450-52f8-b210-7387575db400_image_0.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4116,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/edea561c-07b2-486e-a175-1db0160c247d_e3a42201-5494-44c3-8237-b48af0d05c36.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d8e8875-9450-52f8-b210-7387575db400/7d8e8875-9450-52f8-b210-7387575db400_image_1.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4706,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/edea561c-07b2-486e-a175-1db0160c247d_fc41fef3-bf12-4a76-855f-19d5ee84b2ed.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d8e8875-9450-52f8-b210-7387575db400/7d8e8875-9450-52f8-b210-7387575db400_image_2.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4574,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/edea561c-07b2-486e-a175-1db0160c247d_6ef2e88f-14be-4776-a1d0-beaf07dea67a.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d8e8875-9450-52f8-b210-7387575db400/7d8e8875-9450-52f8-b210-7387575db400_image_3.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4738,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/edea561c-07b2-486e-a175-1db0160c247d_2bb48d80-bef1-462b-97f2-bfcdce0df5a7.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d8e8875-9450-52f8-b210-7387575db400/7d8e8875-9450-52f8-b210-7387575db400_image_4.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3740,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/edea561c-07b2-486e-a175-1db0160c247d_cb70f43d-295d-4a58-a2f1-aeff9b7a873b.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d8e8875-9450-52f8-b210-7387575db400/7d8e8875-9450-52f8-b210-7387575db400_image_5.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4474,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/edea561c-07b2-486e-a175-1db0160c247d_ccf4d8b2-c602-41fb-9594-b11961ce1102.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d8e8875-9450-52f8-b210-7387575db400/7d8e8875-9450-52f8-b210-7387575db400_image_6.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5108,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/edea561c-07b2-486e-a175-1db0160c247d_57e30be6-0422-423a-bfa5-19c2e20a4bf4.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d8e8875-9450-52f8-b210-7387575db400/7d8e8875-9450-52f8-b210-7387575db400_image_7.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 7104,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/edea561c-07b2-486e-a175-1db0160c247d_bd58cdeb-7b1b-467d-9849-894115fb89c3.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d8e8875-9450-52f8-b210-7387575db400/7d8e8875-9450-52f8-b210-7387575db400_image_8.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 6240,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/edea561c-07b2-486e-a175-1db0160c247d_6c61aa7a-8acc-4e67-9f8b-8dd65e9bd9ec.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d8e8875-9450-52f8-b210-7387575db400/7d8e8875-9450-52f8-b210-7387575db400_image_9.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 6332,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/edea561c-07b2-486e-a175-1db0160c247d_4accc556-5199-4e7a-a751-1df8673707ce.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d8e8875-9450-52f8-b210-7387575db400/7d8e8875-9450-52f8-b210-7387575db400_image_10.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5528,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/edea561c-07b2-486e-a175-1db0160c247d_3d7e64f2-444e-41a0-bfd0-7a78067fbe83.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d8e8875-9450-52f8-b210-7387575db400/7d8e8875-9450-52f8-b210-7387575db400_image_11.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5236,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/edea561c-07b2-486e-a175-1db0160c247d_7d366344-983c-4e60-8ba5-c25498392d32.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d8e8875-9450-52f8-b210-7387575db400/7d8e8875-9450-52f8-b210-7387575db400_image_12.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3506,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/edea561c-07b2-486e-a175-1db0160c247d_3be1af68-65d1-45e4-bf2a-7908f175e6a7.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d8e8875-9450-52f8-b210-7387575db400/7d8e8875-9450-52f8-b210-7387575db400_image_13.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4996,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/edea561c-07b2-486e-a175-1db0160c247d_66f196ad-9da9-4dc3-adee-4f52e097649d.jpg/250x188.webp',
             'Width': 250}],
 'price': 35900,
 'price_includes_vat': False,
 'registration_date': '2025-09-01',
 'seller_name': None,
 'title': 'BYD Seal U DMi COMFORT Super DM Technology eCVT 218CV PROMO!',
 'transmission': 'automatic',
 'trim': 'DMi COMFORT Super DM Technology eCVT 218CV PROMO!',
 'vin': None,
 'year': 2025}
2025-12-05 12:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27edea561c-07b2-486e-a175-1db0160c247d%27 HTTP/1.1" 200 None
2025-12-05 12:02:25 [auto_selling_autoscout24.it] INFO: Saving data for edea561c-07b2-486e-a175-1db0160c247d: {'created_time': 1764936145.754124, 'last_price_update_time': 1764936145.754133}
2025-12-05 12:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autoscout24.it',RowKey='edea561c-07b2-486e-a175-1db0160c247d') HTTP/1.1" 204 0
2025-12-05 12:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/0a58f9ba-3145-45ca-9114-9e9a3ad6f5c2_5ca8cafa-1c7a-4e9e-9564-bed0d490e24d.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/19b0ff2a-9dd2-4480-b693-eae1f76c5540_54f5727d-e89d-4f58-8d5e-9cf91db1469d.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F19b0ff2a-9dd2-4480-b693-eae1f76c5540_e4421783-a81d-4f44-a715-0603aef75ce7.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/19b0ff2a-9dd2-4480-b693-eae1f76c5540_e4421783-a81d-4f44-a715-0603aef75ce7.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e5d2d0>
2025-12-05 12:02:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3add5f16-8355-53f2-9a28-4fe2bc57531c/3add5f16-8355-53f2-9a28-4fe2bc57531c_image_0.webp HTTP/1.1" 201 0
2025-12-05 12:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F0a58f9ba-3145-45ca-9114-9e9a3ad6f5c2_01ca3a05-9980-45fc-8f80-97ed9a12bb30.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/0a58f9ba-3145-45ca-9114-9e9a3ad6f5c2_01ca3a05-9980-45fc-8f80-97ed9a12bb30.jpg/250x188.webp saved to cache
2025-12-05 12:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3add5f16-8355-53f2-9a28-4fe2bc57531c
2025-12-05 12:02:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e7ff10>
2025-12-05 12:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3add5f16-8355-53f2-9a28-4fe2bc57531c/3add5f16-8355-53f2-9a28-4fe2bc57531c_image_1.webp HTTP/1.1" 201 0
2025-12-05 12:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F0a58f9ba-3145-45ca-9114-9e9a3ad6f5c2_b65ed713-3353-49db-9542-05a433f7df91.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/0a58f9ba-3145-45ca-9114-9e9a3ad6f5c2_b65ed713-3353-49db-9542-05a433f7df91.jpg/250x188.webp saved to cache
2025-12-05 12:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3add5f16-8355-53f2-9a28-4fe2bc57531c
2025-12-05 12:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%2733b06507-edb0-4d5a-855d-6b1feb2998a0%27 HTTP/1.1" 200 None
2025-12-05 12:02:26 [auto_selling_autoscout24.it] INFO: Scrape type for 33b06507-edb0-4d5a-855d-6b1feb2998a0: 1
2025-12-05 12:02:26 [auto_selling_autoscout24.it] INFO: Scraping new listing 33b06507-edb0-4d5a-855d-6b1feb2998a0
2025-12-05 12:02:26 [auto_selling_autoscout24.it] INFO: Extracting item from listing ID: 33b06507-edb0-4d5a-855d-6b1feb2998a0
2025-12-05 12:02:26 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: af78a4e2-cd27-523f-b005-5f9f2c2f746f with identifier: 33b06507-edb0-4d5a-855d-6b1feb2998a0
2025-12-05 12:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item af78a4e2-cd27-523f-b005-5f9f2c2f746f
2025-12-05 12:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F33b06507-edb0-4d5a-855d-6b1feb2998a0_b4364f84-d47e-47f3-87bd-3cf50f2b14e6.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/33b06507-edb0-4d5a-855d-6b1feb2998a0_b4364f84-d47e-47f3-87bd-3cf50f2b14e6.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/19b0ff2a-9dd2-4480-b693-eae1f76c5540_f885c474-b648-4c01-bfde-86080fe9bb57.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/19b0ff2a-9dd2-4480-b693-eae1f76c5540_7844ff4b-5bfe-4373-bdc0-018ce9def105.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F33b06507-edb0-4d5a-855d-6b1feb2998a0_86b6747c-883d-4e44-8e93-731d25fc271d.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/33b06507-edb0-4d5a-855d-6b1feb2998a0_86b6747c-883d-4e44-8e93-731d25fc271d.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d6f8dc10>
2025-12-05 12:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 12:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3add5f16-8355-53f2-9a28-4fe2bc57531c/3add5f16-8355-53f2-9a28-4fe2bc57531c_image_2.webp HTTP/1.1" 201 0
2025-12-05 12:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F0a58f9ba-3145-45ca-9114-9e9a3ad6f5c2_5ca8cafa-1c7a-4e9e-9564-bed0d490e24d.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/0a58f9ba-3145-45ca-9114-9e9a3ad6f5c2_5ca8cafa-1c7a-4e9e-9564-bed0d490e24d.jpg/250x188.webp saved to cache
2025-12-05 12:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3add5f16-8355-53f2-9a28-4fe2bc57531c
2025-12-05 12:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 3add5f16-8355-53f2-9a28-4fe2bc57531c from tracking dictionaries
2025-12-05 12:02:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3add5f16-8355-53f2-9a28-4fe2bc57531c sending to next pipeline
2025-12-05 12:02:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d6f6b050>
2025-12-05 12:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 12:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d3c0799-21f3-50aa-b14e-901fde34fe8e/1d3c0799-21f3-50aa-b14e-901fde34fe8e_image_0.webp HTTP/1.1" 201 0
2025-12-05 12:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F19b0ff2a-9dd2-4480-b693-eae1f76c5540_54f5727d-e89d-4f58-8d5e-9cf91db1469d.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/19b0ff2a-9dd2-4480-b693-eae1f76c5540_54f5727d-e89d-4f58-8d5e-9cf91db1469d.jpg/250x188.webp saved to cache
2025-12-05 12:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1d3c0799-21f3-50aa-b14e-901fde34fe8e
2025-12-05 12:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F33b06507-edb0-4d5a-855d-6b1feb2998a0_bae08fd9-1f36-4925-8899-52162a9f9712.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/33b06507-edb0-4d5a-855d-6b1feb2998a0_bae08fd9-1f36-4925-8899-52162a9f9712.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:26 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 3add5f16-8355-53f2-9a28-4fe2bc57531c with identifier 0a58f9ba-3145-45ca-9114-9e9a3ad6f5c2
2025-12-05 12:02:26 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:02:26 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:02:26 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 3add5f16-8355-53f2-9a28-4fe2bc57531c
2025-12-05 12:02:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://prod.pictures.autoscout24.net/listing-images/0a58f9ba-3145-45ca-9114-9e9a3ad6f5c2_5ca8cafa-1c7a-4e9e-9564-bed0d490e24d.jpg/250x188.webp>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'emission_standard': None,
 'engine': None,
 'engine_horse_power': 630,
 'expiration_date': None,
 'fuel_type': 'Gasoline',
 'id': '3add5f16-8355-53f2-9a28-4fe2bc57531c',
 'is_damaged': False,
 'is_operable': True,
 'license_plate': None,
 'link_to_web_offer': 'https://www.autoscout24.it/offers/audi-rs6-avant-performance-630-cv-quattro-tiptronic-promo-gasoline-grey-0a58f9ba-3145-45ca-9114-9e9a3ad6f5c2',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'RS6',
 'odometer': 1,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 3,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3add5f16-8355-53f2-9a28-4fe2bc57531c/3add5f16-8355-53f2-9a28-4fe2bc57531c_image_0.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4114,
             'Height': 151,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/0a58f9ba-3145-45ca-9114-9e9a3ad6f5c2_01ca3a05-9980-45fc-8f80-97ed9a12bb30.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3add5f16-8355-53f2-9a28-4fe2bc57531c/3add5f16-8355-53f2-9a28-4fe2bc57531c_image_1.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3624,
             'Height': 168,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/0a58f9ba-3145-45ca-9114-9e9a3ad6f5c2_b65ed713-3353-49db-9542-05a433f7df91.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3add5f16-8355-53f2-9a28-4fe2bc57531c/3add5f16-8355-53f2-9a28-4fe2bc57531c_image_2.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5232,
             'Height': 142,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/0a58f9ba-3145-45ca-9114-9e9a3ad6f5c2_5ca8cafa-1c7a-4e9e-9564-bed0d490e24d.jpg/250x188.webp',
             'Width': 250}],
 'price': 163800,
 'price_includes_vat': False,
 'registration_date': '2025-09-01',
 'seller_name': None,
 'title': 'Audi RS6 AVANT PERFORMANCE 630 CV QUATTRO TIPTRONIC *PROMO*',
 'transmission': 'automatic',
 'trim': 'AVANT PERFORMANCE 630 CV QUATTRO TIPTRONIC *PROMO*',
 'vin': None,
 'year': 2025}
2025-12-05 12:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%270a58f9ba-3145-45ca-9114-9e9a3ad6f5c2%27 HTTP/1.1" 200 None
2025-12-05 12:02:26 [auto_selling_autoscout24.it] INFO: Saving data for 0a58f9ba-3145-45ca-9114-9e9a3ad6f5c2: {'created_time': 1764936146.899302, 'last_price_update_time': 1764936146.899311}
2025-12-05 12:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autoscout24.it',RowKey='0a58f9ba-3145-45ca-9114-9e9a3ad6f5c2') HTTP/1.1" 204 0
2025-12-05 12:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/19b0ff2a-9dd2-4480-b693-eae1f76c5540_1dcf7364-9f9e-4014-83ad-078f64308695.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/19b0ff2a-9dd2-4480-b693-eae1f76c5540_e4421783-a81d-4f44-a715-0603aef75ce7.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F33b06507-edb0-4d5a-855d-6b1feb2998a0_e30c7332-c298-4560-9241-96504f7471f4.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/33b06507-edb0-4d5a-855d-6b1feb2998a0_e30c7332-c298-4560-9241-96504f7471f4.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d6f13a10>
2025-12-05 12:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d3c0799-21f3-50aa-b14e-901fde34fe8e/1d3c0799-21f3-50aa-b14e-901fde34fe8e_image_1.webp HTTP/1.1" 201 0
2025-12-05 12:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F19b0ff2a-9dd2-4480-b693-eae1f76c5540_f885c474-b648-4c01-bfde-86080fe9bb57.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/19b0ff2a-9dd2-4480-b693-eae1f76c5540_f885c474-b648-4c01-bfde-86080fe9bb57.jpg/250x188.webp saved to cache
2025-12-05 12:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1d3c0799-21f3-50aa-b14e-901fde34fe8e
2025-12-05 12:02:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d6f2bd10>
2025-12-05 12:02:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d3c0799-21f3-50aa-b14e-901fde34fe8e/1d3c0799-21f3-50aa-b14e-901fde34fe8e_image_2.webp HTTP/1.1" 201 0
2025-12-05 12:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F19b0ff2a-9dd2-4480-b693-eae1f76c5540_7844ff4b-5bfe-4373-bdc0-018ce9def105.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/19b0ff2a-9dd2-4480-b693-eae1f76c5540_7844ff4b-5bfe-4373-bdc0-018ce9def105.jpg/250x188.webp saved to cache
2025-12-05 12:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1d3c0799-21f3-50aa-b14e-901fde34fe8e
2025-12-05 12:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F33b06507-edb0-4d5a-855d-6b1feb2998a0_44275681-b94b-4851-ab7c-772fbbb01906.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/33b06507-edb0-4d5a-855d-6b1feb2998a0_44275681-b94b-4851-ab7c-772fbbb01906.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/33b06507-edb0-4d5a-855d-6b1feb2998a0_86b6747c-883d-4e44-8e93-731d25fc271d.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/33b06507-edb0-4d5a-855d-6b1feb2998a0_b4364f84-d47e-47f3-87bd-3cf50f2b14e6.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27311bd31e-6a80-4e5c-a32a-5ead4d947170%27 HTTP/1.1" 200 None
2025-12-05 12:02:27 [auto_selling_autoscout24.it] INFO: Scrape type for 311bd31e-6a80-4e5c-a32a-5ead4d947170: 1
2025-12-05 12:02:27 [auto_selling_autoscout24.it] INFO: Scraping new listing 311bd31e-6a80-4e5c-a32a-5ead4d947170
2025-12-05 12:02:27 [auto_selling_autoscout24.it] INFO: Extracting item from listing ID: 311bd31e-6a80-4e5c-a32a-5ead4d947170
2025-12-05 12:02:27 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 70932ba2-d55e-5fbb-9c16-562e68843854 with identifier: 311bd31e-6a80-4e5c-a32a-5ead4d947170
2025-12-05 12:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 70932ba2-d55e-5fbb-9c16-562e68843854
2025-12-05 12:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F311bd31e-6a80-4e5c-a32a-5ead4d947170_a7a0d6a3-7a02-4812-9e0f-c9d89067cc9b.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/311bd31e-6a80-4e5c-a32a-5ead4d947170_a7a0d6a3-7a02-4812-9e0f-c9d89067cc9b.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9dc1e5490>
2025-12-05 12:02:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d3c0799-21f3-50aa-b14e-901fde34fe8e/1d3c0799-21f3-50aa-b14e-901fde34fe8e_image_3.webp HTTP/1.1" 201 0
2025-12-05 12:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F19b0ff2a-9dd2-4480-b693-eae1f76c5540_1dcf7364-9f9e-4014-83ad-078f64308695.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/19b0ff2a-9dd2-4480-b693-eae1f76c5540_1dcf7364-9f9e-4014-83ad-078f64308695.jpg/250x188.webp saved to cache
2025-12-05 12:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1d3c0799-21f3-50aa-b14e-901fde34fe8e
2025-12-05 12:02:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d6ffbcd0>
2025-12-05 12:02:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d3c0799-21f3-50aa-b14e-901fde34fe8e/1d3c0799-21f3-50aa-b14e-901fde34fe8e_image_4.webp HTTP/1.1" 201 0
2025-12-05 12:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F19b0ff2a-9dd2-4480-b693-eae1f76c5540_e4421783-a81d-4f44-a715-0603aef75ce7.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/19b0ff2a-9dd2-4480-b693-eae1f76c5540_e4421783-a81d-4f44-a715-0603aef75ce7.jpg/250x188.webp saved to cache
2025-12-05 12:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1d3c0799-21f3-50aa-b14e-901fde34fe8e
2025-12-05 12:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 1d3c0799-21f3-50aa-b14e-901fde34fe8e from tracking dictionaries
2025-12-05 12:02:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1d3c0799-21f3-50aa-b14e-901fde34fe8e sending to next pipeline
2025-12-05 12:02:28 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 1d3c0799-21f3-50aa-b14e-901fde34fe8e with identifier 19b0ff2a-9dd2-4480-b693-eae1f76c5540
2025-12-05 12:02:28 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:02:28 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:02:28 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 1d3c0799-21f3-50aa-b14e-901fde34fe8e
2025-12-05 12:02:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://prod.pictures.autoscout24.net/listing-images/19b0ff2a-9dd2-4480-b693-eae1f76c5540_e4421783-a81d-4f44-a715-0603aef75ce7.jpg/250x188.webp>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'emission_standard': None,
 'engine': None,
 'engine_horse_power': 231,
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': '1d3c0799-21f3-50aa-b14e-901fde34fe8e',
 'is_damaged': False,
 'is_operable': True,
 'license_plate': None,
 'link_to_web_offer': 'https://www.autoscout24.it/offers/audi-q8-45tdi-quattro-tiptronic-s-line-231cv-nuovo-uff-ita-diesel-black-19b0ff2a-9dd2-4480-b693-eae1f76c5540',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q8',
 'odometer': 1,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d3c0799-21f3-50aa-b14e-901fde34fe8e/1d3c0799-21f3-50aa-b14e-901fde34fe8e_image_0.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3926,
             'Height': 155,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/19b0ff2a-9dd2-4480-b693-eae1f76c5540_54f5727d-e89d-4f58-8d5e-9cf91db1469d.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d3c0799-21f3-50aa-b14e-901fde34fe8e/1d3c0799-21f3-50aa-b14e-901fde34fe8e_image_1.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 2534,
             'Height': 132,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/19b0ff2a-9dd2-4480-b693-eae1f76c5540_f885c474-b648-4c01-bfde-86080fe9bb57.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d3c0799-21f3-50aa-b14e-901fde34fe8e/1d3c0799-21f3-50aa-b14e-901fde34fe8e_image_2.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3354,
             'Height': 147,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/19b0ff2a-9dd2-4480-b693-eae1f76c5540_7844ff4b-5bfe-4373-bdc0-018ce9def105.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d3c0799-21f3-50aa-b14e-901fde34fe8e/1d3c0799-21f3-50aa-b14e-901fde34fe8e_image_3.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 2886,
             'Height': 111,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/19b0ff2a-9dd2-4480-b693-eae1f76c5540_1dcf7364-9f9e-4014-83ad-078f64308695.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d3c0799-21f3-50aa-b14e-901fde34fe8e/1d3c0799-21f3-50aa-b14e-901fde34fe8e_image_4.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3204,
             'Height': 108,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/19b0ff2a-9dd2-4480-b693-eae1f76c5540_e4421783-a81d-4f44-a715-0603aef75ce7.jpg/250x188.webp',
             'Width': 250}],
 'price': 84700,
 'price_includes_vat': False,
 'registration_date': '2025-08-01',
 'seller_name': None,
 'title': 'Audi Q8 45TDI QUATTRO TIPTRONIC S-LINE 231CV NUOVO UFF.ITA',
 'transmission': 'automatic',
 'trim': '45TDI QUATTRO TIPTRONIC S-LINE 231CV NUOVO UFF.ITA',
 'vin': None,
 'year': 2025}
2025-12-05 12:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%2719b0ff2a-9dd2-4480-b693-eae1f76c5540%27 HTTP/1.1" 200 None
2025-12-05 12:02:28 [auto_selling_autoscout24.it] INFO: Saving data for 19b0ff2a-9dd2-4480-b693-eae1f76c5540: {'created_time': 1764936148.266519, 'last_price_update_time': 1764936148.266528}
2025-12-05 12:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autoscout24.it',RowKey='19b0ff2a-9dd2-4480-b693-eae1f76c5540') HTTP/1.1" 204 0
2025-12-05 12:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/33b06507-edb0-4d5a-855d-6b1feb2998a0_bae08fd9-1f36-4925-8899-52162a9f9712.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/33b06507-edb0-4d5a-855d-6b1feb2998a0_e30c7332-c298-4560-9241-96504f7471f4.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F311bd31e-6a80-4e5c-a32a-5ead4d947170_5dc75d73-7f77-4bcd-937f-ed4d2e0d98d5.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/311bd31e-6a80-4e5c-a32a-5ead4d947170_5dc75d73-7f77-4bcd-937f-ed4d2e0d98d5.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d6fe4e90>
2025-12-05 12:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af78a4e2-cd27-523f-b005-5f9f2c2f746f/af78a4e2-cd27-523f-b005-5f9f2c2f746f_image_1.webp HTTP/1.1" 201 0
2025-12-05 12:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F33b06507-edb0-4d5a-855d-6b1feb2998a0_86b6747c-883d-4e44-8e93-731d25fc271d.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/33b06507-edb0-4d5a-855d-6b1feb2998a0_86b6747c-883d-4e44-8e93-731d25fc271d.jpg/250x188.webp saved to cache
2025-12-05 12:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item af78a4e2-cd27-523f-b005-5f9f2c2f746f
2025-12-05 12:02:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5eb5b50>
2025-12-05 12:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af78a4e2-cd27-523f-b005-5f9f2c2f746f/af78a4e2-cd27-523f-b005-5f9f2c2f746f_image_0.webp HTTP/1.1" 201 0
2025-12-05 12:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F33b06507-edb0-4d5a-855d-6b1feb2998a0_b4364f84-d47e-47f3-87bd-3cf50f2b14e6.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/33b06507-edb0-4d5a-855d-6b1feb2998a0_b4364f84-d47e-47f3-87bd-3cf50f2b14e6.jpg/250x188.webp saved to cache
2025-12-05 12:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item af78a4e2-cd27-523f-b005-5f9f2c2f746f
2025-12-05 12:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F311bd31e-6a80-4e5c-a32a-5ead4d947170_def60a3c-bd47-49c0-a1ad-ded54506f620.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/311bd31e-6a80-4e5c-a32a-5ead4d947170_def60a3c-bd47-49c0-a1ad-ded54506f620.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/33b06507-edb0-4d5a-855d-6b1feb2998a0_44275681-b94b-4851-ab7c-772fbbb01906.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F311bd31e-6a80-4e5c-a32a-5ead4d947170_a1c208aa-1028-402b-8f1a-c1c9a2b6581d.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/311bd31e-6a80-4e5c-a32a-5ead4d947170_a1c208aa-1028-402b-8f1a-c1c9a2b6581d.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9dd5e3990>
2025-12-05 12:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af78a4e2-cd27-523f-b005-5f9f2c2f746f/af78a4e2-cd27-523f-b005-5f9f2c2f746f_image_2.webp HTTP/1.1" 201 0
2025-12-05 12:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F33b06507-edb0-4d5a-855d-6b1feb2998a0_bae08fd9-1f36-4925-8899-52162a9f9712.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/33b06507-edb0-4d5a-855d-6b1feb2998a0_bae08fd9-1f36-4925-8899-52162a9f9712.jpg/250x188.webp saved to cache
2025-12-05 12:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item af78a4e2-cd27-523f-b005-5f9f2c2f746f
2025-12-05 12:02:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9dc126750>
2025-12-05 12:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 12:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af78a4e2-cd27-523f-b005-5f9f2c2f746f/af78a4e2-cd27-523f-b005-5f9f2c2f746f_image_3.webp HTTP/1.1" 201 0
2025-12-05 12:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F33b06507-edb0-4d5a-855d-6b1feb2998a0_e30c7332-c298-4560-9241-96504f7471f4.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/33b06507-edb0-4d5a-855d-6b1feb2998a0_e30c7332-c298-4560-9241-96504f7471f4.jpg/250x188.webp saved to cache
2025-12-05 12:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item af78a4e2-cd27-523f-b005-5f9f2c2f746f
2025-12-05 12:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/311bd31e-6a80-4e5c-a32a-5ead4d947170_a7a0d6a3-7a02-4812-9e0f-c9d89067cc9b.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/311bd31e-6a80-4e5c-a32a-5ead4d947170_5dc75d73-7f77-4bcd-937f-ed4d2e0d98d5.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F311bd31e-6a80-4e5c-a32a-5ead4d947170_5f693e6a-6db9-45a5-8966-657fb99054e1.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/311bd31e-6a80-4e5c-a32a-5ead4d947170_5f693e6a-6db9-45a5-8966-657fb99054e1.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5c69bd0>
2025-12-05 12:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 12:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af78a4e2-cd27-523f-b005-5f9f2c2f746f/af78a4e2-cd27-523f-b005-5f9f2c2f746f_image_4.webp HTTP/1.1" 201 0
2025-12-05 12:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F33b06507-edb0-4d5a-855d-6b1feb2998a0_44275681-b94b-4851-ab7c-772fbbb01906.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/33b06507-edb0-4d5a-855d-6b1feb2998a0_44275681-b94b-4851-ab7c-772fbbb01906.jpg/250x188.webp saved to cache
2025-12-05 12:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item af78a4e2-cd27-523f-b005-5f9f2c2f746f
2025-12-05 12:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Removing item af78a4e2-cd27-523f-b005-5f9f2c2f746f from tracking dictionaries
2025-12-05 12:02:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item af78a4e2-cd27-523f-b005-5f9f2c2f746f sending to next pipeline
2025-12-05 12:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F311bd31e-6a80-4e5c-a32a-5ead4d947170_c6e6f023-004f-49b6-95c4-8ea447ebdb8a.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/311bd31e-6a80-4e5c-a32a-5ead4d947170_c6e6f023-004f-49b6-95c4-8ea447ebdb8a.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:29 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: af78a4e2-cd27-523f-b005-5f9f2c2f746f with identifier 33b06507-edb0-4d5a-855d-6b1feb2998a0
2025-12-05 12:02:29 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:02:29 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:02:29 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item af78a4e2-cd27-523f-b005-5f9f2c2f746f
2025-12-05 12:02:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://prod.pictures.autoscout24.net/listing-images/33b06507-edb0-4d5a-855d-6b1feb2998a0_44275681-b94b-4851-ab7c-772fbbb01906.jpg/250x188.webp>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'emission_standard': None,
 'engine': None,
 'engine_horse_power': 204,
 'expiration_date': None,
 'fuel_type': 'Electric/Diesel',
 'id': 'af78a4e2-cd27-523f-b005-5f9f2c2f746f',
 'is_damaged': False,
 'is_operable': True,
 'license_plate': None,
 'link_to_web_offer': 'https://www.autoscout24.it/offers/audi-q5-spb-tdi-qtr-s-tr-s-line-204cv-uff-italia-promo-electric-diesel-grey-33b06507-edb0-4d5a-855d-6b1feb2998a0',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 1,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af78a4e2-cd27-523f-b005-5f9f2c2f746f/af78a4e2-cd27-523f-b005-5f9f2c2f746f_image_0.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3988,
             'Height': 163,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/33b06507-edb0-4d5a-855d-6b1feb2998a0_b4364f84-d47e-47f3-87bd-3cf50f2b14e6.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af78a4e2-cd27-523f-b005-5f9f2c2f746f/af78a4e2-cd27-523f-b005-5f9f2c2f746f_image_1.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 2952,
             'Height': 127,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/33b06507-edb0-4d5a-855d-6b1feb2998a0_86b6747c-883d-4e44-8e93-731d25fc271d.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af78a4e2-cd27-523f-b005-5f9f2c2f746f/af78a4e2-cd27-523f-b005-5f9f2c2f746f_image_2.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3794,
             'Height': 157,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/33b06507-edb0-4d5a-855d-6b1feb2998a0_bae08fd9-1f36-4925-8899-52162a9f9712.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af78a4e2-cd27-523f-b005-5f9f2c2f746f/af78a4e2-cd27-523f-b005-5f9f2c2f746f_image_3.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 2586,
             'Height': 110,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/33b06507-edb0-4d5a-855d-6b1feb2998a0_e30c7332-c298-4560-9241-96504f7471f4.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af78a4e2-cd27-523f-b005-5f9f2c2f746f/af78a4e2-cd27-523f-b005-5f9f2c2f746f_image_4.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 2622,
             'Height': 110,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/33b06507-edb0-4d5a-855d-6b1feb2998a0_44275681-b94b-4851-ab7c-772fbbb01906.jpg/250x188.webp',
             'Width': 250}],
 'price': 73500,
 'price_includes_vat': False,
 'registration_date': '2025-08-01',
 'seller_name': None,
 'title': 'Audi Q5 SPB TDI QTR S-TR S-LINE 204CV UFF. ITALIA PROMO',
 'transmission': 'automatic',
 'trim': 'SPB TDI QTR S-TR S-LINE 204CV UFF. ITALIA PROMO',
 'vin': None,
 'year': 2025}
2025-12-05 12:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%2733b06507-edb0-4d5a-855d-6b1feb2998a0%27 HTTP/1.1" 200 None
2025-12-05 12:02:29 [auto_selling_autoscout24.it] INFO: Saving data for 33b06507-edb0-4d5a-855d-6b1feb2998a0: {'created_time': 1764936149.713023, 'last_price_update_time': 1764936149.713035}
2025-12-05 12:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autoscout24.it',RowKey='33b06507-edb0-4d5a-855d-6b1feb2998a0') HTTP/1.1" 204 0
2025-12-05 12:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/311bd31e-6a80-4e5c-a32a-5ead4d947170_def60a3c-bd47-49c0-a1ad-ded54506f620.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F311bd31e-6a80-4e5c-a32a-5ead4d947170_1fd291c5-7b53-4ad4-8f2c-daced17425a5.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/311bd31e-6a80-4e5c-a32a-5ead4d947170_1fd291c5-7b53-4ad4-8f2c-daced17425a5.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d6f68c90>
2025-12-05 12:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 12:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70932ba2-d55e-5fbb-9c16-562e68843854/70932ba2-d55e-5fbb-9c16-562e68843854_image_0.webp HTTP/1.1" 201 0
2025-12-05 12:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F311bd31e-6a80-4e5c-a32a-5ead4d947170_a7a0d6a3-7a02-4812-9e0f-c9d89067cc9b.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/311bd31e-6a80-4e5c-a32a-5ead4d947170_a7a0d6a3-7a02-4812-9e0f-c9d89067cc9b.jpg/250x188.webp saved to cache
2025-12-05 12:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 70932ba2-d55e-5fbb-9c16-562e68843854
2025-12-05 12:02:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e5ff90>
2025-12-05 12:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 12:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70932ba2-d55e-5fbb-9c16-562e68843854/70932ba2-d55e-5fbb-9c16-562e68843854_image_1.webp HTTP/1.1" 201 0
2025-12-05 12:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F311bd31e-6a80-4e5c-a32a-5ead4d947170_5dc75d73-7f77-4bcd-937f-ed4d2e0d98d5.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/311bd31e-6a80-4e5c-a32a-5ead4d947170_5dc75d73-7f77-4bcd-937f-ed4d2e0d98d5.jpg/250x188.webp saved to cache
2025-12-05 12:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 70932ba2-d55e-5fbb-9c16-562e68843854
2025-12-05 12:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F311bd31e-6a80-4e5c-a32a-5ead4d947170_29238e5e-0ac3-4eda-81a7-ee7fe0bb66f9.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/311bd31e-6a80-4e5c-a32a-5ead4d947170_29238e5e-0ac3-4eda-81a7-ee7fe0bb66f9.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/311bd31e-6a80-4e5c-a32a-5ead4d947170_a1c208aa-1028-402b-8f1a-c1c9a2b6581d.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/311bd31e-6a80-4e5c-a32a-5ead4d947170_5f693e6a-6db9-45a5-8966-657fb99054e1.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%274220a66b-c3d7-4d16-9927-ebc23edd910d%27 HTTP/1.1" 200 None
2025-12-05 12:02:30 [auto_selling_autoscout24.it] INFO: Scrape type for 4220a66b-c3d7-4d16-9927-ebc23edd910d: 1
2025-12-05 12:02:30 [auto_selling_autoscout24.it] INFO: Scraping new listing 4220a66b-c3d7-4d16-9927-ebc23edd910d
2025-12-05 12:02:30 [auto_selling_autoscout24.it] INFO: Extracting item from listing ID: 4220a66b-c3d7-4d16-9927-ebc23edd910d
2025-12-05 12:02:30 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: fc875a6a-569f-57d4-919c-e3cbc4d33500 with identifier: 4220a66b-c3d7-4d16-9927-ebc23edd910d
2025-12-05 12:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item fc875a6a-569f-57d4-919c-e3cbc4d33500
2025-12-05 12:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F4220a66b-c3d7-4d16-9927-ebc23edd910d_bbd503c4-0042-4010-8eb7-a1e2ec1eb27c.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/4220a66b-c3d7-4d16-9927-ebc23edd910d_bbd503c4-0042-4010-8eb7-a1e2ec1eb27c.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d6fa5e90>
2025-12-05 12:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 12:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70932ba2-d55e-5fbb-9c16-562e68843854/70932ba2-d55e-5fbb-9c16-562e68843854_image_2.webp HTTP/1.1" 201 0
2025-12-05 12:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F311bd31e-6a80-4e5c-a32a-5ead4d947170_def60a3c-bd47-49c0-a1ad-ded54506f620.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/311bd31e-6a80-4e5c-a32a-5ead4d947170_def60a3c-bd47-49c0-a1ad-ded54506f620.jpg/250x188.webp saved to cache
2025-12-05 12:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 70932ba2-d55e-5fbb-9c16-562e68843854
2025-12-05 12:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F4220a66b-c3d7-4d16-9927-ebc23edd910d_fd0e6997-2fcf-47fc-8286-e9bf7bc98461.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/4220a66b-c3d7-4d16-9927-ebc23edd910d_fd0e6997-2fcf-47fc-8286-e9bf7bc98461.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/311bd31e-6a80-4e5c-a32a-5ead4d947170_1fd291c5-7b53-4ad4-8f2c-daced17425a5.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/311bd31e-6a80-4e5c-a32a-5ead4d947170_c6e6f023-004f-49b6-95c4-8ea447ebdb8a.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F4220a66b-c3d7-4d16-9927-ebc23edd910d_0f2bbfb8-5240-4b3e-8194-f81b8463210f.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/4220a66b-c3d7-4d16-9927-ebc23edd910d_0f2bbfb8-5240-4b3e-8194-f81b8463210f.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d6f84fd0>
2025-12-05 12:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 12:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70932ba2-d55e-5fbb-9c16-562e68843854/70932ba2-d55e-5fbb-9c16-562e68843854_image_3.webp HTTP/1.1" 201 0
2025-12-05 12:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F311bd31e-6a80-4e5c-a32a-5ead4d947170_a1c208aa-1028-402b-8f1a-c1c9a2b6581d.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/311bd31e-6a80-4e5c-a32a-5ead4d947170_a1c208aa-1028-402b-8f1a-c1c9a2b6581d.jpg/250x188.webp saved to cache
2025-12-05 12:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 70932ba2-d55e-5fbb-9c16-562e68843854
2025-12-05 12:02:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e7c150>
2025-12-05 12:02:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 12:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70932ba2-d55e-5fbb-9c16-562e68843854/70932ba2-d55e-5fbb-9c16-562e68843854_image_4.webp HTTP/1.1" 201 0
2025-12-05 12:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F311bd31e-6a80-4e5c-a32a-5ead4d947170_5f693e6a-6db9-45a5-8966-657fb99054e1.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/311bd31e-6a80-4e5c-a32a-5ead4d947170_5f693e6a-6db9-45a5-8966-657fb99054e1.jpg/250x188.webp saved to cache
2025-12-05 12:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 70932ba2-d55e-5fbb-9c16-562e68843854
2025-12-05 12:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F4220a66b-c3d7-4d16-9927-ebc23edd910d_c5214216-1d66-4455-8b0d-7cb5f7b96620.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/4220a66b-c3d7-4d16-9927-ebc23edd910d_c5214216-1d66-4455-8b0d-7cb5f7b96620.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/311bd31e-6a80-4e5c-a32a-5ead4d947170_29238e5e-0ac3-4eda-81a7-ee7fe0bb66f9.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/4220a66b-c3d7-4d16-9927-ebc23edd910d_bbd503c4-0042-4010-8eb7-a1e2ec1eb27c.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F4220a66b-c3d7-4d16-9927-ebc23edd910d_c3d97051-3899-4414-bd4e-950f1a24dbfd.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/4220a66b-c3d7-4d16-9927-ebc23edd910d_c3d97051-3899-4414-bd4e-950f1a24dbfd.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d6f116d0>
2025-12-05 12:02:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 12:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70932ba2-d55e-5fbb-9c16-562e68843854/70932ba2-d55e-5fbb-9c16-562e68843854_image_6.webp HTTP/1.1" 201 0
2025-12-05 12:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F311bd31e-6a80-4e5c-a32a-5ead4d947170_1fd291c5-7b53-4ad4-8f2c-daced17425a5.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/311bd31e-6a80-4e5c-a32a-5ead4d947170_1fd291c5-7b53-4ad4-8f2c-daced17425a5.jpg/250x188.webp saved to cache
2025-12-05 12:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 70932ba2-d55e-5fbb-9c16-562e68843854
2025-12-05 12:02:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9dc10ea50>
2025-12-05 12:02:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 12:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70932ba2-d55e-5fbb-9c16-562e68843854/70932ba2-d55e-5fbb-9c16-562e68843854_image_5.webp HTTP/1.1" 201 0
2025-12-05 12:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F311bd31e-6a80-4e5c-a32a-5ead4d947170_c6e6f023-004f-49b6-95c4-8ea447ebdb8a.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/311bd31e-6a80-4e5c-a32a-5ead4d947170_c6e6f023-004f-49b6-95c4-8ea447ebdb8a.jpg/250x188.webp saved to cache
2025-12-05 12:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 70932ba2-d55e-5fbb-9c16-562e68843854
2025-12-05 12:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F4220a66b-c3d7-4d16-9927-ebc23edd910d_93e56e25-7505-48c6-a207-6132c6af5c9b.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/4220a66b-c3d7-4d16-9927-ebc23edd910d_93e56e25-7505-48c6-a207-6132c6af5c9b.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/4220a66b-c3d7-4d16-9927-ebc23edd910d_0f2bbfb8-5240-4b3e-8194-f81b8463210f.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/4220a66b-c3d7-4d16-9927-ebc23edd910d_fd0e6997-2fcf-47fc-8286-e9bf7bc98461.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F4220a66b-c3d7-4d16-9927-ebc23edd910d_6aa4e99f-68f4-46c3-bfef-bcd9c644601a.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/4220a66b-c3d7-4d16-9927-ebc23edd910d_6aa4e99f-68f4-46c3-bfef-bcd9c644601a.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d6f0bf90>
2025-12-05 12:02:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 12:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70932ba2-d55e-5fbb-9c16-562e68843854/70932ba2-d55e-5fbb-9c16-562e68843854_image_7.webp HTTP/1.1" 201 0
2025-12-05 12:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F311bd31e-6a80-4e5c-a32a-5ead4d947170_29238e5e-0ac3-4eda-81a7-ee7fe0bb66f9.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/311bd31e-6a80-4e5c-a32a-5ead4d947170_29238e5e-0ac3-4eda-81a7-ee7fe0bb66f9.jpg/250x188.webp saved to cache
2025-12-05 12:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 70932ba2-d55e-5fbb-9c16-562e68843854
2025-12-05 12:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 70932ba2-d55e-5fbb-9c16-562e68843854 from tracking dictionaries
2025-12-05 12:02:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 70932ba2-d55e-5fbb-9c16-562e68843854 sending to next pipeline
2025-12-05 12:02:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5b97090>
2025-12-05 12:02:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 12:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc875a6a-569f-57d4-919c-e3cbc4d33500/fc875a6a-569f-57d4-919c-e3cbc4d33500_image_0.webp HTTP/1.1" 201 0
2025-12-05 12:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F4220a66b-c3d7-4d16-9927-ebc23edd910d_bbd503c4-0042-4010-8eb7-a1e2ec1eb27c.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/4220a66b-c3d7-4d16-9927-ebc23edd910d_bbd503c4-0042-4010-8eb7-a1e2ec1eb27c.jpg/250x188.webp saved to cache
2025-12-05 12:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fc875a6a-569f-57d4-919c-e3cbc4d33500
2025-12-05 12:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F4220a66b-c3d7-4d16-9927-ebc23edd910d_e4e06bf6-24f3-45a4-a2d0-490f51832f59.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/4220a66b-c3d7-4d16-9927-ebc23edd910d_e4e06bf6-24f3-45a4-a2d0-490f51832f59.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:32 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 70932ba2-d55e-5fbb-9c16-562e68843854 with identifier 311bd31e-6a80-4e5c-a32a-5ead4d947170
2025-12-05 12:02:32 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:02:32 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:02:32 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 70932ba2-d55e-5fbb-9c16-562e68843854
2025-12-05 12:02:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://prod.pictures.autoscout24.net/listing-images/311bd31e-6a80-4e5c-a32a-5ead4d947170_29238e5e-0ac3-4eda-81a7-ee7fe0bb66f9.jpg/250x188.webp>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'emission_standard': None,
 'engine': None,
 'engine_horse_power': 116,
 'expiration_date': None,
 'fuel_type': 'Gasoline',
 'id': '70932ba2-d55e-5fbb-9c16-562e68843854',
 'is_damaged': False,
 'is_operable': True,
 'license_plate': None,
 'link_to_web_offer': 'https://www.autoscout24.it/offers/audi-a1-spb-30-tfsi-s-tronic-116cv-garanzia-promo-gasoline-white-311bd31e-6a80-4e5c-a32a-5ead4d947170',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1',
 'odometer': 1,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 8,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70932ba2-d55e-5fbb-9c16-562e68843854/70932ba2-d55e-5fbb-9c16-562e68843854_image_0.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3616,
             'Height': 145,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/311bd31e-6a80-4e5c-a32a-5ead4d947170_a7a0d6a3-7a02-4812-9e0f-c9d89067cc9b.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70932ba2-d55e-5fbb-9c16-562e68843854/70932ba2-d55e-5fbb-9c16-562e68843854_image_1.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4036,
             'Height': 188,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/311bd31e-6a80-4e5c-a32a-5ead4d947170_5dc75d73-7f77-4bcd-937f-ed4d2e0d98d5.jpg/250x188.webp',
             'Width': 241},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70932ba2-d55e-5fbb-9c16-562e68843854/70932ba2-d55e-5fbb-9c16-562e68843854_image_2.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 2482,
             'Height': 112,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/311bd31e-6a80-4e5c-a32a-5ead4d947170_def60a3c-bd47-49c0-a1ad-ded54506f620.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70932ba2-d55e-5fbb-9c16-562e68843854/70932ba2-d55e-5fbb-9c16-562e68843854_image_3.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3076,
             'Height': 183,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/311bd31e-6a80-4e5c-a32a-5ead4d947170_a1c208aa-1028-402b-8f1a-c1c9a2b6581d.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70932ba2-d55e-5fbb-9c16-562e68843854/70932ba2-d55e-5fbb-9c16-562e68843854_image_4.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3108,
             'Height': 140,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/311bd31e-6a80-4e5c-a32a-5ead4d947170_5f693e6a-6db9-45a5-8966-657fb99054e1.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70932ba2-d55e-5fbb-9c16-562e68843854/70932ba2-d55e-5fbb-9c16-562e68843854_image_5.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 2680,
             'Height': 126,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/311bd31e-6a80-4e5c-a32a-5ead4d947170_c6e6f023-004f-49b6-95c4-8ea447ebdb8a.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70932ba2-d55e-5fbb-9c16-562e68843854/70932ba2-d55e-5fbb-9c16-562e68843854_image_6.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3304,
             'Height': 125,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/311bd31e-6a80-4e5c-a32a-5ead4d947170_1fd291c5-7b53-4ad4-8f2c-daced17425a5.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70932ba2-d55e-5fbb-9c16-562e68843854/70932ba2-d55e-5fbb-9c16-562e68843854_image_7.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 2366,
             'Height': 125,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/311bd31e-6a80-4e5c-a32a-5ead4d947170_29238e5e-0ac3-4eda-81a7-ee7fe0bb66f9.jpg/250x188.webp',
             'Width': 250}],
 'price': 29800,
 'price_includes_vat': False,
 'registration_date': '2025-09-01',
 'seller_name': None,
 'title': 'Audi A1 SPB 30 TFSI S-TRONIC 116CV *GARANZIA*PROMO',
 'transmission': 'automatic',
 'trim': 'SPB 30 TFSI S-TRONIC 116CV *GARANZIA*PROMO',
 'vin': None,
 'year': 2025}
2025-12-05 12:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27311bd31e-6a80-4e5c-a32a-5ead4d947170%27 HTTP/1.1" 200 None
2025-12-05 12:02:32 [auto_selling_autoscout24.it] INFO: Saving data for 311bd31e-6a80-4e5c-a32a-5ead4d947170: {'created_time': 1764936152.612833, 'last_price_update_time': 1764936152.612899}
2025-12-05 12:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autoscout24.it',RowKey='311bd31e-6a80-4e5c-a32a-5ead4d947170') HTTP/1.1" 204 0
2025-12-05 12:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/4220a66b-c3d7-4d16-9927-ebc23edd910d_c5214216-1d66-4455-8b0d-7cb5f7b96620.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/4220a66b-c3d7-4d16-9927-ebc23edd910d_c3d97051-3899-4414-bd4e-950f1a24dbfd.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F4220a66b-c3d7-4d16-9927-ebc23edd910d_ac0f37fc-75fe-43ae-ab7d-f125b2379f66.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/4220a66b-c3d7-4d16-9927-ebc23edd910d_ac0f37fc-75fe-43ae-ab7d-f125b2379f66.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5b80fd0>
2025-12-05 12:02:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 12:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc875a6a-569f-57d4-919c-e3cbc4d33500/fc875a6a-569f-57d4-919c-e3cbc4d33500_image_2.webp HTTP/1.1" 201 0
2025-12-05 12:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F4220a66b-c3d7-4d16-9927-ebc23edd910d_0f2bbfb8-5240-4b3e-8194-f81b8463210f.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/4220a66b-c3d7-4d16-9927-ebc23edd910d_0f2bbfb8-5240-4b3e-8194-f81b8463210f.jpg/250x188.webp saved to cache
2025-12-05 12:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fc875a6a-569f-57d4-919c-e3cbc4d33500
2025-12-05 12:02:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5ccbbd0>
2025-12-05 12:02:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 12:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc875a6a-569f-57d4-919c-e3cbc4d33500/fc875a6a-569f-57d4-919c-e3cbc4d33500_image_1.webp HTTP/1.1" 201 0
2025-12-05 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F4220a66b-c3d7-4d16-9927-ebc23edd910d_fd0e6997-2fcf-47fc-8286-e9bf7bc98461.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/4220a66b-c3d7-4d16-9927-ebc23edd910d_fd0e6997-2fcf-47fc-8286-e9bf7bc98461.jpg/250x188.webp saved to cache
2025-12-05 12:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fc875a6a-569f-57d4-919c-e3cbc4d33500
2025-12-05 12:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/4220a66b-c3d7-4d16-9927-ebc23edd910d_6aa4e99f-68f4-46c3-bfef-bcd9c644601a.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/4220a66b-c3d7-4d16-9927-ebc23edd910d_93e56e25-7505-48c6-a207-6132c6af5c9b.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F4220a66b-c3d7-4d16-9927-ebc23edd910d_e8fa7718-ecd0-4a66-93cc-27cb0663706d.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/4220a66b-c3d7-4d16-9927-ebc23edd910d_e8fa7718-ecd0-4a66-93cc-27cb0663706d.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d6f86750>
2025-12-05 12:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc875a6a-569f-57d4-919c-e3cbc4d33500/fc875a6a-569f-57d4-919c-e3cbc4d33500_image_3.webp HTTP/1.1" 201 0
2025-12-05 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F4220a66b-c3d7-4d16-9927-ebc23edd910d_c5214216-1d66-4455-8b0d-7cb5f7b96620.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/4220a66b-c3d7-4d16-9927-ebc23edd910d_c5214216-1d66-4455-8b0d-7cb5f7b96620.jpg/250x188.webp saved to cache
2025-12-05 12:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fc875a6a-569f-57d4-919c-e3cbc4d33500
2025-12-05 12:02:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9dd5db450>
2025-12-05 12:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 12:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc875a6a-569f-57d4-919c-e3cbc4d33500/fc875a6a-569f-57d4-919c-e3cbc4d33500_image_4.webp HTTP/1.1" 201 0
2025-12-05 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F4220a66b-c3d7-4d16-9927-ebc23edd910d_c3d97051-3899-4414-bd4e-950f1a24dbfd.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/4220a66b-c3d7-4d16-9927-ebc23edd910d_c3d97051-3899-4414-bd4e-950f1a24dbfd.jpg/250x188.webp saved to cache
2025-12-05 12:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fc875a6a-569f-57d4-919c-e3cbc4d33500
2025-12-05 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F4220a66b-c3d7-4d16-9927-ebc23edd910d_01f89f47-934d-42c2-8728-38455b7ee89d.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/4220a66b-c3d7-4d16-9927-ebc23edd910d_01f89f47-934d-42c2-8728-38455b7ee89d.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/4220a66b-c3d7-4d16-9927-ebc23edd910d_e4e06bf6-24f3-45a4-a2d0-490f51832f59.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F4220a66b-c3d7-4d16-9927-ebc23edd910d_b55ffb16-a347-459c-b846-5f50be1e6dd1.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/4220a66b-c3d7-4d16-9927-ebc23edd910d_b55ffb16-a347-459c-b846-5f50be1e6dd1.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5c95e90>
2025-12-05 12:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc875a6a-569f-57d4-919c-e3cbc4d33500/fc875a6a-569f-57d4-919c-e3cbc4d33500_image_6.webp HTTP/1.1" 201 0
2025-12-05 12:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F4220a66b-c3d7-4d16-9927-ebc23edd910d_6aa4e99f-68f4-46c3-bfef-bcd9c644601a.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/4220a66b-c3d7-4d16-9927-ebc23edd910d_6aa4e99f-68f4-46c3-bfef-bcd9c644601a.jpg/250x188.webp saved to cache
2025-12-05 12:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fc875a6a-569f-57d4-919c-e3cbc4d33500
2025-12-05 12:02:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d6f5a510>
2025-12-05 12:02:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 12:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc875a6a-569f-57d4-919c-e3cbc4d33500/fc875a6a-569f-57d4-919c-e3cbc4d33500_image_5.webp HTTP/1.1" 201 0
2025-12-05 12:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F4220a66b-c3d7-4d16-9927-ebc23edd910d_93e56e25-7505-48c6-a207-6132c6af5c9b.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/4220a66b-c3d7-4d16-9927-ebc23edd910d_93e56e25-7505-48c6-a207-6132c6af5c9b.jpg/250x188.webp saved to cache
2025-12-05 12:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fc875a6a-569f-57d4-919c-e3cbc4d33500
2025-12-05 12:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F4220a66b-c3d7-4d16-9927-ebc23edd910d_497ca0e1-1a72-4763-b0bc-32e80d6a005d.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/4220a66b-c3d7-4d16-9927-ebc23edd910d_497ca0e1-1a72-4763-b0bc-32e80d6a005d.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/4220a66b-c3d7-4d16-9927-ebc23edd910d_ac0f37fc-75fe-43ae-ab7d-f125b2379f66.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/4220a66b-c3d7-4d16-9927-ebc23edd910d_e8fa7718-ecd0-4a66-93cc-27cb0663706d.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F4220a66b-c3d7-4d16-9927-ebc23edd910d_561955be-7e26-4b5b-9d8d-0a26611b770e.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/4220a66b-c3d7-4d16-9927-ebc23edd910d_561955be-7e26-4b5b-9d8d-0a26611b770e.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5b248d0>
2025-12-05 12:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 12:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc875a6a-569f-57d4-919c-e3cbc4d33500/fc875a6a-569f-57d4-919c-e3cbc4d33500_image_7.webp HTTP/1.1" 201 0
2025-12-05 12:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F4220a66b-c3d7-4d16-9927-ebc23edd910d_e4e06bf6-24f3-45a4-a2d0-490f51832f59.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/4220a66b-c3d7-4d16-9927-ebc23edd910d_e4e06bf6-24f3-45a4-a2d0-490f51832f59.jpg/250x188.webp saved to cache
2025-12-05 12:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fc875a6a-569f-57d4-919c-e3cbc4d33500
2025-12-05 12:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F4220a66b-c3d7-4d16-9927-ebc23edd910d_d825cb9e-441b-4df5-97d7-93c081f8b09a.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/4220a66b-c3d7-4d16-9927-ebc23edd910d_d825cb9e-441b-4df5-97d7-93c081f8b09a.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/4220a66b-c3d7-4d16-9927-ebc23edd910d_01f89f47-934d-42c2-8728-38455b7ee89d.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/4220a66b-c3d7-4d16-9927-ebc23edd910d_b55ffb16-a347-459c-b846-5f50be1e6dd1.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27bddda395-c5f1-4f0f-9f2e-c82f996b6f6b%27 HTTP/1.1" 200 None
2025-12-05 12:02:35 [auto_selling_autoscout24.it] INFO: Scrape type for bddda395-c5f1-4f0f-9f2e-c82f996b6f6b: 1
2025-12-05 12:02:35 [auto_selling_autoscout24.it] INFO: Scraping new listing bddda395-c5f1-4f0f-9f2e-c82f996b6f6b
2025-12-05 12:02:35 [auto_selling_autoscout24.it] INFO: Extracting item from listing ID: bddda395-c5f1-4f0f-9f2e-c82f996b6f6b
2025-12-05 12:02:35 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 415f8916-ec80-5858-88dc-95a93c19969a with identifier: bddda395-c5f1-4f0f-9f2e-c82f996b6f6b
2025-12-05 12:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 14 photos for item 415f8916-ec80-5858-88dc-95a93c19969a
2025-12-05 12:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fbddda395-c5f1-4f0f-9f2e-c82f996b6f6b_6845573b-5617-4aa8-a3a8-9a80cfa47748.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/bddda395-c5f1-4f0f-9f2e-c82f996b6f6b_6845573b-5617-4aa8-a3a8-9a80cfa47748.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d6fafcd0>
2025-12-05 12:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc875a6a-569f-57d4-919c-e3cbc4d33500/fc875a6a-569f-57d4-919c-e3cbc4d33500_image_8.webp HTTP/1.1" 201 0
2025-12-05 12:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F4220a66b-c3d7-4d16-9927-ebc23edd910d_ac0f37fc-75fe-43ae-ab7d-f125b2379f66.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/4220a66b-c3d7-4d16-9927-ebc23edd910d_ac0f37fc-75fe-43ae-ab7d-f125b2379f66.jpg/250x188.webp saved to cache
2025-12-05 12:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fc875a6a-569f-57d4-919c-e3cbc4d33500
2025-12-05 12:02:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5b25e10>
2025-12-05 12:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc875a6a-569f-57d4-919c-e3cbc4d33500/fc875a6a-569f-57d4-919c-e3cbc4d33500_image_9.webp HTTP/1.1" 201 0
2025-12-05 12:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F4220a66b-c3d7-4d16-9927-ebc23edd910d_e8fa7718-ecd0-4a66-93cc-27cb0663706d.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/4220a66b-c3d7-4d16-9927-ebc23edd910d_e8fa7718-ecd0-4a66-93cc-27cb0663706d.jpg/250x188.webp saved to cache
2025-12-05 12:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fc875a6a-569f-57d4-919c-e3cbc4d33500
2025-12-05 12:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fbddda395-c5f1-4f0f-9f2e-c82f996b6f6b_3f7aa8dd-c1fa-461a-8cfa-227f2f7f6a4f.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/bddda395-c5f1-4f0f-9f2e-c82f996b6f6b_3f7aa8dd-c1fa-461a-8cfa-227f2f7f6a4f.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/4220a66b-c3d7-4d16-9927-ebc23edd910d_497ca0e1-1a72-4763-b0bc-32e80d6a005d.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/4220a66b-c3d7-4d16-9927-ebc23edd910d_561955be-7e26-4b5b-9d8d-0a26611b770e.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fbddda395-c5f1-4f0f-9f2e-c82f996b6f6b_2ff7fecb-fe00-4e31-a7b2-57a3c7268ea7.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/bddda395-c5f1-4f0f-9f2e-c82f996b6f6b_2ff7fecb-fe00-4e31-a7b2-57a3c7268ea7.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9dc1ca0d0>
2025-12-05 12:02:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc875a6a-569f-57d4-919c-e3cbc4d33500/fc875a6a-569f-57d4-919c-e3cbc4d33500_image_10.webp HTTP/1.1" 201 0
2025-12-05 12:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F4220a66b-c3d7-4d16-9927-ebc23edd910d_01f89f47-934d-42c2-8728-38455b7ee89d.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/4220a66b-c3d7-4d16-9927-ebc23edd910d_01f89f47-934d-42c2-8728-38455b7ee89d.jpg/250x188.webp saved to cache
2025-12-05 12:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item fc875a6a-569f-57d4-919c-e3cbc4d33500
2025-12-05 12:02:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5c77ad0>
2025-12-05 12:02:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc875a6a-569f-57d4-919c-e3cbc4d33500/fc875a6a-569f-57d4-919c-e3cbc4d33500_image_11.webp HTTP/1.1" 201 0
2025-12-05 12:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F4220a66b-c3d7-4d16-9927-ebc23edd910d_b55ffb16-a347-459c-b846-5f50be1e6dd1.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/4220a66b-c3d7-4d16-9927-ebc23edd910d_b55ffb16-a347-459c-b846-5f50be1e6dd1.jpg/250x188.webp saved to cache
2025-12-05 12:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item fc875a6a-569f-57d4-919c-e3cbc4d33500
2025-12-05 12:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fbddda395-c5f1-4f0f-9f2e-c82f996b6f6b_f17da32a-40ad-4798-bba8-88ee95188b55.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/bddda395-c5f1-4f0f-9f2e-c82f996b6f6b_f17da32a-40ad-4798-bba8-88ee95188b55.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/4220a66b-c3d7-4d16-9927-ebc23edd910d_d825cb9e-441b-4df5-97d7-93c081f8b09a.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/bddda395-c5f1-4f0f-9f2e-c82f996b6f6b_6845573b-5617-4aa8-a3a8-9a80cfa47748.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fbddda395-c5f1-4f0f-9f2e-c82f996b6f6b_721213d2-fd37-46fc-bac4-0016f0d53ba4.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/bddda395-c5f1-4f0f-9f2e-c82f996b6f6b_721213d2-fd37-46fc-bac4-0016f0d53ba4.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d6fa5a50>
2025-12-05 12:02:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 12:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc875a6a-569f-57d4-919c-e3cbc4d33500/fc875a6a-569f-57d4-919c-e3cbc4d33500_image_12.webp HTTP/1.1" 201 0
2025-12-05 12:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F4220a66b-c3d7-4d16-9927-ebc23edd910d_497ca0e1-1a72-4763-b0bc-32e80d6a005d.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/4220a66b-c3d7-4d16-9927-ebc23edd910d_497ca0e1-1a72-4763-b0bc-32e80d6a005d.jpg/250x188.webp saved to cache
2025-12-05 12:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item fc875a6a-569f-57d4-919c-e3cbc4d33500
2025-12-05 12:02:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e35fd0>
2025-12-05 12:02:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 12:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc875a6a-569f-57d4-919c-e3cbc4d33500/fc875a6a-569f-57d4-919c-e3cbc4d33500_image_13.webp HTTP/1.1" 201 0
2025-12-05 12:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F4220a66b-c3d7-4d16-9927-ebc23edd910d_561955be-7e26-4b5b-9d8d-0a26611b770e.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/4220a66b-c3d7-4d16-9927-ebc23edd910d_561955be-7e26-4b5b-9d8d-0a26611b770e.jpg/250x188.webp saved to cache
2025-12-05 12:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item fc875a6a-569f-57d4-919c-e3cbc4d33500
2025-12-05 12:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fbddda395-c5f1-4f0f-9f2e-c82f996b6f6b_2fc57134-6d8b-4482-ad44-d9350491e214.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/bddda395-c5f1-4f0f-9f2e-c82f996b6f6b_2fc57134-6d8b-4482-ad44-d9350491e214.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/bddda395-c5f1-4f0f-9f2e-c82f996b6f6b_3f7aa8dd-c1fa-461a-8cfa-227f2f7f6a4f.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/bddda395-c5f1-4f0f-9f2e-c82f996b6f6b_2ff7fecb-fe00-4e31-a7b2-57a3c7268ea7.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fbddda395-c5f1-4f0f-9f2e-c82f996b6f6b_5b4e7f7f-be7a-465c-8df5-271be820e59d.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/bddda395-c5f1-4f0f-9f2e-c82f996b6f6b_5b4e7f7f-be7a-465c-8df5-271be820e59d.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d6fafad0>
2025-12-05 12:02:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc875a6a-569f-57d4-919c-e3cbc4d33500/fc875a6a-569f-57d4-919c-e3cbc4d33500_image_14.webp HTTP/1.1" 201 0
2025-12-05 12:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F4220a66b-c3d7-4d16-9927-ebc23edd910d_d825cb9e-441b-4df5-97d7-93c081f8b09a.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/4220a66b-c3d7-4d16-9927-ebc23edd910d_d825cb9e-441b-4df5-97d7-93c081f8b09a.jpg/250x188.webp saved to cache
2025-12-05 12:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item fc875a6a-569f-57d4-919c-e3cbc4d33500
2025-12-05 12:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Removing item fc875a6a-569f-57d4-919c-e3cbc4d33500 from tracking dictionaries
2025-12-05 12:02:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fc875a6a-569f-57d4-919c-e3cbc4d33500 sending to next pipeline
2025-12-05 12:02:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e36390>
2025-12-05 12:02:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-05 12:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_415f8916-ec80-5858-88dc-95a93c19969a/415f8916-ec80-5858-88dc-95a93c19969a_image_0.webp HTTP/1.1" 201 0
2025-12-05 12:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fbddda395-c5f1-4f0f-9f2e-c82f996b6f6b_6845573b-5617-4aa8-a3a8-9a80cfa47748.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/bddda395-c5f1-4f0f-9f2e-c82f996b6f6b_6845573b-5617-4aa8-a3a8-9a80cfa47748.jpg/250x188.webp saved to cache
2025-12-05 12:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 415f8916-ec80-5858-88dc-95a93c19969a
2025-12-05 12:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fbddda395-c5f1-4f0f-9f2e-c82f996b6f6b_cc093262-567b-4ca2-bb49-fb4e7d55f89f.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/bddda395-c5f1-4f0f-9f2e-c82f996b6f6b_cc093262-567b-4ca2-bb49-fb4e7d55f89f.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:37 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: fc875a6a-569f-57d4-919c-e3cbc4d33500 with identifier 4220a66b-c3d7-4d16-9927-ebc23edd910d
2025-12-05 12:02:37 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:02:37 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:02:37 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item fc875a6a-569f-57d4-919c-e3cbc4d33500
2025-12-05 12:02:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://prod.pictures.autoscout24.net/listing-images/4220a66b-c3d7-4d16-9927-ebc23edd910d_d825cb9e-441b-4df5-97d7-93c081f8b09a.jpg/250x188.webp>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'emission_standard': None,
 'engine': None,
 'engine_horse_power': 204,
 'expiration_date': None,
 'fuel_type': 'Electric/Diesel',
 'id': 'fc875a6a-569f-57d4-919c-e3cbc4d33500',
 'is_damaged': False,
 'is_operable': True,
 'license_plate': None,
 'link_to_web_offer': 'https://www.autoscout24.it/offers/audi-q5-tdi-quattro-s-tronic-business-204cv-led-navi-acc-electric-diesel-white-4220a66b-c3d7-4d16-9927-ebc23edd910d',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 1,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc875a6a-569f-57d4-919c-e3cbc4d33500/fc875a6a-569f-57d4-919c-e3cbc4d33500_image_0.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3692,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/4220a66b-c3d7-4d16-9927-ebc23edd910d_bbd503c4-0042-4010-8eb7-a1e2ec1eb27c.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc875a6a-569f-57d4-919c-e3cbc4d33500/fc875a6a-569f-57d4-919c-e3cbc4d33500_image_1.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3270,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/4220a66b-c3d7-4d16-9927-ebc23edd910d_fd0e6997-2fcf-47fc-8286-e9bf7bc98461.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc875a6a-569f-57d4-919c-e3cbc4d33500/fc875a6a-569f-57d4-919c-e3cbc4d33500_image_2.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3424,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/4220a66b-c3d7-4d16-9927-ebc23edd910d_0f2bbfb8-5240-4b3e-8194-f81b8463210f.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc875a6a-569f-57d4-919c-e3cbc4d33500/fc875a6a-569f-57d4-919c-e3cbc4d33500_image_3.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4304,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/4220a66b-c3d7-4d16-9927-ebc23edd910d_c5214216-1d66-4455-8b0d-7cb5f7b96620.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc875a6a-569f-57d4-919c-e3cbc4d33500/fc875a6a-569f-57d4-919c-e3cbc4d33500_image_4.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3396,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/4220a66b-c3d7-4d16-9927-ebc23edd910d_c3d97051-3899-4414-bd4e-950f1a24dbfd.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc875a6a-569f-57d4-919c-e3cbc4d33500/fc875a6a-569f-57d4-919c-e3cbc4d33500_image_5.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4098,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/4220a66b-c3d7-4d16-9927-ebc23edd910d_93e56e25-7505-48c6-a207-6132c6af5c9b.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc875a6a-569f-57d4-919c-e3cbc4d33500/fc875a6a-569f-57d4-919c-e3cbc4d33500_image_6.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5684,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/4220a66b-c3d7-4d16-9927-ebc23edd910d_6aa4e99f-68f4-46c3-bfef-bcd9c644601a.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc875a6a-569f-57d4-919c-e3cbc4d33500/fc875a6a-569f-57d4-919c-e3cbc4d33500_image_7.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5288,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/4220a66b-c3d7-4d16-9927-ebc23edd910d_e4e06bf6-24f3-45a4-a2d0-490f51832f59.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc875a6a-569f-57d4-919c-e3cbc4d33500/fc875a6a-569f-57d4-919c-e3cbc4d33500_image_8.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 6372,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/4220a66b-c3d7-4d16-9927-ebc23edd910d_ac0f37fc-75fe-43ae-ab7d-f125b2379f66.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc875a6a-569f-57d4-919c-e3cbc4d33500/fc875a6a-569f-57d4-919c-e3cbc4d33500_image_9.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5816,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/4220a66b-c3d7-4d16-9927-ebc23edd910d_e8fa7718-ecd0-4a66-93cc-27cb0663706d.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc875a6a-569f-57d4-919c-e3cbc4d33500/fc875a6a-569f-57d4-919c-e3cbc4d33500_image_10.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4882,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/4220a66b-c3d7-4d16-9927-ebc23edd910d_01f89f47-934d-42c2-8728-38455b7ee89d.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc875a6a-569f-57d4-919c-e3cbc4d33500/fc875a6a-569f-57d4-919c-e3cbc4d33500_image_11.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4614,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/4220a66b-c3d7-4d16-9927-ebc23edd910d_b55ffb16-a347-459c-b846-5f50be1e6dd1.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc875a6a-569f-57d4-919c-e3cbc4d33500/fc875a6a-569f-57d4-919c-e3cbc4d33500_image_12.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4880,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/4220a66b-c3d7-4d16-9927-ebc23edd910d_497ca0e1-1a72-4763-b0bc-32e80d6a005d.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc875a6a-569f-57d4-919c-e3cbc4d33500/fc875a6a-569f-57d4-919c-e3cbc4d33500_image_13.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5062,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/4220a66b-c3d7-4d16-9927-ebc23edd910d_561955be-7e26-4b5b-9d8d-0a26611b770e.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc875a6a-569f-57d4-919c-e3cbc4d33500/fc875a6a-569f-57d4-919c-e3cbc4d33500_image_14.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5024,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/4220a66b-c3d7-4d16-9927-ebc23edd910d_d825cb9e-441b-4df5-97d7-93c081f8b09a.jpg/250x188.webp',
             'Width': 250}],
 'price': 68800,
 'price_includes_vat': False,
 'registration_date': '2025-09-01',
 'seller_name': None,
 'title': 'Audi Q5 TDI QUATTRO S-TRONIC BUSINESS 204CV *LED+NAVI+ACC*',
 'transmission': 'automatic',
 'trim': 'TDI QUATTRO S-TRONIC BUSINESS 204CV *LED+NAVI+ACC*',
 'vin': None,
 'year': 2025}
2025-12-05 12:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%274220a66b-c3d7-4d16-9927-ebc23edd910d%27 HTTP/1.1" 200 None
2025-12-05 12:02:37 [auto_selling_autoscout24.it] INFO: Saving data for 4220a66b-c3d7-4d16-9927-ebc23edd910d: {'created_time': 1764936157.970971, 'last_price_update_time': 1764936157.970981}
2025-12-05 12:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autoscout24.it',RowKey='4220a66b-c3d7-4d16-9927-ebc23edd910d') HTTP/1.1" 204 0
2025-12-05 12:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/bddda395-c5f1-4f0f-9f2e-c82f996b6f6b_f17da32a-40ad-4798-bba8-88ee95188b55.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/bddda395-c5f1-4f0f-9f2e-c82f996b6f6b_721213d2-fd37-46fc-bac4-0016f0d53ba4.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fbddda395-c5f1-4f0f-9f2e-c82f996b6f6b_598f84e4-8436-41e5-bbf9-530538441291.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/bddda395-c5f1-4f0f-9f2e-c82f996b6f6b_598f84e4-8436-41e5-bbf9-530538441291.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d6fae1d0>
2025-12-05 12:02:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_415f8916-ec80-5858-88dc-95a93c19969a/415f8916-ec80-5858-88dc-95a93c19969a_image_1.webp HTTP/1.1" 201 0
2025-12-05 12:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fbddda395-c5f1-4f0f-9f2e-c82f996b6f6b_3f7aa8dd-c1fa-461a-8cfa-227f2f7f6a4f.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/bddda395-c5f1-4f0f-9f2e-c82f996b6f6b_3f7aa8dd-c1fa-461a-8cfa-227f2f7f6a4f.jpg/250x188.webp saved to cache
2025-12-05 12:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 415f8916-ec80-5858-88dc-95a93c19969a
2025-12-05 12:02:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9dd5e5e90>
2025-12-05 12:02:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_415f8916-ec80-5858-88dc-95a93c19969a/415f8916-ec80-5858-88dc-95a93c19969a_image_2.webp HTTP/1.1" 201 0
2025-12-05 12:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fbddda395-c5f1-4f0f-9f2e-c82f996b6f6b_2ff7fecb-fe00-4e31-a7b2-57a3c7268ea7.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/bddda395-c5f1-4f0f-9f2e-c82f996b6f6b_2ff7fecb-fe00-4e31-a7b2-57a3c7268ea7.jpg/250x188.webp saved to cache
2025-12-05 12:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 415f8916-ec80-5858-88dc-95a93c19969a
2025-12-05 12:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fbddda395-c5f1-4f0f-9f2e-c82f996b6f6b_45d0ae43-7e86-47db-acb8-a62fa58b37b9.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/bddda395-c5f1-4f0f-9f2e-c82f996b6f6b_45d0ae43-7e86-47db-acb8-a62fa58b37b9.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/bddda395-c5f1-4f0f-9f2e-c82f996b6f6b_2fc57134-6d8b-4482-ad44-d9350491e214.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/bddda395-c5f1-4f0f-9f2e-c82f996b6f6b_5b4e7f7f-be7a-465c-8df5-271be820e59d.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fbddda395-c5f1-4f0f-9f2e-c82f996b6f6b_508b1749-5cfc-482e-8d04-97111cc6eba2.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/bddda395-c5f1-4f0f-9f2e-c82f996b6f6b_508b1749-5cfc-482e-8d04-97111cc6eba2.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5c90f50>
2025-12-05 12:02:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-05 12:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_415f8916-ec80-5858-88dc-95a93c19969a/415f8916-ec80-5858-88dc-95a93c19969a_image_3.webp HTTP/1.1" 201 0
2025-12-05 12:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fbddda395-c5f1-4f0f-9f2e-c82f996b6f6b_f17da32a-40ad-4798-bba8-88ee95188b55.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/bddda395-c5f1-4f0f-9f2e-c82f996b6f6b_f17da32a-40ad-4798-bba8-88ee95188b55.jpg/250x188.webp saved to cache
2025-12-05 12:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 415f8916-ec80-5858-88dc-95a93c19969a
2025-12-05 12:02:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d6f58590>
2025-12-05 12:02:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 12:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_415f8916-ec80-5858-88dc-95a93c19969a/415f8916-ec80-5858-88dc-95a93c19969a_image_4.webp HTTP/1.1" 201 0
2025-12-05 12:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fbddda395-c5f1-4f0f-9f2e-c82f996b6f6b_721213d2-fd37-46fc-bac4-0016f0d53ba4.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/bddda395-c5f1-4f0f-9f2e-c82f996b6f6b_721213d2-fd37-46fc-bac4-0016f0d53ba4.jpg/250x188.webp saved to cache
2025-12-05 12:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 415f8916-ec80-5858-88dc-95a93c19969a
2025-12-05 12:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fbddda395-c5f1-4f0f-9f2e-c82f996b6f6b_e62569fa-0714-4292-b470-69423b8f1a57.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/bddda395-c5f1-4f0f-9f2e-c82f996b6f6b_e62569fa-0714-4292-b470-69423b8f1a57.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/bddda395-c5f1-4f0f-9f2e-c82f996b6f6b_598f84e4-8436-41e5-bbf9-530538441291.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/bddda395-c5f1-4f0f-9f2e-c82f996b6f6b_cc093262-567b-4ca2-bb49-fb4e7d55f89f.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fbddda395-c5f1-4f0f-9f2e-c82f996b6f6b_a72865ca-e351-4e56-b828-8ff6ff1b2033.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/bddda395-c5f1-4f0f-9f2e-c82f996b6f6b_a72865ca-e351-4e56-b828-8ff6ff1b2033.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9dd5d2f90>
2025-12-05 12:02:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_415f8916-ec80-5858-88dc-95a93c19969a/415f8916-ec80-5858-88dc-95a93c19969a_image_5.webp HTTP/1.1" 201 0
2025-12-05 12:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fbddda395-c5f1-4f0f-9f2e-c82f996b6f6b_2fc57134-6d8b-4482-ad44-d9350491e214.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/bddda395-c5f1-4f0f-9f2e-c82f996b6f6b_2fc57134-6d8b-4482-ad44-d9350491e214.jpg/250x188.webp saved to cache
2025-12-05 12:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 415f8916-ec80-5858-88dc-95a93c19969a
2025-12-05 12:02:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9dc1042d0>
2025-12-05 12:02:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_415f8916-ec80-5858-88dc-95a93c19969a/415f8916-ec80-5858-88dc-95a93c19969a_image_6.webp HTTP/1.1" 201 0
2025-12-05 12:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fbddda395-c5f1-4f0f-9f2e-c82f996b6f6b_5b4e7f7f-be7a-465c-8df5-271be820e59d.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/bddda395-c5f1-4f0f-9f2e-c82f996b6f6b_5b4e7f7f-be7a-465c-8df5-271be820e59d.jpg/250x188.webp saved to cache
2025-12-05 12:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 415f8916-ec80-5858-88dc-95a93c19969a
2025-12-05 12:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fbddda395-c5f1-4f0f-9f2e-c82f996b6f6b_afcaac6d-d2cd-49fa-9f68-aa8e38ec2956.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/bddda395-c5f1-4f0f-9f2e-c82f996b6f6b_afcaac6d-d2cd-49fa-9f68-aa8e38ec2956.jpg/250x188.webp not downloaded yet
2025-12-05 12:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/bddda395-c5f1-4f0f-9f2e-c82f996b6f6b_508b1749-5cfc-482e-8d04-97111cc6eba2.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/bddda395-c5f1-4f0f-9f2e-c82f996b6f6b_45d0ae43-7e86-47db-acb8-a62fa58b37b9.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%2791c9f81a-400e-489f-9fce-710a1560b60f%27 HTTP/1.1" 200 None
2025-12-05 12:02:39 [auto_selling_autoscout24.it] INFO: Scrape type for 91c9f81a-400e-489f-9fce-710a1560b60f: 1
2025-12-05 12:02:39 [auto_selling_autoscout24.it] INFO: Scraping new listing 91c9f81a-400e-489f-9fce-710a1560b60f
2025-12-05 12:02:39 [auto_selling_autoscout24.it] INFO: Extracting item from listing ID: 91c9f81a-400e-489f-9fce-710a1560b60f
2025-12-05 12:02:39 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a3247a6-7758-558a-a97d-36d3530353bc with identifier: 91c9f81a-400e-489f-9fce-710a1560b60f
2025-12-05 12:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 7a3247a6-7758-558a-a97d-36d3530353bc
2025-12-05 12:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F91c9f81a-400e-489f-9fce-710a1560b60f_9649a8f8-c273-4989-966f-0e5e4bd87dca.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/91c9f81a-400e-489f-9fce-710a1560b60f_9649a8f8-c273-4989-966f-0e5e4bd87dca.jpg/250x188.webp already downloaded
2025-12-05 12:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F91c9f81a-400e-489f-9fce-710a1560b60f_99a03322-f6fa-4ce1-bb2e-74b35f1905c3.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/91c9f81a-400e-489f-9fce-710a1560b60f_99a03322-f6fa-4ce1-bb2e-74b35f1905c3.jpg/250x188.webp already downloaded
2025-12-05 12:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F91c9f81a-400e-489f-9fce-710a1560b60f_3306ff87-d4a6-4837-9d13-b64a3a7db22f.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/91c9f81a-400e-489f-9fce-710a1560b60f_3306ff87-d4a6-4837-9d13-b64a3a7db22f.jpg/250x188.webp already downloaded
2025-12-05 12:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F91c9f81a-400e-489f-9fce-710a1560b60f_317635a8-80c5-470a-8286-51dfab634aec.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/91c9f81a-400e-489f-9fce-710a1560b60f_317635a8-80c5-470a-8286-51dfab634aec.jpg/250x188.webp already downloaded
2025-12-05 12:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F91c9f81a-400e-489f-9fce-710a1560b60f_84802486-8568-489c-9dd2-2ca4c3fa7f0f.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/91c9f81a-400e-489f-9fce-710a1560b60f_84802486-8568-489c-9dd2-2ca4c3fa7f0f.jpg/250x188.webp already downloaded
2025-12-05 12:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F91c9f81a-400e-489f-9fce-710a1560b60f_bb3e5e75-2935-487e-ab55-0a5221616ab9.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/91c9f81a-400e-489f-9fce-710a1560b60f_bb3e5e75-2935-487e-ab55-0a5221616ab9.jpg/250x188.webp already downloaded
2025-12-05 12:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F91c9f81a-400e-489f-9fce-710a1560b60f_3fbc86e8-195d-4d6d-8161-5023503ee421.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/91c9f81a-400e-489f-9fce-710a1560b60f_3fbc86e8-195d-4d6d-8161-5023503ee421.jpg/250x188.webp already downloaded
2025-12-05 12:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F91c9f81a-400e-489f-9fce-710a1560b60f_01114b2b-291e-4ee9-a940-e1fa5f98ebf5.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/91c9f81a-400e-489f-9fce-710a1560b60f_01114b2b-291e-4ee9-a940-e1fa5f98ebf5.jpg/250x188.webp already downloaded
2025-12-05 12:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F91c9f81a-400e-489f-9fce-710a1560b60f_6639c74e-a05e-47f3-adf4-058609063dcd.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/91c9f81a-400e-489f-9fce-710a1560b60f_6639c74e-a05e-47f3-adf4-058609063dcd.jpg/250x188.webp already downloaded
2025-12-05 12:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F91c9f81a-400e-489f-9fce-710a1560b60f_f2442510-aa89-4355-9d5f-be37767007f3.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/91c9f81a-400e-489f-9fce-710a1560b60f_f2442510-aa89-4355-9d5f-be37767007f3.jpg/250x188.webp already downloaded
2025-12-05 12:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F91c9f81a-400e-489f-9fce-710a1560b60f_0a0a301d-2f3c-4281-a3db-4b1e228005d5.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/91c9f81a-400e-489f-9fce-710a1560b60f_0a0a301d-2f3c-4281-a3db-4b1e228005d5.jpg/250x188.webp already downloaded
2025-12-05 12:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F91c9f81a-400e-489f-9fce-710a1560b60f_851cc22f-1048-42b7-8647-893b12ff2237.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/91c9f81a-400e-489f-9fce-710a1560b60f_851cc22f-1048-42b7-8647-893b12ff2237.jpg/250x188.webp already downloaded
2025-12-05 12:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F91c9f81a-400e-489f-9fce-710a1560b60f_4ad0f60b-8c84-47b7-9638-0335eba0b76e.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/91c9f81a-400e-489f-9fce-710a1560b60f_4ad0f60b-8c84-47b7-9638-0335eba0b76e.jpg/250x188.webp already downloaded
2025-12-05 12:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F91c9f81a-400e-489f-9fce-710a1560b60f_52edd190-abb3-412b-b541-092b1717903b.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/91c9f81a-400e-489f-9fce-710a1560b60f_52edd190-abb3-412b-b541-092b1717903b.jpg/250x188.webp already downloaded
2025-12-05 12:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F91c9f81a-400e-489f-9fce-710a1560b60f_e916208d-5b47-44b4-be9e-6643720b1b6d.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/91c9f81a-400e-489f-9fce-710a1560b60f_e916208d-5b47-44b4-be9e-6643720b1b6d.jpg/250x188.webp already downloaded
2025-12-05 12:02:39 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 7a3247a6-7758-558a-a97d-36d3530353bc with identifier 91c9f81a-400e-489f-9fce-710a1560b60f
2025-12-05 12:02:39 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:02:39 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:02:39 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 7a3247a6-7758-558a-a97d-36d3530353bc
2025-12-05 12:02:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autoscout24.it/api/dealer-detail/fetch-listings>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'emission_standard': None,
 'engine': None,
 'engine_horse_power': 204,
 'expiration_date': None,
 'fuel_type': 'Diesel',
 'id': '7a3247a6-7758-558a-a97d-36d3530353bc',
 'is_damaged': False,
 'is_operable': True,
 'license_plate': None,
 'link_to_web_offer': 'https://www.autoscout24.it/offers/audi-q5-spb-2-0-tdi-quattro-s-tronic-204cv-facelift-promo-diesel-black-91c9f81a-400e-489f-9fce-710a1560b60f',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 1,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://prod.pictures.autoscout24.net/listing-images/91c9f81a-400e-489f-9fce-710a1560b60f_9649a8f8-c273-4989-966f-0e5e4bd87dca.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/91c9f81a-400e-489f-9fce-710a1560b60f_99a03322-f6fa-4ce1-bb2e-74b35f1905c3.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/91c9f81a-400e-489f-9fce-710a1560b60f_3306ff87-d4a6-4837-9d13-b64a3a7db22f.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/91c9f81a-400e-489f-9fce-710a1560b60f_317635a8-80c5-470a-8286-51dfab634aec.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/91c9f81a-400e-489f-9fce-710a1560b60f_84802486-8568-489c-9dd2-2ca4c3fa7f0f.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/91c9f81a-400e-489f-9fce-710a1560b60f_bb3e5e75-2935-487e-ab55-0a5221616ab9.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/91c9f81a-400e-489f-9fce-710a1560b60f_3fbc86e8-195d-4d6d-8161-5023503ee421.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/91c9f81a-400e-489f-9fce-710a1560b60f_01114b2b-291e-4ee9-a940-e1fa5f98ebf5.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/91c9f81a-400e-489f-9fce-710a1560b60f_6639c74e-a05e-47f3-adf4-058609063dcd.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/91c9f81a-400e-489f-9fce-710a1560b60f_f2442510-aa89-4355-9d5f-be37767007f3.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/91c9f81a-400e-489f-9fce-710a1560b60f_0a0a301d-2f3c-4281-a3db-4b1e228005d5.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/91c9f81a-400e-489f-9fce-710a1560b60f_851cc22f-1048-42b7-8647-893b12ff2237.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/91c9f81a-400e-489f-9fce-710a1560b60f_4ad0f60b-8c84-47b7-9638-0335eba0b76e.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/91c9f81a-400e-489f-9fce-710a1560b60f_52edd190-abb3-412b-b541-092b1717903b.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/91c9f81a-400e-489f-9fce-710a1560b60f_e916208d-5b47-44b4-be9e-6643720b1b6d.jpg/250x188.webp'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d44999dc-bcae-5b9d-9c8f-c50a0fd3168f/d44999dc-bcae-5b9d-9c8f-c50a0fd3168f_image_0.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5268,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/91c9f81a-400e-489f-9fce-710a1560b60f_9649a8f8-c273-4989-966f-0e5e4bd87dca.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d44999dc-bcae-5b9d-9c8f-c50a0fd3168f/d44999dc-bcae-5b9d-9c8f-c50a0fd3168f_image_1.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 6514,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/91c9f81a-400e-489f-9fce-710a1560b60f_99a03322-f6fa-4ce1-bb2e-74b35f1905c3.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d44999dc-bcae-5b9d-9c8f-c50a0fd3168f/d44999dc-bcae-5b9d-9c8f-c50a0fd3168f_image_2.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4792,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/91c9f81a-400e-489f-9fce-710a1560b60f_3306ff87-d4a6-4837-9d13-b64a3a7db22f.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d44999dc-bcae-5b9d-9c8f-c50a0fd3168f/d44999dc-bcae-5b9d-9c8f-c50a0fd3168f_image_3.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4808,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/91c9f81a-400e-489f-9fce-710a1560b60f_317635a8-80c5-470a-8286-51dfab634aec.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d44999dc-bcae-5b9d-9c8f-c50a0fd3168f/d44999dc-bcae-5b9d-9c8f-c50a0fd3168f_image_4.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4554,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/91c9f81a-400e-489f-9fce-710a1560b60f_84802486-8568-489c-9dd2-2ca4c3fa7f0f.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d44999dc-bcae-5b9d-9c8f-c50a0fd3168f/d44999dc-bcae-5b9d-9c8f-c50a0fd3168f_image_5.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4842,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/91c9f81a-400e-489f-9fce-710a1560b60f_bb3e5e75-2935-487e-ab55-0a5221616ab9.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d44999dc-bcae-5b9d-9c8f-c50a0fd3168f/d44999dc-bcae-5b9d-9c8f-c50a0fd3168f_image_6.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5770,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/91c9f81a-400e-489f-9fce-710a1560b60f_3fbc86e8-195d-4d6d-8161-5023503ee421.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d44999dc-bcae-5b9d-9c8f-c50a0fd3168f/d44999dc-bcae-5b9d-9c8f-c50a0fd3168f_image_7.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 8584,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/91c9f81a-400e-489f-9fce-710a1560b60f_01114b2b-291e-4ee9-a940-e1fa5f98ebf5.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d44999dc-bcae-5b9d-9c8f-c50a0fd3168f/d44999dc-bcae-5b9d-9c8f-c50a0fd3168f_image_8.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5934,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/91c9f81a-400e-489f-9fce-710a1560b60f_6639c74e-a05e-47f3-adf4-058609063dcd.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d44999dc-bcae-5b9d-9c8f-c50a0fd3168f/d44999dc-bcae-5b9d-9c8f-c50a0fd3168f_image_9.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 7138,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/91c9f81a-400e-489f-9fce-710a1560b60f_f2442510-aa89-4355-9d5f-be37767007f3.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d44999dc-bcae-5b9d-9c8f-c50a0fd3168f/d44999dc-bcae-5b9d-9c8f-c50a0fd3168f_image_10.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 6510,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/91c9f81a-400e-489f-9fce-710a1560b60f_0a0a301d-2f3c-4281-a3db-4b1e228005d5.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d44999dc-bcae-5b9d-9c8f-c50a0fd3168f/d44999dc-bcae-5b9d-9c8f-c50a0fd3168f_image_11.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5884,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/91c9f81a-400e-489f-9fce-710a1560b60f_851cc22f-1048-42b7-8647-893b12ff2237.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d44999dc-bcae-5b9d-9c8f-c50a0fd3168f/d44999dc-bcae-5b9d-9c8f-c50a0fd3168f_image_12.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5758,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/91c9f81a-400e-489f-9fce-710a1560b60f_4ad0f60b-8c84-47b7-9638-0335eba0b76e.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d44999dc-bcae-5b9d-9c8f-c50a0fd3168f/d44999dc-bcae-5b9d-9c8f-c50a0fd3168f_image_13.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 6440,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/91c9f81a-400e-489f-9fce-710a1560b60f_52edd190-abb3-412b-b541-092b1717903b.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d44999dc-bcae-5b9d-9c8f-c50a0fd3168f/d44999dc-bcae-5b9d-9c8f-c50a0fd3168f_image_14.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5058,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/91c9f81a-400e-489f-9fce-710a1560b60f_e916208d-5b47-44b4-be9e-6643720b1b6d.jpg/250x188.webp',
             'Width': 250}],
 'price': 59800,
 'price_includes_vat': False,
 'registration_date': '2025-10-01',
 'seller_name': None,
 'title': 'Audi Q5 SPB 2.0 TDI QUATTRO S-TRONIC 204CV FACELIFT PROMO',
 'transmission': 'automatic',
 'trim': 'SPB 2.0 TDI QUATTRO S-TRONIC 204CV FACELIFT PROMO',
 'vin': None,
 'year': 2025}
2025-12-05 12:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%2791c9f81a-400e-489f-9fce-710a1560b60f%27 HTTP/1.1" 200 None
2025-12-05 12:02:40 [auto_selling_autoscout24.it] INFO: Saving data for 91c9f81a-400e-489f-9fce-710a1560b60f: {'created_time': 1764936160.008754, 'last_price_update_time': 1764936160.008762}
2025-12-05 12:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autoscout24.it',RowKey='91c9f81a-400e-489f-9fce-710a1560b60f') HTTP/1.1" 204 0
2025-12-05 12:02:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5b1e6d0>
2025-12-05 12:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-05 12:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_415f8916-ec80-5858-88dc-95a93c19969a/415f8916-ec80-5858-88dc-95a93c19969a_image_8.webp HTTP/1.1" 201 0
2025-12-05 12:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fbddda395-c5f1-4f0f-9f2e-c82f996b6f6b_598f84e4-8436-41e5-bbf9-530538441291.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/bddda395-c5f1-4f0f-9f2e-c82f996b6f6b_598f84e4-8436-41e5-bbf9-530538441291.jpg/250x188.webp saved to cache
2025-12-05 12:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 415f8916-ec80-5858-88dc-95a93c19969a
2025-12-05 12:02:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d5e4c450>
2025-12-05 12:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 12:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_415f8916-ec80-5858-88dc-95a93c19969a/415f8916-ec80-5858-88dc-95a93c19969a_image_7.webp HTTP/1.1" 201 0
2025-12-05 12:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fbddda395-c5f1-4f0f-9f2e-c82f996b6f6b_cc093262-567b-4ca2-bb49-fb4e7d55f89f.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/bddda395-c5f1-4f0f-9f2e-c82f996b6f6b_cc093262-567b-4ca2-bb49-fb4e7d55f89f.jpg/250x188.webp saved to cache
2025-12-05 12:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 415f8916-ec80-5858-88dc-95a93c19969a
2025-12-05 12:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/bddda395-c5f1-4f0f-9f2e-c82f996b6f6b_e62569fa-0714-4292-b470-69423b8f1a57.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/bddda395-c5f1-4f0f-9f2e-c82f996b6f6b_a72865ca-e351-4e56-b828-8ff6ff1b2033.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27347e067c-1ba0-49ab-b19c-ef67f3767180%27 HTTP/1.1" 200 None
2025-12-05 12:02:40 [auto_selling_autoscout24.it] INFO: Scrape type for 347e067c-1ba0-49ab-b19c-ef67f3767180: 1
2025-12-05 12:02:40 [auto_selling_autoscout24.it] INFO: Scraping new listing 347e067c-1ba0-49ab-b19c-ef67f3767180
2025-12-05 12:02:40 [auto_selling_autoscout24.it] INFO: Extracting item from listing ID: 347e067c-1ba0-49ab-b19c-ef67f3767180
2025-12-05 12:02:40 [crawlers.auto_selling.middlewares.id_gen_middleware] INFO: Generated ID for item: 739dbe6a-1294-5bd8-9cf0-4106c6e7a08b with identifier: 347e067c-1ba0-49ab-b19c-ef67f3767180
2025-12-05 12:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 739dbe6a-1294-5bd8-9cf0-4106c6e7a08b
2025-12-05 12:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F347e067c-1ba0-49ab-b19c-ef67f3767180_f97272c0-c0b2-431e-9662-3f3185d69536.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/347e067c-1ba0-49ab-b19c-ef67f3767180_f97272c0-c0b2-431e-9662-3f3185d69536.jpg/250x188.webp already downloaded
2025-12-05 12:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F347e067c-1ba0-49ab-b19c-ef67f3767180_d1cd4ee0-b893-41f9-975c-10cd4a89bace.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/347e067c-1ba0-49ab-b19c-ef67f3767180_d1cd4ee0-b893-41f9-975c-10cd4a89bace.jpg/250x188.webp already downloaded
2025-12-05 12:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F347e067c-1ba0-49ab-b19c-ef67f3767180_837f935b-0da8-4a6f-93d1-9c84f46f2f8f.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/347e067c-1ba0-49ab-b19c-ef67f3767180_837f935b-0da8-4a6f-93d1-9c84f46f2f8f.jpg/250x188.webp already downloaded
2025-12-05 12:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F347e067c-1ba0-49ab-b19c-ef67f3767180_e2c8f691-e158-4a47-81a4-d27845d35e01.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/347e067c-1ba0-49ab-b19c-ef67f3767180_e2c8f691-e158-4a47-81a4-d27845d35e01.jpg/250x188.webp already downloaded
2025-12-05 12:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F347e067c-1ba0-49ab-b19c-ef67f3767180_270c3279-e3d4-4a55-8e3a-3f381ac3c7e2.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/347e067c-1ba0-49ab-b19c-ef67f3767180_270c3279-e3d4-4a55-8e3a-3f381ac3c7e2.jpg/250x188.webp already downloaded
2025-12-05 12:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F347e067c-1ba0-49ab-b19c-ef67f3767180_485b4261-9f5f-4da6-bf43-867ff9078c89.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/347e067c-1ba0-49ab-b19c-ef67f3767180_485b4261-9f5f-4da6-bf43-867ff9078c89.jpg/250x188.webp already downloaded
2025-12-05 12:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F347e067c-1ba0-49ab-b19c-ef67f3767180_da74eec7-33a2-4013-8c70-6dfd98c3d389.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/347e067c-1ba0-49ab-b19c-ef67f3767180_da74eec7-33a2-4013-8c70-6dfd98c3d389.jpg/250x188.webp already downloaded
2025-12-05 12:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F347e067c-1ba0-49ab-b19c-ef67f3767180_c7838c1e-d67b-4d5d-904a-b4e3efb93948.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/347e067c-1ba0-49ab-b19c-ef67f3767180_c7838c1e-d67b-4d5d-904a-b4e3efb93948.jpg/250x188.webp already downloaded
2025-12-05 12:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F347e067c-1ba0-49ab-b19c-ef67f3767180_2110c2f1-d1ad-4f2e-827d-62f8c5dc61ed.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/347e067c-1ba0-49ab-b19c-ef67f3767180_2110c2f1-d1ad-4f2e-827d-62f8c5dc61ed.jpg/250x188.webp already downloaded
2025-12-05 12:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F347e067c-1ba0-49ab-b19c-ef67f3767180_d59eab59-d7ff-4151-8dba-9222df87181c.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/347e067c-1ba0-49ab-b19c-ef67f3767180_d59eab59-d7ff-4151-8dba-9222df87181c.jpg/250x188.webp already downloaded
2025-12-05 12:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F347e067c-1ba0-49ab-b19c-ef67f3767180_c55f7386-b8ce-4515-9b37-592a20ef06e2.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/347e067c-1ba0-49ab-b19c-ef67f3767180_c55f7386-b8ce-4515-9b37-592a20ef06e2.jpg/250x188.webp already downloaded
2025-12-05 12:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F347e067c-1ba0-49ab-b19c-ef67f3767180_f32a2463-c66a-476a-9bbe-ab3688d91fba.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/347e067c-1ba0-49ab-b19c-ef67f3767180_f32a2463-c66a-476a-9bbe-ab3688d91fba.jpg/250x188.webp already downloaded
2025-12-05 12:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F347e067c-1ba0-49ab-b19c-ef67f3767180_fddcba84-b6b0-4167-abf0-2b05cf473d21.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/347e067c-1ba0-49ab-b19c-ef67f3767180_fddcba84-b6b0-4167-abf0-2b05cf473d21.jpg/250x188.webp already downloaded
2025-12-05 12:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F347e067c-1ba0-49ab-b19c-ef67f3767180_caa89da7-a5cd-4297-afac-1b95a8fb2c07.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/347e067c-1ba0-49ab-b19c-ef67f3767180_caa89da7-a5cd-4297-afac-1b95a8fb2c07.jpg/250x188.webp already downloaded
2025-12-05 12:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252F347e067c-1ba0-49ab-b19c-ef67f3767180_0d9e8395-833a-49d5-816c-bcdeea4bd352.jpg%252F250x188.webp%27 HTTP/1.1" 200 None
2025-12-05 12:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/347e067c-1ba0-49ab-b19c-ef67f3767180_0d9e8395-833a-49d5-816c-bcdeea4bd352.jpg/250x188.webp already downloaded
2025-12-05 12:02:40 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 739dbe6a-1294-5bd8-9cf0-4106c6e7a08b with identifier 347e067c-1ba0-49ab-b19c-ef67f3767180
2025-12-05 12:02:40 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:02:40 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:02:40 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 739dbe6a-1294-5bd8-9cf0-4106c6e7a08b
2025-12-05 12:02:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.autoscout24.it/api/dealer-detail/fetch-listings>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'emission_standard': None,
 'engine': None,
 'engine_horse_power': 204,
 'expiration_date': None,
 'fuel_type': 'Electric/Diesel',
 'id': '739dbe6a-1294-5bd8-9cf0-4106c6e7a08b',
 'is_damaged': False,
 'is_operable': True,
 'license_plate': None,
 'link_to_web_offer': 'https://www.autoscout24.it/offers/audi-q5-spb-2-0-tdi-qtr-s-tr-s-line-204cv-facelift-promo-electric-diesel-black-347e067c-1ba0-49ab-b19c-ef67f3767180',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 1,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 15,
 'photo_urls': ['https://prod.pictures.autoscout24.net/listing-images/347e067c-1ba0-49ab-b19c-ef67f3767180_f97272c0-c0b2-431e-9662-3f3185d69536.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/347e067c-1ba0-49ab-b19c-ef67f3767180_d1cd4ee0-b893-41f9-975c-10cd4a89bace.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/347e067c-1ba0-49ab-b19c-ef67f3767180_837f935b-0da8-4a6f-93d1-9c84f46f2f8f.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/347e067c-1ba0-49ab-b19c-ef67f3767180_e2c8f691-e158-4a47-81a4-d27845d35e01.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/347e067c-1ba0-49ab-b19c-ef67f3767180_270c3279-e3d4-4a55-8e3a-3f381ac3c7e2.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/347e067c-1ba0-49ab-b19c-ef67f3767180_485b4261-9f5f-4da6-bf43-867ff9078c89.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/347e067c-1ba0-49ab-b19c-ef67f3767180_da74eec7-33a2-4013-8c70-6dfd98c3d389.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/347e067c-1ba0-49ab-b19c-ef67f3767180_c7838c1e-d67b-4d5d-904a-b4e3efb93948.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/347e067c-1ba0-49ab-b19c-ef67f3767180_2110c2f1-d1ad-4f2e-827d-62f8c5dc61ed.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/347e067c-1ba0-49ab-b19c-ef67f3767180_d59eab59-d7ff-4151-8dba-9222df87181c.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/347e067c-1ba0-49ab-b19c-ef67f3767180_c55f7386-b8ce-4515-9b37-592a20ef06e2.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/347e067c-1ba0-49ab-b19c-ef67f3767180_f32a2463-c66a-476a-9bbe-ab3688d91fba.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/347e067c-1ba0-49ab-b19c-ef67f3767180_fddcba84-b6b0-4167-abf0-2b05cf473d21.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/347e067c-1ba0-49ab-b19c-ef67f3767180_caa89da7-a5cd-4297-afac-1b95a8fb2c07.jpg/250x188.webp',
                'https://prod.pictures.autoscout24.net/listing-images/347e067c-1ba0-49ab-b19c-ef67f3767180_0d9e8395-833a-49d5-816c-bcdeea4bd352.jpg/250x188.webp'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_726b9a5b-b1ac-5af6-80c6-7872363727b5/726b9a5b-b1ac-5af6-80c6-7872363727b5_image_0.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4918,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/347e067c-1ba0-49ab-b19c-ef67f3767180_f97272c0-c0b2-431e-9662-3f3185d69536.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_726b9a5b-b1ac-5af6-80c6-7872363727b5/726b9a5b-b1ac-5af6-80c6-7872363727b5_image_1.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5730,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/347e067c-1ba0-49ab-b19c-ef67f3767180_d1cd4ee0-b893-41f9-975c-10cd4a89bace.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_726b9a5b-b1ac-5af6-80c6-7872363727b5/726b9a5b-b1ac-5af6-80c6-7872363727b5_image_2.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4658,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/347e067c-1ba0-49ab-b19c-ef67f3767180_837f935b-0da8-4a6f-93d1-9c84f46f2f8f.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_726b9a5b-b1ac-5af6-80c6-7872363727b5/726b9a5b-b1ac-5af6-80c6-7872363727b5_image_3.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4900,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/347e067c-1ba0-49ab-b19c-ef67f3767180_e2c8f691-e158-4a47-81a4-d27845d35e01.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_726b9a5b-b1ac-5af6-80c6-7872363727b5/726b9a5b-b1ac-5af6-80c6-7872363727b5_image_4.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5030,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/347e067c-1ba0-49ab-b19c-ef67f3767180_270c3279-e3d4-4a55-8e3a-3f381ac3c7e2.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_726b9a5b-b1ac-5af6-80c6-7872363727b5/726b9a5b-b1ac-5af6-80c6-7872363727b5_image_5.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4770,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/347e067c-1ba0-49ab-b19c-ef67f3767180_485b4261-9f5f-4da6-bf43-867ff9078c89.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_726b9a5b-b1ac-5af6-80c6-7872363727b5/726b9a5b-b1ac-5af6-80c6-7872363727b5_image_6.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5778,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/347e067c-1ba0-49ab-b19c-ef67f3767180_da74eec7-33a2-4013-8c70-6dfd98c3d389.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_726b9a5b-b1ac-5af6-80c6-7872363727b5/726b9a5b-b1ac-5af6-80c6-7872363727b5_image_7.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 8736,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/347e067c-1ba0-49ab-b19c-ef67f3767180_c7838c1e-d67b-4d5d-904a-b4e3efb93948.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_726b9a5b-b1ac-5af6-80c6-7872363727b5/726b9a5b-b1ac-5af6-80c6-7872363727b5_image_8.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5722,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/347e067c-1ba0-49ab-b19c-ef67f3767180_2110c2f1-d1ad-4f2e-827d-62f8c5dc61ed.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_726b9a5b-b1ac-5af6-80c6-7872363727b5/726b9a5b-b1ac-5af6-80c6-7872363727b5_image_9.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 6900,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/347e067c-1ba0-49ab-b19c-ef67f3767180_d59eab59-d7ff-4151-8dba-9222df87181c.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_726b9a5b-b1ac-5af6-80c6-7872363727b5/726b9a5b-b1ac-5af6-80c6-7872363727b5_image_10.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 6618,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/347e067c-1ba0-49ab-b19c-ef67f3767180_c55f7386-b8ce-4515-9b37-592a20ef06e2.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_726b9a5b-b1ac-5af6-80c6-7872363727b5/726b9a5b-b1ac-5af6-80c6-7872363727b5_image_11.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5616,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/347e067c-1ba0-49ab-b19c-ef67f3767180_f32a2463-c66a-476a-9bbe-ab3688d91fba.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_726b9a5b-b1ac-5af6-80c6-7872363727b5/726b9a5b-b1ac-5af6-80c6-7872363727b5_image_12.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5476,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/347e067c-1ba0-49ab-b19c-ef67f3767180_fddcba84-b6b0-4167-abf0-2b05cf473d21.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_726b9a5b-b1ac-5af6-80c6-7872363727b5/726b9a5b-b1ac-5af6-80c6-7872363727b5_image_13.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5958,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/347e067c-1ba0-49ab-b19c-ef67f3767180_caa89da7-a5cd-4297-afac-1b95a8fb2c07.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_726b9a5b-b1ac-5af6-80c6-7872363727b5/726b9a5b-b1ac-5af6-80c6-7872363727b5_image_14.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 3558,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/347e067c-1ba0-49ab-b19c-ef67f3767180_0d9e8395-833a-49d5-816c-bcdeea4bd352.jpg/250x188.webp',
             'Width': 250}],
 'price': 59800,
 'price_includes_vat': False,
 'registration_date': '2025-09-01',
 'seller_name': None,
 'title': 'Audi Q5 SPB 2.0 TDI QTR S-TR S-LINE 204CV FACELIFT PROMO',
 'transmission': 'automatic',
 'trim': 'SPB 2.0 TDI QTR S-TR S-LINE 204CV FACELIFT PROMO',
 'vin': None,
 'year': 2025}
2025-12-05 12:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27347e067c-1ba0-49ab-b19c-ef67f3767180%27 HTTP/1.1" 200 None
2025-12-05 12:02:40 [auto_selling_autoscout24.it] INFO: Saving data for 347e067c-1ba0-49ab-b19c-ef67f3767180: {'created_time': 1764936160.896572, 'last_price_update_time': 1764936160.896581}
2025-12-05 12:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autoscout24.it',RowKey='347e067c-1ba0-49ab-b19c-ef67f3767180') HTTP/1.1" 204 0
2025-12-05 12:02:40 [auto_selling_autoscout24.it] INFO: Fetching listings for customerId: 31910200, page: 5
2025-12-05 12:02:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9dc1c8390>
2025-12-05 12:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 12:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_415f8916-ec80-5858-88dc-95a93c19969a/415f8916-ec80-5858-88dc-95a93c19969a_image_10.webp HTTP/1.1" 201 0
2025-12-05 12:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fbddda395-c5f1-4f0f-9f2e-c82f996b6f6b_508b1749-5cfc-482e-8d04-97111cc6eba2.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/bddda395-c5f1-4f0f-9f2e-c82f996b6f6b_508b1749-5cfc-482e-8d04-97111cc6eba2.jpg/250x188.webp saved to cache
2025-12-05 12:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 415f8916-ec80-5858-88dc-95a93c19969a
2025-12-05 12:02:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9dd5e7090>
2025-12-05 12:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 12:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_415f8916-ec80-5858-88dc-95a93c19969a/415f8916-ec80-5858-88dc-95a93c19969a_image_9.webp HTTP/1.1" 201 0
2025-12-05 12:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fbddda395-c5f1-4f0f-9f2e-c82f996b6f6b_45d0ae43-7e86-47db-acb8-a62fa58b37b9.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/bddda395-c5f1-4f0f-9f2e-c82f996b6f6b_45d0ae43-7e86-47db-acb8-a62fa58b37b9.jpg/250x188.webp saved to cache
2025-12-05 12:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 415f8916-ec80-5858-88dc-95a93c19969a
2025-12-05 12:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://prod.pictures.autoscout24.net/listing-images/bddda395-c5f1-4f0f-9f2e-c82f996b6f6b_afcaac6d-d2cd-49fa-9f68-aa8e38ec2956.jpg/250x188.webp> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings)
2025-12-05 12:02:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-05 12:02:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d6fd8e50>
2025-12-05 12:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-05 12:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_415f8916-ec80-5858-88dc-95a93c19969a/415f8916-ec80-5858-88dc-95a93c19969a_image_11.webp HTTP/1.1" 201 0
2025-12-05 12:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fbddda395-c5f1-4f0f-9f2e-c82f996b6f6b_e62569fa-0714-4292-b470-69423b8f1a57.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/bddda395-c5f1-4f0f-9f2e-c82f996b6f6b_e62569fa-0714-4292-b470-69423b8f1a57.jpg/250x188.webp saved to cache
2025-12-05 12:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 415f8916-ec80-5858-88dc-95a93c19969a
2025-12-05 12:02:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d6f85b10>
2025-12-05 12:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-05 12:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_415f8916-ec80-5858-88dc-95a93c19969a/415f8916-ec80-5858-88dc-95a93c19969a_image_12.webp HTTP/1.1" 201 0
2025-12-05 12:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fbddda395-c5f1-4f0f-9f2e-c82f996b6f6b_a72865ca-e351-4e56-b828-8ff6ff1b2033.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/bddda395-c5f1-4f0f-9f2e-c82f996b6f6b_a72865ca-e351-4e56-b828-8ff6ff1b2033.jpg/250x188.webp saved to cache
2025-12-05 12:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 415f8916-ec80-5858-88dc-95a93c19969a
2025-12-05 12:02:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-05 12:02:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-05 12:02:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-05 12:02:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fd9d6fcc810>
2025-12-05 12:02:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-05 12:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-05 12:02:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-05 12:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-05 12:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-05 12:02:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-05 12:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_415f8916-ec80-5858-88dc-95a93c19969a/415f8916-ec80-5858-88dc-95a93c19969a_image_13.webp HTTP/1.1" 201 0
2025-12-05 12:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto_selling_autoscout24.it',RowKey='https%3A%252F%252Fprod.pictures.autoscout24.net%252Flisting-images%252Fbddda395-c5f1-4f0f-9f2e-c82f996b6f6b_afcaac6d-d2cd-49fa-9f68-aa8e38ec2956.jpg%252F250x188.webp') HTTP/1.1" 204 0
2025-12-05 12:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://prod.pictures.autoscout24.net/listing-images/bddda395-c5f1-4f0f-9f2e-c82f996b6f6b_afcaac6d-d2cd-49fa-9f68-aa8e38ec2956.jpg/250x188.webp saved to cache
2025-12-05 12:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 415f8916-ec80-5858-88dc-95a93c19969a
2025-12-05 12:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 415f8916-ec80-5858-88dc-95a93c19969a from tracking dictionaries
2025-12-05 12:02:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 415f8916-ec80-5858-88dc-95a93c19969a sending to next pipeline
2025-12-05 12:02:42 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: Azure Bus Pipeline processing item: 415f8916-ec80-5858-88dc-95a93c19969a with identifier bddda395-c5f1-4f0f-9f2e-c82f996b6f6b
2025-12-05 12:02:42 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:02:42 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:02:42 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process item CloudEvent for item 415f8916-ec80-5858-88dc-95a93c19969a
2025-12-05 12:02:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://prod.pictures.autoscout24.net/listing-images/bddda395-c5f1-4f0f-9f2e-c82f996b6f6b_afcaac6d-d2cd-49fa-9f68-aa8e38ec2956.jpg/250x188.webp>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'Unknown',
 'currency': 'EUR',
 'emission_standard': None,
 'engine': None,
 'engine_horse_power': 61,
 'expiration_date': None,
 'fuel_type': 'Electric',
 'id': '415f8916-ec80-5858-88dc-95a93c19969a',
 'is_damaged': False,
 'is_operable': True,
 'license_plate': None,
 'link_to_web_offer': 'https://www.autoscout24.it/offers/dr-automobiles-dr1-0-ev-elettrica-31-kwh-my-2025-61cv-only-promo-electric-red-bddda395-c5f1-4f0f-9f2e-c82f996b6f6b',
 'listing': 'auction',
 'make': 'DR Automobiles',
 'model': 'DR1.0',
 'odometer': 1000,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'IT',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_415f8916-ec80-5858-88dc-95a93c19969a/415f8916-ec80-5858-88dc-95a93c19969a_image_0.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4680,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/bddda395-c5f1-4f0f-9f2e-c82f996b6f6b_6845573b-5617-4aa8-a3a8-9a80cfa47748.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_415f8916-ec80-5858-88dc-95a93c19969a/415f8916-ec80-5858-88dc-95a93c19969a_image_1.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 6032,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/bddda395-c5f1-4f0f-9f2e-c82f996b6f6b_3f7aa8dd-c1fa-461a-8cfa-227f2f7f6a4f.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_415f8916-ec80-5858-88dc-95a93c19969a/415f8916-ec80-5858-88dc-95a93c19969a_image_2.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4972,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/bddda395-c5f1-4f0f-9f2e-c82f996b6f6b_2ff7fecb-fe00-4e31-a7b2-57a3c7268ea7.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_415f8916-ec80-5858-88dc-95a93c19969a/415f8916-ec80-5858-88dc-95a93c19969a_image_3.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4364,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/bddda395-c5f1-4f0f-9f2e-c82f996b6f6b_f17da32a-40ad-4798-bba8-88ee95188b55.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_415f8916-ec80-5858-88dc-95a93c19969a/415f8916-ec80-5858-88dc-95a93c19969a_image_4.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4416,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/bddda395-c5f1-4f0f-9f2e-c82f996b6f6b_721213d2-fd37-46fc-bac4-0016f0d53ba4.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_415f8916-ec80-5858-88dc-95a93c19969a/415f8916-ec80-5858-88dc-95a93c19969a_image_5.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4350,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/bddda395-c5f1-4f0f-9f2e-c82f996b6f6b_2fc57134-6d8b-4482-ad44-d9350491e214.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_415f8916-ec80-5858-88dc-95a93c19969a/415f8916-ec80-5858-88dc-95a93c19969a_image_6.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 5134,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/bddda395-c5f1-4f0f-9f2e-c82f996b6f6b_5b4e7f7f-be7a-465c-8df5-271be820e59d.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_415f8916-ec80-5858-88dc-95a93c19969a/415f8916-ec80-5858-88dc-95a93c19969a_image_7.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 7112,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/bddda395-c5f1-4f0f-9f2e-c82f996b6f6b_cc093262-567b-4ca2-bb49-fb4e7d55f89f.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_415f8916-ec80-5858-88dc-95a93c19969a/415f8916-ec80-5858-88dc-95a93c19969a_image_8.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4060,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/bddda395-c5f1-4f0f-9f2e-c82f996b6f6b_598f84e4-8436-41e5-bbf9-530538441291.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_415f8916-ec80-5858-88dc-95a93c19969a/415f8916-ec80-5858-88dc-95a93c19969a_image_9.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 4682,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/bddda395-c5f1-4f0f-9f2e-c82f996b6f6b_45d0ae43-7e86-47db-acb8-a62fa58b37b9.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_415f8916-ec80-5858-88dc-95a93c19969a/415f8916-ec80-5858-88dc-95a93c19969a_image_10.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 6020,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/bddda395-c5f1-4f0f-9f2e-c82f996b6f6b_508b1749-5cfc-482e-8d04-97111cc6eba2.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_415f8916-ec80-5858-88dc-95a93c19969a/415f8916-ec80-5858-88dc-95a93c19969a_image_11.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 6002,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/bddda395-c5f1-4f0f-9f2e-c82f996b6f6b_e62569fa-0714-4292-b470-69423b8f1a57.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_415f8916-ec80-5858-88dc-95a93c19969a/415f8916-ec80-5858-88dc-95a93c19969a_image_12.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 6022,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/bddda395-c5f1-4f0f-9f2e-c82f996b6f6b_a72865ca-e351-4e56-b828-8ff6ff1b2033.jpg/250x188.webp',
             'Width': 250},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_415f8916-ec80-5858-88dc-95a93c19969a/415f8916-ec80-5858-88dc-95a93c19969a_image_13.webp',
             'Extension': 'webp',
             'FileSizeInBytes': 7070,
             'Height': 187,
             'OriginUrl': 'https://prod.pictures.autoscout24.net/listing-images/bddda395-c5f1-4f0f-9f2e-c82f996b6f6b_afcaac6d-d2cd-49fa-9f68-aa8e38ec2956.jpg/250x188.webp',
             'Width': 250}],
 'price': 16900,
 'price_includes_vat': False,
 'registration_date': '2025-10-01',
 'seller_name': None,
 'title': 'DR Automobiles DR1.0 EV Elettrica 31 KWh MY 2025 61CV Only - Promo',
 'transmission': 'automatic',
 'trim': 'EV Elettrica 31 KWh MY 2025 61CV Only - Promo',
 'vin': None,
 'year': 2025}
2025-12-05 12:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20RowKey%20eq%20%27bddda395-c5f1-4f0f-9f2e-c82f996b6f6b%27 HTTP/1.1" 200 None
2025-12-05 12:02:42 [auto_selling_autoscout24.it] INFO: Saving data for bddda395-c5f1-4f0f-9f2e-c82f996b6f6b: {'created_time': 1764936162.40085, 'last_price_update_time': 1764936162.40086}
2025-12-05 12:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto_selling_autoscout24.it',RowKey='bddda395-c5f1-4f0f-9f2e-c82f996b6f6b') HTTP/1.1" 204 0
2025-12-05 12:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.autoscout24.it/api/dealer-detail/fetch-listings> (referer: https://www.autoscout24.it/api/dealer-detail/fetch-listings) ['zyte-api']
2025-12-05 12:02:50 [auto_selling_autoscout24.it] INFO: Parsing listings response for page: 5
2025-12-05 12:02:50 [scrapy.core.engine] INFO: Closing spider (finished)
2025-12-05 12:02:50 [crawlers.pipelines.save_to_cdlq_db_auto_selling] DEBUG: [SaveToCdlqDbAutoSelling] failed to close cursor: 'SaveToCdlqDbAutoSelling' object has no attribute 'cursor'
2025-12-05 12:02:50 [crawlers.pipelines.save_to_cdlq_db_auto_selling] DEBUG: [SaveToCdlqDbAutoSelling] failed to close connection: 'SaveToCdlqDbAutoSelling' object has no attribute 'conn'
2025-12-05 12:02:50 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:02:50 [azure.servicebus._pyamqp.cbs] DEBUG: CBS status check: state == <CbsAuthState.OK: 0>, expired == False, refresh required == False
2025-12-05 12:02:50 [crawlers.pipelines.post_to_azurebus_auto_selling] DEBUG: [AzureBusPipeline] sent process scrape complete CloudEvent for item 30122efad1c111f0b120928152083da5
2025-12-05 12:02:50 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2025-12-05 12:02:50 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2025-12-05 12:02:50 [azure.servicebus._pyamqp.management_link] INFO: Management link receiver state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2025-12-05 12:02:50 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2025-12-05 12:02:50 [azure.servicebus._pyamqp.management_link] INFO: Management link sender state changed: <LinkState.ATTACHED: 3> -> <LinkState.DETACH_SENT: 4>
2025-12-05 12:02:50 [azure.servicebus._pyamqp.session] INFO: Session state changed: <SessionState.MAPPED: 3> -> <SessionState.END_SENT: 4>
2025-12-05 12:02:50 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.OPENED: 9> -> <ConnectionState.CLOSE_SENT: 11>
2025-12-05 12:02:50 [azure.servicebus._pyamqp._connection] INFO: Connection state changed: <ConnectionState.CLOSE_SENT: 11> -> <ConnectionState.END: 13>
2025-12-05 12:02:50 [azure.servicebus._pyamqp.session] INFO: Session state changed: <SessionState.END_SENT: 4> -> <SessionState.DISCARDING: 6>
2025-12-05 12:02:50 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2025-12-05 12:02:50 [azure.servicebus._pyamqp.management_link] INFO: Management link sender state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2025-12-05 12:02:50 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2025-12-05 12:02:50 [azure.servicebus._pyamqp.management_link] INFO: Management link receiver state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2025-12-05 12:02:50 [azure.servicebus._pyamqp.link] INFO: Link state changed: <LinkState.DETACH_SENT: 4> -> <LinkState.DETACHED: 0>
2025-12-05 12:02:50 [crawlers.pipelines.post_to_azurebus_auto_selling] INFO: [AzureBusPipeline] connection closed
2025-12-05 12:02:50 [auto_selling_autoscout24.it] INFO: auto_selling_autoscout24.it Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 9, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 0}
2025-12-05 12:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-05 12:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto_selling_autoscout24.it%27%20and%20last_price_update_time%20lt%201763640171 HTTP/1.1" 200 None
2025-12-05 12:02:51 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (78 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto_selling_autoscout24.it/30122efad1c111f0b120928152083da5.jl
2025-12-05 12:02:51 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 286972,
 'downloader/request_count': 553,
 'downloader/request_method_count/GET': 548,
 'downloader/request_method_count/POST': 5,
 'downloader/response_bytes': 3321161,
 'downloader/response_count': 553,
 'downloader/response_status_count/200': 553,
 'elapsed_time_seconds': 333.879671,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2025, 12, 5, 12, 2, 51, 243428, tzinfo=datetime.timezone.utc),
 'item_scraped_count': 78,
 'log_count/DEBUG': 6710,
 'log_count/INFO': 5854,
 'memusage/max': 163250176,
 'memusage/startup': 126955520,
 'photo_download_count': 547,
 'request_depth_max': 5,
 'response_received_count': 6,
 'scheduler/dequeued': 553,
 'scheduler/dequeued/memory': 553,
 'scheduler/enqueued': 553,
 'scheduler/enqueued/memory': 553,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 6,
 'scrapy-zyte-api/error_ratio': 0.0,
 'scrapy-zyte-api/errors': 0,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 26.107569579326082,
 'scrapy-zyte-api/mean_response_seconds': 26.182580747195363,
 'scrapy-zyte-api/processed': 6,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 5,
 'scrapy-zyte-api/request_args/experimental.requestCookies': 5,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 6,
 'scrapy-zyte-api/request_args/httpRequestBody': 5,
 'scrapy-zyte-api/request_args/httpRequestMethod': 5,
 'scrapy-zyte-api/request_args/httpResponseBody': 6,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 6,
 'scrapy-zyte-api/request_args/url': 6,
 'scrapy-zyte-api/status_codes/200': 6,
 'scrapy-zyte-api/success': 6,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'start_time': datetime.datetime(2025, 12, 5, 11, 57, 17, 363757, tzinfo=datetime.timezone.utc)}
2025-12-05 12:02:51 [scrapy.core.engine] INFO: Spider closed (finished)
2025-12-05 12:02:51 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7fd9de924b50>
2025-12-05 12:02:51 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7fd9de9253d0>

PROJECT (sourcing_v2)
SPIDER (auto_selling_autoscout24.it)